About this role
Create challenging tasks and evaluation criteria to test AI coding agents within simulated developer environments. Write and iterate on tests to verify agent solutions and ensure robust evaluation of model performance.
Requires over 5 years of software development experience with a core stack including Python, JavaScript/TypeScript, and various infrastructure tools. Must have strong English proficiency (B2+) and experience in functional and integration testing.
What they're looking for
PythonFastAPIJavaScriptTypeScriptReactDockerPostgresKafka
Frequently asked questions
What does a Freelance Agent Evaluation Engineer at Mindrift do?
Create challenging tasks and evaluation criteria to test AI coding agents within simulated developer environments. Write and iterate on tests to verify agent solutions and ensure robust evaluation of model performance. Requires over 5 years of software development experience with a core stack includ…
What skills does this Freelance Agent Evaluation Engineer role need?
Key skills for this role include Python, FastAPI, JavaScript, TypeScript, React, Docker.
How much does a Freelance Agent Evaluation Engineer at Mindrift pay?
The employer did not list a salary for this role. Most similar Singapore roles publish their band on the job page.
Is this Freelance Agent Evaluation Engineer role remote, hybrid, or on-site?
This role is remote solely, based in Singapore.
How do I apply for this Freelance Agent Evaluation Engineer role?
You can apply directly on Mindrift's careers page. ApplyLah can tailor your résumé and cover letter to this exact role in seconds first.