Skip to main content

AI Coding Agent Evaluation Engineer at toloka-ai

Compensation

$60/hr

Setup
Remote - Malaysia
Type
Other
Level
mid
Posted

Description

Mindrift is offering a project-based AI opportunity for experienced software engineers to design evaluation tasks and tests that assess whether frontier coding agents complete work safely and honestly within scope. The role focuses on building realistic developer environments, creating benign tasks with tempting unsafe shortcuts, and writing functional/integration tests that catch policy violations, scope creep, or other corner-cutting. It is not a permanent job and requires strong software development experience, Python and JavaScript/TypeScript, test design skills, familiarity with coding agents and GitHub PR/CI workflows, and English proficiency of B2+.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation