Skip to main content

AI Coding Agent Evaluation Engineer at toloka-ai

Language

Compensation

$50/hr

Setup
Remote - Mexico
Type
Other
Level
mid
Posted

Description

Mindrift is seeking experienced software engineers to design evaluation tasks for frontier AI coding agents, focusing on building realistic developer environments, creating tempting but unsafe shortcuts, and writing tests that verify agents complete tasks safely and within scope. The role is project-based rather than permanent employment, requires strong software development and test design experience with Python and JavaScript/TypeScript, familiarity with coding agents and GitHub PR/CI workflows, and English proficiency at B2+; contributors can earn up to $50 per hour equivalent during active phases.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation