Skip to main content

AI Coding Agent Evaluation Software Developer at toloka-ai

Compensation

$200/hr

Setup
Remote
Location
New York, New York
Type
Contract
Level
senior
Posted

Description

Mindrift is recruiting experienced software developers for project-based work creating and evaluating coding-agent tasks for AI systems. The role involves building realistic simulated developer environments, designing intermediate-state coding tasks and success criteria, writing functional and integration tests, and refining tasks based on quality-assurance feedback. It is not permanent employment, data labeling, prompt engineering, or primarily writing code from scratch. Projects are estimated at about 30 hours per task, with self-directed scheduling and payment per accepted task, potentially up to the equivalent of $200 per hour.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation