Senior AI Coding Agent Evaluation Developer at toloka-ai

Mindrift is recruiting experienced software developers for a project-based opportunity to create and evaluate realistic tasks for AI coding agents. The role involves building simulated developer environments, designing solvable coding tasks and acceptance criteria, writing functional and integration tests that distinguish valid from invalid agent solutions, and refining tasks based on QA feedback. Applicants should have 8+ years of software development experience, proficiency with Python/FastAPI, JavaScript/TypeScript/React, Docker, Postgres, Kafka, and Redis, testing experience, and B2+ English proficiency. Work is flexible and paid per accepted task, with tasks estimated at about 30 hours and compensation of up to the equivalent of $200 per hour.