Skip to main content

AI Coding Agent Evaluator at toloka-ai

Compensation

$0 – $50/hr

Setup
Remote
Location
Birmingham, England
Type
Contract
Level
senior
Posted

Description

Mindrift is recruiting experienced software developers for project-based work evaluating AI coding agents. The role involves building realistic simulated software environments, designing developer tasks and success criteria, writing functional and integration tests that fairly assess agent-generated solutions, and iterating based on QA feedback. Candidates need at least five years of software development experience, proficiency with Python/FastAPI, JavaScript/TypeScript/React, Docker, PostgreSQL, Kafka, Redis, test writing, and English at B2 level or above. The work is not permanent employment, offers a self-directed schedule, and pays up to $50 per hour equivalent depending on level and pace.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation