Skip to main content

AI Coding Agent Task Designer / Evaluator at toloka-ai

Language

Compensation

$50/hr

Setup
Remote
Location
Quebec
Type
Other
Posted

Description

Mindrift is seeking specialists for a project-based AI opportunity to help build a dataset for evaluating AI coding agents. The role involves creating realistic simulated developer environments, designing solvable coding tasks, and writing robust tests and evaluation criteria, with a focus on Python/FastAPI, JavaScript/TypeScript/React, Docker, Postgres, Kafka, and Redis. The work is not permanent employment, requires 5+ years of software development experience and B2+ English proficiency, and is paid up to $50/hr equivalent for an estimated 20 hours per task.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation