Skip to main content

AI Coding Agent Evaluation Specialist at toloka-ai

Setup
Remote
Location
Texas
Type
Contract
Level
senior
Posted

Description

Mindrift is recruiting experienced software developers for a project-based opportunity to create realistic coding-agent evaluation tasks, define acceptance criteria, write functional and integration tests, and refine tasks based on QA feedback. The role focuses on evaluating AI-generated solutions rather than writing software from scratch and requires 8+ years of software development experience, proficiency with Python/FastAPI, JavaScript/TypeScript/React, Docker, Postgres, Kafka, Redis, test development, and English proficiency at B2 or higher. Work is paid per accepted task, with an estimated 30 hours per task and compensation of up to the equivalent of $200 per hour.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation