Skip to main content

Senior Software Developer – AI Coding Agent Evaluation Specialist at toloka-ai

Language

Compensation

$200/hr

Setup
Remote - Japan
Type
Contract
Level
senior
Posted

Description

Mindrift is recruiting experienced software development specialists for a project-based opportunity to create and evaluate datasets for AI coding agents. The work involves building realistic simulated developer environments, designing intermediate-state coding tasks, writing robust functional and integration tests, and iterating based on QA feedback. The opportunity is not permanent employment or data labeling; participants apply, qualify, join a project, complete tasks, and are paid per accepted task, with tasks estimated at about 30 hours and compensation up to the equivalent of $200 per hour. Applicants need 8+ years of software development experience, proficiency with Python/FastAPI, JavaScript/TypeScript/React, Docker, Postgres, Kafka, Redis, testing, and English at B2+ level.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation