Skip to main content

AI Coding Agent Evaluation Specialist at toloka-ai

Language

Compensation

$40/hr

Setup
Remote
Location
Rome, Lazio
Type
Contract
Posted

Description

Mindrift is seeking a specialist to build a dataset for evaluating AI coding agents. The role involves creating challenging tasks and defining evaluation criteria within simulated environments, designing tasks, writing tests, and iterating based on feedback. It's a project-based opportunity focusing on assessing AI performance rather than traditional data labeling or prompt engineering.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation