Skip to main content

AI Coding Agent Evaluation Task Designer at toloka-ai

Language

Compensation

$40/hr

Setup
Remote
Location
Lisbon
Type
Contract, Other
Posted

Description

Mindrift is seeking experienced software developers to join a project-based opportunity focused on building evaluation datasets for AI coding agents. The role involves creating realistic simulated development environments, designing solvable tasks, writing robust tests, and iterating on tasks based on QA feedback. It requires strong experience with a modern full-stack backend/frontend stack, testing, and English proficiency, and pays up to $40 per hour equivalent for roughly 20 hours of task work per project.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation