Skip to main content

AI Coding Agent Evaluator / Software Development Expert at toloka-ai

Language

Compensation

$0 – $40/hr

Setup
Remote - Jordan
Type
Contract
Level
senior
Posted

Description

Mindrift is recruiting experienced software development specialists for a project-based opportunity evaluating AI coding agents. The role involves building realistic simulated developer environments, designing coding tasks and success criteria, writing functional and integration tests that fairly assess AI-generated solutions, and iterating based on QA feedback. It is not permanent employment or data labeling, and participants set their own schedules; compensation is up to $40 per hour equivalent for approximately 20 hours per task.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation