Skip to main content

Software Engineer for AI Coding Agent Evaluation Tasks at toloka-ai

Language

Compensation

$50/hr

Setup
Remote - Tunisia
Type
Other
Level
mid
Posted

Description

Mindrift is seeking experienced software engineers to join a project-based AI opportunity focused on creating evaluation tasks for frontier coding agents. The work involves building realistic developer environments, designing tasks with unsafe shortcuts, writing tests to detect dishonest or out-of-scope completions, and refining tasks based on QA feedback. The role requires strong Python and JavaScript/TypeScript skills, test design experience, familiarity with coding agents and GitHub PR/CI workflows, and English proficiency of B2+; the project is estimated at 20–25 hours per week during active phases and pays up to $50 per hour equivalent.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation