---
title: "Senior AI Coding Agent… at toloka-ai – New York, NY"
canonical: "https://www.metaintro.com/job/senior-ai-coding-agent-evaluator-software-development-task-designer-3dd33dae-7f03-5e4b-ab77-eb8b943d6fee"
language: "en"
author: "Metaintro"
---

[/company/toloka-ai](/company/toloka-ai)[toloka-ai](/company/toloka-ai)
# Senior AI Coding Agent Evaluator / Software Development Task Designer at toloka-ai

Compensation

$200/hr

**Setup**
: Remote

**Location**
: New York, New York

**Type**
: Contract

**Level**
: senior

**Posted**
: Aug 17, 2026

## Description

Mindrift is recruiting experienced software developers for a project-based opportunity to create and evaluate coding-agent tasks for leading technology companies. The work involves building realistic simulated developer environments, designing solvable tasks and acceptance criteria, writing functional and integration tests, and refining tasks based on QA feedback. It is not permanent employment, data labeling, prompt engineering, or primarily writing code from scratch. Candidates need 8+ years of software development experience, proficiency with Python/FastAPI, JavaScript/TypeScript/React, Docker, Postgres, Kafka, Redis, test development, and English at B2+ level. Work is flexible and paid per accepted task, with compensation up to the equivalent of $200 per hour.

## Trending job searches

Every query opens live roles, salary samples, and market demand — tap a search to run it instantly.

- [Find Senior AI Coding Agent Evaluator / Software Development Task Designer jobs in New York, New York, United States](/jobs/search?q=Find+Senior+AI+Coding+Agent+Evaluator+%2F+Software+Development+Task+Designer+jobs+in+New+York%2C+New+York%2C+United+States)
- [Find roles similar to Senior AI Coding Agent Evaluator / Software Development Task Designer in New York, New York, United States](/jobs/search?q=Find+roles+similar+to+Senior+AI+Coding+Agent+Evaluator+%2F+Software+Development+Task+Designer+in+New+York%2C+New+York%2C+United+States)
- [Find remote Senior AI Coding Agent Evaluator / Software Development Task Designer jobs](/jobs/search?q=Find+remote+Senior+AI+Coding+Agent+Evaluator+%2F+Software+Development+Task+Designer+jobs)
- [Find Senior AI Coding Agent Evaluator / Software Development Task Designer jobs with Environment design and Task design](/jobs/search?q=Find+Senior+AI+Coding+Agent+Evaluator+%2F+Software+Development+Task+Designer+jobs+with+Environment+design+and+Task+design)
- [Find jobs similar to Senior AI Coding Agent Evaluator / Software Development Task Designer](/jobs/search?q=Find+jobs+similar+to+Senior+AI+Coding+Agent+Evaluator+%2F+Software+Development+Task+Designer)
- [Find Senior AI Coding Agent Evaluator / Software Development Task Designer jobs posted this week](/jobs/search?q=Find+Senior+AI+Coding+Agent+Evaluator+%2F+Software+Development+Task+Designer+jobs+posted+this+week)
- [Find Senior AI Coding Agent Evaluator / Software Development Task Designer jobs paying $410,000 or more per year](/jobs/search?q=Find+Senior+AI+Coding+Agent+Evaluator+%2F+Software+Development+Task+Designer+jobs+paying+%24410%2C000+or+more+per+year)
- [Find Developer jobs in New York, New York, United States](/jobs/search?q=Find+Developer+jobs+in+New+York%2C+New+York%2C+United+States)

## Get More from Metaintro

Unlock powerful job search, personalized recommendations, and deep career insights from comprehensive, market-leading data and live market signals.

- [Browse all jobs](/jobs/search)
- [Access help center](/help)
- [Explore our content](/blog)

![](https://cdn.metaintro.com/rs:fill:1200:800/q:30/plain/images/bridges/bridge-expand.1df895c6bd76d96f.png)

For job seekers

## Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

[Get Started Free](/signup)[Search matching jobs](/jobs/search)

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

[Return to navigation](#main-navigation)