---
title: "AI Coding Agent Evaluation… at toloka-ai – Remote - Hungary"
canonical: "https://www.metaintro.com/job/ai-coding-agent-evaluation-task-designer-at-toloka-ai-e459edd0-6de3-5036-92b0-208cd2976b72"
language: "en"
author: "Metaintro"
---

[/company/toloka-ai](/company/toloka-ai)[toloka-ai](/company/toloka-ai)
# AI Coding Agent Evaluation Task Designer at toloka-ai

LanguageEnglish
Magyar

Compensation

$50/hr

**Setup**
: Remote - Hungary

**Type**
: Part-time, Contract, Other

**Level**
: senior

**Posted**
: Aug 25, 2026

## Description

Mindrift is recruiting specialists for a project-based freelance role creating and evaluating datasets for AI coding agents. The work involves building realistic simulated developer environments, designing coding tasks and evaluation criteria, writing functional and integration tests, reviewing agent solutions, and refining tasks based on QA feedback. Candidates should have substantial software development experience, proficiency with Python/FastAPI and JavaScript/TypeScript/React, and familiarity with Docker, Postgres, Kafka, and Redis. The opportunity is remote and part-time, paid per accepted task at up to the equivalent of $50 per hour, and is not permanent employment.

## Trending job searches

Every query opens live roles, salary samples, and market demand — tap a search to run it instantly.

- [Find AI Coding Agent Evaluation Task Designer jobs in Hungary](/jobs/search?q=Find+AI+Coding+Agent+Evaluation+Task+Designer+jobs+in+Hungary)
- [Find roles similar to AI Coding Agent Evaluation Task Designer in Hungary](/jobs/search?q=Find+roles+similar+to+AI+Coding+Agent+Evaluation+Task+Designer+in+Hungary)
- [Find remote AI Coding Agent Evaluation Task Designer jobs](/jobs/search?q=Find+remote+AI+Coding+Agent+Evaluation+Task+Designer+jobs)
- [Find AI Coding Agent Evaluation Task Designer jobs with Python and FastAPI](/jobs/search?q=Find+AI+Coding+Agent+Evaluation+Task+Designer+jobs+with+Python+and+FastAPI)
- [Find jobs similar to AI Coding Agent Evaluation Task Designer](/jobs/search?q=Find+jobs+similar+to+AI+Coding+Agent+Evaluation+Task+Designer)
- [Find AI Coding Agent Evaluation Task Designer jobs posted this week](/jobs/search?q=Find+AI+Coding+Agent+Evaluation+Task+Designer+jobs+posted+this+week)
- [Find AI Coding Agent Evaluation Task Designer jobs paying $100,000 or more per year](/jobs/search?q=Find+AI+Coding+Agent+Evaluation+Task+Designer+jobs+paying+%24100%2C000+or+more+per+year)
- [Find Quality Assurance jobs in Hungary](/jobs/search?q=Find+Quality+Assurance+jobs+in+Hungary)

## Get More from Metaintro

Unlock powerful job search, personalized recommendations, and deep career insights from comprehensive, market-leading data and live market signals.

- [Browse all jobs](/jobs/search)
- [Access help center](/help)
- [Explore our content](/blog)

![](https://cdn.metaintro.com/rs:fill:1200:800/q:30/plain/images/bridges/bridge-expand.1df895c6bd76d96f.png)

For job seekers

## Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

[Get Started Free](/signup)[Search matching jobs](/jobs/search)

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

[Return to navigation](#main-navigation)