AI Coding Agent Evaluation Specialist at toloka-ai

This project-based opportunity focuses on creating challenging tasks and evaluation criteria for AI coding agents. The role involves designing tasks within realistic simulated environments, crafting prompts, defining success metrics, and verifying agent solutions. It's important to note that this isn't data labeling or prompt engineering, and the primary responsibility is to guide and evaluate AI agent solutions rather than writing code.