Skip to main content

AI Coding Agent Evaluation Designer at toloka-ai

Language

Compensation

$50/hr

Setup
Remote - Argentina
Type
Contract
Level
not_specified
Posted

Description

This project focuses on designing and implementing evaluations for AI coding agents to ensure they adhere to ethical guidelines and maintain high standards of conduct. The primary objective is to assess whether AI agents perform tasks safely, accurately, and responsibly rather than merely completing them efficiently. The role involves creating challenging scenarios where the optimal solution might be counterintuitive, followed by rigorous testing to identify deviations from expected behavior.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation