---
title: "Manager, AI Evaluation at usyd – Sydney, Australia"
canonical: "https://www.metaintro.com/job/manager-ai-evaluation-at-usyd-bfaae4e2-755f-5483-b8dc-aac3d93bbb2a"
language: "en"
author: "Metaintro"
---

[/company/usyd](/company/usyd)[usyd](/company/usyd)
# Manager, AI Evaluation at usyd

Compensation

A$152,045/yr

**Location**
: Sydney, New South Wales

**Type**
: Full-time

**Level**
: lead/mgmt

## Description

The University of Sydney is hiring a full-time continuing Manager, AI Evaluation to lead the assessment, testing, governance, monitoring and continuous improvement of generative AI solutions across its AI Hub. The role develops evaluation frameworks, datasets, metrics and testing methods; oversees pre-release assurance and governance approvals; monitors production AI services for drift, risk and performance; and advises technical, legal, privacy, data stewardship and governance stakeholders. Candidates need postgraduate qualifications or equivalent experience, demonstrated data science, machine learning, natural language processing and AI experience, strong knowledge of generative AI, large language models and agentic AI frameworks, advanced analytical skills, experience developing evaluation and monitoring frameworks, and strong communication and stakeholder engagement skills. The position is based in Australia, requires unrestricted Australian work rights, and does not offer visa sponsorship.

## Trending job searches

Every query opens live roles, salary samples, and market demand — tap a search to run it instantly.

- [Find Manager, AI Evaluation jobs in Sydney, New South Wales, Australia](/jobs/search?q=Find+Manager%2C+AI+Evaluation+jobs+in+Sydney%2C+New+South+Wales%2C+Australia)
- [Find roles similar to Manager, AI Evaluation in Sydney, New South Wales, Australia](/jobs/search?q=Find+roles+similar+to+Manager%2C+AI+Evaluation+in+Sydney%2C+New+South+Wales%2C+Australia)
- [Find remote Manager, AI Evaluation jobs](/jobs/search?q=Find+remote+Manager%2C+AI+Evaluation+jobs)
- [Find Manager, AI Evaluation jobs with AI evaluation and Evaluation datasets](/jobs/search?q=Find+Manager%2C+AI+Evaluation+jobs+with+AI+evaluation+and+Evaluation+datasets)
- [Find jobs similar to Manager, AI Evaluation](/jobs/search?q=Find+jobs+similar+to+Manager%2C+AI+Evaluation)
- [Find Manager, AI Evaluation jobs posted this week](/jobs/search?q=Find+Manager%2C+AI+Evaluation+jobs+posted+this+week)
- [Find Manager, AI Evaluation jobs paying $100,000 or more per year](/jobs/search?q=Find+Manager%2C+AI+Evaluation+jobs+paying+%24100%2C000+or+more+per+year)
- [Find Artificial Intelligence/Machine Learning jobs in Sydney, New South Wales, Australia](/jobs/search?q=Find+Artificial+Intelligence%2FMachine+Learning+jobs+in+Sydney%2C+New+South+Wales%2C+Australia)

## Get More from Metaintro

Unlock powerful job search, personalized recommendations, and deep career insights from comprehensive, market-leading data and live market signals.

- [Browse all jobs](/jobs/search)
- [Access help center](/help)
- [Explore our content](/blog)

![](https://cdn.metaintro.com/rs:fill:1200:800/q:30/plain/images/bridges/bridge-expand.1df895c6bd76d96f.png)

For job seekers

## Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

[Get Started Free](/signup)[Search matching jobs](/jobs/search)

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

[Return to navigation](#main-navigation)