Description
Ignite IT Hub is seeking a Senior Model Evaluation Analyst to evaluate the accuracy and reliability of the U.S. Census Bureau's LLM Autocoder. The role maintains versioned evaluation datasets and test cases, runs accuracy and coding-rate comparisons, investigates model and coding discrepancies, develops Python or SQL analyses, and prepares performance reports for government review. The position requires a bachelor's degree or equivalent experience, at least 8 years of quantitative analysis, data quality, or model validation experience, and 3+ years evaluating machine learning, natural language processing, or automated classification systems. It is contingent on contract award and requires Census Special Sworn Status and Personal Identity Verification credentials.
