Description
ScienceLogic is hiring a Data Scientist to evaluate, benchmark, and improve a suite of small, locally-hosted language models and agentic systems. The role focuses on LLM evaluation harnesses, response-quality metrics, red-teaming, retrieval and agent-trajectory analysis, production behavioral regression, and predictive trend modeling from operational telemetry. The Data Scientist will also analyze AIOps and IT operations data, quantify system economics, and communicate findings to engineering and product stakeholders. The position requires a bachelor's or master's degree in a relevant field, at least three years of data science or applied quantitative analysis experience, strong Python and SQL skills, and experience with LLM evaluation and production predictive models.

