Member of Technical Staff (QA Engineer - Agentic Systems) at SOLSTICE

Department: Engineering

Compensation

$160,000 – $300,000/yr

Setup: On-site
Location: New York, New York
Type: Full-time
Level: senior
Posted: Jun 26, 2026

Description

Solstice is hiring its first dedicated QA Lead to own quality for its AI-powered pharmaceutical marketing platform. The role combines hands-on engineering with test infrastructure, evaluation systems, Playwright end-to-end testing, manual and exploratory QA, CI/CD quality gates, production monitoring, and background-job reliability. It requires strong Python, test automation, LLM and non-deterministic system testing, evaluation methods, statistical quality thinking, error analysis, and independent ownership. The position is based in New York City and offers health, dental, and vision insurance, visa sponsorship, equity, and a salary of $160,000 to $300,000.

Required Skills

Python
Playwright
Test infrastructure
LLM systems
Evaluation methods
CI/CD
Manual QA
Error analysis

Additional Information

Required Previous Experiences: Experience building test infrastructure and integrating it into CI/CD
End-to-end and UI test automation with Playwright
Manual and exploratory QA
Testing non-deterministic, ML, or LLM-based systems
LLM evaluation methods
Statistical quality analysis
Error analysis
Independent ownership
Preferred Qualifications: Agent or LLM framework experience
LLM observability tools
TypeScript and React
Adversarial testing
Async Python services
Regulated industry experience
MLOps or LLMOps