QA Engineer at iFindTech

Department: Software Development

Language

Setup: Remote - Netherlands
Location: London, England · Berlin · +1
Type: Full-time
Level: not_specified
Posted: Sep 10, 2026

Description

The QA Engineer will own the measurement, testing, and improvement of an AI company’s AI products. The role combines AI evaluation, software engineering, and product quality by building evaluation frameworks, datasets, automated tests, and tooling for LLM-powered features. The engineer will work with engineering and product teams to identify AI failures, analyze model outputs, determine root causes, and translate findings into measurable improvements. The position requires a strong software or technical background, Python or similar programming experience, LLM and generative AI knowledge, and experience creating evaluation datasets, test cases, and regression suites.

Required Skills

Python
LLMs
AI evaluation
Test automation
Root cause analysis
RAG evaluation

Additional Information

Required Previous Experiences: Software engineering or technical background
Building testing, evaluation, or quality frameworks for AI-powered products
Python or similar programming and evaluation tooling
Creating evaluation datasets, test cases, and regression suites
Analyzing model outputs and identifying failure patterns
Preferred Qualifications: RAG and retrieval-system evaluation
AI agent and workflow testing
LLM evaluation methodologies and benchmarking
Automated AI regression testing in CI/CD
Human-in-the-loop evaluation
Prompt evaluation
AI evaluation tooling and monitoring
AI product accuracy and reliability experience
Translation Company Name: iFindTech