Senior Software Quality Engineer at UMO

Department: Tech DepartmentSeniority in posting: Experienced

Language

Setup: Hybrid
Location: Lisbon
Type: Full-time
Level: lead/mgmt
Posted: Sep 9, 2026

Description

UMO is hiring a full-time Quality Engineering Manager to own end-to-end test automation architecture across backend microservices and native mobile applications, while also owning quality for LLM-powered features. The role covers API and data testing, LLM evaluation and red-teaming, CI/CD integration, MLOps/LLMOps, and AI-powered testing, with strong commercial software testing and quality engineering experience required. The position is based in Lisbon, Dubai, Kyiv, or Lviv, with remote work possible for the right fit.

Required Skills

TypeScript
Playwright
Appium
Cucumber
REST
RAGAS
DeepEval
GitHub Actions
GitLab CI
LLM Evaluation
Red Teaming
MLOps

Additional Information

Required Previous Experiences: 5+ years of commercial software testing and quality engineering experience
Experience building and scaling automation frameworks
Practical experience with native iOS and Android test automation using Appium or native frameworks
Experience testing REST APIs in data-sensitive environments
Experience evaluating LLM/RAG systems with RAGAS or DeepEval
Experience adversarially testing LLM systems with red-teaming frameworks
Experience embedding automated test suites into GitHub Actions or GitLab CI pipelines
Experience using AI tools in daily engineering activities
Basic understanding of the ML/LLM lifecycle, including prompt and model versioning, evaluation datasets, and production monitoring
Preferred Qualifications: Experience with financial APIs, payment processing, data security, or compliance standards
Experience testing GraphQL or gRPC alongside REST
Familiarity with LLM observability or experiment-tracking tools
Experience with performance or load testing and cloud infrastructure
Translation Company Name: UMO