Senior AI Systems Quality Engineer

Onsite United States

pythontypescriptawsgo engineering

greenhouse

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

You will ensure the reliability and safety of AI systems in healthcare by building automated testing frameworks. This role focuses on embedding quality into the design and deployment of AI solutions.

Details

United States, on-site
7+ years of software engineering experience
Skills: Python, TypeScript, AWS, Go

The work

Build and ship automated validation frameworks and evaluation pipelines across the AI lifecycle.
Design an AI testing platform integrated with Databricks and MLflow for repeatable testing.
Create large-scale test suites to validate agentic workflows, including edge cases and failure modes.
Define measurable quality signals for LLM systems and integrate them into CI/CD pipelines.