Senior/Staff AI Engineer, Quality & Evals (m/f/x)

Onsite Berlin

pythongcp engineeringfulltime

ashby

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Join Cortea in Berlin to enhance AI systems for audits. You'll focus on building evaluation and observability frameworks for LLM agents.

Build online and offline evaluation systems for LLM agents
Create automated quality gates for testing changes before production
Analyze agent traces in databases to identify issues and optimization opportunities
Manage observability tools for monitoring and debugging audit agents