Save application

cortea

Sep 09

Senior/Staff AI Engineer, Quality & Evals (m/f/x)

Onsite · Berlin

pythongcp engineeringfulltime

ashby

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: ashby Verified source

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

Join Cortea in Berlin to enhance AI systems for audits. You'll focus on building evaluation and observability frameworks for LLM agents.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Senior/Staff AI Engineer, Quality & Evals (m/f/x) at cortea?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

Join Cortea in Berlin to enhance AI systems for audits. You'll focus on building evaluation and observability frameworks for LLM agents.

Details

  • Berlin, work from office
  • Competitive salary and significant equity
  • Strong Python and backend engineering experience required
  • Experience with GCP preferred

The work

  • Build online and offline evaluation systems for LLM agents
  • Create automated quality gates for testing changes before production
  • Analyze agent traces in databases to identify issues and optimization opportunities
  • Manage observability tools for monitoring and debugging audit agents