Save application

Cortea AI

13 days ago

Senior/Staff AI Engineer, Quality & Evals (m/f/x)

Onsite · Berlin

pythongcp engineering

arbeitnow

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: arbeitnow

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

Join Cortea AI in Berlin to enhance AI systems for audits. You'll focus on building evaluation and observability systems for LLM agents.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Senior/Staff AI Engineer, Quality & Evals (m/f/x) at Cortea AI?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

Join Cortea AI in Berlin to enhance AI systems for audits. You'll focus on building evaluation and observability systems for LLM agents.

Details

  • Berlin, work from office
  • Competitive salary plus significant equity
  • Strong Python and backend engineering experience required
  • Experience with GCP preferred

The work

  • Build online and offline evaluation systems for LLM agents
  • Create automated quality gates for testing changes before production
  • Analyze agent traces and executions to identify issues
  • Manage observability tools for monitoring and debugging audit agents