Save application

iai

2 hours ago

Senior AI Evaluation Engineer (Data Scientist)

Onsite · London, Bristol, Manchester London, Bristol, Manchester

python i.ai

greenhouse

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: greenhouse Verified source

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

Join a team focused on evaluating AI products that enhance public services in the UK. You will lead the design and implementation of evaluation methods to assess AI model performance.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Senior AI Evaluation Engineer (Data Scientist) at iai?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

Join a team focused on evaluating AI products that enhance public services in the UK. You will lead the design and implementation of evaluation methods to assess AI model performance.

Details

  • Location: London, Bristol, Manchester, work from office
  • Salary: £58,275 - £81,885 (maximum includes non-pensionable technical allowance of up to £15,600)
  • Skills: Highly proficient in Python, experience with software development tools and practices

The work

  • Lead the design and development of evaluation pipelines and experiments across AI products
  • Architect product-wide evaluation suites that integrate with engineering and CI/CD workflows
  • Design and implement complex evaluation methods to assess accuracy, bias, safety, and overall model performance
  • Analyze complex evaluation results and turn findings into clear recommendations for stakeholders