Save application

defcon

21 days ago

Model Test and Measurement Engineer

Remote · Remote, USA Remote, USA

pythonsql defcon - engineering

greenhouse

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: greenhouse Verified source

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

Join a remote team as a Model Test and Measurement Engineer, focusing on evaluating AI systems. You'll ensure model performance and reliability through rigorous testing and validation processes.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Model Test and Measurement Engineer at defcon?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

Join a remote team as a Model Test and Measurement Engineer, focusing on evaluating AI systems. You'll ensure model performance and reliability through rigorous testing and validation processes.

Details

  • Remote, USA
  • $150,000–$190,000 salary
  • 5+ years of model validation experience
  • Strong Python and SQL skills

The work

  • Construct labeled ground truth for model evaluation
  • Design and run sampled audits
  • Gate releases against model version and maintain evaluation records
  • Produce evidence for human oversight and fairness testing