Save application

Black Forest Labs

8 days ago

Applied Research Engineer, Evaluation

Onsite · Freiburg (Germany)

pythonpytorch research

arbeitnow

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: arbeitnow

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

Join Black Forest Labs in Freiburg to enhance the evaluation of cutting-edge generative models. You'll work on building and maintaining the evaluation stack for FLUX models and contribute to the assessment of their performance.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Applied Research Engineer, Evaluation at Black Forest Labs?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

Join Black Forest Labs in Freiburg to enhance the evaluation of cutting-edge generative models. You'll work on building and maintaining the evaluation stack for FLUX models and contribute to the assessment of their performance.

Details

  • Freiburg, in-office work required
  • €150K-€220K base salary plus equity based on experience
  • Advanced degree (MS/PhD) or equivalent practical experience
  • Strong Python and software engineering skills

The work

  • Build and maintain the evaluation stack for model checkpoints
  • Design evaluation metrics across various criteria like aesthetics and fidelity
  • Benchmark FLUX against competitor models continuously
  • Evaluate the evaluation stack for consistency and improvement