Save application

Alephalpha

12 days ago

Senior AI Researcher- Pre-training (f/m/d)

Onsite · Heidelberg

pythonpytorch research

arbeitnow

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: arbeitnow

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

Join our Pre-training team in Heidelberg to advance the architecture and training of foundation models. You'll work on optimizing training recipes and scaling strategies using large GPU clusters.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Senior AI Researcher- Pre-training (f/m/d) at Alephalpha?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

Join our Pre-training team in Heidelberg to advance the architecture and training of foundation models. You'll work on optimizing training recipes and scaling strategies using large GPU clusters.

Details

  • Heidelberg, work from office
  • Proficient in Python and PyTorch
  • Strong track record in machine learning research and software engineering
  • Hands-on experience pre-training large models on substantial infrastructure

The work

  • Optimize training recipes and design PyTorch-based architectural improvements
  • Develop hyperparameter scaling laws and scale-up methodologies
  • Investigate convergence issues and resolve distributed system failures
  • Collaborate with teams to align model lifecycle with hardware constraints