Save application

Annapurna Labs (U.S.) Inc.

Manual apply

7 days ago

Principal Engineer: Annapurna Labs Training and Inference , Annapurna Labs, AWS Neuron SDK

Onsite · US, CA, Cupertino United States

awspytorch software development

amazon

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: amazon

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

You will lead AI model performance initiatives on AWS Trainium, focusing on pre-training, post-training, and inference. This role involves hands-on coding and technical decision-making to optimize model serving at scale.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Principal Engineer: Annapurna Labs Training and Inference , Annapurna Labs, AWS Neuron SDK at Annapurna Labs (U.S.) Inc.?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

You will lead AI model performance initiatives on AWS Trainium, focusing on pre-training, post-training, and inference. This role involves hands-on coding and technical decision-making to optimize model serving at scale.

Details

  • Cupertino, CA, onsite
  • Experience in AWS and PyTorch required

The work

  • Drive performance for AI models across pre-training, post-training, and inference
  • Optimize kernel performance for ML training and implement collective algorithms
  • Deliver first-class reinforcement learning and preference optimization methods
  • Influence hardware-software co-design with chip architecture teams