Save application

Annapurna Labs (U.S.) Inc.

Manual apply

19 days ago

Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives

Onsite · US, CA, Cupertino United States

aws software development

amazon

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: amazon

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

You will develop low-level data-movement software for AI models at Annapurna Labs in Cupertino. This role involves optimizing performance-critical systems and collaborating with a diverse team.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives at Annapurna Labs (U.S.) Inc.?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

You will develop low-level data-movement software for AI models at Annapurna Labs in Cupertino. This role involves optimizing performance-critical systems and collaborating with a diverse team.

Details

  • Cupertino, CA, on-site
  • Salary not specified
  • Skills: AWS, Go
  • Experience: Strong C/C++ and performance-critical systems

The work

  • Build and optimize data-movement software for KV cache and activations
  • Profile workloads to identify and resolve bottlenecks
  • Work across the stack from network transport to inference frameworks
  • Deliver features for large AI models in production