Save application

Annapurna Labs (U.S.) Inc.

3 days ago

Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives

Onsite US, CA, Cupertino United States

awsgo software development

amazon

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

You will develop low-level data-movement software for AI models at Annapurna Labs in Cupertino. This role involves optimizing performance-critical systems and collaborating with a diverse team.

Details

  • Cupertino, CA, on-site
  • Salary not specified
  • Skills: AWS, Go
  • Experience: Strong C/C++ and performance-critical systems

The work

  • Build and optimize data-movement software for KV cache and activations
  • Profile workloads to identify and resolve bottlenecks
  • Work across the stack from network transport to inference frameworks
  • Deliver features for large AI models in production