Save application

togetherai

14 days ago

Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Remote · India

pythonkubernetesrustkafka engineering

greenhouse

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: greenhouse Verified source

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

Join a team to build a Kubernetes-native control plane for GPU inference in India. You'll design APIs and systems to enhance efficiency and reliability in managing inference clusters.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering at togetherai?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

Join a team to build a Kubernetes-native control plane for GPU inference in India. You'll design APIs and systems to enhance efficiency and reliability in managing inference clusters.

Details

  • India, work from office
  • Experience with Go, Python, Rust, or similar
  • Skills in Kubernetes, Kafka, and event-driven systems

The work

  • Design and implement the provisioning state machine for GPU lifecycle management
  • Create a self-service API for inference cluster management
  • Automate self-healing processes for degraded nodes
  • Ensure reliability of the provisioning pipeline with idempotency and rollback