Save application

togetherai

12 days ago

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

Onsite San Francisco

pythonkubernetesgorustkafka engineering

greenhouse

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

Join a team to build a Kubernetes-native control plane for GPU inference. You'll design APIs and systems to enhance efficiency and reliability in a production environment.

Details

  • San Francisco, work from office
  • $160,000 - $280,000 and equity
  • Experience with Go, Python, Rust, or similar

The work

  • Build the provisioning state machine for GPU lifecycle management
  • Design self-service APIs for inference cluster management
  • Automate self-healing for degraded or failed nodes
  • Ensure reliability of the provisioning pipeline