Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Onsite India

pythonkubernetesgorustkafka engineering

greenhouse

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

Join a team to build a Kubernetes-native control plane for GPU inference in India. You'll design APIs and systems to enhance efficiency and reliability in managing inference clusters.

Details

India, work from office
Experience with Go, Python, Rust, or similar
Skills in Kubernetes, Kafka, and event-driven systems

The work

Design and implement the provisioning state machine for GPU lifecycle management
Create a self-service API for inference cluster management
Automate self-healing processes for degraded nodes
Ensure reliability of the provisioning pipeline with idempotency and rollback