togetherai
29 days ago
Junior/Senior/Staff Software Engineer, Inference / Compute Infrastructure Engineering
Onsite · Amsterdam Amsterdam
pythonkubernetesrustkafka
engineering
greenhouse
Match & cover letter
Create a profile to see your match and get a cover letter for this role.
Source: greenhouse Verified source
Never pay or share passwords or codes with an employer. How to spot a fake job
AI TL;DR
You will develop systems that automate the management of hardware infrastructure for AI clusters. This role involves building APIs and workflows to streamline the provisioning and lifecycle of physical hosts.
AI match
Clear role · 80/100 against the market band on this page.
Interview prep for this job
- What would you ship in the first month as Junior/Senior/Staff Software Engineer, Inference / Compute Infrastructure Engineering at togetherai?
- Which tradeoff in the description would you ask about first?
- How do you explain a production incident to this team?
- What would you measure in the first two weeks?
- Which part of your last project maps to this stack?
Five questions are free. The rest are Pro. See Pro
Similar roles
- Senior AI Engineer Yuno
- Software Engineer, Data Platform OneChronos
- Staff AI Deployment Engineer, Amsterdam altanaai
- Senior Manager, Delivery altanaai
- AI Workflow Lead (London, UK) blab
- AI Workflow Lead(Amsterdam, NLD) blab
Job description
You will develop systems that automate the management of hardware infrastructure for AI clusters. This role involves building APIs and workflows to streamline the provisioning and lifecycle of physical hosts.
Details
- Amsterdam, work from office
- Experience with Go, Python, Rust, or similar
- Experience with durable workflow orchestration tools
- Experience with event-driven systems like Kafka
The work
- Build the provisioning state machine for physical hosts
- Design self-service APIs for the inference team
- Automate self-healing of degraded or failed nodes
- Ensure reliability of the provisioning pipeline