Save application

Kimchi

6 days ago

Senior ML Engineer | Kimchi (Inference Stack Optimization)

Onsite

pythonnodekubernetespytorch technology

arbeitnow

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: arbeitnow

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

Join Kimchi to optimize the inference stack for faster and cheaper model serving. You'll work with a global team to enhance performance metrics and improve customer experience.

AI match

Solid listing · 60/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Senior ML Engineer | Kimchi (Inference Stack Optimization) at Kimchi?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

Join Kimchi to optimize the inference stack for faster and cheaper model serving. You'll work with a global team to enhance performance metrics and improve customer experience.

Details

  • 5+ years of experience in ML systems
  • Location: Miami, remote not available
  • Skills: Python, Kubernetes, PyTorch

The work

  • Push throughput through continuous batching and scheduler tuning
  • Cut latency by profiling and fixing bottlenecks
  • Optimize KV cache for better throughput
  • Reduce cold start times for large checkpoints