Save application

Kimchi

18 days ago

Senior ML Engineer | Kimchi (LLM Inference Optimization)

Onsite

pythonnodeawskubernetesgcpazurepytorch technology

arbeitnow

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: arbeitnow

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

You will optimize LLM inference performance at Kimchi, focusing on throughput and latency. This role allows you to lead technical decisions and work on cutting-edge cloud-native infrastructure.

AI match

Solid listing · 60/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Senior ML Engineer | Kimchi (LLM Inference Optimization) at Kimchi?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

You will optimize LLM inference performance at Kimchi, focusing on throughput and latency. This role allows you to lead technical decisions and work on cutting-edge cloud-native infrastructure.

Details

  • 5+ years of experience in ML systems
  • Location: Miami, in-office
  • Skills: Python, vLLM, SGLang, TensorRT-LLM, Kubernetes, AWS, GCP, Azure

The work

  • Push throughput through kernel-level tuning and continuous batching
  • Cut latency by profiling and fixing bottlenecks
  • Optimize KV cache utilization with advanced techniques
  • Quantize models without quality regression