Save application

Runware

2 days ago

Principal Engineer, Model Performance

Remote · United States United States

pythonnodepytorch full time

speedrun

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: speedrun

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

You will lead the optimization of model performance for Runware's AI inference platform. This role involves hands-on engineering and team leadership to enhance the efficiency of over 400,000 models across various workloads.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Principal Engineer, Model Performance at Runware?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

You will lead the optimization of model performance for Runware's AI inference platform. This role involves hands-on engineering and team leadership to enhance the efficiency of over 400,000 models across various workloads.

Details

  • Remote work available
  • 10+ years of experience required
  • Skills: Python, Node, PyTorch

The work

  • Own inference performance for the fleet, including kernels and model-level optimizations
  • Set the model performance roadmap based on real traffic and costs
  • Write and tune CUDA kernels and implement new quantization formats
  • Build and lead the Model Performance team, mentoring engineers