Save application

Tensordyne

7 days ago

Working Student - LLM Quantization & Inference Performance

Remote · Munich, Bavaria, Germany

pythonpytorch

arbeitnow

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: arbeitnow

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

You will assist in evaluating and optimizing LLM quantization and inference performance at Tensordyne in Munich. This role involves hands-on experimentation and coding to improve AI model efficiency.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Working Student - LLM Quantization & Inference Performance at Tensordyne?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

Job description

You will assist in evaluating and optimizing LLM quantization and inference performance at Tensordyne in Munich. This role involves hands-on experimentation and coding to improve AI model efficiency.

Details

  • Munich, Germany, work from office
  • Current enrollment in a master's degree program in Computer Science, Mathematics, Electrical Engineering, or Machine Learning
  • Strong skills in Python and PyTorch

The work

  • Measure how low-precision computation affects model performance
  • Implement and compare post-training quantization methods
  • Automate evaluations and track configurations and results
  • Characterize latency, throughput, and memory usage