Save application

snorkelai

19 days ago

Research Scientist - Frontier Benchmarks

Hybrid · New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote) New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)

316 - research

greenhouse

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: greenhouse Verified source

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

You will design next-generation benchmarks and datasets for frontier AI evaluation. This role involves collaboration across teams to translate research insights into actionable data solutions.

AI match

Solid listing · 60/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Research Scientist - Frontier Benchmarks at snorkelai?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

  • No similar roles on the board yet.

Job description

You will design next-generation benchmarks and datasets for frontier AI evaluation. This role involves collaboration across teams to translate research insights into actionable data solutions.

Details

  • New York City, NY; San Francisco, CA; or Remote in the United States
  • $200,000—$375,000 USD
  • Ph.D. in machine learning, NLP, or related field preferred; equivalent experience considered
  • Experience in AI/ML evaluation, NLP, or related fields

The work

  • Design datasets for frontier model training and evaluation
  • Translate benchmark insights into narratives for presentations and reports
  • Collaborate with cross-functional teams to inform the company roadmap
  • Stay updated on LLM evaluation research and integrate best practices