Member of Technical Staff, Evals Lead

Onsite San Francisco

researchfulltime

ashby

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

Join our team in San Francisco as an Evals Lead to benchmark video and world-model capabilities. You'll design and run evaluations that influence critical decisions in our research and product development.

Details

San Francisco, work from office
Competitive pay
Housing subsidy of $2k per month for local employees
Relocation support for those moving to San Francisco

The work

Design and run benchmarks for video and world models
Ensure honest comparisons with contamination and leakage checks
Build the analytics layer for model performance and failure patterns
Push consequential evals that influence training and product decisions