Save application

Openbenchmarks

17 days ago

Founding Engineer (AI + Backend)

Onsite · San Francisco, CA, US United States

$100,000–$120,000 / year engineeringbackendfull-timef24

ycombinator

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Source: ycombinator

Never pay or share passwords or codes with an employer. How to spot a fake job

AI TL;DR

You will design and build evaluation benchmarks for AI agents in San Francisco. This role involves creating systems that run evaluations autonomously and researching model behavior.

AI match

Clear role · 80/100 against the market band on this page.

Interview prep for this job

  1. What would you ship in the first month as Founding Engineer (AI + Backend) at Openbenchmarks?
  2. Which tradeoff in the description would you ask about first?
  3. How do you explain a production incident to this team?
  4. What would you measure in the first two weeks?
  5. Which part of your last project maps to this stack?

Five questions are free. The rest are Pro. See Pro

Similar roles

  • No similar roles on the board yet.

Job description

You will design and build evaluation benchmarks for AI agents in San Francisco. This role involves creating systems that run evaluations autonomously and researching model behavior.

Details

  • San Francisco, CA, US, work from office
  • $100,000–$120,000 USD / year
  • Full-time position

The work

  • Design domain-specific benchmarks from scratch
  • Build large-scale autonomous evaluation systems
  • Research model behavior and synthetic data generation
  • Produce continuous evaluations for AI-first companies