Block
7 days ago
AI Evaluation Infrastructure Engineer
Remote · Bay Area, CA, United States of America Bay Area, CA, United States of America
10418 engineering - data & data science
greenhouse
Match & cover letter
Create a profile to see your match and get a cover letter for this role.
Source: greenhouse Verified source
Never pay or share passwords or codes with an employer. How to spot a fake job
AI TL;DR
You will build the infrastructure for AI evaluation at Block, ensuring high-quality assessments of AI products. This role involves collaborating with various teams to enhance the speed and reliability of evaluation processes.
AI match
Solid listing · 60/100 against the market band on this page.
Interview prep for this job
- What would you ship in the first month as AI Evaluation Infrastructure Engineer at Block?
- Which tradeoff in the description would you ask about first?
- How do you explain a production incident to this team?
- What would you measure in the first two weeks?
- Which part of your last project maps to this stack?
Five questions are free. The rest are Pro. See Pro
Similar roles
- No similar roles on the board yet.
Job description
You will build the infrastructure for AI evaluation at Block, ensuring high-quality assessments of AI products. This role involves collaborating with various teams to enhance the speed and reliability of evaluation processes.
Details
- Bay Area, CA, United States, work from office
- $263,600—$395,400 USD based on location and experience
- Experience in building production platforms or infrastructure
The work
- Build an execution engine for scoring candidate versions quickly
- Create tooling for task set validation from production logs
- Develop grader infrastructure for evaluation consistency
- Build systems for comparing offline scores with online outcomes