AI Evaluation Infrastructure Engineer

Onsite Bay Area, CA, United States of America

10418 engineering - data & data science

greenhouse

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

You will build the infrastructure for AI evaluation at Block, ensuring high-quality assessments of AI products. This role involves collaborating with various teams to enhance the speed and reliability of evaluation processes.

Details

Bay Area, CA, United States, work from office
$263,600—$395,400 USD based on location and experience
Experience in building production platforms or infrastructure

The work

Build an execution engine for scoring candidate versions quickly
Create tooling for task set validation from production logs
Develop grader infrastructure for evaluation consistency
Build systems for comparing offline scores with online outcomes