Senior Software Engineer, Artificial Intelligence/LLM

Onsite San Carlos - Hybrid

pythontypescriptaws engineeringfulltime

ashby

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

You will develop LLM-powered features and own the service layer in a hybrid role based in San Carlos. This position requires strong coding skills and experience in production ML/LLM systems.

Details

San Carlos, hybrid (3+ days onsite)
5-8 years experience in production ML/LLM systems
Skills: Python, TypeScript, AWS

The work

Design and implement retrieval-augmented generation and tool-calling flows
Ship APIs and workers with clear contracts and backoff
Collaborate on chunking, embeddings, and indexing capabilities
Create offline evals and online metrics for task success and latency