Token Engineer

Remote Remote · Seoul, South Korea

pythonawskubernetesgoterraform techfulltime

ashby

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

You will design and implement token management solutions for AI tools, ensuring cost, performance, and security. This role involves collaboration across various teams to create a transparent AI usage environment.

Details

Seoul, South Korea, remote work available
5+ years of experience in infrastructure, platform, backend, or engineering
Skills: Python, AWS, Kubernetes, Go, Terraform

The work

Design and implement a measurement pipeline for token usage and costs across AI tools
Build dashboards and alert systems for real-time usage and cost tracking
Design and operate an AI gateway for managing authentication, permissions, and usage limits
Define policies to prevent excessive costs while maintaining productivity