Research Crawling Engineer

Remote

pythongorustjava engineeringfulltime

ashby

Match & cover letter

Create a profile to see your match and get a cover letter for this role.

Create profile and match

Job description

You will design and operate large-scale web data acquisition systems for research and model development. This role requires collaboration with a remote team during EST business hours.

Details

Remote work
Salary based on experience
Strong programming experience in Go, Rust, Python, or Java
Experience building web crawlers or large-scale data pipelines

The work

Build and maintain large-scale web crawlers across diverse domains
Design high-throughput, fault-tolerant systems for data collection
Develop pipelines for cleaning, deduplication, filtering, and normalization
Monitor crawl performance, coverage, and data quality