ElevenLabs
Research Engineer - Web Crawlers
- United Kingdom
- Remote
- Mid-level
- Permanent
Owns large-scale distributed web crawling systems that discover, fetch and extract data from billions of pages to feed frontier AI models. Work spans content extraction from messy HTML, web-scale deduplication, recrawl and freshness strategies, politeness and rate limiting, plus tooling for researchers to request and explore crawled data.
Kubernetes