Backend Infrastructure Engineer, Anti-Bot

Job description

ABOUT THE ROLE

Join a team building the infrastructure behind a web data extraction platform for AI applications. You will own production systems that keep extraction fast and reliable against websites using sophisticated automated-access defenses.

WHAT YOU'LL DO - Architect and operate proxy rotation, IP and session management, and isolated egress infrastructure at scale. - Improve extraction success rates against websites that actively block automated access. - Build and maintain browser and TLS fingerprint management, CAPTCHA handling, and challenge-solving systems. - Monitor proxy-layer reliability and cost efficiency, and manage its operating economics. - Diagnose intermittent failures across the stack, implement durable fixes, and support systems in production.

WHAT WE'RE LOOKING FOR - More than 3 years of experience in adversarial web infrastructure, proxy-layer engineering, or web data extraction, with recent hands-on work in this area. - Production experience architecting proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction. - Experience bypassing major anti-bot defenses, such as Akamai, DataDome, Cloudflare, or Kasada, and owning extraction success-rate metrics. - Production experience with browser and TLS fingerprinting, CAPTCHA or challenge handling, and high-volume extraction against adversarial defenses. - Proficiency in Go and/or Python, plus strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration. - Experience owning production systems end to end, including on-call, observability, and tools such as Prometheus and Grafana.

COMPENSATION & BENEFITS

Base salary: $235,000 to $260,000 USD annually. Visa sponsorship is available.

LOCATION

Hybrid role based in San Francisco, California, United States.