Backend Infrastructure Engineer, Anti-Bot

Job description

ABOUT THE ROLE

Join a team building web data-extraction infrastructure for AI applications. You will own production systems that keep high-volume extraction reliable when websites actively resist automated access.

WHAT YOU'LL DO - Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale. - Improve extraction success rates against websites with active anti-bot and anti-scraping defenses. - Build and maintain browser and TLS fingerprinting, CAPTCHA handling, and challenge-solving infrastructure. - Monitor the health and cost efficiency of the proxy layer. - Diagnose intermittent failures across the stack and deliver lasting fixes. - Own production systems end to end, including reliability and on-call responsibilities.

WHAT WE'RE LOOKING FOR - More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in production web extraction. - Experience building proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction. - Production experience evading aggressive anti-bot defenses, including platforms such as Akamai, DataDome, Cloudflare, or Kasada, and ownership of success-rate metrics. - Experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale. - Proficiency in Go and/or Python, with strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration. - Experience operating end-to-end production systems and implementing observability and on-call tooling such as Prometheus and Grafana.

COMPENSATION & BENEFITS

Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.

LOCATION

Hybrid, San Francisco, California, United States.