Senior Anti-Bot / Scraping Engineer

About the role

Adthena is seeking a Senior Anti-Bot Engineer to design, build, and operate large-scale, resilient web scraping systems focused on search environments. This role sits at the intersection of data engineering, reverse engineering, and systems reliability, ensuring the delivery of accurate and timely data at scale. You will tackle complex challenges including dynamic rendering, anti-bot defenses, and high-volume data collection.

Responsibilities

• Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites
• Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches
• Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms
• Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability
• Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput
• Monitor scrape health, detect failures early, and rapidly debug production issues
• Optimise performance, cost, and latency across scraping infrastructure
• Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted

Required skills

• Python
• HTTP
• TLS
• Playwright
• Selenium
• Puppeteer
• HTML parsing
• DOM traversal
• Asynchronous programming
• Concurrent architectures
• Headless browser fingerprinting

Nice to have

• Docker
• Kubernetes
• Distributed task systems
• Job queues
• Data quality monitoring
• Anomaly detection

Benefits

• Stock options
• Trust-based vacation
• Bespoke training
• Monthly Hackdays
• Family care package
• Home office stipend
• Birthday day off
• Volunteer days

About the Company

Adthena is an award-winning search intelligence platform powered by patented AI technology that helps brands, marketers, and agencies dominate their competitive landscapes. Trusted by global brands like Citibank, L’Oréal, and Volvo, the company has been redefining search intelligence since 2012.