Live opening · Posted 1 day ago

Python Web scraping Engineer (Immediate joiners preferred)

AIMLEAP · Bengaluru, Karnataka, India (Remote)
Linkedin No
You are 1 day behind. JobBeeper subscribers saw this role while it was still new.

At a glance

The key details from the original listing.

Posted 1 day ago
CompanyAIMLEAP
LocationBengaluru, Karnataka, India (Remote)
Work modeNo
SourceLinkedin
Listed1 day ago

Your early-applicant advantage

Live timing from JobBeeper.

Live data
9 min from Linkedin publishing this role to us finding it
11 min median time from a role going live to a subscriber being told
6 hours subscribers had this role before this page existed
16,610 roles found in the last 24 hours — the newest are not on this site yet
Start your free trial →

About the role

Description supplied by the original job listing.

Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright
, or Puppeteer.
· Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems.
· Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
· Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
· Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
· Hands-on experience in web scraping using tools like Python (BeautifulSoup, Scrapy, Selenium) for extracting, cleaning, and structuring data from dynamic web sources.
Responsibilities
· Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
· Implement browser automation solutions using Selenium, Playwright, Puppeteer, or similar frameworks for complex user flows and asynchronous rendering.
· Integrate CAPTCHA-solving services, proxy rotation systems, and advanced anti-detection mechanisms.
· Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
· Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
Qualifications
· 2–5 years of experience in web scraping and automation using Python or JavaScript.
· Strong experience in Selenium, Playwright, Puppeteer, and browser automation.
· Proficiency in Python (Requests, BeautifulSoup, Scrapy, Async frameworks) or JavaScript/Node.js for automation workflows.
· Hands-on experience with proxy networks, fingerprinting, session handling, and anti-bot strategies.
· Understanding of SQL/NoSQL databases for structured data storage.
· Experience working with AWS/GCP/Azure is a plus.
· Strong debugging, analytical, and problem-solving skills.

Work arrangement
No

Get JobBeeper Mobile App

Never miss a job opening! Get instant job alerts on your phone.

Subscribers see fresh openings within minutes. Download the JobBeeper App on Google Play to get real-time push notifications and apply before anyone else.

⚡ Instant Push Alerts 🎯 Tailored Filters 🚀 Direct Employer Links
GET IT ON Google Play

More openings worth a look

Recently tracked roles with full details and direct application links.

6 roles
Good roles move before most people even see them. Tell JobBeeper what you want and get fresh matches delivered in minutes.
Start your free trial →
⚡ Get fresh job alerts 📱 Get App