Web Scraping Developer

 Posted an hour ago
  
 Malta
  
2-5 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

Design and maintain automated web scraping solutions to collect affiliate and market intelligence data. Integrate extracted data from various APIs and websites into a centralized data warehouse.

Growth Leads is an online lead generation company that creates quality leads in highly competitive verticals, such as iGaming, Financials, Health and Communications. We focus on building high-end websites with quality content that let customers make an informed decision about the product they’re about to buy or sign-up to. We pride ourselves on adopting a customer-focused approach to quality and usability.


About the Role

We are seeking an experienced Web Scraping Developer to join our data acquisition team. In this role, you will be responsible for designing, developing, and maintaining automation solutions that interact with websites, APIs, email systems, Google Sheets, and other external platforms.
The primary objective of these automations is to collect affiliate and market intelligence data from various sources and integrate it into our centralized data warehouse.


What you'll do

  • Design, develop, and maintain web scraping and automation solutions.
  • Build integrations with websites, APIs, email platforms, spreadsheets, and other third-party systems.
  • Extract, transform, and load (ETL) data into the company's data warehouse.
  • Monitor and maintain existing scraping infrastructure to ensure reliability and scalability.
  • Analyze, troubleshoot, and adapt to changes in target systems and anti-bot mechanisms.
  • Collaborate with internal teams to define data collection requirements and optimize data pipelines.


What we're looking for

  • Strong proficiency in Python.
  • Experience using UV for Python dependency and environment management.
  • Daily development experience in Linux environments.
  • Solid knowledge of PostgreSQL.
  • Experience with Docker.
  • Experience working with AWS services.
  • Proficiency with Git, particularly GitHub.
  • Hands-on experience with browser automation frameworks: e.g., Selenium
  • Experience with HTTP clients: e.g. requests
  • Strong understanding of:
    • CSS Selectors and XPath
    • Proxy rotation and management
    • JavaScript injection and DOM manipulation
    • Browser fingerprint spoofing and rotation
    • Scraping dynamic and JavaScript-heavy websites


Preferred Qualifications (Nice to Have)

  • Experience bypassing anti-bot and anti-scraping systems.
    Familiarity with advanced browser evasion techniques and detection avoidance strategies.
  • Experience with:
    CAPTCHA solving services
    Network request analysis and reverse engineering


What we offer

  • Ownership & Impact: You will help shape the architecture, scalability, and long-term direction of a growing digital platform operating in competitive industries
  • Flexibility: Remote working environment, or come join us at our office in Malta
  • Competitive Compensation: We offer competitive compensation packages, with opportunities for performance-based incentives

Similar Jobs

See all Remote Software Development jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Software Development

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified