For Employers

Oxylabs

Experienced Web Scraping Engineer - Python (Remote)

Posted 24 days ago
2-5 years experience
Apply Now

Please mention DailyRemote when applying

?
Resume Match Score

See how much of this job your resume covers, and what’s missing.

Want a recruiter to go through it line by line?

Get professional review

Create a cover letter for this job

Upload your resume and we draft a letter for this exact role, tailored to what it asks for.

  • Tailored to this role
  • Based on your resume
  • Fully editable
AI Summary

You will develop and maintain scalable web scraping and parsing solutions while improving system observability. The role involves defining resilient scraping strategies and managing high-traffic infrastructure.

We’re a team of 500+ professionals who develop cutting-edge proxy and web data scraping solutions for thousands of the world’s best known businesses, including Fortune 500 companies. 


What’s in store for you:

You’ll be solving complex challenges and maintaining our own infrastructure with 60PB+ monthly data traffic. Here are its scale and maturity in numbers:


- 6PB+ Ceph storage

- 60PB+ monthly data traffic through our systems

- 300k+ service requests/sec processed

- 500k+ Kafka messages/sec streamed


A word from the team:

We run one of the most advanced and largest scraping and parsing products in the world. We serve thousands of requests per second with a very high success rate. Our scrapers and parsers are used by leading e-commerce, market intelligence, and AI industry players making the work challenging and truly global. The team is a blend of different interesting personalities from different walks of life and nationalities. Here you can find people who are experts in gaming, playing guitar, riding bicycles, and other areas. We, as a team, will support you in learning how to build your own scrapers and will share all the tips, tricks and hacks we know to ensure that you are onboard in no time.

\n


In this role, you’ll:
  • Develop scalable scrapers.
  • Define resilient scraping strategies, unblock websites for scrapingImprove observability in the system.
  • Develop back-end solutions for scraping & parsing problems of various magnitudes.
  • Maintain the current system and develop new features related to scraping & parsing.


Your skills & experience:
  • Experience working with Python.
  • Understanding of computer science, including data structures, algorithms, computability and complexity.
  • Version Control skills using Git.
  • Knowledge on how to unblock websites for scraping.
  • Is able to use different scraping techniques & open-source tools to build scrapers.
  • Is comfortable with using Dev Tools.
  • Network (TLS/SSL) knowledge.
  • Worked with browser automations.
  • Knows their way around asynchronous programming.


Nice to have:
  • Web development knowledge.
  • Knows how to use CSS Selectors / XPaths for parsing.
  • Experience working with Go & C++.
  • Worked on browser source code.
  • Knowledge of any front-end framework.
  • Experience working with Pydantic, FastAPI, SQLAlchemy.
  • Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus.
  • Experience with machine learning that is scraping domain-specific.
  • Has experience in building scalable systems.


Salary:
  • Gross salary: from 23 000 PLN/month. Keep in mind that we are open to discussing a different salary based on your skills and experience.
 


\n

Up for the challenge? Let’s talk!

Automatically Apply to the Best Remote Jobs

Stop the endless job search. Our AI finds and applies to the best jobs for you.

Try it Now
Keep looking

Similar Jobs

See all Remote Software Development jobs →

Blockchain Developer (Java)

Freelance United States Software Development

Senior .NET Developer / Tech Lead

Freelance Estonia, Latvia, Lithuania Software Development

Lead Mainframe Developer

Full Time United States $132K - $221K per year Software Development

Member of Technical Staff, Production Site Reliability Engineer

Full Time United States $200K - $400K per year Software Development

Senior Database Administrator

Other United States $150K - $170K per year Software Development

AI & Technical Upskilling Sr Specialist

Full Time United States $72590 - $95000 per year Software Development
Apply Now

Personalize your Remote Job Search in 3 Easy Steps!

Featuring 213,604+ Jobs in Python Developer

Answer easy questions

Answer easy questions

213,604+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified