Senior Python Data Scraping Engineer (Remote)

We’re looking for an experienced Senior Python Data Scraping Engineer to build a scalable data collection platform capable of gathering publicly available information from a variety of online sources.

The ideal candidate has extensive experience developing custom scraping applications in Python and understands how to build reliable, efficient systems that collect, process, and organize large amounts of public web data.

Responsibilities

* Design and build a custom Python-based data scraping platform
* Collect publicly available information from websites, forums, blogs, message boards, directories, and social platforms where permitted
* Develop scalable scraping workflows capable of handling large datasets
* Implement proxy management and request optimization for reliable data collection
* Build modular, maintainable, and well-documented code
* Store, clean, and organize collected data for downstream processing
* Monitor scraper performance and resolve issues as websites evolve

Required Skills

* 3+ years of professional Python development
* Strong experience building custom web scraping applications
* Experience with Scrapy, Playwright, BeautifulSoup, Requests, Selenium, or similar frameworks
* Experience with proxy management and large-scale scraping architecture
* Strong understanding of HTTP, APIs, sessions, cookies, headers, and HTML parsing
* Experience with databases such as PostgreSQL, MySQL, MongoDB, or SQLite
* Comfortable working in PyCharm or another professional Python development environment
* Experience using Git and collaborative development workflows

Nice to Have

* Experience collecting publicly available data from online communities, discussion forums, blogs, review websites, and social platforms where permitted
* Experience with asynchronous programming, multiprocessing, or distributed scraping
* Experience deploying Python applications to cloud or VPS environments
* Familiarity with Docker and automated scheduling tools

To Apply

Please include:

1. A summary of your Python development experience.
2. Examples of scraping projects you’ve built.
3. Which Python libraries and frameworks you use most often.
4. The largest data collection project you’ve completed.
5. Your experience working with proxies and scalable scraping systems.
6. Links to your GitHub or portfolio (if available).
7. Your expected hourly or monthly rate.

We’re looking for someone who can architect and build a reliable, production-ready data collection system from the ground up while following applicable laws and the terms governing the data sources used.