Data Engineer (Web Scraping)

We’re looking for someone to help us with scraping web data. You will be responsible for extracting and ingesting data from websites using web crawling ---------- this role you will own the creation process of these tools, services, and workflows to improve crawl/ scrape analysis, reports and data management.

A few samples of things we would scrape:

- Scrape dentists from here: ----------
- Scrape all dentists in zip code on google maps & also gather yelp + facebook profile URLS
- Scrape ---------- for inpatient treatment facilities.

You will own the process to identify and rectify any issues with breaks as well as scale scrapes as needed.

Requirements for the role:

* Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
* Experience with applications designed to display archived web content
* Experience with system monitoring/administration tools

This role would be contract and per hour to start, with a possibility of going full time. You also would be starting this role/department for us, so we would rely heavily on you to advise us for databases, etc to use. If interested, please send resume/cv and possibly a few other projects you’ve worked on.