Immediate Hire: Multipage Web Scraper / Web Crawler

U.S. based company seeking an experienced programmer to develop a multipage web scraper that efficiently extracts data from a complex U.S. government website. The scraper should also have the capability to utilize the scraped data to interact with another related government site.

The job requires scraping 4-5 websites that are interconnected with one another. Two of the five websites are U.S. government websites. At the start of the scraper, we need the ability to manually solve a captcha, pick a document type and add a date range.

The ideal candidate will have a strong understanding of web scraping techniques and experience in handling challenging data structures. This project requires attention to detail and the ability to work with dynamic content.

Before you get hired for this job, we will require you to show that you can scrape the government website on an elementary level.