Node.js Developer for Web Scraping project

German consulting company is looking for an experienced software engineer.

Tasks:
- Implementation of backend crawling scripts (logic already in place)
- Implementation of cloud based database infrastructure (around 3 million websites will be crawled and 10 million datasets will be saved)
- Setup and implementation of cloud based crawling service
- Installation of proxy landscape to ensue anonymity during the crawling process
- Provision of successfully crawled datasets and scripts that were devleoped

Additionally work can proceed in frontend and backend tasks that follow after that first project.


Technical Know-How needed:

JavaScript
node.js
MySQL
Cloud based server (to run node.js and database)