Freelance
3500php per week
TBD
Jun 8, 2026
We are looking for a Skilled "Java" Programmer to write several website scraping scripts
That scrap data from websites like smilarsites.com, alexa.com, ect and extract the data, or screen shots of the sites, then record the scrapped infomation in a database. At the moment we research sites manually but the roll of the scrapers is to Automate the process
YOU MUST BE ABLE TO DO THE FOLLOWING: to write the scrapper
Scrapper Requirements:
Written in Java 1.6.0_31Must use Selenium FireFox Web Driver 2.34.0 http://www.seleniumhq.org/Must use log4j 1.2.16 as logger http://logging.apache.org/log4j/1.2/Must use JSoup.1.7.2 http://jsoup.org/Once there is no simulated User interactions with the page and the scraper is about just to parse its content to retrieve data, page must be loaded in a JSoup document to carry on parsing. This is required because Selenium FireFox Web Driver has shown to much instability.Class must extends attached abstract Scraper classMulti-threading forbiddenIf there is some properties to be loaded like credentials, they must be placed in a file at the root package. The name of the file must match the concrete scraper class name in lower case. The provided method loadProperties in the Scraper class must be used to load the file.
Return type of method scrape is a Map: must contain all the keys that have been agreed to be returned as result of the scraping. Exception must be handled and re thrown to the caller.
PLEASE NOTE: EACH SCRAPPER WILL BE SIMILAR THE ONLY DIFFERENCE IS THAT THEY WILL BE SCRAPING DIFFERENT SITES
SO THE FIRST SCRAPER SCRIP MUST BE WRITTEN WITH IN 3 - 4
DAYS, OR LESS AS IT IS PRETTY SIMPLE.