Python Developer for Web Crawling and Data Insertion

Please login or register as jobseeker to apply for this job.

TYPE OF WORK

Gig

WAGE / SALARY

USD 700 per month

HOURS PER WEEK

40

DATE UPDATED

Dec 7, 2024

JOB OVERVIEW

We are seeking a skilled Python developer to join our team, due to the nature of this project we expect the role to last one to two months. The responsibility of this role is to develop software that crawls various websites to collect price data and inserts the collected information into SQL databases at set intervals.
Responsibilities:
• Design, develop, and implement efficient web scraping scripts using Python to gather price data from multiple websites.
• Store and manage collected data in SQL databases.
• Develop automation scripts for regular data crawling and stock / price updates.
Requirements:
• Proficiency in Python with hands-on experience in web scraping using libraries such as BeautifulSoup and Selenium.
• Strong knowledge of SQL and experience working with databases such as MySQL.
• Familiarity with data cleaning and processing techniques.
• Ability to write efficient and scalable code.
• Excellent problem-solving skills and attention to detail.
• Understanding of fuzzy search principals and how to apply against products and product variations newly identified against a master table of existing products.

Application Process: Please submit your experience and example data taken from each of the first page of the two following web pages:
----------
----------

SKILL REQUIREMENT
VIEW OTHER JOB POSTS FROM:
SHARE THIS POST
facebook linkedin