Gig
USD 700 per month
40
Dec 7, 2024
We are seeking a skilled Python developer to join our team, due to the nature of this project we expect the role to last one to two months. The responsibility of this role is to develop software that crawls various websites to collect price data and inserts the collected information into SQL databases at set intervals.
Responsibilities:
• Design, develop, and implement efficient web scraping scripts using Python to gather price data from multiple websites.
• Store and manage collected data in SQL databases.
• Develop automation scripts for regular data crawling and stock / price updates.
Requirements:
• Proficiency in Python with hands-on experience in web scraping using libraries such as BeautifulSoup and Selenium.
• Strong knowledge of SQL and experience working with databases such as MySQL.
• Familiarity with data cleaning and processing techniques.
• Ability to write efficient and scalable code.
• Excellent problem-solving skills and attention to detail.
• Understanding of fuzzy search principals and how to apply against products and product variations newly identified against a master table of existing products.
Application Process: Please submit your experience and example data taken from each of the first page of the two following web pages: