About this project
it-programming / others-5
Open
I need a customized program to fetch data (and calculation) from an online ecommerce platform.
I want to fetch data from these ecommerce sites , esp. Inventory and sales quantity. The program shall read user input excel file every day to check what categories are required for fetching data.
I need around 30 categories, first 10 pages of products (Sku) for each category, i.e. 500 sku for each category, total 15,000 sku for 1 site. The same for the other sites. 2 programs shall run independently, 1 for each site, to scrap the data.
The program shall be able to run 7x24 in a VPS environment. Developer shall suggest a reliable and reasonable cost VPS provider. Output excel file for each fetching shall be uploaded to Google Drive and sent by email (auto).
Only the latest file shall be stored in Google Drive - that is old file shall be cleared from Google Drive.
There is no api available from ecommerce site. The sites are blocking IP address, proxy etc. Developer shall be able to handle platform robot detection, captcha, proxy blocking, rate limitation etc.
If proxy service is required, developer shall advise such service provider and monthly cost, in addition to handle the work. Good database design and management are necessary.
Developer shall provide 3 months warranty to ensure the program can run 7x24 in VPS server.
Document and all necessary information shall be provided to ensure buyer can have 3rd party to do maintenance work (both the script and vps set up details) in another vps server if required.
Buyer will pay for VPS and proxy service every month after deploy.
Developer shall include the cost for 1 month proxy service required (in addition to free proxy service) during development and testing.
1st milestone payment is to cover this proxy service (1 month).
2nd milestone payment - when the project testing is completed (7x24)
3rd milestone payment (balance 15%) - when 3 months warranty is completed.
Applicant shall submit a sample of data fetching result (5 SKU) in order to understand data requirement and corresponding ecommerce site.
Applicant shall also recommend the selected VPS and Proxy service. Base on recommendation, applicant shall inform buyer the monthly charge of such service after deployment.
Buyer confirmation of such charge is a pre-requisite to start any work.
Only serious and professional shall contact me for detail and project requirement documentation.
Please include 7 days verification in VPS environment in project time.
Upon mutual agreement of the project development time, no delay of the project is accepted.
2nd part of this project will also be awarded to successful developer who delivers satisfactory work.
Category IT & Programming
Subcategory Other
Project size Medium
Is this a project or a position? Project
I currently have I have specifications
Required availability As needed
Delivery term: March 15, 2021
Skills needed