Analisando propostas

Full-Stack Web Scraper Development for Uae Car Listing Aggregator with Admin Dashboard

Publicado em 16 de Julho de 2025 dias na TI e Programação

Sobre este projeto

Aberto

We are seeking a skilled freelancer to develop a comprehensive, fully automated web scraping solution and an accompanying web-based dashboard. The primary goal is to aggregate car listings from six specified websites targeting the UAE market, for our platform FindUsedCarz.com. The solution must be robust, efficient, and user-friendly.

Scraper Capabilities:
- Develop individual scrapers for six distinct car listing websites (e.g., Dubizzle, YallaMotor, etc.).
- Each scraper must accurately extract the following data fields for every car listing: Title, Brand, Model, Year, Price, Mileage, Fuel Type, Transmission, Location, Posting Date, Main Image URL, Short Description, and Original Listing URL.
- Implement support for various search filters (e.g., Brand, model, year) to refine data collection.
- Ensure robust pagination handling to automatically navigate and collect data from multiple pages.
- Integrate anti-bot measures such as intelligent delays and proxy rotation to prevent blocking and ensure consistent data flow.

Dashboard Requirements:
- Create an intuitive web-based dashboard for managing all scraping operations.
- The dashboard should allow for manual execution of individual or all scrapers.
- Implement a scheduling feature for automatic daily runs (once or twice a day).
- Provide a clear log and status view for each scraping run, indicating success, failures, and data volume.
- Enable data export functionality to Google Sheets, csv, and json formats.

Integration:
- The dashboard should be deployable on shared hosting (Hostinger) or provided as a standalone link with clear instructions for future integration into our main website.
- Guidance on how to integrate the collected data for dynamic search and filtering on our main website is highly appreciated.

Deliverables:
- Fully functional and tested web scrapers for all six target websites.
- A complete web-based dashboard with all specified features.
- Comprehensive source code and detailed documentation for both the scrapers and the dashboard.
- Clear guidance on hosting and integration.

Preferred Technologies:
Experience with modern scraping frameworks and libraries such as Selenium, Puppeteer, or Playwright is preferred. For the dashboard, familiarity with frameworks like Flask, Django, or Node.js is a plus, though no-code solutions will also be considered if they meet all requirements.

Categoria TI e Programação
Subcategoria Programação
Qual é o alcance do projeto? Criar um novo site personalizado

Prazo de Entrega: Não estabelecido

Habilidades necessárias