Evaluating bids

Linkedin High-Volume Scraping Solution

Published on the June 08, 2025 in IT & Programming

About this project

Open

I need a high-volume, repeatable scraping solution that:

- Extracts thousands of LinkedIn profiles based on customizable search queries
- Runs multiple times without blocking (with smart anti-detection)
- Automatically detects and removes duplicates across runs
- Exports clean, structured data (CSV)
- Simple user-friendly interface

Key Requirements:

- Massive Scale: Ability to collect 10,000+ profiles per run
- Repeatable Execution: Can be run daily/weekly without breaking
- Duplicate Handling: Auto-deduplication by profile URL/email/name
- Anti-Blocking: Rotating user agents, proxies, random delays
- Flexible Input: Let me define search keywords/targets

Technical Approach = Your Choice
Python, Node,js, APIs etc... Any other creative solution

Deliverables:

- Fully functional script/tool/app
- Sample output with 1000 test profiles

Budget: Open to discussion based on solution quality

Proposal Instructions:

- Describe your scraping approach
- Share examples of similar high-volume projects
- Confirm you can handle deduplication
- Provide realistic volume estimates

Category IT & Programming
Subcategory Other
Project size Small
Is this a project or a position? Project
I currently have I have an idea
Required availability As needed

Delivery term: Not specified

Skills needed

Other projects posted by I.