Evaluating bids

Full Stack Developer - Python, Scrapping

Published on the May 16, 2025 in IT & Programming

About this project

Open

Company Context:
•  Small engineering team (4 people) based in San Francisco.
•  Fast-paced, startup-style environment with minimal process (no formal Agile/sprints).
•  Main tech stack: Python + MongoDB backend.
Project Goal:
•  Build one-off, fast integrations with platforms like PitchBook, CapIQ, Bloomberg, etc.
•  No official APIs — integrations require reverse engineering of web interfaces.
•  Target is to deliver each integration in 3–6 hours, fast enough for internal demos.
•  Common challenges: Cloudflare bypassing, non-api endpoints, dom parsing, etc.
•  Emphasis on speed and functionality over clean/tested code — scrappy "it works" attitude.
Role Requirements:
•  Experienced full stack developer or backend scraper with:
o  Strong skills in Python
o  Familiarity with bypassing Cloudflare, session-based scraping
o  Ability to work modularly and independently
o  Quick context switching and minimal hand-holding
•  Must be comfortable delivering working integrations quickly, not building long-term infrastructure.
Ideal Candidate Traits:
•  “Scrappy winner” who can execute fast
•  Comfortable with unstable or undocumented environments
•  Able to reverse engineer and deliver under pressure
•  No reliance on tools like Selenium; prefers faster/more lightweight solutions
Process:
•  Likely trial starting with one integration.
•  If all goes well, leads to more integrations in rapid succession.

Category IT & Programming
Subcategory Web development
Is this a project or a position? Project
I currently have I have specifications
Required availability Full time
API Integrations Other (Other APIs)
Roles needed Developer

Project duration 3 to 6 months

Skills needed

Other projects posted by W. W.