We are seeking a skilled freelancer to develop a robust web scraping application. The primary objective is to extract specific data from government websites, focusing on information related to social security benefits. Specifically, the application needs to identify and collect data pertaining to users who applied for benefits and subsequently had their applications denied. The initial target for data exploration is the Brazilian government's open data portal,
http://www.dados.gov.br/, or other relevant official social security websites that may be accessible through or linked from this portal. The ideal candidate will have experience in building reliable scraping tools that can handle dynamic content, navigate complex website structures, and efficiently extract structured data. The extracted data should be clean and organized, ready for further analysis. The project requires a solution that is both effective in data retrieval and mindful of ethical scraping practices.
Delivery term: Not specified