Python Data Engineer for Automated Resource Discovery System
€100–500 / project
Freelancer
NEVIE-GLOBAL is seeking a Python Data Engineer/Web Scraping & Automation specialist to build an automated discovery system for a large-scale Product & Technology Library. The system will continuously collect, classify, and enrich millions of records from publicly accessible sources.
This project requires a robust architecture for data normalization, deduplication, and quality scoring, with an emphasis on licensing and commercial rights. The duration is 5 months with an initial budget of 500 EUR.
Responsibilities: Building the data pipeline, identifying resource sources, implementing data processing methods, and ensuring continuous system discovery.
Requirements: Experience with Python, PostgreSQL, API integrations, and web scraping, alongside a strong understanding of relevant technology stacks.
You will be redirected to a third-party platform not affiliated with n8ndevs to complete your application