Job Description
We are seeking an experienced engineer to design and implement a resilient web data acquisition solution for collecting publicly accessible information from designated websites.
The ideal candidate will have strong expertise in web architecture, browser automation, and scalable crawling systems. The objective of this project is to build a stable, high-performance data collection framework capable of handling dynamic content, structural variability, and operational constraints across complex websites.
All activities must be conducted strictly within applicable legal boundaries and in compliance with relevant terms of service and data usage policies.
Responsibilities
Design and develop a robust, scalable crawling framework
Extract structured data from dynamic, JavaScript-rendered websites
Analyze network traffic to identify relevant data endpoints
Implement intelligent retry, throttling, and session management mechanisms
Ensure system stability, monitoring, and pe...
The ideal candidate will have strong expertise in web architecture, browser automation, and scalable crawling systems. The objective of this project is to build a stable, high-performance data collection framework capable of handling dynamic content, structural variability, and operational constraints across complex websites.
All activities must be conducted strictly within applicable legal boundaries and in compliance with relevant terms of service and data usage policies.
Responsibilities
Design and develop a robust, scalable crawling framework
Extract structured data from dynamic, JavaScript-rendered websites
Analyze network traffic to identify relevant data endpoints
Implement intelligent retry, throttling, and session management mechanisms
Ensure system stability, monitoring, and pe...
Ready to Apply?
Take the next step in your AI career. Submit your application to Confidential today.
Submit Application