Job Description
Job Description
A client of Insight Global is seeking a Senior Data Engineer to support a high-impact Connectivity project, focused on building and maintaining scalable data pipelines that ingest, clean, transform, and integrate both structured and real-time streaming data. This role partners closely with Data Scientists to deliver production-ready datasets that power advanced analytics and machine learning models.
Key Responsibilities
Design, build, and maintain robust data pipelines for both batch and real-time data ingestion, including structured sources and raw streaming data from Kafka
Clean, transform, and standardize incoming data to ensure high-quality, analytics-ready datasets
Integrate curated data pipelines with machine learning models developed by Data Science teams
Develop and optimize workflows using Apache Airflow for scheduling and orchestration
Build cloud-native data solutions leveraging AWS, including S3, Kubernetes, and related services
A client of Insight Global is seeking a Senior Data Engineer to support a high-impact Connectivity project, focused on building and maintaining scalable data pipelines that ingest, clean, transform, and integrate both structured and real-time streaming data. This role partners closely with Data Scientists to deliver production-ready datasets that power advanced analytics and machine learning models.
Key Responsibilities
Design, build, and maintain robust data pipelines for both batch and real-time data ingestion, including structured sources and raw streaming data from Kafka
Clean, transform, and standardize incoming data to ensure high-quality, analytics-ready datasets
Integrate curated data pipelines with machine learning models developed by Data Science teams
Develop and optimize workflows using Apache Airflow for scheduling and orchestration
Build cloud-native data solutions leveraging AWS, including S3, Kubernetes, and related services
Ready to Apply?
Take the next step in your AI career. Submit your application to Insight Global today.
Submit Application