Data Engineer

We are seeking a skilled Data Engineer with a strong background in Python and experience managing data at scale. The ideal candidate will be proficient in AWS services like S3 and EC2, and will have proven expertise in building, optimizing, and maintaining large-scale data pipelines (petabyte-level). A bonus would be familiarity with video processing workflows.

Responsibilities

• Data Pipeline Development : Design, build, and maintain scalable, efficient data pipelines in Python.
• AWS Ecosystem : Leverage services like S3 and EC2 for data storage, retrieval, and processing in production environments.
• Big Data Handling : Develop and optimize systems to handle petabyte-scale datasets with a focus on performance, reliability, and cost-effectiveness.
• Monitoring & Reliability : Implement robust monitoring, alerting, and logging to ensure smooth data flow and quickly troublesho...