Sr. Data Engineer

Key Responsibilities

1. Create and maintain large-scale data processing systems and infrastructure.
2. Build robust, performant, and scalable data pipelines to ingest, transform, and store complex data from multiple sources.
3. Collaborate with data science and software engineering team members to provide required data in an accessible, timely, and accurate manner.
4. Optimize and refine processes, algorithms, and systems to enhance data quality and reliability.
5. Ensure data privacy and security compliance.
6. Implement monitoring, logging, and alert systems to ensure data pipeline health and performance.
7. Collaborate with infrastructure and IT teams to ensure optimal data storage and retrieval mechanisms.
8. Drive the optimization, testing, and tooling to improve data quality.
9. Mentor junior data engineers, imparting knowledge and promoting best practices.
10. Stay updated with emerging technologies and int...