Job Description
Job Description
We are seeking a highly skilled Data Engineer with experience in designing and maintaining real-time data streaming pipelines and building robust data lake infrastructure and architecture. The right candidate will be excited by the prospect of optimizing and building data architecture to support our next generation of products and data initiatives.
We are seeking a highly skilled Data Engineer with experience in designing and maintaining real-time data streaming pipelines and building robust data lake infrastructure and architecture. The right candidate will be excited by the prospect of optimizing and building data architecture to support our next generation of products and data initiatives.
Key Responsibilities:
- Design, develop, and maintain scalable, real-time and batch data pipelines using AWS Glue, Lambda, Apache Spark, and Kafka.
- Implement data lake architecture to ensure efficient data storage, processing, and retrieval.
- Collaborate with cross-functional teams to understand data requirements and ensure the data infrastructure supports their needs.
- Use Terraform to manage and provision infrastructure in a reproducible and scalable manner.
- Optimize and troubleshoot complex data pipelines, ensuring high availability and performance.
Ready to Apply?
Take the next step in your AI career. Submit your application to HRB today.
Submit Application