Data Engineer

The Data Engineer will be responsible for designing, developing, and managing data pipelines and architectures. S/he will ensure that data flows seamlessly from multiple sources into databases, data lakes, or warehouses and is processed in a way that supports business analysis and decision-making. The ideal candidate will have strong software engineering skills, experience with data processing frameworks, and the ability to optimize and scale large data systems.

Responsibilities

• Design, build, and maintain scalable data pipelines that support data collection, transformation, and integration from various sources.
• Maintain databases, data warehouses, data lake ensuring data integrity, scalability, and reliability.
• Implement efficient ETL/ELT (Extract, Transform, Load) processes to automate data collection, cleaning, and transformation tasks.
• Integrate data from various internal and external sources, including APIs, cloud storage...