Azure Data Engineer

Key Responsibilities

• Design, implement, and maintain end-to-end data pipelines for ingestion, processing, and transformation using Azure services.
• Collaborate with data analysts and stakeholders to understand data requirements and build efficient data workflows.
• Develop and manage data storage solutions such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Build and maintain ETL processes using Azure Data Factory or equivalent technologies.
• Implement data validation, cleansing, and quality assurance procedures to ensure data accuracy and reliability.
• Optimize data pipelines for scalability, performance, and cost-effectiveness.
• Monitor, troubleshoot, and resolve data pipeline issues to ensure uninterrupted data availability.
• Support data migration activities and data modelling initiatives as part of project development.