Senior Data Engineer

Project Role Summary

Need an experienced Senior Data Engineer (8+ years) to design, develop, and optimize data pipelines and storage layers in a Medallion Architecture on Microsoft Azure . The ideal candidate will work on building scalable ETL/ELT pipelines , ensuring data governance, security, and performance optimization for batch and real-time data processing .

This role requires expertise in Azure Data Factory (ADF), Azure Databricks, Delta Lake, Microsoft Purview, Unity Catalog, Azure Databricks, ADLS Gen 2 and Python/PySpark to transform raw API-based data into curated and structured data marts.

Key Responsibilities

• Design, document and implement scalable ETL/ELT pipelines to process data from APIs into Bronze, Silver and Gold layers .
• Desi...