Senior Data Engineer

<table border="0" cellpadding="0" cellspacing="0" width="707"> <tbody> <tr> <td colspan="3" valign="top"> <p>Role Description / Essential Skills<br /> Data Engineering Development<br /> Design, develop, and optimize ETL/ELT data pipelines using Azure Databricks (Spark) and PySpark.<br /> Build and maintain large-scale distributed data processing systems.<br /> Work with structured, semi-structured, and unstructured data using Spark DataFrames, Delta Lake, and similar technologies.<br /> Implement Delta Lake architecture to support ACID transactions, time travel, and scalable storage.<br /> Azure Cloud Ecosystem<br /> Develop solutions leveraging:<br /> Azure Data Lake Storage (ADLS)<br /> Azure Synapse<br /> Azure Data Factory (ADF)<br /> Azure Key Vault<br /> Build automated data workflows using ADF pipelines and Databricks j...