Azure Databricks Engineer - Python/Spark

We are seeking a highly skilled Azure Databricks Engineer to establish and maintain an efficient data ecosystem within our organization. You will play a critical role in designing and implementing scalable data pipelines, optimizing data workflows, and ensuring data quality using Azure Data Bricks, Python, and Spark. This position requires strong technical expertise and the ability to collaborate across various functional teams to drive data-driven decision-making.

Roles & Responsibilities:

• Design and implement scalable data pipelines using Azure Data Bricks.
• Develop ETL processes to efficiently extract, transform, and load data.
• Collaborate with data scientists and analysts to define and refine data requirements.
• Optimize Spark jobs for performance and efficiency.
• Monitor and troubleshoot production workflows and job...