Job Description
Roles & Responsibilities
Work on Azure Databricks pipelines—enhance, modify, and optimize existing pipelines and develop new ones when required.
Handle data migration from SAP/SQL Server and enterprise databases into Azure cloud environments (Lakehouse, Delta, Synapse).
Configure, manage, and optimize Databricks clusters, compute, workspaces, and resources for performance and cost efficiency.
Build scalable ETL/ELT processes using PySpark, SQL, Delta Lake, and medallion architecture across Bronze–Silver–Gold layers.
Work extensively on Azure Data Factory, orchestration pipelines, triggers, monitoring, and integration with Databricks.
Design and maintain data warehouse & dimensional models (Facts, Dimensions, SCD, Star/Snowflake schema).
Ensure strong data quality, validation, governance, and security—including Unity Catalog, RBAC, and ...
Ready to Apply?
Take the next step in your AI career. Submit your application to Antal International today.
Submit Application