Job Description
Contract Length: Initial 6 months (extension likely)
Day Rate: £500 per day (Outside IR35)
Location: Hybrid in South Wales
Role Overview
We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands‑on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework.
Key Responsibilities
Develop and maintain data pipelines in Azure Databricks using PySpark and SQL
Build incremental processing using Delta Lake and Change Data Feed
Extend and maintain watermark‑driven CDC frameworks
Implement and maintain Slowly Changing Dimension (SCD Type 2) logic
Engineer time‑aware joins and dimensional transformations
Support optimisation of Spark workload...
Day Rate: £500 per day (Outside IR35)
Location: Hybrid in South Wales
Role Overview
We are seeking an experienced Senior Data Engineer contractor to support and extend the Azure Databricks Lakehouse platform, ensuring the reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands‑on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework.
Key Responsibilities
Develop and maintain data pipelines in Azure Databricks using PySpark and SQL
Build incremental processing using Delta Lake and Change Data Feed
Extend and maintain watermark‑driven CDC frameworks
Implement and maintain Slowly Changing Dimension (SCD Type 2) logic
Engineer time‑aware joins and dimensional transformations
Support optimisation of Spark workload...
Ready to Apply?
Take the next step in your AI career. Submit your application to Hays Technology today.
Submit Application