Data Engineer

ESSENTIAL ROLES & RESPONSIBILITIES

• Identify and understand customer data-centric use cases within regulated financial services environments
• Design and implement data ingestion, processing, and transformation pipelines on Azure
• Build and maintain data pipelines for cleaning, normalisation, enrichment, and preparation
• Apply appropriate data modelling techniques and architecture patterns, with a strong focus on medallion architecture
• Orchestrate, monitor, and optimise Azure Databricks jobs and Azure Data Factory pipelines across development, UAT, and production environments
• Configure platforms, clusters, and compute resources to optimise performance, cost, and reliability
• Use automated CI/CD pipelines to manage, deploy, and version data artefacts and pipelines
• Operationalise workflows developed by analysts and data scientists
• Support customers in adopting Azure data, analytics, and mac...