Azure Data QA

We are seeking an experienced Azure Data QA with over 7 years of expertise in validating and ensuring the reliability of data pipelines across Azure and Databricks environments. The ideal candidate will possess a deep understanding of data quality frameworks, testing automation, and CI/CD integration within cloud-based data platforms.

Key Responsibilities

• Develop and implement test strategies, test cases, and automation scripts to validate data pipelines in Azure and Databricks.
• Perform detailed data validation, reconciliation, and comparative analysis between source and target systems.
• Validate ETL/ELT pipelines developed in Azure Data Factory (ADF) and Databricks.
• Collaborate with Data Engineers and Product Owners to understand Source-to-Target Mapping (STM) and verify accurate transformation logic.
• Monitor and validate data quality across Delta tables and Data Warehouses.
• Identify data anomalies, documen...