Azure Web Developer And Data Engineer

Key Responsibilities

Data Engineering & ETL Development

• Develop and maintain end-to-end ETL pipelines using Azure Databricks and PySpark
• Manage, process, and transform data using Python
• Ensure performance optimization and scalability of data pipelines

ETL Testing & Data Quality

• Perform ETL testing including Master Data Management (MDM), data completeness, cataloging, lineage, and quality validation
• Validate data across multiple source feeds to ensure consistency and reliability

Domain-Specific Responsibilities

• Support regulatory and business reporting requirements, especially in the Banking domain (preferred)
• Collaborate with stakeholders to understand data requirements and ensure accurate delivery

Collaboration & Documentation

• Work closely with cross-functional teams to design, impl...