Job Description
Overview
We are looking for a highly skilled Azure Data Engineer for an engagement to build scalable, production-ready data solutions.
Responsibilities
- Build and optimize data pipelines using Python, PySpark, Spark SQL, and Azure Databricks
- Develop clean, modular code for data ingestion, transformation, validation, and quality checks
- Work with Azure Data Lake Storage Gen2 and Azure SQL to deliver reliable solutions
- Implement best practices for data quality, integrity, and security
- Troubleshoot issues independently and collaborate with cross-functional teams
- Maintain clear technical documentation and support production environments
Required Skills
- Strong expertise in PySpark, Spark SQL, and Spark optimization/performance tuning
- Hands-on experience with Azure Databricks (notebooks, workflows, job clusters)
- Solid understanding of Delta Lake (schema...
Ready to Apply?
Take the next step in your AI career. Submit your application to EPERGNE SOLUTIONS PTE. LTD. today.
Submit Application