Job Description
The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
- Build and maintain scalable ETL/ELT data pipelines using Databricks.
- Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
- Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
- Work with teams across the organization to prepare data for BI dashboards and reporting tools.
- Partner with business stakeholders to understand requirements and...
Ready to Apply?
Take the next step in your AI career. Submit your application to Compunnel, Inc. today.
Submit Application