Job Description

The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.

This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.

The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.

Key Responsibilities

  • Build and maintain scalable ETL/ELT data pipelines using Databricks.
  • Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
  • Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
  • Work with teams across the organization to prepare data for BI dashboards and reporting tools.
  • Partner with business stakeholders to understand requirements and...

Ready to Apply?

Take the next step in your AI career. Submit your application to Compunnel, Inc. today.

Submit Application