Databricks Data Engineer

Position Overview:

The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems.

Key Responsibilities:

• Develop and maintain scalable data pipelines using Databricks and Apache Spark (primarily with PySpark).
• Build and manage Delta Lake tables and optimize them for analytics and machine learning workloads.
• Integrate data from diverse sources including APIs, cloud storage, databases, and streaming platforms like Kafka.
• Transform raw data into clean, structured formats using best practices in ETL/ELT.
• Implement data quality checks