Databricks Technical Lead

Job Description

Summary

Our talented Data & AI Practice is made up of globally recognized experts - and there's room for more analytical and ambitious data professionals. If you're passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let's talk. Take your skills to a new level and launch a career where you can truly do what matters.

Key Responsibilities

• Lead the Design: Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Databricks Workflows.
• Hands-on Development: Serve as the most senior developer, writing high-quality, production-grade code in PySpark/Scala and SQL for complex batch and streaming ETL/ELT pipelines.
• Performance Optimization: Lead performance tuning and optimization efforts for large-scale Spark jobs, ensuring efficient cluster utilization and cost management. <...