Databricks Consultant

Key Responsibilities

• Design, implement, and optimize scalable data solutions using Snowflake and Databricks platforms to meet evolving business needs.
• Develop and maintain complex ETL/ELT pipelines integrating structured and semi-structured data from diverse sources, ensuring reliability and performance.
• Create and manage Snowflake objects including databases, schemas, tables, views, stored procedures, streams, and tasks to support robust data management and accessibility.
• Construct and optimize Databricks notebooks and Spark jobs leveraging PySpark and Spark SQL for advanced data transformation and analytics.
• Collaborate with cloud infrastructure teams to integrate data pipelines with cloud storage solutions and enterprise applications using APIs and connectors.
• Apply data modeling best practices including dimensional modeling, partitioning, and data partition strategies to enhance query performance and syst...