Job Description
10 years of hands-on data engineering experience, including technical leadership of data platform initiatives
• Strong, hands-on expertise with the Databricks Lakehouse Platform, including Delta Lake, Delta Live Tables, Databricks Workflows, and Unity Catalog
• Proven experience designing and implementing the medallion (bronze/silver/gold) architecture for data ingestion, curation, and consumption
• Strong expertise in distributed data processing using Apache Spark (PySpark and Spark SQL) or equivalent big-data frameworks
• Proven experience designing and building ETL/ELT pipelines for both batch and streaming data at scale
• Expert-level proficiency in Python and SQL for data transformation, validation, and pipeline development
• Strong experience building and managing data lakes and data warehouses, including dimensional and lakehouse data modeling
• Working knowledge of Large Language Models (LLMs) and GenAI concepts — prompts, embeddings, vector database...
• Strong, hands-on expertise with the Databricks Lakehouse Platform, including Delta Lake, Delta Live Tables, Databricks Workflows, and Unity Catalog
• Proven experience designing and implementing the medallion (bronze/silver/gold) architecture for data ingestion, curation, and consumption
• Strong expertise in distributed data processing using Apache Spark (PySpark and Spark SQL) or equivalent big-data frameworks
• Proven experience designing and building ETL/ELT pipelines for both batch and streaming data at scale
• Expert-level proficiency in Python and SQL for data transformation, validation, and pipeline development
• Strong experience building and managing data lakes and data warehouses, including dimensional and lakehouse data modeling
• Working knowledge of Large Language Models (LLMs) and GenAI concepts — prompts, embeddings, vector database...
Ready to Apply?
Take the next step in your AI career. Submit your application to ALTRAIZE today.
Submit Application