Job Description
Description We are looking for an experienced Data Engineer to join our team in Jacksonville, Florida. In this role, you will take the lead in designing and building a cutting-edge Azure lakehouse platform that enables business leaders to access analytics through natural language queries. This position combines hands-on technical expertise with leadership responsibilities, offering an opportunity to mentor a team of skilled engineers while driving innovation.
Responsibilities:
• Architect and develop a robust Azure lakehouse platform, utilizing Azure Data Lake Gen2, Delta Lake, and PySpark to create efficient data pipelines.
• Implement a semantic layer and metric store to ensure consistent data translation and definitions across the organization.
• Design and maintain real-time and batch data pipelines, incorporating medallion architecture, schema evolution, and data contracts.
• Build retrieval systems for large language models (LLMs) using Azure OpenAI and vecto...
Responsibilities:
• Architect and develop a robust Azure lakehouse platform, utilizing Azure Data Lake Gen2, Delta Lake, and PySpark to create efficient data pipelines.
• Implement a semantic layer and metric store to ensure consistent data translation and definitions across the organization.
• Design and maintain real-time and batch data pipelines, incorporating medallion architecture, schema evolution, and data contracts.
• Build retrieval systems for large language models (LLMs) using Azure OpenAI and vecto...
Ready to Apply?
Take the next step in your AI career. Submit your application to Robert Half Technology today.
Submit Application