Lead Data Engineer (Azure/Databricks)

Data Engineer - Azure Databricks

Experience: 5-10 Years

Location: Hyderabad/Noida

Notice Period: Immediate to 60 Days

Job Description:

Responsibilities

- Design, develop, and maintain scalable and robust data pipelines on Databricks.

- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.

- Optimize and troubleshoot existing data pipelines for performance and reliability.

- Ensure data quality and integrity across various data sources.

- Implement data security and compliance best practices.

- Monitor data pipeline performance and conduct necessary maintenance and updates.

- Document data pipeline processes and technical specifications.

Qualifications

- A bachelor’s degree in computer science, Engineering, or a closely related discipline is required.

- 5+ years of e...