Job Description
Role: Data Engineer – Unity Catalog Migration
Location: Gurgaon
Experience: 5+ Years
Immediate Joiners
Senior Data Engineer - Unity Catalog Migration
- 5-8+ years in data engineering with proven large-scale migration experience (500+ notebooks minimum)
- Strong hands-on PySpark proficiency including RDD operations, DataFrame/Dataset APIs, and performance optimization
- Deep Unity Catalog migration experience : Hive metastore to UC, mount-to-volume patterns, RBAC implementation
- Testing : Perform end-to-end validation of Unity Catalog migrated notebooks, tables, volumes, and data pipelines to ensure functional correctness and data integrity.
- Hands-on experience with Azure Databricks, UCX tool, and Azure Data Factory orchestrat...
Ready to Apply?
Take the next step in your AI career. Submit your application to Innova ESI today.
Submit Application