Job Description
Senior PySpark Developer
Job Summary
We are looking for a Senior PySpark Developer with strong hands-on experience working on the Cloudera stack. The role involves building and maintaining large-scale data processing and ETL pipelines using PySpark. Experience in finance or banking environments is a plus.
Experience: 5+ years
Key Responsibilities
• Develop and maintain PySpark-based ETL pipelines on the Cloudera platform
• Write efficient PySpark and Spark SQL transformations
• Process large volumes of structured and semi-structured data
• Optimize Spark jobs for performance and scalability
• Create and manage Hive tables and partitions
• Handle data validation, reconciliation, and error handling
• Support production deployments and troubles...
Ready to Apply?
Take the next step in your AI career. Submit your application to Kavi Software Technologies Private Limited today.
Submit Application