Job Description

JOB DESCRIPTION

We need a Senior Data Engineer with 10+ years exp proficient in Spark, Scala/Java, and Hive, with extensive hands-on development experience in the Big Data Ecosystem.

Key Responsibilities:

  • Design, implement, and optimize highly performant data pipelines using Spark, Scala/Java, and Hive on platforms like Cloudera Data Platform (CDP) or other Hadoop echo systems.
  • Take complete ownership of complex data engineering projects within the big data ecosystem, covering the entire lifecycle from initial design and development to deployment and ongoing maintenance.
  • Develop robust and efficient Hive queries for extensive data analysis and reporting.
  • Champion and enforce best practices and coding standards for new and existing data flows to ensure they are robust, scalable, secure, and maintainable using Spark, Scala/Java, and Hive within the big data ecosystem.
  • Diagnose, tro...

Ready to Apply?

Take the next step in your AI career. Submit your application to Photon Interactive Private limited today.

Submit Application