Job Description
Elevate your career as a Senior Big Data Developer with expertise in Python and PySpark. This role focuses on designing and optimizing data processes in a dynamic Hadoop ecosystem.
We are seeking an experienced Senior Big Data Developer to join our team. You will utilize strong skills in Python, PySpark, and data analysis to create robust data pipelines. Your work will involve ensuring data quality and performance across large datasets, while collaborating with globally distributed teams to deliver effective solutions.
Key Responsibilities:
• Develop data pipelines using Python, PySpark, and Kafka
• Conduct data analysis and wrangling on high-volume datasets
• Optimize queries with Hive, Impala, and SQL for scalability
• Troubleshoot performance issues in the Cloudera ecosystem
• Monitor jobs with Autosys and analyze system logs via Splunk
Requirements:
• Advanced proficiency in Python and PySpark
• Hands-on experience with Hadoop and Cloudera
• Strong ...
We are seeking an experienced Senior Big Data Developer to join our team. You will utilize strong skills in Python, PySpark, and data analysis to create robust data pipelines. Your work will involve ensuring data quality and performance across large datasets, while collaborating with globally distributed teams to deliver effective solutions.
Key Responsibilities:
• Develop data pipelines using Python, PySpark, and Kafka
• Conduct data analysis and wrangling on high-volume datasets
• Optimize queries with Hive, Impala, and SQL for scalability
• Troubleshoot performance issues in the Cloudera ecosystem
• Monitor jobs with Autosys and analyze system logs via Splunk
Requirements:
• Advanced proficiency in Python and PySpark
• Hands-on experience with Hadoop and Cloudera
• Strong ...
Ready to Apply?
Take the next step in your AI career. Submit your application to Confidential today.
Submit Application