Big Data Engineer

Responsibilities

• Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.
• Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.
• Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.
• Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.
• Optimize data processing workflows for maximum performance and efficiency.
• Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.
• Implement best practices for data governance, security, and compliance.
• Document technical designs, processes, and procedures to support knowledge sharing across teams.

Requirements

• Bachelor's or Master's...