Job Description
- Design, develop, and maintain data pipelines and ETL processes using Databricks.
- Manage and optimize data solutions on cloud platforms such as Azure and AWS.
- Implement big data processing workflows using PySpark.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.
- Ensure data quality and integrity through rigorous testing and validation.
- Optimize and tune big data solutions for performance and scalability.
- Stay updated with the latest industry trends and technologies in big data and cloud computing.
- Requirements:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Big Data Engineer or similar role.
- Strong proficiency in Databricks and cloud platforms (Azure/AWS).
- Expertise in PySpark and big data processing.
- Experience with data mode...
Ready to Apply?
Take the next step in your AI career. Submit your application to Virtusa today.
Submit Application