Big Data Engineer_BST

Role Overview

We are looking for a Big Data Engineer to join our data team and lead the development of scalable data pipelines and analytics workflows. The role focuses on processing large-scale test and experimental data using PySpark, building reliable data models, and enabling downstream analytics and visualization in Tableau.

You will work closely with sensor experts, test engineers, and infrastructure engineers to transform raw testing data into high-quality datasets that support operational monitoring, performance analysis, and decision making.

Key Responsibilities

Data Pipeline Development

• Design, build, and maintain scalable data pipelines using PySpark and Spark SQL
• Process and transform large volumes of structured and semi-structured test data
• Implement effici...