Data Engineer

Title: Spark Scala Data Engineer

We are seeking a highly skilled Data Engineer with expertise in Scala, Spark, SQL, AWS. The ideal candidate should have experience in building piplelines using Scala with Spark in a fast-paced environment, demonstrate a high degree of ownership, and be comfortable working independently with minimal oversight.

A strong ability to learn new skills quickly is highly desirable, as we would like this individual to also gain expertise in Google Cloud (GCP) over time.

Key Responsibilities:

• Design, develop, and optimize ETL pipelines on AWS using Scala with Spark, SQL, and Python.
• Implement performance tuning techniques to enhance data workflows.
• Develop dashboards and reports using Amazon QuickSight to enable data-driven decision-making.
• Ensure data quality, reliability, and security across all data pipelines.
• Troubl...