Data Engineer

Job Description:

• Design, build, and maintain data pipelines using PySpark
• Develop and manage ETL workflows using AWS Glue
• Work with data platforms such as Databricks to process and transform large datasets
• Query and analyze data using SQL and Amazon Athena
• Monitor data pipelines and system performance using Grafana
• Deploy changes to production environments and support live systems

Requirements:

• 4 years and above of relevant experience as a Data Engineer
• Expert proficiency in PySpark (mandatory)
• Strong experience with AWS Glue
• Advanced knowledge of SQL
• Hands-on experience with Databricks platform
• Experience using Amazon Athena and Grafana
• Comfortable pushing changes directly to production without formal review
• Strong experience working in AWS environments