Job Description
Job Description:
Design, build, and maintain data pipelines using PySpark
Develop and manage ETL workflows using AWS Glue
Work with data platforms such as Databricks to process and transform large datasets
Query and analyze data using SQL and Amazon Athena
Monitor data pipelines and system performance using Grafana
Deploy changes to production environments and support live systems
Requirements:
4 years and above of relevant experience as a Data Engineer
Expert proficiency in PySpark (mandatory)
Strong experience with AWS Glue
Advanced knowledge of SQL
Hands-on experience with Databricks platform
Experience using Amazon Athena and Grafana
Comfortable pushing changes directly to production without formal review
Strong experience working in AWS environments
Design, build, and maintain data pipelines using PySpark
Develop and manage ETL workflows using AWS Glue
Work with data platforms such as Databricks to process and transform large datasets
Query and analyze data using SQL and Amazon Athena
Monitor data pipelines and system performance using Grafana
Deploy changes to production environments and support live systems
Requirements:
4 years and above of relevant experience as a Data Engineer
Expert proficiency in PySpark (mandatory)
Strong experience with AWS Glue
Advanced knowledge of SQL
Hands-on experience with Databricks platform
Experience using Amazon Athena and Grafana
Comfortable pushing changes directly to production without formal review
Strong experience working in AWS environments
Ready to Apply?
Take the next step in your AI career. Submit your application to MindGraph today.
Submit Application