Job Description
We are seeking a **Senior Data Engineer** to join our innovative team and drive the development of robust, scalable data infrastructure.
If you are passionate about crafting high-quality data solutions and working with cutting-edge technologies, this role offers a perfect platform to demonstrate your expertise.
**Responsibilities**
- Design and implement scalable data pipelines using Python3 and PySpark
- Develop and manage Delta Tables on Databricks for efficient data storage and processing
- Collaborate with cross-functional teams to optimize performance on AWS infrastructure including S3, IAM, and EC2
- Ensure data platform security, reliability, and compliance with organizational standards
- Optimize workflows for ETL/ELT processes to improve efficiency and maintainability
- Troubleshoot and resolve technical issues in existing systems and pipelines
- Introduce best practices for data engineering and mentor junior engineers on advanced techniques
**Req...
If you are passionate about crafting high-quality data solutions and working with cutting-edge technologies, this role offers a perfect platform to demonstrate your expertise.
**Responsibilities**
- Design and implement scalable data pipelines using Python3 and PySpark
- Develop and manage Delta Tables on Databricks for efficient data storage and processing
- Collaborate with cross-functional teams to optimize performance on AWS infrastructure including S3, IAM, and EC2
- Ensure data platform security, reliability, and compliance with organizational standards
- Optimize workflows for ETL/ELT processes to improve efficiency and maintainability
- Troubleshoot and resolve technical issues in existing systems and pipelines
- Introduce best practices for data engineering and mentor junior engineers on advanced techniques
**Req...
Ready to Apply?
Take the next step in your AI career. Submit your application to EPAM Systems, Inc. today.
Submit Application