Job Description
We are seeking a **Lead Data Engineer** to join our innovative team and develop robust, scalable data infrastructure.
If you are passionate about crafting high-quality data solutions and working with cutting-edge technologies, this role offers an excellent opportunity to showcase your expertise.
**Responsibilities**
- Create scalable data pipelines leveraging Python3 and PySpark
- Manage Delta Tables on Databricks to enhance data storage and processing efficiency
- Partner with cross-functional teams to improve performance within AWS infrastructure, including S3, IAM, and EC2
- Maintain the security, reliability, and compliance of the data platform with organizational standards
- Streamline ETL/ELT workflows to improve efficiency and maintainability
- Diagnose and resolve technical issues in existing systems and pipelines
- Introduce advanced data engineering best practices and provide mentorship to junior engineers
**Requirements**:
- 5+ years of profe...
If you are passionate about crafting high-quality data solutions and working with cutting-edge technologies, this role offers an excellent opportunity to showcase your expertise.
**Responsibilities**
- Create scalable data pipelines leveraging Python3 and PySpark
- Manage Delta Tables on Databricks to enhance data storage and processing efficiency
- Partner with cross-functional teams to improve performance within AWS infrastructure, including S3, IAM, and EC2
- Maintain the security, reliability, and compliance of the data platform with organizational standards
- Streamline ETL/ELT workflows to improve efficiency and maintainability
- Diagnose and resolve technical issues in existing systems and pipelines
- Introduce advanced data engineering best practices and provide mentorship to junior engineers
**Requirements**:
- 5+ years of profe...
Ready to Apply?
Take the next step in your AI career. Submit your application to EPAM Systems, Inc. today.
Submit Application