Intermediate Data Engineer

About the job Intermediate Data Engineer

Job Purpose

We are seeking a talented and experienced Data Engineer to join our MLOps team which drives critical business applications. As a key member of our team, you will play a crucial role in designing, building, testing, deploying, and monitoring end-to-end data pipelines for both batch and streaming use cases. You will work closely with data scientists, actuaries, software engineers, and other data engineers to contribute to architecting our Client's modern Machine Learning ecosystem.

Areas of responsibility may include but not limited to:

• Design, build, and maintain ETL pipelines for both batch and streaming use cases.
• Optimize and refactor existing ETL pipelines to improve efficiency, scalability, and cost-effectiveness.
• Data visualization and report building.
• Re-architecting data pipelines for a moder...