Engineer: Data X2

Job category: FMCG, Retail, Wholesale and Supply Chain

Location: Cape Town

Contract: Permanent

Remuneration: Market Related

EE position: No

Introduction

Data Engineer who will assist in designing and implementing scalable and robust processes to support the data engineering capability. This role will be responsible for extracting and transforming massive amounts of data at scale and consolidating this data into a bigger data ecosystem.

• Design, build, and maintain scalable, automated data pipelines using AWS services like Glue, Lambda, Step Functions, EMR, and Kinesis.
• Develop ETL/ELT processes to ingest, transform, and deliver structured and unstructured data into data lakes, data warehouses, and analytical environments.
• Ensure efficient batch and real-time data processing, optimising workflows for performance, scalability, and cost efficiency.
• Implement...