Job Description

A client based in SA is seeking an
Intermediate Data Engineer
as follows

Responsibilities:

  • To design and build data pipelines using Hadoop / Apache on Cloudera
  • Design Data Models / do Data Mapping in Hadoop
  • Build ELT / ETL pipelines using Hive / Nifi into their Data Lake (Hadoop)
  • Mentor Jnr Data Engineers with their work
  • Assist Data Scientists, Analysts and DevOps Eng's (as needed)

Skills Required
:

  • At least 4 - 5 yrs exp. in Data Engineering
  • From a BI Developer or Data Analyst background
  • Exp. in ETL / ELT using Hadoop HDFS + Impala, Apache Nifi + Hive
  • Exp. using Cloudera (or similar Azure / AWS platform pipelines)
  • Understand Data Quality, Data Governance, Data Security and DevOps (CI/CD pipelines)
  • Ideally with Telecoms exp. (billing / calls, PGW, MSC, CDR's) or any high volume data environment
  • A Comp. Science / Eng. degree and relevant cert...

Ready to Apply?

Take the next step in your AI career. Submit your application to AZ Consulting today.

Submit Application