Big Data lead

Design & Build ingestion pipelines using ELT and schema on read in Databricks Delta

lake;

Design & Develop 'Transformations' aspects using ELT framework to modernize the

Ingestion pipelines and build data transformations at scale;

Provide technical expertise in the areas of design and implementation of Ratings Data

Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive,

Databricks, Scala, Python, and Spark;

Build and maintain a data environment for speed, accuracy, consistency, and 'up' time;

Work closely with other data teams & Data Science team and participate in the

development of ingestion pipelines;

Ensure data governance principles are adopted, data quality checks and data lineage are

implemented in each hop of the data;

Be in tune with emerging trends Big data and cloud technologies and participate in the

evaluation of new technologies;

Ensure complianc...