Job Description

Data Platform Engineer

As a Data Platform Engineer, you will be a key contributor in building and maintaining the new Operational Data Store. You will develop the infrastructure that captures, stores, and publishes master data across the enterprise, transitioning away from legacy point-to-point integrations to a highly decoupled event-driven architecture

Expanded Responsibilities

  • Pipeline Engineering: Build and maintain batch and real-time data pipelines using Dataflow and Kafka.
  • Orchestration: Develop and monitor complex Airflow (Cloud Composer) DAGs to ensure data arrives on time.
  • Infrastructure: Use Terraform to deploy and manage GCP resources, ensuring environmental consistency.
  • Software Development: Create internal APIs and microservices using FastAPI and Golang to enhance platform utility.
  • Data Modelling: Use dbt to transform raw data into clean, tested models within BigQuery.
  • Re...

    • Ready to Apply?

    Take the next step in your AI career. Submit your application to TVH today.

    Submit Application