Job Description

The Role

A Senior Data Engineer who can lead the design and implementation of our next-generation Data Lakehouse. In this role, you will be designing and implementing our unified storage and compute layer, bridging the gap between the flexibility of a data lake and the performance of a traditional warehouse. You will be responsible for designing data ingestion for a large volume of data, and optimizing the storage for performant downstream analytics. 

What You’ll Do


  • Design and implement a scalable Lakehouse environment. Own the lifecycle of efficient storage, including schema evolution, partition transformation, and snapshot management.

  • Build and manage real-time and batch data ingestion pipelines using Kafka and Spark

  • Deploy, manage, and scale data workloads (such as Spark executors) using Kubernetes (EKS).

  • Develop complex ETL workflows. Optimize jobs for large-scale data processing focusing on ...

    • Ready to Apply?

    Take the next step in your AI career. Submit your application to Veeva Systems today.

    Submit Application