Job Description
Job Summary:
We are seeking an experienced Senior Data Platform Engineer with over 15 years of expertise in managing and administering complex data and compute infrastructure across on-premises and cloud environments. The ideal candidate will have deep hands-on experience with Kubernetes (on-prem & Azure) , Spark Clusters , and CI/CD pipelines using Azure DevOps , with a strong background in modern data platform tools including Apache Ranger, Kafka, Airflow, Trino, Iceberg , and Datahub .
Key Responsibilities:
We are seeking an experienced Senior Data Platform Engineer with over 15 years of expertise in managing and administering complex data and compute infrastructure across on-premises and cloud environments. The ideal candidate will have deep hands-on experience with Kubernetes (on-prem & Azure) , Spark Clusters , and CI/CD pipelines using Azure DevOps , with a strong background in modern data platform tools including Apache Ranger, Kafka, Airflow, Trino, Iceberg , and Datahub .
Key Responsibilities:
- Administer and maintain on-prem Kubernetes environments using in-house Kubernetes packages , as well as Azure Kubernetes Service (AKS) clusters.
- Provision, configure, monitor, and manage Apache Spark clusters for large-scale data processing.
- Implement and support CI/CD pipelines using Azure DevOps (ADO) for data platform components and i...
Ready to Apply?
Take the next step in your AI career. Submit your application to Tech Aalto today.
Submit Application