Job Description

Role Purpose

The Senior Cloud Data Engineer will be responsible for operating and optimizing our cloud-based data processing environment. The role involves working with Databricks, AWS services, Spark, Unity Catalog, and Delta Lake to ensure that data pipelines and analytics workloads run efficiently, securely, and reliably.

Main responsibilities

  • Refines data transformations using PySpark and Spark SQL within notebooks such as Databricks enabling efficient processing of large-scale datasets.
  • Leverages orchestration tools like Apache Airflow to automate, schedule, and oversees data workflows for consistent and reliable execution.
  • Participates in code reviews, testing, and documentation as part of the development lifecycle.
  • Supports and troubleshoots Databricks jobs, Spark workloads, and AWS-based data processes across DEV/QA/Production.
  • Optimizes Databricks clusters and jobs for performance and cost.
  • Maintains and improve...

    • Ready to Apply?

    Take the next step in your AI career. Submit your application to Cepal Hellas today.

    Submit Application