Job Description

We are looking for an experienced Senior Data Engineer to join one of our client’s team.

Role and Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Python, PySpark and Databricks.

  • Implement data orchestration workflows using Airflow or similar tools.

  • Manage and optimize data storage solutions on Azure Cloud.

  • Develop and maintain containerized microservices using Docker.

  • Collaborate with cross-functional teams to ensure data quality and integrity.

  • Support the setup of blockchains.

  • Build tools to acquire data from blockchains and perform analysis on the data using Databricks.

  • Support production infrastructure, including monitoring and automation using tools like Datadog.

  • Participate in agile development practices, contributing to planning exercises and working in cross-functional groups.

    • Skills and Qualifications:

  • Bachelor’s o...

    • Ready to Apply?

    Take the next step in your AI career. Submit your application to Cavendish Professionals today.

    Submit Application