Job Description

We are seeking an experienced Data Integration Engineer to design, develop, and optimize scalable data solutions using Azure SQL and Azure Databricks. This role involves implementing data processing pipelines, ensuring data integrity and security, and collaborating with cross-functional teams to enhance performance and efficiency.

Key Responsibilities

  1. Implement scalable data solutions using Azure SQL and Azure Databricks
  2. Develop and deploy data processing pipelines using Azure Databricks
  3. Optimize data processing and storage for performance and efficiency
  4. Collaborate with cross-functional teams to ensure data integrity and security

Required Qualifications

  1. Minimum 5 years of hands-on experience with PySpark
  2. Strong experience with Databricks, Python, and SQL
  3. Strong background as an ETL developer

Location: Halifax, Nova Scotia - Remote

#J-18808-Ljbffr

Ready to Apply?

Take the next step in your AI career. Submit your application to Compunnel, Inc. today.

Submit Application