Data Engineer

Job Title Azure Data Engineer

Job Location: Toronto, ON

Job Type: Full Time

Experience: 7+ Years

Skills Required:

• Strong understanding of data warehousing, data lakes, and best practices for data quality, security, and performance.

• Design and Development Design, develop, deploy, and maintain scalable data pipelines and ETL

• ELT processes using Azure Data Factory (ADF), Azure Databricks, and other Azure data services (e.g., Azure Data Lake Storage, Azure Synapse Analytics).

• Python, PySpark Programming Implement efficient, reusable, and testable code for data transformation, cleansing, and analysis using Python and PySpark within Databricks notebooks and jobs.

• Orchestration and Integration Use ADF pipelines to orchestrate data movement and trigger Databricks notebooks or jobs, ensuring seamless integration between various data sources and destinations.

• Data Management Manage data storage, ...