Senior Bilingual Data Engineer to support the transformation and loading of data using Azure Databricks

Senior Bilingual Data Engineer to support the transformation and loading of data using Azure Databricks

Initial 1 year contract with possibility of renewal. Hybrid 3 days a week in Montreal, QC. 7.5 hour work days, Monday to Friday.

Responsibilities:

• Use of Azure Data Factory for the ingestion in the data lake
• Use of Databricks for transformation and loading of the data in the different layers
• Use of Spark/python for the development of the loading libraries
• Participate in the development of the new ingestion pattern using databricks streaming and Kafka
• Develop best practices on the data quality validation
• Collaborate with the team to keep the coherence of the platform and make sure knowledge tranfers are done

Must Have Skills:

• 5 years as a data engineer working on the development of analytical...