Senior Bilingual Data Engineer to support the transformation and loading of data using Azure Databricks
S.i. Systems
Montreal (Hybride)
Détails du poste
- Lieu de travail : Montreal (Hybride)
- Type de poste : Permanent à temps plein
- Horaire de travail : Poste de jour
Senior Bilingual Data Engineer to support the transformation and loading of data using Azure Databricks
Initial 1 year contract with possibility of renewal. Hybrid 3 days a week in Montreal, QC. 7.5 hour work days, Monday to Friday.
Responsibilities :
- Use of Azure Data Factory for the ingestion in the data lake
- Use of Databricks for transformation and loading of the data in the different layers
- Use of Spark / python for the development of the loading libraries
- Participate in the development of the new ingestion pattern using databricks streaming and Kafka
- Develop best practices on the data quality validation
- Collaborate with the team to keep the coherence of the platform and make sure knowledge tranfers are done
Must Have Skills :
- 5 years as a data engineer working on the development of analytical platforms with programming languages such as spark / python
- Excellent communication skils in English & French
- 4+ years on databricks
- Experience on Azure data lake and Azure data factory
- 3+ on Azure DevOps pipelines
Disclaimer :
AI may be used in evaluating candidates.
This posting is for an existing vacancy.
Apply