Senior Bilingual Data Engineer to support the transformation and loading of data using Azure Databri
S.i. Systems
Montreal (Hybride)
Détails du poste
- Lieu de travail : Montreal (Hybride)
- Type de poste : Temporaire à temps plein
- Horaire de travail : Poste de jour
Description du poste
Senior Bilingual Data Engineer to support the transformation and loading of data using Azure Databricks
Initial 1-year contract with possibility of renewal. Hybrid 3 days a week in Montreal, QC. 7.5-hour work days, Monday to Friday.
Responsabilités
- Use of Azure Data Factory for the ingestion into the data lake
- Use of Databricks for transformation and loading of the data into the different layers
- Use of Spark / Python for the development of the loading libraries
- Participate in the development of the new ingestion pattern using Databricks streaming and Kafka
- Develop best practices for data quality validation
- Collaborate with the team to maintain the coherence of the platform and ensure knowledge transfers are conducted
Exigences
- 5 years as a data engineer working on the development of analytical platforms with programming languages such as Spark / Python
- Excellent communication skills in English & French
- 4+ years on Databricks
- Experience with Azure Data Lake and Azure Data Factory
- 3+ on Azure DevOps pipelines
Informations complémentaires
Disclaimer :
AI may be used in evaluating candidates.
This posting is for an existing vacancy.
Apply
