Senior Azure Databricks Data Engineer

Build Azure Databricks Lakehouse pipelines as a Senior Data Engineer in the Greater Toronto Area, working four days onsite and one remotely.

This senior role develops the production data and AI foundation on Azure Databricks. You will scale Medallion architecture across Bronze, Silver, and Gold layers while optimizing clusters hosted in Azure. The work includes Python, PySpark, Spark SQL, Delta Lake, and Azure SQL Server.

Key Responsibilities:

• Design scalable ETL and ELT pipelines using Python and PySpark
• Maintain Bronze, Silver, and Gold data layers
• Configure Databricks clusters, workflows, and Unity Catalog governance
• Optimize Azure SQL Server schemas, queries, and integrations
• Establish automated quality checks and schema evolution standards

Requirements:

• Production experience building Azure Databricks Lakehouse solutions
• Advanced Python, PySpark, Spark SQL, and Delta Lake proficiency
• Hands-on Unity Catalog access control and lineage experience
• Azure SQL Server modeling, normalization, and query tuning knowledge
• Strong communication with business and executive stakeholders
• Apply senior Azure Databricks expertise across Lakehouse engineering, governance, SQL Server integration, and production data pipelines.