Unity Catalog Migration Data Engineer

Lead hands-on Unity Catalog migration work with Databricks, SQL, and Python across Toronto’s enterprise data engineering environment. Support workloads moving from Hive Metastore.

Apex Systems is seeking a Data Engineer focused on migration and centralization into an enterprise Databricks data hub. This contract assignment includes developing pipelines, transforming multiple source systems, and supporting users and workloads in Unity Catalog. You will collaborate with architecture, ADF, BI, and downstream teams.

Key Responsibilities:

• Migrate jobs and workloads from Hive Metastore
• Support Unity Catalog access and workload transitions
• Transform data from Db2 and SQL Server
• Assess jobs, users, dependencies, and migration data
• Support Azure Data Factory integrations and pipelines

Requirements:

• Hands-on Databricks engineering experience
• Unity Catalog tables, objects, and access control experience
• Python, PySpark, and SQL development experience
• Experience migrating relational and file-based data
• Strong troubleshooting and problem-solving skills

Bring Unity Catalog, Databricks, ADF, and migration experience to Apex Systems’ Toronto data engineering assignment.