Cloud Data Engineer Databricks Python

Build scalable cloud data pipelines with Python, SQL, and Databricks in a Cloud Data Engineer position focused on secure processing.

This Cloud Data Engineer position centers on designing, building, and maintaining scalable data pipelines and Azure cloud platforms. You will work with large datasets, optimize workflows, and support efficient storage and processing. The work includes Spark programs, Delta Lake, data integration, and modeling.

Key Responsibilities:

• Build and optimize ingestion, transformation, and loading pipelines
• Develop Spark programs in Databricks for large datasets
• Optimize, monitor, and troubleshoot Databricks jobs
• Implement data management, security, and governance practices
• Perform code reviews against requirements and standards

Requirements:

• Five-plus years of Python coding experience
• Five-plus years developing with SQL Server large datasets
• Five-plus years deploying Databricks PySpark ETL pipelines
• Experience with cloud warehouses including Synapse or Snowflake
• Experience with dimensional data modeling and data warehousing

Apply Python, SQL, Databricks, and cloud data engineering expertise to scalable pipelines and secure data processing.