Data Engineer - Spark & Scala
Is this the right opportunity for you?
Explore more jobs, compare advertised salaries and see which skills employers want.
Explore this careerSearch for a different role
More Data Engineer jobs →Skills
Description
We are hiring: Data Engineer – Spark & Scala
Location: Glasgow, UK – Hybrid (2–3 days onsite)
- Strong hands-on experience with Apache Spark and Scala for processing, transforming and validating large-scale datasets.
- Experience developing and maintaining data pipelines and orchestration workflows using Apache Airflow.
- Proficiency in Python, SQL and PostgreSQL for data processing, validation, reconciliation and troubleshooting.
- Experience with production support, investigating failed workflows, data mismatches, missing files and pipeline failures.
- Familiarity with GitLab, CI/CD, Docker and controlled software release practices.
- Understanding of data quality, monitoring, logging, auditability and operational resilience.
- Experience with Starburst/Trino, AWS S3, Kubernetes or OpenShift would be an advantage.
Key Skills: Apache Spark / Scala / Python / Apache Airflow / SQL / PostgreSQL / Starburst / Trino / GitLab / CI/CD / Docker / Data Engineering / Production Support
Get similar jobs in United Kingdom by email
We'll email you when new jobs similar to this one appear.
Similar jobs
Explore more Data Engineer jobs in United Kingdom.
Finding similar jobs…