Apache Data Engineer (SC Cleared)
Is this the right opportunity for you?
Explore more jobs, compare advertised salaries and see which skills employers want.
Explore this careerSearch for a different role
More Data Engineer jobs →Skills
Description
- Design and build data pipelines and ETL processes into a Lakehouse architecture across cloud (AWS) and on premises platforms
- Implement change data capture and event-driven patterns to ingest data from source systems
- Develop data models for the pipeline layer
- Handle non-functional requirements including security, performance and metadata labelling
- Write unit and integration tests for pipeline components
- Work within a defined SDLC using Git-based CI/CD tooling
- Contribute to sprint delivery as part of an integrated development teamExperience building data pipelines within Lakehouse architectures
- Comfortable with Apache tooling, for data engineering work
- Experience with event sourcing, change data capture and event-driven architectures
- Java and/or Groovy, with a solid grasp of object-oriented design principles
- Experience working in an SDLC with an integrated team on CI/CD tooling (Git)
Nice-to-have
- Apache NiFi
- AWS, particularly EMR, S3 and SQS
- Awareness of domain-driven design
- Linux and Scripting
- Postgres or PL/SQL
Get similar jobs in United Kingdom by email
We'll email you when new jobs similar to this one appear.
Similar jobs
Explore more Data Engineer jobs in United Kingdom.
Finding similar jobs…