Lead Data Engineer
Is this the right opportunity for you?
Explore more jobs, compare advertised salaries and see which skills employers want.
Explore this careerSearch for a different role
More Data Engineer jobs →Skills
Description
- The Reporting & Data Analytics platform underpins regulatory reporting, risk visibility, member reporting and internal analytics across SwapClear and Listed Rates
- Given the scale, criticality and regulatory scrutiny of this data, the platform is subject to exacting availability, accuracy, lineage and governance requirements
- LCH has embarked on a strategic transformation of its Reporting & Data Analytics architecture, moving from legacy on-premise Oracle / Informatica stacks to a cloud native, Snowflake based data platform
- This solution will enable robust, performant reporting, self-service analytics, and new data distribution patterns for our members and clients
- Joining as a Senior Engineer, you will be accountable for setting the platform’s technical direction, delivering Reporting & Data Analytics features, and ensuring the ongoing stability of the platform during and beyond the transformation
- You will be a technology leader with deep hands-on data engineering experience, strong technical judgement, and the seniority to engage confidently with Group Architecture, Group Data Governance, and senior business partners
- You will lead a team of engineers to deliver the reporting and data analytics transformation, with responsibility for technical standards and professional development
- You will ensure the team designs and builds solutions in line with our Engineering Principles, taking a data-driven approach, innovating with purpose, and acting as an owner
- You will ensure the platform evolves beyond migration into a scalable, governed platform that supports our members and clients, and internal partners
- Technology owner of the end-to-end data solutions for reporting and data analytics across SwapClear and Listed Rates
- Lead the safe migration from legacy Oracle / Informatica platform to the target cloud architecture. Take accountability for successful legacy decommissioning, not just building the new platform
- Lead the design, implementation and multi-year phased delivery for SwapClear and Listed Rates
- Define and drive evolution of the Strategic Cloud data platform, ensure it is fit for purpose for SwapClear and Listed Rates use cases
- Ensure the E2E platform meets availability, performance, resilience and security expected of a “systemically important” clearing house
- Assists Product Owners and Delivery Leads with delivery planning of business goals/outcomes
- Act as a senior technical partner to Group Architecture Authority, Group Data Governance and Product and business partners
- Partner with Quality engineering to ensure that all aspects of the software development lifecycle is delivered to high levels of quality and using modern testing standards, automation and cloud-native practices
- Build and maintain strong relationships with internal and external partners, using influence and trust to drive alignment, resolve challenges, and promote shared quality goals
- Practical and relevant AI experience in data engineering / migrations use cases
- Seniority and credibility to influence group level architecture and governance bodies
- Enterprise scale data modelling
- Quality-first approach
- 15+ years of hands-on software engineering experience, including at least 5+ years as a technical lead, with consistent track record of delivering high-quality solutions
- Immutable, incremental and versioned data architectures
- Passionate about metrics driven approach and leading with data
- Prior experience working with Informatica PowerCenter or similar solutions
- ELT data architectures, using dbt or similar
- Strong engineering background with the ability to engage deeply in design and implementation
- Data warehouse modelling approaches
- Solid experience of data-centric solution using SQL, PL/SQL and Python
- Deep expertise in
- Shown leadership of enterprise scale Snowflake (or similar) data platform implementations
- Detail oriented problem solver, comfortable “diving-deep”
- Data governance, lineage and control frameworks
- Cloud data lake and data warehouse solutions
- Experience operating in regulated, high availability environments
- Degree in Computer Science, Software Engineering or equivalent
- Knowledge and practical experience running technology both on prem and in cloud
- Experience of large-scale real-time and batch process orchestration, optionally with third-party orchestration engines
- Good understanding of cyber security standards and practices and follows secure-by-design principle
- Experience of working with agile frameworks like Scrum, Kanban
- Background working in financial industry
- Experience of modern observability platforms e.g. DataDog
Get similar jobs in United Kingdom by email
We'll email you when new jobs similar to this one appear.
Similar jobs
Explore more Data Engineer jobs in United Kingdom.
Finding similar jobs…