DataState Data Engineer

Overview

An exciting opportunity is available for an experienced DataStage Data Engineer to join a high-profile programme delivering complex data integration and migration solutions within a large-scale enterprise environment. The successful candidate will play a key role in designing, developing, and supporting robust data pipelines, ETL processes, and data warehouse solutions using a range of AWS and enterprise data technologies.

Job title: DataStage Data Engineer
Location: London (Hybrid)
Day Rate: £514.00 per day
Contract Length: 12 Months
IR35 Status: Inside IR35
Public Sector

Overview

An exciting opportunity is available for an experienced DataStage Data Engineer to join a high-profile programme delivering complex data integration and migration solutions within a large-scale enterprise environment. The successful candidate will play a key role in designing, developing, and supporting robust data pipelines, ETL processes, and data warehouse solutions using a range of AWS and enterprise data technologies.

This role requires a strong technical background in data engineering, ETL development, cloud-based data platforms, and DevSecOps practices. You will work closely with architects, developers, business stakeholders, and delivery teams to ensure the successful movement, transformation, and management of critical business data.

Key Responsibilities

• Design, develop, and maintain scalable ETL and data migration solutions using IBM DataStage.
• Build and optimise batch and real-time data integration pipelines to support business and operational requirements.
• Develop and enhance data warehouse solutions, ensuring high performance, resilience, and scalability.
• Design and implement data solutions using AWS services, including Amazon Redshift, Amazon S3, and Amazon QuickSight.
• Collaborate with cross-functional teams to analyse data requirements and translate them into technical solutions.
• Support the adoption of DevSecOps principles, ensuring secure and automated deployment practices.
• Develop and maintain high-quality code using Java and SQL.
• Design, query, and optimise relational database structures and data models.
• Implement source control, version management, and CI/CD processes using GitHub and/or GitLab.
• Troubleshoot and resolve data-related issues, ensuring data integrity and platform stability.
• Contribute to technical design reviews, code reviews, and best practice initiatives across the engineering team.

Essential Skills & Experience

• Strong commercial experience with IBM DataStage.
• Proven expertise in data migration and ETL development, including both batch and real-time processing.
• Experience designing and supporting enterprise data warehouse solutions.
• Hands-on experience with:
• Amazon Redshift
• Amazon S3
• Amazon QuickSight
• Strong understanding of DevSecOps methodologies and modern software delivery practices.
• Proficiency in Java development.
• Advanced SQL skills.
• Experience working with relational databases.
• Hands-on experience with GitHub and/or GitLab.
• Strong analytical, problem-solving, and stakeholder engagement skills.
• Ability to work effectively within Agile delivery environments.

Desirable Skills

• Experience implementing and monitoring data quality frameworks.
• Knowledge of XML technologies and data formats.
• AWS Certified Data Analytics or AWS Data Specialty Certification.
• Experience working within large-scale cloud migration or transformation programmes.

Candidate Profile

The ideal candidate will be a proactive and technically strong Data Engineer with a proven track record of delivering enterprise-scale data solutions. They will possess excellent communication skills, a collaborative approach to problem solving, and the ability to operate effectively within fast-paced, complex environments.

An award-winning organisation, having secured the prestigious Queens Award for Enterprise: International Trade over multiple years.

We are committed to fostering an inclusive, equitable and accessible workplace where everyone feels valued and supported. We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply. If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience.

Please Note: If a high volume of applications is received, only candidates shortlisted will be contacted.