Senior Data Engineer - Cloud Pipelines (Hybrid, SC)

Role: Senior Data Engineer
Rate: £700 per day inside IR35
Duration: 4 months + Ext
Location: National - London travel required (hybrid)
Clearance: Active SC clearance required

Are you a Senior Data Engineer with experience in modern, cloud-native data platforms and a drive to shape performance-led digital delivery? We are hiring on behalf of a central government programme undergoing a transformative journey to enhance data-driven decision-making at scale.

The Opportunity - Senior Data Engineer
The Senior Data Engineer will join a multi-disciplinary team working to redefine how performance is measured and managed across a large, national directorate. The team has already delivered an MVP dashboard using Amazon QuickSight, now in active use and is moving into an exciting rebuild phase with a fully automated, code-first approach.

This is more than a dashboard project - it's a strategic initiative to improve organisational health, leadership alignment, and delivery effectiveness through better data foundations. The Senior Data Engineer play a key role in transforming manual pipelines into scalable, automated solutions within a modern analytics platform, while embedding AI-native tools and working in lean, product-focused ways.

Key Responsibilities - Senior Data Engineer

• Rebuild and optimise existing data pipelines, reducing manual effort and improving reliability
• Lead on structuring data to align with performance, delivery, and leadership metrics
• Work with cloud-native tooling (AWS, dbt, Airflow) to build scalable data infrastructure
• Collaborate with digital, performance, and portfolio teams to drive cross-functional delivery
• Champion data quality, completeness, and usability at every stage of the data lifecycle
• Support experimentation with AI tools such as GitHub Copilot and ChatGPT to enhance delivery

Skills & Experience - Senior Data Engineer

• Strong hands-on experience building and maintaining automated data pipelines
• Advanced proficiency in Python and SQL
• Experience with dbt and strong understanding of data modelling (e.g., star schema)
• Proficient with orchestration tools such as Airflow
• Comfortable working with AWS services (Glue, S3, etc.) or similar cloud platforms
• Experience with Git, GitHub Actions and CI/CD workflows
• Confident engaging stakeholders to shape technical solutions around real-world needs
• Comfortable iterating based on user feedback and operating in agile, product-oriented teams
• Open to using AI tooling and agile delivery methodologies to enhance engineering outcomes

This is a unique chance to contribute to a high-impact public sector transformation, where your work will directly influence strategic leadership and operational performance. If you thrive in environments where data is central to decision-making and innovation is encouraged, we'd love to hear from you.

Apply now to discuss this role in more detail.