308 jobs found

Senior Data Engineer - Java, AWS, Kafka, Kubernetes SC Cleared | London (Hybrid) | Inside IR35 | Contract until December 2027 Are you an experienced Senior Data Engineer with a strong Java software engineering background looking to work on a high-profile UK Government AI & Data programme? We're recruiting for a Senior Data Engineer to support a major public sector organisation delivering critical data solutions within a secure environment. This is an opportunity to work with modern cloud-native technologies, build scalable data processing solutions and contribute to systems that support essential public services. The Role You'll work within an established engineering environment, developing and maintaining robust data solutions using Java and modern cloud technologies. The role combines hands-on software engineering with data engineering , making it particularly suitable for someone who has developed production-grade Java applications alongside data pipelines and distributed processing systems. Key Responsibilities Design, develop and maintain scalable data pipelines and processing solutions. Build reliable, high-performance applications using Java. Develop and enhance data ingestion, transformation and integration processes. Work with cloud-based infrastructure and services, particularly AWS. Support event-driven and distributed processing architectures. Apply data modelling, data quality and data life cycle management principles. Collaborate with software engineers, data engineers, architects and other delivery teams. Contribute to technical design, code reviews, testing and continuous improvement. Deliver solutions using Agile engineering practices. Essential Skills and Experience Advanced Java development experience , including hands-on delivery of production systems. Strong commercial experience in Data Engineering . Experience designing and developing data pipelines, ETL processes and data integration solutions . Strong software engineering fundamentals and experience building scalable, maintainable applications. Knowledge of data modelling, data quality and data life cycle management. Experience working within Agile development teams. Active UK SC security clearance. Highly Desirable AWS - experience building or supporting cloud-native data solutions. Apache Kafka - experience with event streaming, messaging or Real Time data processing. Kubernetes - experience with container orchestration and distributed application deployment. Experience developing Java-based data processing or event-driven applications. Additional Advantageous Experience Apache Spark, Flink, Hadoop or other Big Data technologies. Working with high-volume or complex enterprise datasets. Experience delivering solutions within government, defence or other secure environments. Why Consider This Opportunity? Long-term contract running until December 2027 . Work on a significant UK public sector AI & Data programme. Modern technology stack involving Java, AWS, Kafka and Kubernetes. Opportunity to contribute to secure, business-critical data platforms. Hybrid London working arrangement. Interested? If you're an SC-cleared Senior Data Engineer with strong Java experience and exposure to modern cloud and data technologies, we'd be keen to hear from you. Apply now or get in touch for a confidential discussion. Please note: Active SC clearance is required for this position. The role requires three days onsite in London each week and falls inside IR35.

Senior Data Engineer - Analytics Engineering - Databricks - Pyspark - Dimensional Models - Perm We're looking for a Senior Analytics Engineer to lead the design and delivery of curated, analytics-ready data within our Lakehouse environment. You'll translate complex business requirements into robust SQL and PySpark pipelines, own the data serving layer, and ensure data is well-modelled, governed, performant and ready for consumption across analytics and BI. You'll also provide technical leadership and mentorship, helping to establish best practices across the team. Key Responsibilities: Design and deliver dimensional and semantic data models for analytics. Define and maintain KPIs, conformed dimensions and consistent data definitions. Develop and optimise SQL and PySpark pipelines using Databricks. Ensure high standards of data quality, testing, performance and observability. Lead modelling reviews and contribute to technical and architectural decisions. Work closely with Data Architects, BI teams, analysts and business stakeholders. Mentor and support other Analytics Engineers. Contribute to CI/CD, automation, testing and data governance standards. About You Essential: Strong experience as an Analytics Engineer within a modern data platform environment. Expert-level SQL and strong hands-on PySpark experience. Strong understanding of dimensional modelling, semantic layers and analytics engineering. Proven experience with Databricks and Lakehouse architectures. Excellent stakeholder management and communication skills. Experience providing technical leadership or mentoring. Desirable: Experience with Unity Catalog, dbt or similar transformation frameworks. Knowledge of Delta Lake, data governance and metadata management. Experience with CI/CD and automated testing.

Senior/Lead Data Engineer - Qlik Sense - Newcastle (3 days p/week) - £350 - £450 p/day (umbrella) Location: Newcastle, onsite 3 days p/week Security Clearance: SC Cleared or eligible to obtain SC clearance Robert Half are looking for an experienced Senior/Lead Data Engineer to join a team delivering complex data-focused projects within a large-scale environment. This is an excellent opportunity for a technically strong Data Engineer with experience across modern data platforms, visualisation and analytics technologies, particularly within the Qlik and ELK ecosystems. The Role You will bring strong technical expertise across data engineering technologies, helping to support the development and delivery of data solutions within a complex project environment. Experience working with large-scale public sector programmes would be highly advantageous, particularly where security, data management and technical delivery are key considerations. Key Skills & Experience Strong experience as a Data Engineer, ideally at Senior level. Hands-on experience with Qlik Sense . Experience working with the ELK Stack , particularly Elasticsearch, Logstash and Kibana. Strong understanding of data engineering concepts and technologies. Previous exposure to large-scale public sector projects would be advantageous. Must currently hold valid SC Security Clearance or be eligible to obtain it. Location The role is based in Newcastle . If you're a Senior/Lead Data Engineer with experience across Qlik Sense and the ELK Stack, and you're interested in working on large-scale projects, we'd be keen to hear from you. Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity, equity and inclusion. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data:

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to 80,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS business that is transforming the way commercial data is managed and utilised. In this role, you will lead the development of scalable data pipelines and integrate complex data sources into a modern cloud-based platform. About the Company Our client is a leading technology business focused on transforming commercial Asset management through data and innovation. Their SaaS platform consolidates and reconciles data across financial, operational, and leasing functions, providing a single source of truth for asset, fund, and portfolio performance. Key Responsibilities Data Pipeline Development Data Platform Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark / PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential Skills & Experience Degree in a STEM discipline, ideally Computer Science, Software Engineering, or a related field. Minimum of 5 years' experience within Data Engineering, Data Warehousing, or a similar role. Strong experience with Python and PySpark. Excellent SQL skills. Experience with data orchestration tools such as Airflow, Azure Data Factory (ADF), SSIS, or similar. Solid understanding of data modelling principles and modern data warehouse architectures. Experience designing and building scalable, production-grade data pipelines. Desirable Experience Experience working within cloud-native Azure environments. Knowledge of modern analytics platforms and semantic data layers. Previous mentoring or technical leadership experience. Apply If you're a passionate Senior Data Engineer looking to work on complex data challenges and build impactful data solutions at scale, we'd love to hear from you. Join a growing technology business where your expertise will directly influence the future of a data-driven platform serving one of the world's largest industries.

Are you a Senior Data Engineer who is at the top of their game? Looking to work on large-scale data initiatives and help shape the future of a data landscape for a well-known UK brand operating at genuine enterprise scale? Do you want to join a proactive, forward-thinking team delivering key transformation projects and complex data integrations? Keep reading Who are my client? Well, they're a massively well-recognised brand here in the UK, but they're also making serious waves in the US market too. They are absolutely THRIVING and are regarded as the Number 1 brand in their sector. They've also been named one of the UK's best places to work on multiple occasions. Trust me, this is a brand you'll want on your CV. They're privately owned too, which means the environment is fast-moving, lean and entrepreneurial. They embrace a "fail fast" mentality and are always open to exploring new ideas, technologies and ways of working. You couldn't be joining at a better time. The business is undergoing a HUGE transformation that will significantly evolve its data capabilities and take its data platform to the next level. This is where you come in. Who are they looking for? They are looking for a highly capable Senior Data Engineer who can play a key role in delivering and enhancing their data platform. You'll be responsible for designing, building and optimising data solutions that support the wider business, whilst helping to drive best practice across the engineering function. You'll have strong Python skills and be comfortable building scalable, efficient data solutions. Experience developing and maintaining ETL pipelines is essential, ensuring the smooth movement and transformation of data across the platform. Ideally, you'll also be passionate about Cloud technologies and have experience working with AWS data services such as Glue and S3. Solid exposure to ETL pipelines and monitoring tools such as Datadog is also essential. You'll be involved in monitoring and improving data processes, identifying performance enhancements and helping ensure the reliability and scalability of the wider data platform. Working closely with senior stakeholders, product teams and fellow engineers, you'll contribute to the ongoing evolution of the data environment and support the delivery of ambitious business objectives. These guys mean business and are investing heavily in their Data function, leveraging industry-leading tools and technologies to build a best-in-class platform. You'll also work extensively with their Data Warehouse, orchestrating data extraction from a variety of sources and enabling robust analytics and reporting capabilities that provide valuable insights across the organisation. As an individual? You live and breathe Data Engineering and keep up to date with the latest trends, tools and technologies within the data ecosystem. You'll thrive in a fast-paced environment where priorities can evolve quickly and where you'll regularly be presented with new technical challenges. I'm looking for the type of Data Engineer who is naturally inquisitive and has a genuine thirst for learning. My client actively supports professional development, technical certifications and continuous learning opportunities, helping you develop your skills whilst working on genuinely exciting projects. You'll also be confident in sharing ideas, contributing to technical discussions and championing improvements that can benefit both the team and the wider business. You'll join a larger, highly talented Development and Change function where the scope for learning is enormous. The estate is substantial, the projects are exciting and the opportunity to make a real impact is HUGE. Cracking role, cracking team and an opportunity to work for a true market leader, building sophisticated data-driven solutions used at genuine enterprise scale. We can offer up to 50,000 plus quarterly bonus , alongside a fantastic benefits package, whilst working from their impressive North Lincolnshire offices 3 days per week . Call me now on (phone number removed) for immediate consideration. Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law. Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers. By applying for this role your details will be submitted to Modis International Ltd and/ or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website.

UK HQ based & fast-growing software business (400+ staff, globally), serving hundreds of enterprise customers worldwide, are looking for a Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business. Location: UK, remote with very occasional visits to the office in London. Salary: Up to £85,000 basic, plus 10% bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to turn business challenges into technical solutions. Embed data quality, governance and access controls throughout the data lifecycle. Mentor a junior engineer and help mature a growing data function. What you need to bring Senior level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Experience of mentoring more junior Data Enigneers A broad range of data source experience (structured & unstructured): from CRM / revenue data, to financial data & subscription usage data. Cloud experience, preferably AWS (but Azure is totally fine), and familiarity with CI/CD and source control best practice. Desirable : More Data Science leaning background or want to explore in this role: ML / AI & data / predictive modelling strategies. Why you'll love this job A highly visible, hands-on role with real influence over data architecture and platform strategy. Join a small, high-impact team at the heart of the company's data strategy, with genuine scope to shape how it evolves. We are near the beginning of our Data Ops journey so an excellent opportunity to shape the future! Extensive benefits package including health insurance, income protection, life assurance, subsidised gym membership and 25 days' holiday plus your birthday off. If you're a Databricks specialist who wants to build something from the ground up rather than maintain someone else's legacy, we'd love to hear from you . Apply now to find out more.

Senior Data Engineer Microsoft Fabric Location: West Yorkshire Working pattern: Hybrid, 2 days per week onsite Salary: £70-80k We are looking for a Senior Data Engineer with strong hands on Microsoft Fabric experience to help design and build a modern data platform supporting analytics, AI and operational use cases. Microsoft Fabric is a key requirement for this role, so we are looking for someone who has used the platform in a genuine delivery environment rather than someone with only limited exposure. Key responsibilities • Design and build end to end ETL and ELT solutions using Microsoft Fabric • Build scalable data pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop semantic models and work with Star Schema and Kimball modelling • Implement CI/CD and automated deployment of data solutions • Build monitoring, data quality, lineage and observability into data pipelines • Work closely with Data Architects, BI teams and wider business stakeholders Essential experience • Strong commercial experience with Microsoft Fabric • Hands on experience with Dataflow Gen2, Fabric Notebooks and Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps and modern data engineering practices • Able to work onsite in West Yorkshire 2 days per week Experience with Semantic Models, DAX, Kimball modelling, Microsoft Fabric certifications such as DP 700, and data governance would also be beneficial.

GCP Senior Data Engineer Location: Surbiton, Surrey (Hybrid 1 day a week onsite) Salary: Up to £100k basic + Bonus + Benefits At Exalto Consulting, we believe the best engineers want more than just another role. They want to solve interesting problems, work with talented people, have a voice in technical decisions and see the impact of their work. We're partnering with an organisation that is investing heavily in its data capability and building a modern cloud-first data platform. As part of this journey, we're looking for a hands-on GCP Senior Data Engineer who wants to be part of a growing team and help shape what great looks like. This isn't a role where you'll inherit years of technical debt and simply maintain existing systems. You'll help build, improve and influence a platform that sits at the heart of the business's future data strategy. Why this opportunity stands out The Data Engineering function is in growth mode. Backed by senior leadership, the team is expanding and investing in permanent engineering talent to build a high-performing in-house capability. You'll join at a stage where your ideas, expertise and contributions will genuinely help shape the direction of the platform and the team. You'll work alongside engineers and stakeholders who are passionate about using data to drive better decisions, better products and better customer outcomes. What you'll be doing You'll be involved in designing, building and enhancing scalable cloud-based data solutions, including: Developing robust data pipelines on Google Cloud Platform. Building and optimising modern data architectures. Working with large-scale datasets to support analytics and business intelligence. Collaborating with analysts, engineers and business stakeholders. Helping drive engineering best practice across the team. Solving complex data challenges and delivering pragmatic solutions. Contributing to the continuous evolution of a modern cloud data platform. We're more interested in capability and attitude than ticking every box. You'll likely have: Strong hands-on experience as a Data Engineer within GCP. Experience building production-grade data pipelines and platforms. Expertise with technologies such as BigQuery, Dataflow, Cloud Composer/Airflow, Pub/Sub and Cloud Storage. Strong SQL and data engineering fundamentals. An engineering mindset and a passion for solving problems. Confidence working independently while remaining highly collaborative. Strong communication skills and the ability to build relationships with stakeholders. If you're a GCP Senior Data Engineer looking for a role where you can make a genuine impact, influence the future of a growing data platform and work with great people, we'd love to hear from you.

Senior Data Engineer Salary: 80,000 - 95,000 Location: London Hybrid/Remote Data Idols are working with a leading technology organisation that is continuing to invest in its data engineering capabilities. They are looking for an experienced Senior Data Engineer to join their team, helping to develop and scale the data infrastructure that supports business growth. This is an exciting opportunity to work with a modern cloud-based data stack, taking ownership of complex data integrations and building reliable data foundations that support analytics, operational decision-making and AI-driven products. The Opportunity As a Senior Data Engineer, you'll play a key role in designing, building and maintaining the data pipelines and integration architecture connecting commercial systems with a central cloud data warehouse. You'll work across a range of data systems and technologies, ensuring data flows reliably and efficiently throughout the organisation. You'll take ownership of developing scalable data solutions, improving data quality and ensuring the underlying infrastructure supports evolving business needs. Working closely with technical teams and business stakeholders, you'll help optimise data processes, simplify complex architectures and ensure the business can make the most of its data. Skills and Experience Strong commercial experience as a Data Engineer, building and maintaining production-grade data pipelines Extensive hands-on experience with Python and SQL Strong experience with GCP and BigQuery Experience with HubSpot Practical experience with reverse ETL and moving data between warehouses and operational systems Strong understanding of APIs Familiarity with modern data engineering tools such as dbt, Airflow, Fivetran or Census Excellent stakeholder management skills If you're an experienced Senior Data Engineer who enjoys solving complex integration challenges, working with modern cloud technologies and building data platforms that make a genuine business impact, we'd love to hear from you. Senior Data Engineer

Senior Data Engineer SQL / Python / AWS Adria Solutions is recruiting a Senior Data Engineer for a growing business developing a new digital services platform. With established backing, the business is building its data capability from the ground up. As its first dedicated data engineer, you ll have significant input into the architecture, technology choices and standards that underpin reporting, analytics and future AI capabilities. The role Reporting to the CTO, you ll turn platform, transaction and third-party data into trusted datasets for operational insight, financial reporting and product development. This is a hands-on opportunity to own the data platform, build reliable pipelines and establish the foundations for a secure, scalable data environment. Key responsibilities Develop and maintain batch and streaming pipelines across multiple data sources. Build the warehouse or lakehouse architecture and data models supporting reporting and analytics. Establish checks and processes for data accuracy, traceability and governance. Deliver reliable datasets for financial and regulatory reporting. Collaborate with engineers and business stakeholders to make data accessible and useful. Implement appropriate access controls, security and privacy practices to support GDPR and FCA requirements. Prepare the platform for future analytics, AI and machine learning applications. Evaluate tooling and contribute to decisions on the wider data architecture. What we re looking for Commercial experience delivering and supporting production data pipelines and warehouses. Strong SQL skills and proficiency in Python or another relevant programming language. Experience with modern data engineering tools, such as dbt, Airflow or Spark. Experience with cloud data warehouses, such as Snowflake, BigQuery or Amazon Redshift. A solid understanding of data modelling, ETL/ELT and data quality. Knowledge of data governance, security and privacy. Confidence taking ownership and making practical technical decisions in an early-stage environment. Desirable experience Working with banking, payments, financial or regulatory datasets. Streaming technologies such as Kafka and real-time data processing. Building datasets and processes for regulatory reporting. Supporting analytics or machine learning use cases. Experience working within a regulated industry. The package The role offers a £50,000 £75,000 salary, alongside a generous annual leave allowance with bank holidays in addition, a pension scheme and hybrid working in Manchester. You ll also benefit from ongoing learning support, opportunities for career progression and the freedom to shape a new data platform as the business grows. Applicants should have at least two years production experience building data pipelines and warehouses, and the right to work in the UK without requiring visa sponsorship. To find out more, apply with your CV or contact Adria Solutions for a confidential discussion. Senior Data Engineer SQL / Python / AWS

Contract - Senior Data Engineer (Snowflake Cortex) Rate: (Apply online only) per day, Outside IR35 Location: London (2 days per week, on-site) Start Date: Monday 9th November 2026 Length: 6 months initially, with a chance of extension. Interview Stages: 1-stage over Teams, with joint company owners (CEO and CTO) Opus have partnered with a rapidly growing HealthTech start-up who's recently received funding. They're on a mission to build a next-gen data platform for processing millions of confidential patient records and clinical documents securely, and at scale. The successful Data Engineer will play a pivotal part in helping to design and deliver AI-enabled document processing pipelines using Snowflake Cortex, helping to extract valuable insights from unstructured healthcare data including patient records, referral letters, clinical notes, PDFs and compliance documentation. The role: - Design and build scalable data pipelines in Snowflake (Snowpipes) - Design and develop cloud-native data platforms on AWS and Snowflake - Build resilient document ingestion pipelines for healthcare data - Develop ETL frameworks to transform raw clinical data into analytics ready datasets - Build secure and compliant solutions that align with GDPR and healthcare data governance standards Stack: Snowflake Snowflake Cortex AWS - S3, Glue, Lambda, Step Functions Python SQL dbt Airflow Terraform Docker GitHub CI/CD Requirements Must have advanced SQL and Python + experience delivering modern cloud-based data platforms Must have enterprise level snowflake experience Strong AWS data engineering experience (Glue preferred) Nice to have: Relevant HealthTech / MedTech experience Snowflake Cortex experience Snowpro / AWS Certifications Experience handling sensitive data / Knowledge of GDPR, NHS DSPT or healthcare compliance frameworks Reach out to Adam Akhtar at Opus Recruitment for futher information.

Working alongside specialist engineering, research and technical teams, you will design and develop data solutions that support analysis, testing and informed decision-making, which will be critical to secure, national securtiy infrastructures. This role offers the opportunity to work with large and complex datasets, develop scalable data pipelines and contribute to projects supporting critical technologies and infrastructure. Key Responsibilities Design, develop and maintain end-to-end data pipelines to support the processing and analysis of complex datasets. Transform and manage data to produce meaningful insights that support technical investigations and decision-making. Develop and maintain analytical tools, data products and visualisations. Create dashboards and reports to communicate findings and support project requirements. Work collaboratively with multidisciplinary teams, including software engineers, researchers and technical specialists. Identify opportunities to improve data processes through automation and more efficient ways of working. About You Proven experience in data engineering or a closely related technical discipline. Experience designing, building and maintaining scalable data pipelines. Strong programming and scripting skills, ideally within a Linux-based environment. Experience working with large, complex datasets and developing solutions to support data analysis. Strong problem-solving skills, with the ability to identify patterns, investigate issues and develop effective technical solutions. A collaborative approach and the ability to communicate effectively with technical stakeholders. Please note candidates will need to be Sole British nationals elligable for Security Clearance. Benefits: 3 x life assurance, Hybrid working, Private medical, memeberships and discounts across leisure, wellness and retail memberships

An exciting opportunity has arisen for a Senior Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources, and delivering reliable datasets that support analytics, reporting, and operational decision-making across the organisation. Working alongside data engineers, BI specialists, and business stakeholders, you'll play a key role in the ongoing evolution of the company's Azure-based data estate. Key Responsibilities Build and maintain ETL/ELT data pipelines Integrate data from multiple systems and external providers Develop scalable and reliable data models Improve monitoring, testing, and platform performance Support data quality and governance initiatives Collaborate with BI teams to deliver trusted reporting datasets Contribute to platform improvements and architectural decisions Maintain documentation and data lineage records Essential Skills Strong SQL development skills Experience with Python or a similar programming language Data engineering or data integration experience Understanding of data modelling and ETL/ELT concepts Experience implementing data validation and testing processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience

You must have Active SC Clearance Role Overview Develop and construct data products and services, integrating them into systems and business processes. Lead the design and implementation of data flows connecting operational systems, analytics and business intelligence (BI) systems, alongside the delivery of data streaming systems and database management activities. Senior Data Engineer You must have Active SC Clearance 750 per day (Inside IR35) 6 month contract initially 100% Remote Key Responsibilities Develop data products and services and integrate them into systems and business processes. Design and lead the implementation of data flows connecting operational systems, analytics and BI systems. Identify opportunities to reuse existing data flows. Lead the build of data streaming systems and optimise code to ensure processes perform effectively. Lead database management activities. Design, build and test complex or large-scale data products. Build teams to deliver data integration services. Select and implement appropriate technologies to deliver resilient, scalable and future-proofed data solutions. Design appropriate metadata repositories and present changes to existing repositories. Respond to problems affecting databases, data processes, data products and services; initiate action, monitor services and identify trends to resolve issues. Determine appropriate remedies and support their implementation, including preventative measures. Use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations. Collaborate with others to review specifications where appropriate. Communicate between technical and non-technical stakeholders and facilitate discussions within a multidisciplinary team. Required Skills and Capabilities Ability to communicate clearly with technical and non-technical stakeholders and facilitate multidisciplinary discussions. Capability to design, build and test complex or large-scale data products and deliver data integration services. Ability to lead data flow implementation, data streaming development and database management work. Ability to build teams to deliver data integration services. Sound judgement in selecting technologies for resilient, scalable and future-proofed data solutions. Capability in metadata repository design and communicating proposed repository changes. Problem-solving skills across databases, data processes, products and services, including service monitoring, trend identification and preventative action. Ability to develop, test, correct and document moderate-to-complex programs and scripts using agreed standards, tools and specifications. Collaborative approach to reviewing specifications and refining solutions through subsequent iterations.

Senior Data Engineer This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity to design, build and maintain modern data platforms that help organisations unlock the value of their data and make better-informed decisions. Working alongside talented engineers, architects, analysts and client stakeholders, you'll contribute to solutions that support critical services across government, defence and highly regulated industries. Whether your experience has been gained through data engineering, software development, cloud platforms or a combination of technical disciplines, you'll be supported to develop your skills while working on meaningful projects that make a real difference. If you're passionate about solving problems, collaborating with others and using data to create positive outcomes, we'd love to hear from you. Day to Day Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns Develop and support data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance tuning and optimisation of data pipelines, SQL workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets that support delivery teams Collaborate with data architects, analysts, software engineers and client stakeholders to deliver high-quality solutions Support DevOps ways of working through source control, automated testing and CI/CD practices Communicate progress, risks and technical decisions effectively with both technical and non-technical stakeholders What's In It For You Work on impactful data engineering projects that support important services and organisations across the UK Build and enhance modern cloud-based data platforms using AWS and Azure technologies Gain hands-on experience with a wide range of data engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable value and meaningful outcomes for clients Progress through clear technical and leadership development pathways as your experience grows Benefits A global network of expertise and opportunity A culture founded on safety, integrity, inclusion and belonging Flexible working arrangements that support your well-being and potential Investment in your development, including certifications, learning time and access to mentors Opportunities to contribute to communities of practice and internal technical initiatives Exposure to diverse projects across multiple industries and sectors Competitive benefits package including pension, holiday allowance and additional perks An inclusive environment where diverse perspectives, backgrounds and experiences are valued and encouraged We welcome applications from candidates with varied backgrounds and experiences. If you don't meet every requirement listed but believe you can bring value to the role, we encourage you to apply. AWS Glue, Lambda, Step Functions or Azure Data Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Experience being most Senior of Lead within a project Current active SC or eligibility for SC Clearance Hybrid working pattern (2-3 days/week) office/client site Manchester base Manchester Greater Manchester United Kingdom Digital and Data National Security & Defense Joining Jacobs not only connects you locally but globally. Our values stand on a foundation of safety, integrity, inclusion and belonging. We put people at the heart of our business, and we truly believe that by supporting one another through our culture of caring, we all succeed. We value positive mental health and a sense of belonging for all employees. With safety and flexibility always top of mind, we've gone beyond traditional ways of working so you have the support, means and space to maximize your potential. You'll uncover flexible working arrangements, benefits, and opportunities, from well-being benefits to our global giving and volunteering program, to exploring new and inventive ways to help our clients make the world a better place. No matter what drives you, you'll discover how you can cultivate, nurture, and achieve your goals - all at a single global company. Find out more about life at Jacobs . We aim to embed inclusion and belonging in everything we do. We know that if we are inclusive, we're more connected and creative. We accept people for who they are, and we champion the richness of different perspectives, lived experiences and backgrounds in the workplace, as a source of learning and innovation. We are committed to building vibrant communities within Jacobs, including through our Jacobs Employee Networks, Communities of Practice and our Find Your Community initiatives, allowing every employee to find connection, purpose, and belonging. Find out more about our Jacobs Employee Networks here . Jacobs partners with VERCIDA to help us attract and retain talent from a wide range of backgrounds. For greater online accessibility please visit to view and access our roles. As a disability confident employer, we will interview all disabled applicants who meet the minimum criteria for a vacancy. We welcome applications from candidates who are seeking flexible working and from those who may not meet all the listed requirements for a role. We value collaboration and believe that in-person interactions are crucial for both our culture and client delivery. We empower employees with our hybrid working policy, allowing them to split their work week between Jacobs offices/projects and remote locations enabling them to deliver their best work. Your application experience is important to us, and we're keen to adapt to make every interaction even better. If you require further support or reasonable adjustments with regards to the recruitment process (for example, you require the application form in a different format), please contact the team via Careers Support .

Senior Director - BMS, Data Centre, Controls Engineering, Automation, Cybersecurity, Full-time £200k+ We are seeking a Senior Director to lead controls and automation across our growing EMEA data centre portfolio. You will be shaping the engineering standards, developing scalable building management system (BMS) architectures, and providing technical leadership from initial concept through commissioning and handover. This is a senior, strategic role for an experienced controls leader with hands-on expertise in BMS, PLCs and cybersecurity, and a strong record of delivering hyperscale data centre projects. You'll lead a regional specialist team across multiple countries, working closely with engineering, operations, commercial and global stakeholders. What you'll do Serve as the EMEA technical authority for BMS, controls and automation. Develop a standardised, scalable EMEA BMS product, including specifications and engineering standards. Define repeatable system architectures, sequences of operation, hardware and software standards, networks, graphics and interfaces. Provide end-to-end technical oversight across multiple projects, from concept through commissioning and handover. Lead, develop and coordinate a regional team of specialists, partners and suppliers. Build strong relationships with engineering, operations, commercial and global teams. Identify and communicate technical risks to senior leaders. What you'll bring Extensive experience in controls engineering and BMS implementation. A track record of leading delivery across hyperscale data centre projects. The ability to define technical standards, control philosophies and repeatable solutions. Strong knowledge of networks, cybersecurity, and relevant IEC and ASHRAE standards. Experience leading and developing teams across multiple countries. Hands-on knowledge of PLCs, industrial automation, programming, systems integration and commissioning. Key skills Controls engineering BMS Industrial automation PLCs and programming Systems integration Commissioning Hyperscale data centres Technical standards Cybersecurity Team leadership Minorities, women, LGBTQ+ candidates, and individuals with disabilities are encouraged to apply. Interviews will take place shortly, so please apply immediately or call Bangura Solutions to discuss this opportunity further.

Ready to get hands-on at the heart of a mission-critical infrastructure environment? We're looking for a proactive and enthusiastic Data Centre IMAC Engineer to join our team near Salisbury. This is a fantastic opportunity for someone who enjoys variety, technical challenges, and working in a highly secure enterprise hosting environment where no two days are the same. Working alongside experienced Data Centre professionals, you'll play a key role in keeping critical infrastructure operational, secure, and ready to support demanding business and customer requirements. You do need to be eligible for SC and DV Clearance for this role. Office based Salisbury. What you'll be doing: Installing, moving, adding and changing (IMAC) enterprise infrastructure. Racking, cabling, deploying and monitoring server and hardware environments. Supporting the maintenance and operation of physical compute platforms and associated systems. Working closely with Project teams to deliver new capabilities and infrastructure changes. Collaborating with Service Operations and BAU teams to resolve incidents and maintain service availability. Managing assets and configuration records across approved systems. Supporting Change Management and Configuration Management processes. Assisting with Data Centre operations across additional sites. Participating in an on-call rota and supporting out-of-hours maintenance, change activity and break-fix work. What you'll bring: Experience working within a Data Centre or IT infrastructure environment. Knowledge of server installation, racking, stacking, and decommissioning. Experience installing and managing structured copper and fibre optic cabling. Understanding of network infrastructure including switches, routers, patch panels and network connectivity. Ability to perform hardware installations, relocations and equipment upgrades. Experience following Change Management and Configuration Management processes. Knowledge of ITIL principles and incident, problem and request management. Experience using IT Service Management (ITSM) tools such as ServiceNow or Remedy. Ability to diagnose and resolve hardware and connectivity issues. Understanding of power distribution, UPS systems, cooling and environmental monitoring within a Data Centre. Employment Type: Permanent Location: Office based Salisbury. Security Clearance Level: Eligible for SC and DV Clearance. Internal Recruiter: Jane Salary: Up to£50K Benefits: 25 days annual leave with the choice to buy additional holiday days, health cash plan, life assurance, and pension. Loved reading about this job and want to know more about us? Sopra Steria's Aerospace, Defence and Security business designs, develops and deploys digital solutions to Central Government clients. The work we do makes a real difference to the client's goal of National Security, and we operate in a unique and privileged environment. We are given time for professional development activities, and we coach and mentor our colleagues, sharing knowledge and learning from each other. We foster a culture in which employees feel valued and supported and have pride in their work for the customer, delivering outstanding rates of customer satisfaction in the UK's most complex safety- and security-critical markets. We embrace difference as a source of creativity, innovation and competitive advantage and are striving to become a more diverse organisation. We welcome applications from people with a diverse variety of backgrounds and identities. We are committed to equality of opportunity for all and do not discriminate on the basis of race, religion, colour, gender, age, disability, sexual orientation or marital status. We havepartnered with Vercida , the UK's largest diversity and inclusion focused careers site, where all our vacancies are available in an accessible format. If you require any adjustments to the recruitment process, to enable you to perform to the best of your ability, please let us knowwhen completingyour application. We participate in the Disability Confident scheme and are committed to offering an interview to any candidate with a disability, who meets the minimum criteria for the role. If you believe this could apply to you, please let us know when completing your application.

Job Title: Senior Data Platform Engineer - Compliance Assurance Contract: 12 Months Location: Chester -3 days per week onsite Rate: Highly Competitive Status: Inside IR35 Working pattern: Fulltime About the role We are looking for a hands-on Senior Data Platform Engineer to design, build and maintain scalable data platforms that support Compliance Assurance within a regulated enterprise environment. You will take ownership of the end-to-end data engineering lifecycle, from integrating source systems and ingesting data through to streaming, processing, storage and automated compliance controls. You will develop reliable, production-grade solutions that identify missing records, data mismatches, configuration issues and other exceptions, ensuring data quality, traceability and auditability. This is a developer-led engineering role, ideal for someone who combines strong data engineering skills with software development expertise and a focus on production reliability. Essential skills and experience Strong hands-on experience developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs, including authentication, pagination, rate limiting and error handling. Understanding of data reconciliation, data quality validation, exception handling and audit evidence. Experience using Git, automated testing, CI/CD and controlled software release processes. Ability to troubleshoot distributed data pipelines and support production systems.Strong analytical, problem-solving and communication skills. Desirable experience Experience in financial services or another regulated enterprise environment. Exposure to voice, recording or collaboration platforms such as Microsoft Teams, Cisco, Zoom or NICE. Experience with Microsoft Azure, Microsoft Graph, Entra ID or service principals. Familiarity with monitoring and visualization tools such as Grafana, Splunk, Tableau or Power BI. Experience using GitHub Copilot or other AI-assisted software development tools. Exposure to agentic AI, workflow orchestration or retrieval-augmented generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls to identify missing, duplicate or inconsistent records. Implement robust data flows with retry mechanisms, error handling, replay, recovery and monitoring. Establish canonical data models, data lineage, validation rules and reliable data structures. Develop automated tests to validate data accuracy, completeness, performance and processing reliability. Use Git, code reviews and CI/CD pipelines to manage code changes and promote solutions through Development, UAT and Production. Troubleshoot production issues, improve pipeline performance and establish operational monitoring and support procedures. Collaborate with architects, platform engineers, control owners, risk teams and vendors to deliver reusable engineering solutions. Explore AI-assisted development tools such as GitHub Copilot while maintaining appropriate security, quality and governance standards. What we are looking for We are seeking an engineer who enjoys solving complex technical problems and taking ownership of solutions from design through to production. You should be comfortable writing code, working with distributed data technologies, investigating data inconsistencies and building reliable systems that meet enterprise compliance requirements. You will bring a practical engineering mindset, attention to detail and a commitment to delivering secure, scalable, testable and maintainable solutions. Why join this role? Work on strategic enterprise data platform engineering. Build reusable ingestion, streaming and processing capabilities. Develop automated controls that support compliance, data integrity and auditability. Work across modern data engineering and software delivery technologies. Contribute to a platform designed to support future integrations and evolving business requirements. Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

Job Title: Senior Data Analyst/ Data Engineer Location: Manchester (2 days in Office Contract: 6 Months (Extension Likely) Payrate: 50 - 66 Per Hour About the Role We are partnering with a leading global digital platform in the travel and mobility space, looking for a Data Analyst to join their Customer & Product Analytics team. This role sits within a fast-growing business unit focused on enhancing end-to-end travel experiences, including areas such as ride-hailing, rail, and airport transfers. You will play a key role in using data to improve customer journeys and influence product decisions at scale. What You'll Be Doing Analyse large and complex datasets to generate actionable insights Design and deliver scalable reporting, dashboards, and data solutions Partner with cross-functional teams including Product, Engineering, and Business stakeholders Conduct A/B testing and experimentation to evaluate product and feature performance Build and maintain high-quality datasets for advanced analytics Translate technical findings into clear, business-focused insights Support and mentor junior analysts within the team What We're Looking For Experimentation Expertise: Strong, demonstrable experience running A/B testing and causal inference in a product-focused environment. Core Technical Stack: Proficiency with SQL , Python / PySpark , and Snowflake . Experience with data visualisation tools (e.g. Tableau, Power BI) Hands-on experience with A/B testing and experimentation Experience with Snowflake Strong stakeholder management and communication skills Ability to work independently and manage multiple priorities Nice to Have Experience in product-led, e-commerce, or customer-centric environments This is an urgent role where Hiring Manager is looking to shortlist for an interview urgently. If you are interested then please apply with a copy of your CV or send your CV to khushboo .co .uk Randstad Technologies is acting as an Employment Business in relation to this vacancy.