Senior Data Engineer

We are seeking a motivated and enthusiastic Senior Data Engineer to join the TED team at the National Institute of Teaching (NIoT). You will build and maintain the technical infrastructure that supports NIoT and TED.

Apply By: 31 July 2026 Location: Within commuting distance of one of our campuses Salary: £56,667 per annum, with London weighting if applicable.

The National Institute of Teaching (NIoT) is committed to high-quality, evidence-informed teacher education and aims to improve teacher and leader development across the education system.

Our Teacher Education Dataset (TED) is a data and research initiative focused on building better evidence about teacher development and what makes teaching impactful. By combining education, research, and digital infrastructure, TED supports new insights into how teachers develop, improve and thrive across their careers.

You will build and maintain Azure-based data pipelines and databases that support the ingestion, transformation and curation of TED datasets. You will contribute to a Common Data Model and ensure secure, reliable and scalable systems for analysis and decision-making.

• Ensure duties reflect the mission and values of the NIoT.
• Adhere to all policies, procedures, working practices and regulations, including Equal Opportunities, Health and Safety, Confidentiality, Data Protection and Financial Regulations, reporting any concerns.
• Comply with all reasonable management requests.

• Design, build and maintain Azure-based data pipelines for TED data.
• Develop and maintain Azure SQL databases and research-facing schemas across raw, transformed and curated data layers.
• Write efficient, secure and well-structured T SQL for ingestion, validation, transformation and optimisation.
• Contribute to the development and refinement of a Common Data Model across multiple education data providers.
• Integrate and harmonise data from school MIS and EdTech platforms, including Bromcom, Arbor and Wonde.
• Build and maintain robust validation, logging, auditing and reconciliation processes to improve data quality and trust.
• Support secure data handling, including pseudonymisation, access control and compliance with data sharing agreements.
• Collaborate with analysts, researchers, architects and partners to deliver scalable, analytics ready data solutions.
• Contribute to agile planning, technical design, documentation and operational handover.
• Strong experience with Azure Data Factory and Azure SQL Server.
• Strong T SQL skills, including schema design, stored procedures and query optimisation.
• Experience implementing validation, monitoring, logging and reconciliation controls within data pipelines.
• Strong understanding of secure data architecture and handling of sensitive personal data.
• Experience with Azure DevOps, version control and CI/CD practices.
• Strong analytical and problem solving skills, with excellent attention to detail.
• Effective communication and ability to work successfully in a multidisciplinary team.
• Experience with education datasets, school MIS systems or EdTech platforms.
• Experience with common data models, longitudinal datasets or research-oriented data infrastructure.
• Experience with Power BI, Fabric or related analytics technologies.
• Experience in a public sector, education or high governance data environment.
• Interest in applying data engineering to improve education and teacher development.

Contract: Permanent, Full Time

Salary: £56,667 per annum (+ London weighting if applicable) + benefits

• Generous Annual Leave - 27 days' holiday a year (plus 8 bank holidays)
• Flexible Working - flexible start and end times, with hybrid working for all roles.
• Pension - Entry to the Local Government Pension Scheme.
• Salary Sacrifice Schemes - options for bikes, cars and tech.
• Lifestyle Benefits - discounts on gyms, cinema, retail and more.
• Parenthood Leave - above statutory minimum for maternity, adoption and paternity leave.
• Working Environment - supportive, rewarding environment with a dedicated team.
• Support - Employee Assistance Programme (EAP) provides confidential support.
• Development - we fully support continuous professional development.

To ensure a fair and robust selection process, we expect all application responses to be based on your own original thoughts, skills and experience. Our system detects AI-generated content; responses that do not appear to be the candidate's own work may be disregarded.

• This role requires a satisfactory enhanced disclosure from the Disclosure and Barring Service (DBS) with a Children's Barred List Check and an Occupational Health Check is required as a condition of employment.
• This document is an overview of the role.
• The responsibilities listed may be expanded over time; duties may change.
• We reserve the right to close this vacancy early if we receive a high volume of applications.

Closing Date: 4.00pm Friday 31 July 2026