Data Architect 6-Month contract - Inside IR35 - up to 700 per day London based - hybrid working - 2/3 days onsite Candidates must hold current and active SC Clearance We are seeking a Data Architect to lead the design and delivery of secure, cloud-based data platforms for the client. The role combines architectural strategy with delivery oversight - shaping target-state architectures while ensuring they are implemented pragmatically within regulated, security-conscious environments. This position will suit an architect who can move comfortably between traditional enterprise data approaches and modern patterns such as lakehouse, streaming, data mesh and ML-enabled platforms - and who values clarity, governance and technical rigour. Candidates must hold active SC clearance . What experience you'll bring: Leadership: Recent experience as a Lead Data Architect / Data Solutions Architect or equivalent senior role. Ability to build relationships and operate at a senior stakeholder level with clients. Demonstrated ownership of end-to-end data platform design and delivery. Experience operating in consulting, systems integration, or delivery partner roles. Experience working within the Government sector strongly preferred. Modern and Enterprise Data Architecture: You should have practical architecture experience across both established enterprise approaches and modern data patterns, including: Azure data systems (must have). Oracle / AWS experience is ideal. Knowledge of Databricks and Snowflake is ideal. Experience of large-scale data migration programmes. Data lake and lakehouse architectures. Event-driven and streaming architectures. Data Mesh and/or Data Fabric principles (applied pragmatically, not theoretically). Data product-oriented design approaches. You understand where traditional patterns remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/CD for data platforms. Understanding of how ML/AI workloads integrate into data architectures. Hands-on coding ability (e.g. Python, Java, R) is beneficial but not required. Governance, Security and Data Management Experience leading a discovery phase for a data transformation programme. Experience designing within structured architectural governance frameworks. Familiarity with government assurance processes and design authorities. Strong understanding of data governance frameworks and metadata management. Experience designing for GDPR and UK public sector data protection requirements. Appreciation of infrastructure considerations and security boundaries in regulated cloud environments. Stakeholder Engagement Ability to influence architectural direction at senior stakeholder level. Clear and structured communicator - able to explain trade-offs and risks. Experience leading and mentoring architects and engineers. Comfortable operating within programme governance structures. Familiarity with Agile delivery models (SAFe, Scrum, Kanban). Disclaimer: This vacancy is being advertised by either Advanced Resource Managers Limited, Advanced Resource Managers IT Limited or Advanced Resource Managers Engineering Limited ("ARM"). ARM is a specialist talent acquisition and management consultancy. We provide technical contingency recruitment and a portfolio of more complex resource solutions. Our specialist recruitment divisions cover the entire technical arena, including some of the most economically and strategically important industries in the UK and the world today. We will never send your CV without your permission. Where the role is marked as Outside IR35 in the advertisement this is subject to receipt of a final Status Determination Statement from the end Client and may be subject to change.
09/06/2026
Contractor
Data Architect 6-Month contract - Inside IR35 - up to 700 per day London based - hybrid working - 2/3 days onsite Candidates must hold current and active SC Clearance We are seeking a Data Architect to lead the design and delivery of secure, cloud-based data platforms for the client. The role combines architectural strategy with delivery oversight - shaping target-state architectures while ensuring they are implemented pragmatically within regulated, security-conscious environments. This position will suit an architect who can move comfortably between traditional enterprise data approaches and modern patterns such as lakehouse, streaming, data mesh and ML-enabled platforms - and who values clarity, governance and technical rigour. Candidates must hold active SC clearance . What experience you'll bring: Leadership: Recent experience as a Lead Data Architect / Data Solutions Architect or equivalent senior role. Ability to build relationships and operate at a senior stakeholder level with clients. Demonstrated ownership of end-to-end data platform design and delivery. Experience operating in consulting, systems integration, or delivery partner roles. Experience working within the Government sector strongly preferred. Modern and Enterprise Data Architecture: You should have practical architecture experience across both established enterprise approaches and modern data patterns, including: Azure data systems (must have). Oracle / AWS experience is ideal. Knowledge of Databricks and Snowflake is ideal. Experience of large-scale data migration programmes. Data lake and lakehouse architectures. Event-driven and streaming architectures. Data Mesh and/or Data Fabric principles (applied pragmatically, not theoretically). Data product-oriented design approaches. You understand where traditional patterns remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/CD for data platforms. Understanding of how ML/AI workloads integrate into data architectures. Hands-on coding ability (e.g. Python, Java, R) is beneficial but not required. Governance, Security and Data Management Experience leading a discovery phase for a data transformation programme. Experience designing within structured architectural governance frameworks. Familiarity with government assurance processes and design authorities. Strong understanding of data governance frameworks and metadata management. Experience designing for GDPR and UK public sector data protection requirements. Appreciation of infrastructure considerations and security boundaries in regulated cloud environments. Stakeholder Engagement Ability to influence architectural direction at senior stakeholder level. Clear and structured communicator - able to explain trade-offs and risks. Experience leading and mentoring architects and engineers. Comfortable operating within programme governance structures. Familiarity with Agile delivery models (SAFe, Scrum, Kanban). Disclaimer: This vacancy is being advertised by either Advanced Resource Managers Limited, Advanced Resource Managers IT Limited or Advanced Resource Managers Engineering Limited ("ARM"). ARM is a specialist talent acquisition and management consultancy. We provide technical contingency recruitment and a portfolio of more complex resource solutions. Our specialist recruitment divisions cover the entire technical arena, including some of the most economically and strategically important industries in the UK and the world today. We will never send your CV without your permission. Where the role is marked as Outside IR35 in the advertisement this is subject to receipt of a final Status Determination Statement from the end Client and may be subject to change.
Data Analyst Onsite Requirements: Remote Start Date: ASAP Role Duration: 1 year Clerance Requirements: Active SC clearance Inside IR35 - umbrella only Role Description We're looking for a Data Engineer whose main focus is understanding and documenting existing systems, with the goal of supporting decommissioning activities. The role centres on analysing current solutions built using Java, Node JS, and React, and developing a clear, end to end picture of how data flows across the wider programme. This includes documenting data flows, system dependencies, and underlying data models, ensuring there is a clear record of how data is structured, stored, and used throughout the solution. The role involves investigating how systems are used on a day-to-day basis, clarifying ownership and integration points, and capturing this information in a way that supports risk assessment and decommissioning decisions. Responsibilities Python and PySpark are required as supporting capabilities, used where needed to analyse data pipelines and confirm how data moves and transforms in practice. The role also requires strong experience with testing and data quality management, ensuring that documented data flows and models are accurate and trusted. Experience working in cloud environments such as AWS or Azure is expected, with Databricks considered a nice to have. Required Skills Java background Node JS Json RDS React Data Modelling Python / Spark Cloud experience (AWS / Azure) o AWS Glue o Databricks Testing e.g. PyTest Data Quality e.g. Great Expectations
09/06/2026
Full time
Data Analyst Onsite Requirements: Remote Start Date: ASAP Role Duration: 1 year Clerance Requirements: Active SC clearance Inside IR35 - umbrella only Role Description We're looking for a Data Engineer whose main focus is understanding and documenting existing systems, with the goal of supporting decommissioning activities. The role centres on analysing current solutions built using Java, Node JS, and React, and developing a clear, end to end picture of how data flows across the wider programme. This includes documenting data flows, system dependencies, and underlying data models, ensuring there is a clear record of how data is structured, stored, and used throughout the solution. The role involves investigating how systems are used on a day-to-day basis, clarifying ownership and integration points, and capturing this information in a way that supports risk assessment and decommissioning decisions. Responsibilities Python and PySpark are required as supporting capabilities, used where needed to analyse data pipelines and confirm how data moves and transforms in practice. The role also requires strong experience with testing and data quality management, ensuring that documented data flows and models are accurate and trusted. Experience working in cloud environments such as AWS or Azure is expected, with Databricks considered a nice to have. Required Skills Java background Node JS Json RDS React Data Modelling Python / Spark Cloud experience (AWS / Azure) o AWS Glue o Databricks Testing e.g. PyTest Data Quality e.g. Great Expectations
Data Solution Architect - Databricks Location: UK Wide (Hybrid) Salary: Up to 110,000 + Bonus + Excellent Benefits Security Clearance: Must be eligible for SC Clearance The Opportunity We're recruiting for an experienced Data Solution Architect with strong Databricks expertise to join a leading technology consultancy delivering large-scale data, analytics, AI and cloud transformation programmes. This role will see you designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. You'll also play a key role in pre-sales activities, solution design, and helping to drive strategic Databricks initiatives across the business. Key Responsibilities Design and architect Databricks-based data platforms and solutions. Build scalable data lakehouse and data warehouse architectures. Design data integration, transformation and analytics solutions. Support AI and Machine Learning use cases through modern data architectures. Collaborate with architects, engineers, data scientists and business stakeholders. Lead technical workshops and contribute to solution design activities. Support pre-sales engagements, proposals and client presentations. Drive best practice across Databricks and modern data platform delivery. Skills & Experience Required 7+ years' experience in Data Architecture or Solution Architecture. Strong commercial experience with Databricks and Apache Spark . Experience delivering enterprise data platforms on AWS, Azure or GCP. Strong understanding of data warehousing, data lakes and lakehouse architectures. Experience designing secure, scalable and governed data solutions. Excellent stakeholder management and communication skills. Experience supporting pre-sales, bids or solution shaping activities is highly desirable. Nice to Have Public sector experience. Databricks certifications. Cloud certifications (AWS, Azure or GCP). Experience with AI, Machine Learning or GenAI projects. What's on Offer? Up to 110,000 base salary Performance bonus Private healthcare Pension scheme Flexible hybrid working Ongoing training and certification support Exposure to enterprise-scale cloud, data and AI projects Clear progression opportunities Security Clearance Candidates must be eligible for SC Clearance , which typically requires continuous UK residency for the past 5 years. Apply If you're an experienced Data Solution Architect with strong Databricks expertise and are looking to work on large-scale cloud and data transformation programmes, we'd love to hear from you.
09/06/2026
Full time
Data Solution Architect - Databricks Location: UK Wide (Hybrid) Salary: Up to 110,000 + Bonus + Excellent Benefits Security Clearance: Must be eligible for SC Clearance The Opportunity We're recruiting for an experienced Data Solution Architect with strong Databricks expertise to join a leading technology consultancy delivering large-scale data, analytics, AI and cloud transformation programmes. This role will see you designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. You'll also play a key role in pre-sales activities, solution design, and helping to drive strategic Databricks initiatives across the business. Key Responsibilities Design and architect Databricks-based data platforms and solutions. Build scalable data lakehouse and data warehouse architectures. Design data integration, transformation and analytics solutions. Support AI and Machine Learning use cases through modern data architectures. Collaborate with architects, engineers, data scientists and business stakeholders. Lead technical workshops and contribute to solution design activities. Support pre-sales engagements, proposals and client presentations. Drive best practice across Databricks and modern data platform delivery. Skills & Experience Required 7+ years' experience in Data Architecture or Solution Architecture. Strong commercial experience with Databricks and Apache Spark . Experience delivering enterprise data platforms on AWS, Azure or GCP. Strong understanding of data warehousing, data lakes and lakehouse architectures. Experience designing secure, scalable and governed data solutions. Excellent stakeholder management and communication skills. Experience supporting pre-sales, bids or solution shaping activities is highly desirable. Nice to Have Public sector experience. Databricks certifications. Cloud certifications (AWS, Azure or GCP). Experience with AI, Machine Learning or GenAI projects. What's on Offer? Up to 110,000 base salary Performance bonus Private healthcare Pension scheme Flexible hybrid working Ongoing training and certification support Exposure to enterprise-scale cloud, data and AI projects Clear progression opportunities Security Clearance Candidates must be eligible for SC Clearance , which typically requires continuous UK residency for the past 5 years. Apply If you're an experienced Data Solution Architect with strong Databricks expertise and are looking to work on large-scale cloud and data transformation programmes, we'd love to hear from you.
The Opportunity: We are currently seeking an experienced Data Engineer to join a high-profile data transformation programme, helping to build and enhance a modern cloud-based data platform using Azure technologies, who combines strong Azure Databricks expertise with modern data engineering practices and a passion for solving complex data challenges. This role will focus on designing and developing scalable data engineering solutions within Azure Databricks, supporting the creation of robust data pipelines and contributing to the evolution of a modern Lakehouse architecture. The successful candidate will also work extensively with geospatial datasets, making this an excellent opportunity for engineers with experience in spatial data processing and geospatial analytics. Working within a collaborative Agile delivery environment, you will partner closely with stakeholders, product owners and technical teams to deliver high-quality, scalable and maintainable data solutions that support critical business and analytical requirements. If you're an experienced Data Engineer with strong Azure Databricks expertise and experience working with geospatial data (ideally within the Public Sector), we'd love to hear from you. Skills and Experience: Strong commercial experience working as a Data Engineer within Azure cloud environments. Proven hands-on expertise with Azure Databricks in enterprise-scale production environments. Strong programming skills using: Python / SQL / PySpark / Spark SQL. Experience designing and building scalable data pipelines and data processing frameworks. Strong understanding of modern Lakehouse architecture principles. Experience working with: Unity Catalog / Databricks Workflows / Delta Live Tables / Databricks SQL. Experience integrating data from APIs and external data sources. Strong understanding of data modelling, data quality and performance optimisation techniques. Experience working within Agile software delivery environments. Geospatial Experience Candidates should have experience working with geospatial datasets and technologies, including: Shapefiles GeoParquet GeoPackage GeoTIFF Spatial data processing and transformation techniques Geospatial analytics and data engineering workflows Experience with Apache Sedona or similar geospatial processing frameworks is highly desirable. Role and Responsibilities: Collaborate with stakeholders, product owners and technical teams to understand data requirements and translate them into scalable engineering solutions. Design, develop and maintain high-performance data pipelines using Azure Databricks, PySpark, Spark SQL and Python. Contribute to the design and implementation of Lakehouse architecture using Delta Lake and Databricks best practices. Develop and manage data workflows using Databricks Workflows and Delta Live Tables. Utilise Unity Catalog to support effective governance, security and data discovery. Develop analytical and reporting datasets using Databricks SQL. Ingest, transform and process data from APIs and a variety of structured, semi-structured and geospatial data sources. Apply geospatial processing techniques to support data integration, analysis and business requirements. Write clean, maintainable and well-tested code in line with engineering best practices. Participate in Agile ceremonies, technical design discussions, code reviews and sprint planning activities. Support data quality, performance optimisation and operational monitoring across data pipelines. NB: The successful candidate will be required to undergo a basic level of security clearance before undertaking the assignment (around two weeks lead-time). Applications: To learn more about this newly created opportunity consulting as an Azure-focused Data Engineer for an initial 6 month engagement, operating on a remote-working basis; please call and speak with Edward Laing here at ISR Recruitment or please send through a copy of your latest online profile and/or CV for an immediate call back in the strictest of confidence.
09/06/2026
Contractor
The Opportunity: We are currently seeking an experienced Data Engineer to join a high-profile data transformation programme, helping to build and enhance a modern cloud-based data platform using Azure technologies, who combines strong Azure Databricks expertise with modern data engineering practices and a passion for solving complex data challenges. This role will focus on designing and developing scalable data engineering solutions within Azure Databricks, supporting the creation of robust data pipelines and contributing to the evolution of a modern Lakehouse architecture. The successful candidate will also work extensively with geospatial datasets, making this an excellent opportunity for engineers with experience in spatial data processing and geospatial analytics. Working within a collaborative Agile delivery environment, you will partner closely with stakeholders, product owners and technical teams to deliver high-quality, scalable and maintainable data solutions that support critical business and analytical requirements. If you're an experienced Data Engineer with strong Azure Databricks expertise and experience working with geospatial data (ideally within the Public Sector), we'd love to hear from you. Skills and Experience: Strong commercial experience working as a Data Engineer within Azure cloud environments. Proven hands-on expertise with Azure Databricks in enterprise-scale production environments. Strong programming skills using: Python / SQL / PySpark / Spark SQL. Experience designing and building scalable data pipelines and data processing frameworks. Strong understanding of modern Lakehouse architecture principles. Experience working with: Unity Catalog / Databricks Workflows / Delta Live Tables / Databricks SQL. Experience integrating data from APIs and external data sources. Strong understanding of data modelling, data quality and performance optimisation techniques. Experience working within Agile software delivery environments. Geospatial Experience Candidates should have experience working with geospatial datasets and technologies, including: Shapefiles GeoParquet GeoPackage GeoTIFF Spatial data processing and transformation techniques Geospatial analytics and data engineering workflows Experience with Apache Sedona or similar geospatial processing frameworks is highly desirable. Role and Responsibilities: Collaborate with stakeholders, product owners and technical teams to understand data requirements and translate them into scalable engineering solutions. Design, develop and maintain high-performance data pipelines using Azure Databricks, PySpark, Spark SQL and Python. Contribute to the design and implementation of Lakehouse architecture using Delta Lake and Databricks best practices. Develop and manage data workflows using Databricks Workflows and Delta Live Tables. Utilise Unity Catalog to support effective governance, security and data discovery. Develop analytical and reporting datasets using Databricks SQL. Ingest, transform and process data from APIs and a variety of structured, semi-structured and geospatial data sources. Apply geospatial processing techniques to support data integration, analysis and business requirements. Write clean, maintainable and well-tested code in line with engineering best practices. Participate in Agile ceremonies, technical design discussions, code reviews and sprint planning activities. Support data quality, performance optimisation and operational monitoring across data pipelines. NB: The successful candidate will be required to undergo a basic level of security clearance before undertaking the assignment (around two weeks lead-time). Applications: To learn more about this newly created opportunity consulting as an Azure-focused Data Engineer for an initial 6 month engagement, operating on a remote-working basis; please call and speak with Edward Laing here at ISR Recruitment or please send through a copy of your latest online profile and/or CV for an immediate call back in the strictest of confidence.
Senior Data Engineer Outside IR- 550 per day Hybrid London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory reporting or financial services Exposure to Tagetik or similar reporting tools Knowledge of metadata-driven or configurable data models This is an opportunity to play a key role in a large-scale data transformation programme with a strong focus on engineering best practice and regulatory delivery. Senior Data Engineer Outside IR- 550 per day Hybrid London
09/06/2026
Contractor
Senior Data Engineer Outside IR- 550 per day Hybrid London We are seeking a Senior Data Engineer / Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks -based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural and regulatory requirements. Key Requirements: Strong experience with Databricks and PySpark Solid Azure data platform experience Proven ability to build reusable frameworks and libraries Experience leading code quality and working with offshore teams Desirable: Experience in regulatory reporting or financial services Exposure to Tagetik or similar reporting tools Knowledge of metadata-driven or configurable data models This is an opportunity to play a key role in a large-scale data transformation programme with a strong focus on engineering best practice and regulatory delivery. Senior Data Engineer Outside IR- 550 per day Hybrid London
Senior Solutions Architect (Utilities/Energy) London, United Kingdom REQ ID: FEQ227R246 Location: London, UK Recruiter: Dina Hussain At Databricks, our core values are at the heart of everything we do; a culture of proactiveness and a customer centric mindset guides us to build a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user friendly and intuitive platform that makes it easy to turn insights into action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer focused team that values innovation and creativity, using your skills to create customised solutions to help our customers achieve their goals and guide their businesses forward. You will engage with our largest and most complex customers across the region to advise them on adopting the Databricks Data Intelligence Platform, in collaboration with a world class, cross functional team of Solutions Architects, Account Executives, and technology Specialists. You will work closely with a small group of customers and their account teams to help them respond to key business opportunities and challenges. Join us in our quest to change how people work with data and make a better world! The impact you will have Engage with some of Databricks' most complex customers to help them achieve their unified platform goals. Develop and execute customer engagement strategies in partnership with the Account Executives and Solutions Architects in your designated accounts. Coach core account teams and peers on positioning, adoption strategies and execution to achieve your outcomes in a defined timeline. Influence stakeholders at all levels through complex engagements with the wider cloud ecosystem and 3rd party applications, ensuring they are excited about the Databricks vision and solution strategy. Be a 'champion' for both customers and colleagues, operating as an expert solution architect and trusted advisor for significant data analytics architecture, design, and adoption of the Databricks Lakehouse platform. Contribute to Databricks' technical community engagement by developing customer facing collateral and leading workshops, seminars, and meet ups. Opportunity to continue your development in one of four tracks - technical specialisation, industry vertical thought leadership, strategic customer vision, and people management. What we look for Know how to engage in complex customer interactions and sales lifecycle in a technical pre sales capacity. Have a technical background in Data Engineering or Data Warehousing (DWH) or a Machine Learning/AI background. Work with our Utilities customers, focusing on establishing the Databricks Data Intelligence Platform as their platform of choice. Have a builder mindset, instinctively prototype, create demos, and craft tailored solutions rather than relying only on slide decks. Enjoy a high degree of autonomy and thrive in working with ambiguous requirements and challenging customer environments. Ability to influence decision makers and C level executives through developing relationships and orchestrating teams to achieve long term success for customers. Prior experience with coding in a core programming language (Python or SQL) and willingness to learn a base level of Spark. Hands on expertise with complex proofs of concept and public cloud platform(s) across AWS, Azure and Google. Know how to provide technical solutions for specialised customer needs and navigate a competitive landscape. Nice to have: Databricks Certification. Up to % travel to London offices and customer sites. About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide - including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit . Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio economic status, veteran status, and other protected characteristics. Compliance If access to export controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
09/06/2026
Full time
Senior Solutions Architect (Utilities/Energy) London, United Kingdom REQ ID: FEQ227R246 Location: London, UK Recruiter: Dina Hussain At Databricks, our core values are at the heart of everything we do; a culture of proactiveness and a customer centric mindset guides us to build a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user friendly and intuitive platform that makes it easy to turn insights into action and fosters a culture of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer focused team that values innovation and creativity, using your skills to create customised solutions to help our customers achieve their goals and guide their businesses forward. You will engage with our largest and most complex customers across the region to advise them on adopting the Databricks Data Intelligence Platform, in collaboration with a world class, cross functional team of Solutions Architects, Account Executives, and technology Specialists. You will work closely with a small group of customers and their account teams to help them respond to key business opportunities and challenges. Join us in our quest to change how people work with data and make a better world! The impact you will have Engage with some of Databricks' most complex customers to help them achieve their unified platform goals. Develop and execute customer engagement strategies in partnership with the Account Executives and Solutions Architects in your designated accounts. Coach core account teams and peers on positioning, adoption strategies and execution to achieve your outcomes in a defined timeline. Influence stakeholders at all levels through complex engagements with the wider cloud ecosystem and 3rd party applications, ensuring they are excited about the Databricks vision and solution strategy. Be a 'champion' for both customers and colleagues, operating as an expert solution architect and trusted advisor for significant data analytics architecture, design, and adoption of the Databricks Lakehouse platform. Contribute to Databricks' technical community engagement by developing customer facing collateral and leading workshops, seminars, and meet ups. Opportunity to continue your development in one of four tracks - technical specialisation, industry vertical thought leadership, strategic customer vision, and people management. What we look for Know how to engage in complex customer interactions and sales lifecycle in a technical pre sales capacity. Have a technical background in Data Engineering or Data Warehousing (DWH) or a Machine Learning/AI background. Work with our Utilities customers, focusing on establishing the Databricks Data Intelligence Platform as their platform of choice. Have a builder mindset, instinctively prototype, create demos, and craft tailored solutions rather than relying only on slide decks. Enjoy a high degree of autonomy and thrive in working with ambiguous requirements and challenging customer environments. Ability to influence decision makers and C level executives through developing relationships and orchestrating teams to achieve long term success for customers. Prior experience with coding in a core programming language (Python or SQL) and willingness to learn a base level of Spark. Hands on expertise with complex proofs of concept and public cloud platform(s) across AWS, Azure and Google. Know how to provide technical solutions for specialised customer needs and navigate a competitive landscape. Nice to have: Databricks Certification. Up to % travel to London offices and customer sites. About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide - including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit . Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio economic status, veteran status, and other protected characteristics. Compliance If access to export controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Role: Head of Data Products UK Remote Salary - upto £110K + Benefits Ideal candidates will have 5+ years in senior Product Data, Product Analytics, Analytics Engineering, or Data Leadership roles within SaaS or technology-driven businesses. The client is looking for someone to lead the transformation of product telemetry, analytics, and data-driven decision-making across a portfolio of products that empower learners through assistive technology and accessibility solutions. Define and execute the Product Data Strategy, enabling teams to understand user behaviour, feature adoption, engagement, and learner outcomes at scale. Own the end-to-end Telemetry Platform Strategy, building a scalable first-party event pipeline and product data ecosystem within a Databricks Lakehouse environment. Establish enterprise-wide standards for product instrumentation, event schemas, governance, versioning, and data quality across a multi-product portfolio. Design and deliver trusted product data products, curated datasets, and governed metrics that drive decisions across Product, Customer Success, Sales, and Leadership teams. Build unified data models that connect product usage, engagement, and outcomes across diverse platforms and acquired products. Partner closely with Product, Engineering, and Data leaders to embed measurement frameworks into product roadmaps, launches, and strategic initiatives. Shape customer-facing analytics and insights capabilities, helping customers measure adoption, engagement, and product impact. Lead evaluation and implementation of product analytics technologies while ensuring governance, scalability, and cost efficiency. Bring strong hands-on expertise in Databricks, Snowflake, BigQuery, SQL, Python, analytics engineering, telemetry architecture, and modern data platforms. Build and scale a high-performing Product Data function, driving self-service analytics, data literacy, and measurable business outcomes across the organisation.
09/06/2026
Full time
Role: Head of Data Products UK Remote Salary - upto £110K + Benefits Ideal candidates will have 5+ years in senior Product Data, Product Analytics, Analytics Engineering, or Data Leadership roles within SaaS or technology-driven businesses. The client is looking for someone to lead the transformation of product telemetry, analytics, and data-driven decision-making across a portfolio of products that empower learners through assistive technology and accessibility solutions. Define and execute the Product Data Strategy, enabling teams to understand user behaviour, feature adoption, engagement, and learner outcomes at scale. Own the end-to-end Telemetry Platform Strategy, building a scalable first-party event pipeline and product data ecosystem within a Databricks Lakehouse environment. Establish enterprise-wide standards for product instrumentation, event schemas, governance, versioning, and data quality across a multi-product portfolio. Design and deliver trusted product data products, curated datasets, and governed metrics that drive decisions across Product, Customer Success, Sales, and Leadership teams. Build unified data models that connect product usage, engagement, and outcomes across diverse platforms and acquired products. Partner closely with Product, Engineering, and Data leaders to embed measurement frameworks into product roadmaps, launches, and strategic initiatives. Shape customer-facing analytics and insights capabilities, helping customers measure adoption, engagement, and product impact. Lead evaluation and implementation of product analytics technologies while ensuring governance, scalability, and cost efficiency. Bring strong hands-on expertise in Databricks, Snowflake, BigQuery, SQL, Python, analytics engineering, telemetry architecture, and modern data platforms. Build and scale a high-performing Product Data function, driving self-service analytics, data literacy, and measurable business outcomes across the organisation.
Values are extremely important to our culture and success at FullFibre We are Customer Centric. Our customers are at the centre of everything we do. We value, serve, and support our customers with care and dedication. We are Collaborative. We prioritise effective communication, cooperation, and collaboration. We work as one team and celebrate our shared success. We are Proud. Proud of the work we do and how we do it; with integrity, pride, confidence, and respect We are Agile. We embrace change. We are innovative, forward thinking and adapt quickly to fast-moving situations and opportunities. We are continuously improving. The Senior Software Engineer will join our Systems, Development and Data team to support our ongoing development of our operations and business support systems, with a focus on our primary OSS platform (Netadmin). You ll be responsible for collaborating with our supplier to deliver enhancements, new functions, and reliability improvements for our key platform, using C#/.NET. Alongside this, you ll work with colleagues to integrate and develop microservices in Python that help automate key business processes and provide new capabilities for the business. As our Senior Software Engineer, you ll support junior engineers and help them develop into great software engineers. You ll also help ensure that we keep our quality standards high and are developing the right tools to solve the business long-term challenges, even where requirements and demands are unclear or changeable. The Systems, Development and Data team is a small but mighty function of the business, responsible for all internal and external facing systems, both third-party (SaaS) and internally delivered solutions. We build key internal tools and make business processes flow smoothly, automating where we can, and making end-user experiences great where people need to be involved. We also own business data management; we deliver complex reporting outputs and maintain our data warehouse and processing pipelines. We re a friendly and diverse team, constantly helping each other out and supporting ongoing learning and development. We re remote-first, and distributed across the UK, with occasional (quarterly-ish) social get-togethers in London, Birmingham, and Manchester. We do use AI where it makes sense in our workflows but are thoughtful when it comes to selection of tools and use of automation in our day-to-day activities. The ideal applicant will bring a similar curious-but-sceptical attitude, be happy in a fully remote async-heavy team, and be aligned with our team values of inclusivity, openness, and curiosity. Ideal Profile At least 8 years of professional experience in software engineering with C# and .NET, ASP.NET, or similar technologies, ideally in Linux environments. At least 5 years of professional experience with modern Python (3.7+, async/typed) or a strong desire to learn and familiarity with similar soft-typed interpreted languages Demonstrated experience working on live, large-scale systems, and a strong understanding of risk and change management principles. The ability to collaborate with technical and operations teams with a range of technical skill levels. Experience working with external technical suppliers and professional services teams. Excellent written communication skills, with strong asynchronous working familiarity. An inquiring attitude you don t like things you can t explain, are driven to figure stuff out if you don t know, and enjoy getting to the bottom of odd glitches and one off events. Significant experience with Linux system and process administration, container technologies (Docker, etc). Experience with git, Jira, and remote working in a fully distributed team. Degree-level qualification in Computer Science, Mathematics, Physics, or similar equivalent professional experience demonstrating your ability to work and think in an analytical manner. Desirable skills, knowledge, experience Experience with Kubernetes/Amazon EKS and GitOps/CI/CD workflows, GitLab Experience with SQL database technologies (PostgreSQL, MySQL) Experience with PySpark, Databricks, Delta Lake or other data warehousing technologies Experience with distributed systems engineering, message/event buses, and RESTful API design Understanding of telecoms operational and business support systems Your key responsibilities as our Senior Software Engineer will be Develop and support extensions and integrations to our primary OSS platform (Netadmin) in C#/.NET, working with end-users and internal customers to scope and design features and improvements to our customisations Develop and support FullFibre s ecosystem of microservices and web applications in Python to deliver new functionality and capabilities for internal teams and customer self-service Work with our DevOps engineers to ensure reliable and robust deployment of your services and code on our Kubernetes clusters and other environments Ensure that systems you develop and support are secure, and protect customer data and privacy effectively Architect, develop, and scope plans and system changes from cradle to grave Collaborate with stakeholders to build and shape roadmaps and future deliverables Support and mentor junior engineers in their development We anticipate this role will involve some occasional travel initially to our key supplier near Stockholm, Sweden for learning and development. Company Benefits Base salary of up to £90,000 depending of qualifications/experience. 25 days paid holiday plus bank holidays A day off for your birthday Pension Scheme Life assurance Private BUPA Healthcare £500 Employee Referral Scheme Enhanced family friendly policies Zzoomm Employee broadband perks inc family & friends Working with us, you will learn new skills on the job, diversify your abilities and enjoy building a new future for the UK s broadband network. FullFibre provides you with the flexibility to work in a way that will help you grow and develop. As well as having clear responsibilities, you will get extensive training to help you develop, and you will be building a legacy here as we build the Full Fibre broadband network of the future
09/06/2026
Full time
Values are extremely important to our culture and success at FullFibre We are Customer Centric. Our customers are at the centre of everything we do. We value, serve, and support our customers with care and dedication. We are Collaborative. We prioritise effective communication, cooperation, and collaboration. We work as one team and celebrate our shared success. We are Proud. Proud of the work we do and how we do it; with integrity, pride, confidence, and respect We are Agile. We embrace change. We are innovative, forward thinking and adapt quickly to fast-moving situations and opportunities. We are continuously improving. The Senior Software Engineer will join our Systems, Development and Data team to support our ongoing development of our operations and business support systems, with a focus on our primary OSS platform (Netadmin). You ll be responsible for collaborating with our supplier to deliver enhancements, new functions, and reliability improvements for our key platform, using C#/.NET. Alongside this, you ll work with colleagues to integrate and develop microservices in Python that help automate key business processes and provide new capabilities for the business. As our Senior Software Engineer, you ll support junior engineers and help them develop into great software engineers. You ll also help ensure that we keep our quality standards high and are developing the right tools to solve the business long-term challenges, even where requirements and demands are unclear or changeable. The Systems, Development and Data team is a small but mighty function of the business, responsible for all internal and external facing systems, both third-party (SaaS) and internally delivered solutions. We build key internal tools and make business processes flow smoothly, automating where we can, and making end-user experiences great where people need to be involved. We also own business data management; we deliver complex reporting outputs and maintain our data warehouse and processing pipelines. We re a friendly and diverse team, constantly helping each other out and supporting ongoing learning and development. We re remote-first, and distributed across the UK, with occasional (quarterly-ish) social get-togethers in London, Birmingham, and Manchester. We do use AI where it makes sense in our workflows but are thoughtful when it comes to selection of tools and use of automation in our day-to-day activities. The ideal applicant will bring a similar curious-but-sceptical attitude, be happy in a fully remote async-heavy team, and be aligned with our team values of inclusivity, openness, and curiosity. Ideal Profile At least 8 years of professional experience in software engineering with C# and .NET, ASP.NET, or similar technologies, ideally in Linux environments. At least 5 years of professional experience with modern Python (3.7+, async/typed) or a strong desire to learn and familiarity with similar soft-typed interpreted languages Demonstrated experience working on live, large-scale systems, and a strong understanding of risk and change management principles. The ability to collaborate with technical and operations teams with a range of technical skill levels. Experience working with external technical suppliers and professional services teams. Excellent written communication skills, with strong asynchronous working familiarity. An inquiring attitude you don t like things you can t explain, are driven to figure stuff out if you don t know, and enjoy getting to the bottom of odd glitches and one off events. Significant experience with Linux system and process administration, container technologies (Docker, etc). Experience with git, Jira, and remote working in a fully distributed team. Degree-level qualification in Computer Science, Mathematics, Physics, or similar equivalent professional experience demonstrating your ability to work and think in an analytical manner. Desirable skills, knowledge, experience Experience with Kubernetes/Amazon EKS and GitOps/CI/CD workflows, GitLab Experience with SQL database technologies (PostgreSQL, MySQL) Experience with PySpark, Databricks, Delta Lake or other data warehousing technologies Experience with distributed systems engineering, message/event buses, and RESTful API design Understanding of telecoms operational and business support systems Your key responsibilities as our Senior Software Engineer will be Develop and support extensions and integrations to our primary OSS platform (Netadmin) in C#/.NET, working with end-users and internal customers to scope and design features and improvements to our customisations Develop and support FullFibre s ecosystem of microservices and web applications in Python to deliver new functionality and capabilities for internal teams and customer self-service Work with our DevOps engineers to ensure reliable and robust deployment of your services and code on our Kubernetes clusters and other environments Ensure that systems you develop and support are secure, and protect customer data and privacy effectively Architect, develop, and scope plans and system changes from cradle to grave Collaborate with stakeholders to build and shape roadmaps and future deliverables Support and mentor junior engineers in their development We anticipate this role will involve some occasional travel initially to our key supplier near Stockholm, Sweden for learning and development. Company Benefits Base salary of up to £90,000 depending of qualifications/experience. 25 days paid holiday plus bank holidays A day off for your birthday Pension Scheme Life assurance Private BUPA Healthcare £500 Employee Referral Scheme Enhanced family friendly policies Zzoomm Employee broadband perks inc family & friends Working with us, you will learn new skills on the job, diversify your abilities and enjoy building a new future for the UK s broadband network. FullFibre provides you with the flexibility to work in a way that will help you grow and develop. As well as having clear responsibilities, you will get extensive training to help you develop, and you will be building a legacy here as we build the Full Fibre broadband network of the future
Senior Data Engineer (Hands-On / Technical Lead Focus) Hybrid working - Central London Ashdown Group are partnering with an innovative, data-led organisation who are recruiting a Senior Data Engineer to take ownership of core data architecture and lead from the front technically. This is a hands-on senior role for someone who enjoys building robust data systems while mentoring others and raising engineering standards. The Role You will design, build, and optimise scalable data pipelines and models across Snowflake, Databricks, and cloud environments (AWS/GCP). Working closely with Data Science, Product, and Analytics teams, you'll ensure reliable, high-performance data flows that power AI and analytics products. Alongside deep technical delivery, you'll be responsible for leading the junior engineers and near shore partners as well as contribute to architectural direction and best practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management of technical teams and near shore partners 5+ years' hands-on Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading and mentoring a small team and near shore technical services providers. There is a lot of transformation work and this will be a technically influential position with a chance to work on AI-driven, high-impact products. Additionally you will have the opportunity to mentor and help scale engineering capability If you're a technically strong Senior Data Engineer who enjoys leading through expertise and building scalable, production-grade data systems, we'd love to hear from you This is a hybrid based role - 3 days in London office and 2 days working remotely. Salary up to £90,000 and generous benefits
09/06/2026
Full time
Senior Data Engineer (Hands-On / Technical Lead Focus) Hybrid working - Central London Ashdown Group are partnering with an innovative, data-led organisation who are recruiting a Senior Data Engineer to take ownership of core data architecture and lead from the front technically. This is a hands-on senior role for someone who enjoys building robust data systems while mentoring others and raising engineering standards. The Role You will design, build, and optimise scalable data pipelines and models across Snowflake, Databricks, and cloud environments (AWS/GCP). Working closely with Data Science, Product, and Analytics teams, you'll ensure reliable, high-performance data flows that power AI and analytics products. Alongside deep technical delivery, you'll be responsible for leading the junior engineers and near shore partners as well as contribute to architectural direction and best practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management of technical teams and near shore partners 5+ years' hands-on Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading and mentoring a small team and near shore technical services providers. There is a lot of transformation work and this will be a technically influential position with a chance to work on AI-driven, high-impact products. Additionally you will have the opportunity to mentor and help scale engineering capability If you're a technically strong Senior Data Engineer who enjoys leading through expertise and building scalable, production-grade data systems, we'd love to hear from you This is a hybrid based role - 3 days in London office and 2 days working remotely. Salary up to £90,000 and generous benefits
A leading data-led organisation in Greater London is looking for a Senior Data Engineer to design and build scalable data pipelines and lead a small technical team. The ideal candidate will have over 5 years of hands-on experience and possess strong skills in SQL, Python, Snowflake, and Databricks. This hybrid role requires working three days in the office and two days remotely, with a salary up to £90,000 and generous benefits on offer.
09/06/2026
Full time
A leading data-led organisation in Greater London is looking for a Senior Data Engineer to design and build scalable data pipelines and lead a small technical team. The ideal candidate will have over 5 years of hands-on experience and possess strong skills in SQL, Python, Snowflake, and Databricks. This hybrid role requires working three days in the office and two days remotely, with a salary up to £90,000 and generous benefits on offer.
Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via About the client Due to continued growth, we're seeking a skilled Data Engineer to join an established organisation at the forefront of building modern, data-driven platforms. The business is investing heavily in its data ecosystem and is focused on delivering real-time insights and trusted analytics that support teams across product, finance, marketing, and compliance. This is an excellent opportunity to work with modern cloud data technologies and play a key role in shaping a scalable, secure, and high-performance data platform. What will you be doing? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed data that supports analytics, reporting, and operational decision making. You'll also play a key role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability, and cost optimisation will also form part of your responsibilities as you contribute to the ongoing development of the organisation's data ecosystem. Our benefits Competitive basic salary Discretionary bonus scheme Company shares option plan Contributory pension scheme Life insurance (4x basic salary) Health cash plan Generous holiday allowance including bank holidays Study support and clear progression opportunities Employee assistance programme available 24/7 Collaborative office environment with regular social and charity events And Much More Data Engineer - Essential Skills Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands on experience with Kafka (MSK) and real time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Solid AWS experience including services such as S3, Glue, Lambda, Batch, and IAM Proficiency in Python and SQL for data engineering and analytics Experience implementing CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) Strong Git and version control practices Experience tuning and optimising Spark workloads To be considered Please either apply by clicking online or emailing me directly . By applying to this role you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Key skills Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data
09/06/2026
Full time
Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via About the client Due to continued growth, we're seeking a skilled Data Engineer to join an established organisation at the forefront of building modern, data-driven platforms. The business is investing heavily in its data ecosystem and is focused on delivering real-time insights and trusted analytics that support teams across product, finance, marketing, and compliance. This is an excellent opportunity to work with modern cloud data technologies and play a key role in shaping a scalable, secure, and high-performance data platform. What will you be doing? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed data that supports analytics, reporting, and operational decision making. You'll also play a key role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability, and cost optimisation will also form part of your responsibilities as you contribute to the ongoing development of the organisation's data ecosystem. Our benefits Competitive basic salary Discretionary bonus scheme Company shares option plan Contributory pension scheme Life insurance (4x basic salary) Health cash plan Generous holiday allowance including bank holidays Study support and clear progression opportunities Employee assistance programme available 24/7 Collaborative office environment with regular social and charity events And Much More Data Engineer - Essential Skills Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands on experience with Kafka (MSK) and real time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Solid AWS experience including services such as S3, Glue, Lambda, Batch, and IAM Proficiency in Python and SQL for data engineering and analytics Experience implementing CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) Strong Git and version control practices Experience tuning and optimising Spark workloads To be considered Please either apply by clicking online or emailing me directly . By applying to this role you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Key skills Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data
Data Engineer (Streaming) - Requirements Strong coding in Java (preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems Tech & Cloud Experience with AWS, Azure, or GCP (AWS preferred) Familiarity with Databricks, Snowflake, or BigQuery Engineering Practices Strong in testing, CI/CD, Git Experience with Terraform, Docker, Kubernetes Experience 3 years in data engineering Agile experience and strong communication skills Nice to Have Consulting/client-facing experience Real-time/low-latency systems Certifications or mentoring experience Details 12 month FTC, very likely to convert to perm Upto 3 days per week in Newcastle Pay dependant on experience SC Clearance Essential
09/06/2026
Full time
Data Engineer (Streaming) - Requirements Strong coding in Java (preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems Tech & Cloud Experience with AWS, Azure, or GCP (AWS preferred) Familiarity with Databricks, Snowflake, or BigQuery Engineering Practices Strong in testing, CI/CD, Git Experience with Terraform, Docker, Kubernetes Experience 3 years in data engineering Agile experience and strong communication skills Nice to Have Consulting/client-facing experience Real-time/low-latency systems Certifications or mentoring experience Details 12 month FTC, very likely to convert to perm Upto 3 days per week in Newcastle Pay dependant on experience SC Clearance Essential
AWS Data Engineer Rate: Up to £400 per day (Outside IR35) Contract Length: 6 Months (with strong potential for extension) Location: Hybrid - 1 day per week onsite in Central London A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing to the design, development and optimisation of large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business decisions. Responsibilities for the AWS Data Engineer: Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem Leverage services such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions Implement and optimise ETL/ELT processes , ensuring data integrity, consistency and quality across multiple sources Apply best practices in data modelling, version control, and CI/CD to deliver maintainable and reusable code Monitor data performance and reliability, proactively identifying opportunities to enhance efficiency and scalability Support the integration of data from diverse systems, including APIs and third-party platforms, into a unified architecture Ensure compliance with data governance, privacy and security policies throughout all stages of development Collaborate in an Agile environment, contributing to sprint planning, peer reviews and continuous improvement initiatives Essential Skills for the AWS Data Engineer: Extensive hands-on experience with AWS data services Strong programming skills in Python (including libraries such as PySpark or Pandas) Solid understanding of data modelling, warehousing and architecture design within cloud environments Experience building and managing ETL/ELT workflows and data pipelines at scale Proficiency with SQL and working knowledge of relational and non-relational databases Experience deploying data infrastructure using IaC tools such as Terraform or CloudFormation Understanding of DevOps and CI/CD pipelines for data engineering solutions Strong problem-solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model deployment pipelines or data lakehouse architectures Data Engineer, AWS Data Engineer
09/06/2026
Full time
AWS Data Engineer Rate: Up to £400 per day (Outside IR35) Contract Length: 6 Months (with strong potential for extension) Location: Hybrid - 1 day per week onsite in Central London A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing to the design, development and optimisation of large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business decisions. Responsibilities for the AWS Data Engineer: Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem Leverage services such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions Implement and optimise ETL/ELT processes , ensuring data integrity, consistency and quality across multiple sources Apply best practices in data modelling, version control, and CI/CD to deliver maintainable and reusable code Monitor data performance and reliability, proactively identifying opportunities to enhance efficiency and scalability Support the integration of data from diverse systems, including APIs and third-party platforms, into a unified architecture Ensure compliance with data governance, privacy and security policies throughout all stages of development Collaborate in an Agile environment, contributing to sprint planning, peer reviews and continuous improvement initiatives Essential Skills for the AWS Data Engineer: Extensive hands-on experience with AWS data services Strong programming skills in Python (including libraries such as PySpark or Pandas) Solid understanding of data modelling, warehousing and architecture design within cloud environments Experience building and managing ETL/ELT workflows and data pipelines at scale Proficiency with SQL and working knowledge of relational and non-relational databases Experience deploying data infrastructure using IaC tools such as Terraform or CloudFormation Understanding of DevOps and CI/CD pipelines for data engineering solutions Strong problem-solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams Desirable Skills for the AWS Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model deployment pipelines or data lakehouse architectures Data Engineer, AWS Data Engineer
Performance Analyst 12 months Location - London/Remote £465 per day inside IR35 - Umbrella only Job Spec As a Performance Analyst, your role is to support product teams by utilising data tools to create insight and actionable outputs for product managers, designers, and developers. You will be developing and maintaining Adobe Analytics and Power BI reports to enable data-driven decisions across the programme. The role involves partnering with product teams to define reporting needs and translate them into clear KPIs and robust data solutions, delivering ad-hoc analysis to inform product improvements, and applying measurement frameworks to shape future analytics capability. You will design and optimise dashboards with consistent metrics and meaningful time-based comparisons, while ensuring data quality, governance, and alignment across data sources. Collaboration with product, analytics, and data engineering teams is central to continuously improving data, reporting, and insight delivery. Key Technical Skills Advanced PowerBI Visualisation or equivalent (2 years) Database or platform experience in tools such as Databricks or equivalent (2 years) Applied experience in Python & SQL (2 years) Optimising costs on exceedingly large queries + cluster management Soft Skills Independent Self Starter, managing your own work and workstreams Strong stakeholder management skills with the ability to translate analytics requirements into reports Proactive Attitude in handling multiple workstreams Experience with working in cross functional teams varying from waterfall and Agile Experience working in the Software Development Cycle Nice to Have Skills Adobe Analytics or Web-based Analytics Tools experience Experience in working in NHS's Federated Data Platform or Palantir Foundry Exposure to Data Lake functionality and architecture (strong relational database skills would be a Good alternative) Experience in working in Generative AI projects Experience in working in Healthcare or digital applications
09/06/2026
Full time
Performance Analyst 12 months Location - London/Remote £465 per day inside IR35 - Umbrella only Job Spec As a Performance Analyst, your role is to support product teams by utilising data tools to create insight and actionable outputs for product managers, designers, and developers. You will be developing and maintaining Adobe Analytics and Power BI reports to enable data-driven decisions across the programme. The role involves partnering with product teams to define reporting needs and translate them into clear KPIs and robust data solutions, delivering ad-hoc analysis to inform product improvements, and applying measurement frameworks to shape future analytics capability. You will design and optimise dashboards with consistent metrics and meaningful time-based comparisons, while ensuring data quality, governance, and alignment across data sources. Collaboration with product, analytics, and data engineering teams is central to continuously improving data, reporting, and insight delivery. Key Technical Skills Advanced PowerBI Visualisation or equivalent (2 years) Database or platform experience in tools such as Databricks or equivalent (2 years) Applied experience in Python & SQL (2 years) Optimising costs on exceedingly large queries + cluster management Soft Skills Independent Self Starter, managing your own work and workstreams Strong stakeholder management skills with the ability to translate analytics requirements into reports Proactive Attitude in handling multiple workstreams Experience with working in cross functional teams varying from waterfall and Agile Experience working in the Software Development Cycle Nice to Have Skills Adobe Analytics or Web-based Analytics Tools experience Experience in working in NHS's Federated Data Platform or Palantir Foundry Exposure to Data Lake functionality and architecture (strong relational database skills would be a Good alternative) Experience in working in Generative AI projects Experience in working in Healthcare or digital applications
Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of a modern event-sourcing architecture, enabling efficient data modelling, streaming, and transformation across platforms Collaborate with cross-functional teams - including Business Analysts, Product Owners, and fellow Senior Data Engineers - to translate business needs into robust technical solutions Champion data governance, privacy, and security best practices, ensuring compliance and protection of customer data Continuously improve existing systems, introducing new technologies and methodologies that enhance efficiency, scalability, and cost optimisation Essential Skills for the Senior Data Engineer: Proficient with Databricks and Apache Spark, including performance tuning and advanced concepts such as Delta Lake and streaming Strong programming skills in Python with experience in software engineering principles, version control, unit testing and CI/CD pipelines Advanced knowledge of SQL and data modelling (dimensional modelling, fact/dimension structures, slowly changing dimensions) Managing and querying data lakes or Lakehouse's Excellent communication skills with the ability to explain complex technical concepts clearly and persuasively Desirable Skills for the Senior Data Engineer: Experience with event sourcing, dbt, or related data transformation tools Familiarity with PostgreSQL and cloud-native data services (Azure Event Hub, Redshift, Kinesis, S3, Blob Storage, OneLake, or Microsoft Fabric) Understanding of machine learning model enablement and operationalisation within data architectures Experience working within Agile delivery environments If you are an experienced Senior Data Engineer with strong expertise in Databricks , Azure , and data architecture design , looking for a hands-on role where you can influence technical direction and drive meaningful change, please apply in the immediate instance. Data Engineer, Senior Data Engineer
09/06/2026
Full time
Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of a modern event-sourcing architecture, enabling efficient data modelling, streaming, and transformation across platforms Collaborate with cross-functional teams - including Business Analysts, Product Owners, and fellow Senior Data Engineers - to translate business needs into robust technical solutions Champion data governance, privacy, and security best practices, ensuring compliance and protection of customer data Continuously improve existing systems, introducing new technologies and methodologies that enhance efficiency, scalability, and cost optimisation Essential Skills for the Senior Data Engineer: Proficient with Databricks and Apache Spark, including performance tuning and advanced concepts such as Delta Lake and streaming Strong programming skills in Python with experience in software engineering principles, version control, unit testing and CI/CD pipelines Advanced knowledge of SQL and data modelling (dimensional modelling, fact/dimension structures, slowly changing dimensions) Managing and querying data lakes or Lakehouse's Excellent communication skills with the ability to explain complex technical concepts clearly and persuasively Desirable Skills for the Senior Data Engineer: Experience with event sourcing, dbt, or related data transformation tools Familiarity with PostgreSQL and cloud-native data services (Azure Event Hub, Redshift, Kinesis, S3, Blob Storage, OneLake, or Microsoft Fabric) Understanding of machine learning model enablement and operationalisation within data architectures Experience working within Agile delivery environments If you are an experienced Senior Data Engineer with strong expertise in Databricks , Azure , and data architecture design , looking for a hands-on role where you can influence technical direction and drive meaningful change, please apply in the immediate instance. Data Engineer, Senior Data Engineer
Data Engineer Remote 7 months Inside ir35 - Umbrella only Required skills Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc. Strong understanding of complex JSON manipulation. Experience working with Data Pipelines using custom Python/PySpark frameworks. Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc., including experience of handling sensitive datasets. Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve). Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc.). Fundamental Linux system administration knowledge - SSH keys and config etc., Bash CLI and scripting, environment variables. Experience using browser-based IDEs (Jupyter Notebooks, RStudio etc.). Experience working in a dynamic Agile environment (SAFE, Scrum, sprints, JIRA etc.). Languages / Frameworks JSON YAML Python (as a programming language, not just able to write basic scripts; Pydantic experience would be a bonus). SQL PySpark Delta Lake Bash (both CLI usage and scripting). Git Markdown Scala (bonus, not compulsory). Azure SQL Server as a HIVE Metastore (bonus). Technologies Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration / Data Ingestion) JIRA If this is the role for you, please submit your CV at your earliest convenience. If you have not had a response within 2 weeks, please take this as you have not been successful on this occasion.
09/06/2026
Full time
Data Engineer Remote 7 months Inside ir35 - Umbrella only Required skills Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc. Strong understanding of complex JSON manipulation. Experience working with Data Pipelines using custom Python/PySpark frameworks. Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc., including experience of handling sensitive datasets. Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve). Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc.). Fundamental Linux system administration knowledge - SSH keys and config etc., Bash CLI and scripting, environment variables. Experience using browser-based IDEs (Jupyter Notebooks, RStudio etc.). Experience working in a dynamic Agile environment (SAFE, Scrum, sprints, JIRA etc.). Languages / Frameworks JSON YAML Python (as a programming language, not just able to write basic scripts; Pydantic experience would be a bonus). SQL PySpark Delta Lake Bash (both CLI usage and scripting). Git Markdown Scala (bonus, not compulsory). Azure SQL Server as a HIVE Metastore (bonus). Technologies Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration / Data Ingestion) JIRA If this is the role for you, please submit your CV at your earliest convenience. If you have not had a response within 2 weeks, please take this as you have not been successful on this occasion.
FRG Technology Consulting is seeking a Stratos - Deployed Engineer in London. This permanent hybrid role is for skilled professionals to enhance data processing and analytics using Microsoft B.I and DataBricks. The ideal candidate has proficiency in PySpark, strong problem-solving abilities, and excellent communication skills. A commitment to continuous learning is essential. The role offers competitive compensation and a Shares Scheme.
09/06/2026
Full time
FRG Technology Consulting is seeking a Stratos - Deployed Engineer in London. This permanent hybrid role is for skilled professionals to enhance data processing and analytics using Microsoft B.I and DataBricks. The ideal candidate has proficiency in PySpark, strong problem-solving abilities, and excellent communication skills. A commitment to continuous learning is essential. The role offers competitive compensation and a Shares Scheme.
La Fosse Associates
Milton Keynes, Buckinghamshire
La Fosse Associates is seeking a Senior Data Engineer for a contract position in Milton Keynes. The role requires extensive experience in designing and optimising data pipelines in a Databricks Lakehouse environment and offers hybrid working arrangements. This opportunity includes an initial contract of 5 months with potential for extension. Candidates should have 7+ years in Data Engineering, strong skills in cloud platforms like Azure, and proficiency in tools such as Python and SQL. A collaborative approach coupled with problem-solving abilities is essential for success.
09/06/2026
Full time
La Fosse Associates is seeking a Senior Data Engineer for a contract position in Milton Keynes. The role requires extensive experience in designing and optimising data pipelines in a Databricks Lakehouse environment and offers hybrid working arrangements. This opportunity includes an initial contract of 5 months with potential for extension. Candidates should have 7+ years in Data Engineering, strong skills in cloud platforms like Azure, and proficiency in tools such as Python and SQL. A collaborative approach coupled with problem-solving abilities is essential for success.
Data Engineer for a major offshore wind project in The United Kingdom Responsibilities Design and implement scalable ingestion pipelines from multiple source systems including and internal business data sources. Ensure reliable, automated, and monitored data flows into the Bronze layer of the Medallion architecture. Work within client's existing security framework to establish compliant connectivity to operational data sources. Build and maintain Silver and Gold layer transformations in Databricks using Python and SQL. Onboard datasets into Unity Catalog, ensuring proper governance, lineage, and discoverability. Platform Collaboration & Delivery Support: support the ML/Data Scientist in preparing clean, structured datasets for anomaly detection and asset performance modelling. Contribute to technical documentation and ensure pipelines are maintainable and transferable. Stay current on Databricks and Azure platform developments relevant to the stack. Support the Digital & AI Strategy Manager in assessing feasibility of new data source integrations as the roadmap evolves. Experience & Qualifications Master's degree in Computer Science, Data Engineering, Software Engineering, or a related technical field. Professional certifications in Azure, Databricks preferred. Training or background in energy systems, renewable energy, offshore wind or BESS technologies is a strong plus. 4-7 years of hands on data engineering experience in a cloud environment. Demonstrated experience delivering production pipelines on Databricks and Azure (ADLS Gen2, ADF or equivalent). Proven ability to implement Medallion architecture or equivalent layered data modelling patterns. Experience with REST API ingestion and integration of business systems (ERP, finance tools). Experience in a contractor or project based delivery model preferred. Exposure to OT/SCADA environments or energy sector data. Exposure to MLOps workflows or collaboration with data science teams.
09/06/2026
Full time
Data Engineer for a major offshore wind project in The United Kingdom Responsibilities Design and implement scalable ingestion pipelines from multiple source systems including and internal business data sources. Ensure reliable, automated, and monitored data flows into the Bronze layer of the Medallion architecture. Work within client's existing security framework to establish compliant connectivity to operational data sources. Build and maintain Silver and Gold layer transformations in Databricks using Python and SQL. Onboard datasets into Unity Catalog, ensuring proper governance, lineage, and discoverability. Platform Collaboration & Delivery Support: support the ML/Data Scientist in preparing clean, structured datasets for anomaly detection and asset performance modelling. Contribute to technical documentation and ensure pipelines are maintainable and transferable. Stay current on Databricks and Azure platform developments relevant to the stack. Support the Digital & AI Strategy Manager in assessing feasibility of new data source integrations as the roadmap evolves. Experience & Qualifications Master's degree in Computer Science, Data Engineering, Software Engineering, or a related technical field. Professional certifications in Azure, Databricks preferred. Training or background in energy systems, renewable energy, offshore wind or BESS technologies is a strong plus. 4-7 years of hands on data engineering experience in a cloud environment. Demonstrated experience delivering production pipelines on Databricks and Azure (ADLS Gen2, ADF or equivalent). Proven ability to implement Medallion architecture or equivalent layered data modelling patterns. Experience with REST API ingestion and integration of business systems (ERP, finance tools). Experience in a contractor or project based delivery model preferred. Exposure to OT/SCADA environments or energy sector data. Exposure to MLOps workflows or collaboration with data science teams.
Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via About the client Due to continued growth, we're seeking a skilled Data Engineer to join an established organisation at the forefront of building modern, data-driven platforms. The business is investing heavily in its data ecosystem and is focused on delivering real-time insights and trusted analytics that support teams across product, finance, marketing, and compliance. This is an excellent opportunity to work with modern cloud data technologies and play a key role in shaping a scalable, secure, and high-performance data platform. What will you be doing? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed data that supports analytics, reporting, and operational decision making. You'll also play a key role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability, and cost optimisation will also form part of your responsibilities as you contribute to the ongoing development of the organisation's data ecosystem. Our benefits Competitive basic salary Discretionary bonus scheme Company shares option plan Contributory pension scheme Life insurance (4x basic salary) Health cash plan Generous holiday allowance including bank holidays Study support and clear progression opportunities Employee assistance programme available 24/7 Collaborative office environment with regular social and charity events And Much More Data Engineer - Essential Skills Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands on experience with Kafka (MSK) and real time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Solid AWS experience including services such as S3, Glue, Lambda, Batch, and IAM Proficiency in Python and SQL for data engineering and analytics Experience implementing CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) Strong Git and version control practices Experience tuning and optimising Spark workloads To be considered Please either apply by clicking online or emailing me directly . By applying to this role you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Key skills Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data
09/06/2026
Full time
Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via About the client Due to continued growth, we're seeking a skilled Data Engineer to join an established organisation at the forefront of building modern, data-driven platforms. The business is investing heavily in its data ecosystem and is focused on delivering real-time insights and trusted analytics that support teams across product, finance, marketing, and compliance. This is an excellent opportunity to work with modern cloud data technologies and play a key role in shaping a scalable, secure, and high-performance data platform. What will you be doing? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed data that supports analytics, reporting, and operational decision making. You'll also play a key role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability, and cost optimisation will also form part of your responsibilities as you contribute to the ongoing development of the organisation's data ecosystem. Our benefits Competitive basic salary Discretionary bonus scheme Company shares option plan Contributory pension scheme Life insurance (4x basic salary) Health cash plan Generous holiday allowance including bank holidays Study support and clear progression opportunities Employee assistance programme available 24/7 Collaborative office environment with regular social and charity events And Much More Data Engineer - Essential Skills Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands on experience with Kafka (MSK) and real time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Solid AWS experience including services such as S3, Glue, Lambda, Batch, and IAM Proficiency in Python and SQL for data engineering and analytics Experience implementing CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) Strong Git and version control practices Experience tuning and optimising Spark workloads To be considered Please either apply by clicking online or emailing me directly . By applying to this role you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Key skills Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data
