it job board logo
  • Home
  • Find IT Jobs
  • Register CV
  • Career Advice
  • Contact us
  • Employers
    • Register as Employer
    • Pricing Plans
  • Recruiting? Post a job
  • Sign in
  • Sign up
  • Home
  • Find IT Jobs
  • Register CV
  • Career Advice
  • Contact us
  • Employers
    • Register as Employer
    • Pricing Plans
Sorry, that job is no longer available. Here are some results that may be similar to the job you were looking for.

107 jobs found

Email me jobs like this
Refine Search
Current Search
data engineer real time pipelines databricks aws
GRADUATE DATA ENGINEER
Reply, Inc.
Affinity Reply is a leading UK-based architecture consultancy focused exclusively on optimising IT/business alignment, and minimising the cost of business and technology change. We distinguish ourselves by fostering trusted client relationships, ensuring successful outcomes through our proactive and insightful approach. To meet growing demand, we are looking for motivated and curious graduates who want to build a career in consulting, technology, and digital transformation. Role Overview As a Graduate Data Engineer joining our Affinity Reply team in London, you will work with our clients in the financial services sector to design and develop high-performance data applications, manage complex data sets, and work across the full development lifecycle. This is a London based role with an immediate start date. Responsibilities Work with clients to translate functional requirements into technical requirements. Develop performant data pipelines for batch or real-time data processing. Manage end-to-end data platform processes, including extraction, transformation, loading, orchestration, deployment, monitoring, alerting, and governance. Research and experiment with emerging technologies and industry trends to drive business value through early adoption. About the Candidate A minimum 2.1 Bachelor's degree in Computer Science or a directly related IT discipline is required. Strong knowledge of, and initial experience with, handling data projects using SQL and Python. Initial experience with cloud warehousing platforms (AWS Redshift, GCP BigQuery, Databricks, Snowflake) is an asset. Excellent communication skills with the ability to convey complex information clearly to a wide range of audiences. Passion for technology and a strong interest in becoming a Data Engineer. Enjoys problem solving with a focus on delivering quality results. Strong interest in becoming a consultant and a continuous hunger to learn. Flexibility for local business travel. Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skincolour, marital status or parental status or any other characteristic protected by the Law. Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need
05/06/2026
Full time
Affinity Reply is a leading UK-based architecture consultancy focused exclusively on optimising IT/business alignment, and minimising the cost of business and technology change. We distinguish ourselves by fostering trusted client relationships, ensuring successful outcomes through our proactive and insightful approach. To meet growing demand, we are looking for motivated and curious graduates who want to build a career in consulting, technology, and digital transformation. Role Overview As a Graduate Data Engineer joining our Affinity Reply team in London, you will work with our clients in the financial services sector to design and develop high-performance data applications, manage complex data sets, and work across the full development lifecycle. This is a London based role with an immediate start date. Responsibilities Work with clients to translate functional requirements into technical requirements. Develop performant data pipelines for batch or real-time data processing. Manage end-to-end data platform processes, including extraction, transformation, loading, orchestration, deployment, monitoring, alerting, and governance. Research and experiment with emerging technologies and industry trends to drive business value through early adoption. About the Candidate A minimum 2.1 Bachelor's degree in Computer Science or a directly related IT discipline is required. Strong knowledge of, and initial experience with, handling data projects using SQL and Python. Initial experience with cloud warehousing platforms (AWS Redshift, GCP BigQuery, Databricks, Snowflake) is an asset. Excellent communication skills with the ability to convey complex information clearly to a wide range of audiences. Passion for technology and a strong interest in becoming a Data Engineer. Enjoys problem solving with a focus on delivering quality results. Strong interest in becoming a consultant and a continuous hunger to learn. Flexibility for local business travel. Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skincolour, marital status or parental status or any other characteristic protected by the Law. Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need
Senior Data Engineer
Wrisk Edinburgh, Midlothian
As a Senior Data Engineer with Atto, you will be part of our Data Science & Engineering team, helping our customers use transactional intelligence to drive smarter financial decisions and build impactful products. You'll play a key role in designing and delivering scalable, production-ready analytical solutions that turn complex data into meaningful insights. You will own and improve the systems that ingest, transform, and serve large-scale transactional data sets. You will be responsible for designing resilient data pipelines, implementing robust data models, deploying real-time and batch processing systems, and introducing observability, testing and automation to keep our data trustworthy at scale. You will work closely with the data science and product teams to understand customer needs and the direction of internal strategy, producing measurable data engineering outcomes. We're looking for someone who's passionate about technology, curious about data infrastructure, and excited to solve real problems. You'll need a strong foundation in data engineering, a creative mindset, and the ability to communicate clearly with both technical and non-technical stakeholders. You'll be supported with training and development opportunities to deepen your expertise and stay ahead of industry trends. Responsibilities Design, build, and operate data ingestion and ETL/ELT pipelines for our data systems that power Atto products and customer-facing applications. Build and maintain our data platform architecture and infrastructure, including data pipelines, warehouses that power analytics and product features and reporting. Implement data modelling, schema design, and data contracts to make datasets easy to consume. Introduce and maintain observability, data quality checks, and automated testing for our production data flows. Driving impact at scale by improving data workflows, service reliability, and making Atto's capabilities faster, more reliable and widely accessible. Collaborate with product managers and cross-functional teams to translate market signals and customers' needs into innovative data-driven solutions. Create new systems and approaches, while continuously improving and scaling existing ones for performance, reliability, and efficiency. Conduct deep analysis of transactional datasets to validate data models, surface data quality issues, and propose engineering fixes. Optimise performance and cost of data processing and storage across cloud services. Communicate technical findings and recommendations clearly to both technical and non-technical stakeholders across the business. Stay current with industry developments, emerging technologies, and best practices in data engineering. Qualifications A Bachelor's degree in Computer Science, Data/Software Engineering, or a related discipline. 5+ years of hands-on experience in data engineering with a proven track record of delivering scalable, production-grade data platforms and data models. Strong SQL skills and proven experience designing, building and optimising data pipelines and data warehouse schemas. Strong proficiency in Python for production data engineering with a focus on building maintainable, testable and clean code. Track record of implementing data quality, observability, monitoring and testing practices. Solid experience with at least one cloud provider (Azure, AWS or GCP), and their managed data services. Experience with CI/CD, infrastructure-as-code and working in containerised environments. Familiarity with modern data stack tools: Databricks, Snowflake or RedShift, etc. Experience working with reporting and modelling tools such as Power BI, including designing performant data models and supporting self-serve analytics. Advanced experience in pattern recognition with the ability to translate complex data into actionable insights. A results-oriented mindset, able to take concepts from ideation through to tangible outputs. Comfortable working in a fast-paced, delivery-focused environment, balancing multiple priorities with agility. A proactive and collaborative approach, with a willingness to iterate, share knowledge, and challenge assumptions constructively Bonus Points (We're getting greedy) Experience building or scaling data platforms in large-scale, regulated data environments. Experience with DevOps for data, platform engineering, or building large data pipelines and real-time data streaming systems. Exposure to working in a high-growth, evolving environment where the customer is at the heart of product and engineering decisions A team of passionate, interesting people committed to your development and success £70-£80k gross/pension Personal training and Continuous Professional Development budget (CPD) Uncapped bike to work scheme Half-day Fridays every last week of the month to recharge Wellness partnerships In-person and virtual team events and workshops Volunteering (Social Good Connect partnership) 33 days holiday allowance to take when you want £200 home working contribution to make sure you have everything you need to do your best work (get comfy - we want you to stay) Ask us about our remote-first, flexible culture - this is core to who we are, and we're rated one of Scotland's most flexible employers Creating a more predictable future for lenders We are on a mission to enable our customers across the globe to effortlessly make use of real-time transaction data to better understand their customers, grow their business, revolutionise their offerings and delight with customer service. At Atto, you will be working for a business that is creating a more predictable future for lenders through our real-time transaction data platform. We use today's data to better predict tomorrow. This is an exciting stage in our growth, and we'd love you to be part of the story. Don't speculate. Calculate.
05/06/2026
Full time
As a Senior Data Engineer with Atto, you will be part of our Data Science & Engineering team, helping our customers use transactional intelligence to drive smarter financial decisions and build impactful products. You'll play a key role in designing and delivering scalable, production-ready analytical solutions that turn complex data into meaningful insights. You will own and improve the systems that ingest, transform, and serve large-scale transactional data sets. You will be responsible for designing resilient data pipelines, implementing robust data models, deploying real-time and batch processing systems, and introducing observability, testing and automation to keep our data trustworthy at scale. You will work closely with the data science and product teams to understand customer needs and the direction of internal strategy, producing measurable data engineering outcomes. We're looking for someone who's passionate about technology, curious about data infrastructure, and excited to solve real problems. You'll need a strong foundation in data engineering, a creative mindset, and the ability to communicate clearly with both technical and non-technical stakeholders. You'll be supported with training and development opportunities to deepen your expertise and stay ahead of industry trends. Responsibilities Design, build, and operate data ingestion and ETL/ELT pipelines for our data systems that power Atto products and customer-facing applications. Build and maintain our data platform architecture and infrastructure, including data pipelines, warehouses that power analytics and product features and reporting. Implement data modelling, schema design, and data contracts to make datasets easy to consume. Introduce and maintain observability, data quality checks, and automated testing for our production data flows. Driving impact at scale by improving data workflows, service reliability, and making Atto's capabilities faster, more reliable and widely accessible. Collaborate with product managers and cross-functional teams to translate market signals and customers' needs into innovative data-driven solutions. Create new systems and approaches, while continuously improving and scaling existing ones for performance, reliability, and efficiency. Conduct deep analysis of transactional datasets to validate data models, surface data quality issues, and propose engineering fixes. Optimise performance and cost of data processing and storage across cloud services. Communicate technical findings and recommendations clearly to both technical and non-technical stakeholders across the business. Stay current with industry developments, emerging technologies, and best practices in data engineering. Qualifications A Bachelor's degree in Computer Science, Data/Software Engineering, or a related discipline. 5+ years of hands-on experience in data engineering with a proven track record of delivering scalable, production-grade data platforms and data models. Strong SQL skills and proven experience designing, building and optimising data pipelines and data warehouse schemas. Strong proficiency in Python for production data engineering with a focus on building maintainable, testable and clean code. Track record of implementing data quality, observability, monitoring and testing practices. Solid experience with at least one cloud provider (Azure, AWS or GCP), and their managed data services. Experience with CI/CD, infrastructure-as-code and working in containerised environments. Familiarity with modern data stack tools: Databricks, Snowflake or RedShift, etc. Experience working with reporting and modelling tools such as Power BI, including designing performant data models and supporting self-serve analytics. Advanced experience in pattern recognition with the ability to translate complex data into actionable insights. A results-oriented mindset, able to take concepts from ideation through to tangible outputs. Comfortable working in a fast-paced, delivery-focused environment, balancing multiple priorities with agility. A proactive and collaborative approach, with a willingness to iterate, share knowledge, and challenge assumptions constructively Bonus Points (We're getting greedy) Experience building or scaling data platforms in large-scale, regulated data environments. Experience with DevOps for data, platform engineering, or building large data pipelines and real-time data streaming systems. Exposure to working in a high-growth, evolving environment where the customer is at the heart of product and engineering decisions A team of passionate, interesting people committed to your development and success £70-£80k gross/pension Personal training and Continuous Professional Development budget (CPD) Uncapped bike to work scheme Half-day Fridays every last week of the month to recharge Wellness partnerships In-person and virtual team events and workshops Volunteering (Social Good Connect partnership) 33 days holiday allowance to take when you want £200 home working contribution to make sure you have everything you need to do your best work (get comfy - we want you to stay) Ask us about our remote-first, flexible culture - this is core to who we are, and we're rated one of Scotland's most flexible employers Creating a more predictable future for lenders We are on a mission to enable our customers across the globe to effortlessly make use of real-time transaction data to better understand their customers, grow their business, revolutionise their offerings and delight with customer service. At Atto, you will be working for a business that is creating a more predictable future for lenders through our real-time transaction data platform. We use today's data to better predict tomorrow. This is an exciting stage in our growth, and we'd love you to be part of the story. Don't speculate. Calculate.
Softwire
Senior Data Engineer
Softwire
Salary: £59,400 - £78,800 with an average of £5,750- £11,250 in profit share Softwire is one of the UK's leading digital technology consultancies, offering services in data, AI, cloud, CX, innovation, design and software engineering. We deliver high-profile, mission critical, and transformational projects for household names across the public and private sectors. Softwire was founded on one simple idea: be the outstanding place to work for smart, passionate technologists who want to make an impact. Attract the best, create a culture where people thrive, and offer our customers access to capabilities that are truly market leading. And it seems to be working - We were recently voted number 1 company to work for in the UK at the Best Company awards; we employ outstanding people across all capabilities (typical destinations after Softwire include Google, DeepMind, start-up founder, algorithmic trading, and AI research roles); and we have helped our clients deliver some of the hardest, most interesting tech programmes, across private and public sectors. A big part of this is our culture and values and we are looking for people who share our core beliefs about what makes a great place to work: That if a job is worth doing, it's worth doing properly That work should be fulfilling but can also be fun That kindness matters and should be extended to employees and clients alike That by being trusting and trustworthy as an organisation and as individuals we can dispense with tedious bureaucracy and rules In brief We're looking for exceptional Senior Data Engineers with deep expertise in data architecture and engineering, a strong track record of technical leadership, and the ability to collaborate closely with client stakeholders and translate business requirements into tangible outcomes. You'll join a high-calibre team and be expected to operate with autonomy, shape technical direction, and provide meaningful mentorship to more junior engineers. This is a role for someone who thrives at the intersection of engineering excellence and client influence. As a Senior Data Engineer you'll take a leading role across complex, multi-stakeholder engagements, working alongside Technical Leads, Architects, and client teams. You will own the technical quality of data solutions end-to-end, across a range of sectors and technologies. You might: Lead the data architecture and modelling for Moorfields Eye Hospital's INSIGHT programme, defining standards and guiding the team to support pioneering ophthalmic research Own the technical strategy for data pipelines, cloud infrastructure, and dashboards on Elexon's Azure platform, driving reliability and performance at the heart of Britain's electricity market Define the end-to-end solution design for a financial services company migrating legacy Excel workflows into a modern cloud-native scheduler, accountable for technical risk and stakeholder sign-off Lead data modelling and advisory work for a civil service department replacing a legacy HR system, acting as the senior technical voice in client engagements Architect and lead the delivery of an AI transcription service for the BBC using GenAI, shaping both the technical approach and team execution Experience and qualifications Technical You have 5+ years' experience in a data engineering, software engineering or similar relevant context, with a demonstrable track record of delivering at senior or lead level You have strong hands-on experience across several of our core technologies, including Python, SQL, Databricks, Snowflake, Fabric, and major cloud platforms (AWS/Azure/GCP), and can credibly advise clients on technology choices You bring deep pattern recognition from prior projects and can rapidly assess unfamiliar tech stacks, client environments, and sectors, getting to grips quickly and providing sound technical guidance from the outset You have a deep understanding of data engineering best practice, including data modelling, pipeline design, data governance, data infrastructure & security, testing, and observability, and are confident setting standards and making architectural decisions on complex, ambiguous projects You are an exceptional communicator, able to translate complex technical concepts for senior stakeholders, build trust with clients at all levels, and represent Softwire with credibility and confidence You are outcome-focused and have a strong track record of driving delivery across complex, multi-team engagements, holding yourself and others to high standards to ensure genuinely high-impact results for clients You actively shape the technical direction of your team, leading on architecture, data modelling, technical design, and client interactions and take genuine ownership of the growth and performance of more junior engineers Your Approach You are deeply passionate about leveraging technology to deliver outstanding outcomes for clients and end users, and you stay current with the data and AI landscape to bring fresh thinking to every engagement You set a high bar for technical quality and delivery rigour not just in your own work, but in the standards you embed across the team and the practices you champion with clients You drive meaningful improvements in your clients' technical maturity, bringing a strategic, advisory mindset that balances long-term engineering ambition with pragmatic business realities You are a natural collaborator who energises those around you creating an environment where engineers do their best work and feel challenged, supported, and invested in shared success You bring a solutions-first mindset to cross-functional collaboration working with developers, product owners, and architects to shape technically excellent, commercially astute solutions that genuinely meet client needs You thrive in ambiguous, fast-paced environments able to bring structure and clarity to complex problems and provide a steady, authoritative technical hand when it matters most Package Softwire operates transparent pay scales and a profit share scheme based on role and overall company performance. Base salary from £59,400 - £78,800 depending on your background and how many years of relevant experience you have You can expect to receive a profit share depending on your experience and company performance. Over the last four years, this ranged between £5,750- £11,250 Pension: Additional 5% of salary Additional benefits 25 days annual leave (with the option to buy and sell) Flexible work options (e.g. working from home 2dpw; 4-day working contract) Time off for company-wide morale activities, time off for charitable / CSR activities Income protection, cycle to work, electric vehicle lease schemes, and payroll charity donations We are there for our clients and colleagues when needed. On average our teams do this working in person 3 days a week. We welcome applications from those with additional needs or caring responsibilities, and will look at where adaptions can support success in the role.
05/06/2026
Full time
Salary: £59,400 - £78,800 with an average of £5,750- £11,250 in profit share Softwire is one of the UK's leading digital technology consultancies, offering services in data, AI, cloud, CX, innovation, design and software engineering. We deliver high-profile, mission critical, and transformational projects for household names across the public and private sectors. Softwire was founded on one simple idea: be the outstanding place to work for smart, passionate technologists who want to make an impact. Attract the best, create a culture where people thrive, and offer our customers access to capabilities that are truly market leading. And it seems to be working - We were recently voted number 1 company to work for in the UK at the Best Company awards; we employ outstanding people across all capabilities (typical destinations after Softwire include Google, DeepMind, start-up founder, algorithmic trading, and AI research roles); and we have helped our clients deliver some of the hardest, most interesting tech programmes, across private and public sectors. A big part of this is our culture and values and we are looking for people who share our core beliefs about what makes a great place to work: That if a job is worth doing, it's worth doing properly That work should be fulfilling but can also be fun That kindness matters and should be extended to employees and clients alike That by being trusting and trustworthy as an organisation and as individuals we can dispense with tedious bureaucracy and rules In brief We're looking for exceptional Senior Data Engineers with deep expertise in data architecture and engineering, a strong track record of technical leadership, and the ability to collaborate closely with client stakeholders and translate business requirements into tangible outcomes. You'll join a high-calibre team and be expected to operate with autonomy, shape technical direction, and provide meaningful mentorship to more junior engineers. This is a role for someone who thrives at the intersection of engineering excellence and client influence. As a Senior Data Engineer you'll take a leading role across complex, multi-stakeholder engagements, working alongside Technical Leads, Architects, and client teams. You will own the technical quality of data solutions end-to-end, across a range of sectors and technologies. You might: Lead the data architecture and modelling for Moorfields Eye Hospital's INSIGHT programme, defining standards and guiding the team to support pioneering ophthalmic research Own the technical strategy for data pipelines, cloud infrastructure, and dashboards on Elexon's Azure platform, driving reliability and performance at the heart of Britain's electricity market Define the end-to-end solution design for a financial services company migrating legacy Excel workflows into a modern cloud-native scheduler, accountable for technical risk and stakeholder sign-off Lead data modelling and advisory work for a civil service department replacing a legacy HR system, acting as the senior technical voice in client engagements Architect and lead the delivery of an AI transcription service for the BBC using GenAI, shaping both the technical approach and team execution Experience and qualifications Technical You have 5+ years' experience in a data engineering, software engineering or similar relevant context, with a demonstrable track record of delivering at senior or lead level You have strong hands-on experience across several of our core technologies, including Python, SQL, Databricks, Snowflake, Fabric, and major cloud platforms (AWS/Azure/GCP), and can credibly advise clients on technology choices You bring deep pattern recognition from prior projects and can rapidly assess unfamiliar tech stacks, client environments, and sectors, getting to grips quickly and providing sound technical guidance from the outset You have a deep understanding of data engineering best practice, including data modelling, pipeline design, data governance, data infrastructure & security, testing, and observability, and are confident setting standards and making architectural decisions on complex, ambiguous projects You are an exceptional communicator, able to translate complex technical concepts for senior stakeholders, build trust with clients at all levels, and represent Softwire with credibility and confidence You are outcome-focused and have a strong track record of driving delivery across complex, multi-team engagements, holding yourself and others to high standards to ensure genuinely high-impact results for clients You actively shape the technical direction of your team, leading on architecture, data modelling, technical design, and client interactions and take genuine ownership of the growth and performance of more junior engineers Your Approach You are deeply passionate about leveraging technology to deliver outstanding outcomes for clients and end users, and you stay current with the data and AI landscape to bring fresh thinking to every engagement You set a high bar for technical quality and delivery rigour not just in your own work, but in the standards you embed across the team and the practices you champion with clients You drive meaningful improvements in your clients' technical maturity, bringing a strategic, advisory mindset that balances long-term engineering ambition with pragmatic business realities You are a natural collaborator who energises those around you creating an environment where engineers do their best work and feel challenged, supported, and invested in shared success You bring a solutions-first mindset to cross-functional collaboration working with developers, product owners, and architects to shape technically excellent, commercially astute solutions that genuinely meet client needs You thrive in ambiguous, fast-paced environments able to bring structure and clarity to complex problems and provide a steady, authoritative technical hand when it matters most Package Softwire operates transparent pay scales and a profit share scheme based on role and overall company performance. Base salary from £59,400 - £78,800 depending on your background and how many years of relevant experience you have You can expect to receive a profit share depending on your experience and company performance. Over the last four years, this ranged between £5,750- £11,250 Pension: Additional 5% of salary Additional benefits 25 days annual leave (with the option to buy and sell) Flexible work options (e.g. working from home 2dpw; 4-day working contract) Time off for company-wide morale activities, time off for charitable / CSR activities Income protection, cycle to work, electric vehicle lease schemes, and payroll charity donations We are there for our clients and colleagues when needed. On average our teams do this working in person 3 days a week. We welcome applications from those with additional needs or caring responsibilities, and will look at where adaptions can support success in the role.
Python Engineer
Grand Arcade Leicester, Leicestershire
Python Engineer (Data) Help shape the future of BCIS data and platforms BCIS is entering an exciting new phase of growth, powered by innovation, technology and data. To support this, we're looking for a Python Engineer (Data) to join our Engineering team. We're looking for software engineers who love building reliable, clean, production-quality systems and are excited to apply those skills in the data space. You don't need to already know Databricks or Spark - if you have a strong engineering mindset and a curiosity to learn, we'll support you every step of the way. At BCIS, we value diversity and encourage applications from women and underrepresented groups in tech. We want to create an environment where everyone can thrive, learn and contribute to shaping the future of our data products. What you'll do Build and maintain production-grade data pipelines and backend services using Python Write clean, modular, well-tested code following good engineering practices Design and implement reliable data workflows that scale with the business Work with SQL and relational databases to model, transform and query complex datasets Collaborate with product managers, analysts and other engineers to deliver data-driven features Contribute to CI/CD pipelines, automated testing and code reviews Improve system reliability, performance and maintainability through thoughtful design Learn and adopt new technologies, such as Databricks and Spark, as part of BCIS's evolving data platform Why this role is great Opportunity to transition into the high-growth data/AI space from a software engineering background Strong emphasis on engineering quality, not just tools or technologies Flexible working options - hybrid or office-based to suit your lifestyle. We would expect this person to be able to visit the Coventry office once a fortnight Supportive, inclusive environment that values curiosity, collaboration and learning Generous benefits including wellbeing day, private medical insurance, life insurance, enhanced pension and annual leave Real opportunity to shape industry-leading data products and make a visible impact Who we're looking for Comfortable writing production-quality Python code Familiar with OOP, functional programming, decorators, type hints and building reusable packages Confident with SQL: complex queries, joins, CTEs and database design (PostgreSQL ideal) Familiar with engineering best practices: Git, code reviews, automated testing (e.g. PyTest), CI/CD pipelines Experience deploying applications to cloud platforms (AWS, Azure or GCP - Azure preferred) Curious, collaborative and motivated to learn new data technologies Enthusiastic about creating maintainable, high-quality systems Nice to have (but not required) Experience with pandas, SQLAlchemy or Pydantic Familiarity with containerisation (Docker/Kubernetes) Understanding of distributed systems or data modelling concepts Why apply This is a fantastic opportunity to join the UK's leading independent provider of cost and carbon data across the built environment and to help engineer the next generation of BCIS data platforms. You'll work on meaningful, real-world data problems, apply strong software engineering principles, and grow your skills in modern data technologies - all within a supportive, flexible and inclusive team that values learning, curiosity and impact. If you're ready to grow, contribute and make a difference, we'd love to hear from you. Salary: GBP 40000 - 50000 per year
05/06/2026
Full time
Python Engineer (Data) Help shape the future of BCIS data and platforms BCIS is entering an exciting new phase of growth, powered by innovation, technology and data. To support this, we're looking for a Python Engineer (Data) to join our Engineering team. We're looking for software engineers who love building reliable, clean, production-quality systems and are excited to apply those skills in the data space. You don't need to already know Databricks or Spark - if you have a strong engineering mindset and a curiosity to learn, we'll support you every step of the way. At BCIS, we value diversity and encourage applications from women and underrepresented groups in tech. We want to create an environment where everyone can thrive, learn and contribute to shaping the future of our data products. What you'll do Build and maintain production-grade data pipelines and backend services using Python Write clean, modular, well-tested code following good engineering practices Design and implement reliable data workflows that scale with the business Work with SQL and relational databases to model, transform and query complex datasets Collaborate with product managers, analysts and other engineers to deliver data-driven features Contribute to CI/CD pipelines, automated testing and code reviews Improve system reliability, performance and maintainability through thoughtful design Learn and adopt new technologies, such as Databricks and Spark, as part of BCIS's evolving data platform Why this role is great Opportunity to transition into the high-growth data/AI space from a software engineering background Strong emphasis on engineering quality, not just tools or technologies Flexible working options - hybrid or office-based to suit your lifestyle. We would expect this person to be able to visit the Coventry office once a fortnight Supportive, inclusive environment that values curiosity, collaboration and learning Generous benefits including wellbeing day, private medical insurance, life insurance, enhanced pension and annual leave Real opportunity to shape industry-leading data products and make a visible impact Who we're looking for Comfortable writing production-quality Python code Familiar with OOP, functional programming, decorators, type hints and building reusable packages Confident with SQL: complex queries, joins, CTEs and database design (PostgreSQL ideal) Familiar with engineering best practices: Git, code reviews, automated testing (e.g. PyTest), CI/CD pipelines Experience deploying applications to cloud platforms (AWS, Azure or GCP - Azure preferred) Curious, collaborative and motivated to learn new data technologies Enthusiastic about creating maintainable, high-quality systems Nice to have (but not required) Experience with pandas, SQLAlchemy or Pydantic Familiarity with containerisation (Docker/Kubernetes) Understanding of distributed systems or data modelling concepts Why apply This is a fantastic opportunity to join the UK's leading independent provider of cost and carbon data across the built environment and to help engineer the next generation of BCIS data platforms. You'll work on meaningful, real-world data problems, apply strong software engineering principles, and grow your skills in modern data technologies - all within a supportive, flexible and inclusive team that values learning, curiosity and impact. If you're ready to grow, contribute and make a difference, we'd love to hear from you. Salary: GBP 40000 - 50000 per year
Senior Python Engineer
OHO Group
Senior Python Engineer - Data Platforms Leading FinTech Hybrid (London) Full-Time Competitive Salary + Bonus + Benefits Join a fast-growing FinTech helping global financial institutions unlock more value from complex data. Working with major banks, asset managers, and trading firms, the team is building modern platforms that power critical decisions at scale. You'll join a high-performing engineering group where strong technical talent is valued, ownership is encouraged, and engineers have real influence over the systems they build. What You'll Do Build scalable backend services in Python Develop data pipelines and platform integrations Improve performance across cloud-based infrastructure Work with product and engineering teams on core systems Help shape technical direction across data platforms Essential Qualifications Strong commercial experience with Python Excellent SQL and data engineering fundamentals Experience with Snowflake or Databricks, and cloud experience on AWS or Azure Strong understanding of scalable systems Clear communication and strong technical ownership Desirable qualifications Linux environments CI/CD and automation tooling Financial or high-volume data experience What's on Offer Competitive salary + bonus Private medical insurance 33 days holiday Hybrid working in London Learning budget + progression Global remote working flexibility Strong team culture and excellent perks If you enjoy solving complex data problems with modern cloud tools, this is a standout opportunity to join a respected FinTech at scale.
05/06/2026
Full time
Senior Python Engineer - Data Platforms Leading FinTech Hybrid (London) Full-Time Competitive Salary + Bonus + Benefits Join a fast-growing FinTech helping global financial institutions unlock more value from complex data. Working with major banks, asset managers, and trading firms, the team is building modern platforms that power critical decisions at scale. You'll join a high-performing engineering group where strong technical talent is valued, ownership is encouraged, and engineers have real influence over the systems they build. What You'll Do Build scalable backend services in Python Develop data pipelines and platform integrations Improve performance across cloud-based infrastructure Work with product and engineering teams on core systems Help shape technical direction across data platforms Essential Qualifications Strong commercial experience with Python Excellent SQL and data engineering fundamentals Experience with Snowflake or Databricks, and cloud experience on AWS or Azure Strong understanding of scalable systems Clear communication and strong technical ownership Desirable qualifications Linux environments CI/CD and automation tooling Financial or high-volume data experience What's on Offer Competitive salary + bonus Private medical insurance 33 days holiday Hybrid working in London Learning budget + progression Global remote working flexibility Strong team culture and excellent perks If you enjoy solving complex data problems with modern cloud tools, this is a standout opportunity to join a respected FinTech at scale.
Data/ Solution Architect
N Consulting Limited Northampton, Northamptonshire
LocationNorthampton, UK, United Kingdom# Data/ Solution Architect at N Consulting LtdLocationNorthampton, UK, United KingdomSalary£450 - £500 /dayJob TypeContractDate PostedApril 8th, 2026Apply Now Job title: Data/ Solution Architect- 2 roles ( 1- Sr Architect and 1- Architect) Location: Northampton, UK Job type: Contract- Hybrid 3 days onsite Required Skills Minimum 8+ years of experience working as Data Architect for AWS Cloud Dataware house Data Architecture & Engineering DeliverablesUnderstand Data Requirements & Authoritative Data Source Assessment: Engage early to capture business and technical data needs.Create and Maintain Architecture Artifacts:Data Flow Diagrams (DFD) and Logical/Physical Data Models for end-to-end lineage.Data Dictionary: Define entities, attributes, naming conventions, encryption/tokenization requirements, and traceability for compliance.Data Mapping Sheets: Document source-to-target mappings, lineage, and transformation logic for all critical flows.Data Privacy Impact Assessment (DPIA) for sensitive data projects.Update Architecture Vision and Security Components: Ensure alignment with AVD (Architecture Vision Delta) and security design decisions.Cloud & Platform ResponsibilitiesDesign and Implement Data Solutions:Design & Build scalable pipelines (Batch and real-time) using cloud-native tools/frameworks (DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).Apply architectural patterns for data lakes, streaming, and batch processing.Exposure to cloud technologies - Snowflake, Redshift, Apache Flink and Apache Kafka.Technical POCsTechnical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementsDesign, execute and lead POC's involving Cloud technologies to validate/support the assessment.Ensure Compliance with Data Standards:Apply Barclays Data Architecture Capability Directives and DACM patterns for governance and quality.Integrate Security and Privacy Controls:Tokenization, masking, and encryption for PII/PCI data across ingestion and storage layers.Governance & ApprovalsLiaise with Lead Architects Guild and Control Tribes:Present artifacts for review and sign-off in forums like TAC, EDP ARB, and Fraud Design Authority.Secure Mandatory Approvals:CAF1 (Non-Prod) and CAF2 (Prod) for environment readiness.CARA, DPIA and DARB for architecture compliance.Collaboration & Lifecycle SupportWork with Solution Architects and Engineering Teams:Assist in solution design, low-level design, and component build.Support SIT, OAT, and E2E testing phases for data integrity and performance.Service Transition & RTB Handover:Ensure smooth deployment and operational readiness for production environments.Continuous Improvement & StandardsDefine and Enhance Standards: Contribute to Data Dictionary and Data Mapping standards and aide-memoires for consistency.Participate in Architecture Working Groups: Drive adoption of reusable patterns, accelerators, and compliance frameworks.Works closely with CTO, CDO and other Solution Architects to deliver Fraud solutions at highest standards. Responsible for designing, sustaining & enhancing Fraud data architectureResponsible for hands-on design and implementation of integrated Fraud based data solutions that are scalable, built for rapid change and meets functional and non-functional requirementsAssist in planning, architecture, analysis, and design of applications and integrate with legacy systems
05/06/2026
Full time
LocationNorthampton, UK, United Kingdom# Data/ Solution Architect at N Consulting LtdLocationNorthampton, UK, United KingdomSalary£450 - £500 /dayJob TypeContractDate PostedApril 8th, 2026Apply Now Job title: Data/ Solution Architect- 2 roles ( 1- Sr Architect and 1- Architect) Location: Northampton, UK Job type: Contract- Hybrid 3 days onsite Required Skills Minimum 8+ years of experience working as Data Architect for AWS Cloud Dataware house Data Architecture & Engineering DeliverablesUnderstand Data Requirements & Authoritative Data Source Assessment: Engage early to capture business and technical data needs.Create and Maintain Architecture Artifacts:Data Flow Diagrams (DFD) and Logical/Physical Data Models for end-to-end lineage.Data Dictionary: Define entities, attributes, naming conventions, encryption/tokenization requirements, and traceability for compliance.Data Mapping Sheets: Document source-to-target mappings, lineage, and transformation logic for all critical flows.Data Privacy Impact Assessment (DPIA) for sensitive data projects.Update Architecture Vision and Security Components: Ensure alignment with AVD (Architecture Vision Delta) and security design decisions.Cloud & Platform ResponsibilitiesDesign and Implement Data Solutions:Design & Build scalable pipelines (Batch and real-time) using cloud-native tools/frameworks (DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).Apply architectural patterns for data lakes, streaming, and batch processing.Exposure to cloud technologies - Snowflake, Redshift, Apache Flink and Apache Kafka.Technical POCsTechnical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementsDesign, execute and lead POC's involving Cloud technologies to validate/support the assessment.Ensure Compliance with Data Standards:Apply Barclays Data Architecture Capability Directives and DACM patterns for governance and quality.Integrate Security and Privacy Controls:Tokenization, masking, and encryption for PII/PCI data across ingestion and storage layers.Governance & ApprovalsLiaise with Lead Architects Guild and Control Tribes:Present artifacts for review and sign-off in forums like TAC, EDP ARB, and Fraud Design Authority.Secure Mandatory Approvals:CAF1 (Non-Prod) and CAF2 (Prod) for environment readiness.CARA, DPIA and DARB for architecture compliance.Collaboration & Lifecycle SupportWork with Solution Architects and Engineering Teams:Assist in solution design, low-level design, and component build.Support SIT, OAT, and E2E testing phases for data integrity and performance.Service Transition & RTB Handover:Ensure smooth deployment and operational readiness for production environments.Continuous Improvement & StandardsDefine and Enhance Standards: Contribute to Data Dictionary and Data Mapping standards and aide-memoires for consistency.Participate in Architecture Working Groups: Drive adoption of reusable patterns, accelerators, and compliance frameworks.Works closely with CTO, CDO and other Solution Architects to deliver Fraud solutions at highest standards. Responsible for designing, sustaining & enhancing Fraud data architectureResponsible for hands-on design and implementation of integrated Fraud based data solutions that are scalable, built for rapid change and meets functional and non-functional requirementsAssist in planning, architecture, analysis, and design of applications and integrate with legacy systems
Accenture
Data Engineer - Newcastle
Accenture City, Newcastle Upon Tyne
Data Engineer Role: Data Engineer Location: Newcastle Upon Tyne Salary: TBC - Depending on experience Levels: Senior Analyst, Specialist Hybrid Working: 3 days per week in our Newcastle, Cobalt business park office Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more spent outside of the UK) and declaration of being a British or EU passport holder or hold Indefinite Leave to remain within the UK at the point of application. Role Overview As a Data Engineer, you will design, build, and maintain scalable data solutions that enable analytics, AI, and operational insights. You'll work alongside client and internal teams to create robust data pipelines, ensure data reliability, and support cloud based architectures that power intelligent decision making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real time streaming pipelines and event driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Kinesis, MSK, Lambda, Glue). Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns (e.g., medallion architecture). Ensure data quality, lineage, governance, and security controls are applied consistently. DevOps & Deployment Deploy and maintain data applications using CI/CD tooling (Azure DevOps, GitHub Actions, Jenkins). Use Infrastructure as Code (e.g., Terraform, CloudFormation) to manage cloud environments. Work with container technologies such as Docker and Kubernetes based workloads. Collaboration Work closely with analytics, ML/AI, and product teams to deliver clean, well structured datasets. Participate in code reviews and internal knowledge sharing sessions. Provide guidance to junior engineers where needed. Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms, ideally AWS, but Azure/GCP also acceptable. Understanding of distributed compute, large scale data systems, and performance considerations. DevOps & Engineering Practices Experience with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins etc.). Infrastructure as Code (Terraform preferred). Experience with containerisation (Docker) and orchestration platforms (Kubernetes/EKS). Certifications & Tools Exposure to enterprise data platforms (Databricks, Snowflake, BigQuery, or similar). Cloud certifications (AWS, Azure, GCP) are beneficial but not required. Other Requirements Minimum 3 years' experience working on data engineering or large scale data solutions. Comfortable working in Agile delivery teams. Strong communication skills and ability to collaborate with technical and non technical stakeholders. Desirable Experience in client facing or consulting environments. Professional cloud or data engineering certifications. Experience mentoring or supporting junior engineers. Background in designing or operating real time, low latency systems.
05/06/2026
Full time
Data Engineer Role: Data Engineer Location: Newcastle Upon Tyne Salary: TBC - Depending on experience Levels: Senior Analyst, Specialist Hybrid Working: 3 days per week in our Newcastle, Cobalt business park office Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more spent outside of the UK) and declaration of being a British or EU passport holder or hold Indefinite Leave to remain within the UK at the point of application. Role Overview As a Data Engineer, you will design, build, and maintain scalable data solutions that enable analytics, AI, and operational insights. You'll work alongside client and internal teams to create robust data pipelines, ensure data reliability, and support cloud based architectures that power intelligent decision making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real time streaming pipelines and event driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Kinesis, MSK, Lambda, Glue). Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns (e.g., medallion architecture). Ensure data quality, lineage, governance, and security controls are applied consistently. DevOps & Deployment Deploy and maintain data applications using CI/CD tooling (Azure DevOps, GitHub Actions, Jenkins). Use Infrastructure as Code (e.g., Terraform, CloudFormation) to manage cloud environments. Work with container technologies such as Docker and Kubernetes based workloads. Collaboration Work closely with analytics, ML/AI, and product teams to deliver clean, well structured datasets. Participate in code reviews and internal knowledge sharing sessions. Provide guidance to junior engineers where needed. Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms, ideally AWS, but Azure/GCP also acceptable. Understanding of distributed compute, large scale data systems, and performance considerations. DevOps & Engineering Practices Experience with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins etc.). Infrastructure as Code (Terraform preferred). Experience with containerisation (Docker) and orchestration platforms (Kubernetes/EKS). Certifications & Tools Exposure to enterprise data platforms (Databricks, Snowflake, BigQuery, or similar). Cloud certifications (AWS, Azure, GCP) are beneficial but not required. Other Requirements Minimum 3 years' experience working on data engineering or large scale data solutions. Comfortable working in Agile delivery teams. Strong communication skills and ability to collaborate with technical and non technical stakeholders. Desirable Experience in client facing or consulting environments. Professional cloud or data engineering certifications. Experience mentoring or supporting junior engineers. Background in designing or operating real time, low latency systems.
Data Engineer
HomeServe UK Walsall, Staffordshire
Overview We're looking for an experienced Data Engineer to join our growing data function and play a key role in designing, building and optimising scalable data solutions. The ideal candidate will bring strong experience working with Databricks, alongside Apache Spark and SQL, and be comfortable operating within Azure or another cloud environment. Experience with DevOps practices - such as CI/CD, infrastructure as code, or platform automation - would be a major advantage, though it's not essential. If you enjoy working with large datasets, modern data tooling, and solving complex engineering challenges in a collaborative environment, we'd love to hear from you. We work in a hybrid way, with a requirement to travel into our Walsall office 2-3 times a week to work with the team. The Business Intelligence and Data department is responsible for the provision of reporting from key business systems to other areas of the business as well as the integrity and maintenance of master data held on those systems, ensuring there is sufficient governance around the set-up processes and exception monitoring in place to identify potential issues. As a Data Engineer at HomeServe, you will play a key role in building and maintaining our data infrastructure and pipelines. You will work closely with data scientists, analysts, and other stakeholders to ensure that data is available, accessible, and ready for analysis. Principal Accountabilities Data Pipeline Development: Develop, and maintain data pipelines to ingest, transform, and load data from various sources into our data warehouse or data lake. Data Integration: Integrate and consolidate data from diverse sources, ensuring data quality, consistency, and reliability. ETL Processes: Build and optimise ETL (Extract, Transform, Load) processes to clean, transform, and enrich data for analysis. Performance Optimization: Review and resolve performance bottlenecks and issues within data pipelines and ETL processes. Data Security: Implement data security measures to protect sensitive information and ensure compliance with data privacy regulations. Monitoring and Maintenance: Implement monitoring and alerting solutions to identify and address data pipeline issues. Documentation: Maintain documentation for data pipelines, ETL processes, and best practices. Testing: Undertake testing activities on developed changes ahead of release About You To be successful in this role you will need to have the following knowledge, skills and attributes: Proven experience as a Data Engineer or similar role, with experience in Databricks and Apache Spark. Proficiency in programming languages such as Python and Scala. Good SQL and data modelling skills. Experience with big data technologies and distributed computing. Hands on experience with cloud platforms (e.g., AWS, Azure, or GCP). Have good relevant knowledge and awareness of market/industry trends Good team player, willing to collaborates with team members to deliver high-quality outputs under guidance Be able to work within established frameworks to implement solutions and troubleshoot issues Excellent stakeholder management skills and capable of managing expectations effectively. Databricks certification. Experience with building near real time streaming data products. Familiarity with DevOps practices and CI/CD pipelines is a plus. Benefits Competitive + £5500 Cash/Car Allowance + 10% Yearly Bonus
05/06/2026
Full time
Overview We're looking for an experienced Data Engineer to join our growing data function and play a key role in designing, building and optimising scalable data solutions. The ideal candidate will bring strong experience working with Databricks, alongside Apache Spark and SQL, and be comfortable operating within Azure or another cloud environment. Experience with DevOps practices - such as CI/CD, infrastructure as code, or platform automation - would be a major advantage, though it's not essential. If you enjoy working with large datasets, modern data tooling, and solving complex engineering challenges in a collaborative environment, we'd love to hear from you. We work in a hybrid way, with a requirement to travel into our Walsall office 2-3 times a week to work with the team. The Business Intelligence and Data department is responsible for the provision of reporting from key business systems to other areas of the business as well as the integrity and maintenance of master data held on those systems, ensuring there is sufficient governance around the set-up processes and exception monitoring in place to identify potential issues. As a Data Engineer at HomeServe, you will play a key role in building and maintaining our data infrastructure and pipelines. You will work closely with data scientists, analysts, and other stakeholders to ensure that data is available, accessible, and ready for analysis. Principal Accountabilities Data Pipeline Development: Develop, and maintain data pipelines to ingest, transform, and load data from various sources into our data warehouse or data lake. Data Integration: Integrate and consolidate data from diverse sources, ensuring data quality, consistency, and reliability. ETL Processes: Build and optimise ETL (Extract, Transform, Load) processes to clean, transform, and enrich data for analysis. Performance Optimization: Review and resolve performance bottlenecks and issues within data pipelines and ETL processes. Data Security: Implement data security measures to protect sensitive information and ensure compliance with data privacy regulations. Monitoring and Maintenance: Implement monitoring and alerting solutions to identify and address data pipeline issues. Documentation: Maintain documentation for data pipelines, ETL processes, and best practices. Testing: Undertake testing activities on developed changes ahead of release About You To be successful in this role you will need to have the following knowledge, skills and attributes: Proven experience as a Data Engineer or similar role, with experience in Databricks and Apache Spark. Proficiency in programming languages such as Python and Scala. Good SQL and data modelling skills. Experience with big data technologies and distributed computing. Hands on experience with cloud platforms (e.g., AWS, Azure, or GCP). Have good relevant knowledge and awareness of market/industry trends Good team player, willing to collaborates with team members to deliver high-quality outputs under guidance Be able to work within established frameworks to implement solutions and troubleshoot issues Excellent stakeholder management skills and capable of managing expectations effectively. Databricks certification. Experience with building near real time streaming data products. Familiarity with DevOps practices and CI/CD pipelines is a plus. Benefits Competitive + £5500 Cash/Car Allowance + 10% Yearly Bonus
Senior Data Engineer (Databricks) - UK
DATAPAO
We are currently looking for aSenior Data Engineer to join us remotely in the UK as we plan to set up a hub in the UK in the following 6-12 months to enable our GTM strategy. You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles. "As a Data Engineer at DATAPAO, you will have the unique opportunity to push the boundaries of technology and lead the way in how data transforms the world. We work with customers who want to innovate and change their industries. So it never gets boring! Sorting out a complex technical puzzle, setting up a new data architecture from scratch, or guiding our customers through adopting the latest technologies is our routine here. Hence, we'd expect you to be more than just a (data) engineer. We'd expect you to breathe and live data, to thrive for knowledge and excellence, and to be keen to build something enduring and impactful for our customers. We'd expect you to be a (data) Paoneer!" (Máté Gulyás, CEO) What will you do? As a Senior Data Engineer, you are expected to deliver (across industries) on some of our most complex projects - individually or by leading small delivery teams. Although we work for the biggest multinational companies where years-long behemoth projects are the norm, our projects are fast-paced, typically 2 to 4 months long. Most are delivered using Apache Spark/Databricks on AWS/Azure and require you to directly manage the customer relationship alone or in collaboration with a Project Manager. Additionally, at this seniority level, we expect you to compound your impact across the team and the organization - by supporting our pre-sales process, mentoring more junior engineers, and contributing to hiring best-in-class data talent. What does it take to fit the bill? Technical Expertise You (ideally) have 5+ years of experience in Data Engineering, with a focus on cloud platforms (AWS, Azure, GCP); You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog); You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.); You're proficient in SQL and Python, using them to transform and optimize data like a pro; You know your way around CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep); You've hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker). Consulting & Client-Facing Skills Ideally, you bring a proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders. If you bring a product company background with you, that's also fine as long as you can show a good consulting mindset and desire to be customer-facing; You've successfully delivered projects like Data Lakehouse buildouts and cloud data migrations; You excel in explaining technical concepts to non-technical audiences and drive decision-making. Operational Readiness & Soft Skills You're (almost) ready to hit the ground running, immediately contributing to live client projects; In a fast-paced consulting environment, where no two days are the same, flexibility and problem-solving comes naturally to you. Furthermore, resilience and thriving on challenges are essential traits in our industry; Your communication skills are on point-whether you're writing, speaking, or collaborating with stakeholders, you know how to keep everyone in the loop. What do we offer? You'll have the rare opportunity to join DATAPAO at a time when you can still meaningfully impact our growth trajectory and organizational success. Furthermore, you'll also get to spearhead our regional expansion. Surely, we know everyone needs a little something to do their best work. Here is a list of some other extras we offer: The chance to work remotely - as we don't have a physical office in the UK yet, we offer a fully remote setup for the time being. However, given our strong community emphasis, we'd expect you to spend one month in our Budapest hub during onboarding and visit the office for one week every quarter; World-class educational benefits - there's no shortage of learning opportunities at DATAPAO, meaning that you'll get access to Databricks' public and internal courses to learn all the tricks of Distributed Data Processing, MLOps, Apache Spark, Databricks, and Cloud Migration from the best. Additionally, we'll pay for various data & cloud certifications, you'll get dedicated time for learning during work hours, and access to our internal library; Flexible PTO days - we're flexible with how many days you take off if that does not conflict with customer success and the work getting done; 4 weeks of paternity leave - because we think it's important for both parents to be there when it matters the most; Employee Assistance Program (EAP) - life always happens! And we'd like to be there for you when it counts the most. Through EAP, we offer our employees access to psychology, financial, and legal consulting services via phone or in person; Pension scheme enrollment and a comprehensive private health insurance plan - offered via our EOR (Employer of Record) provider, Remote will be your official employer in the UK for the foreseeable future until we establish our own legal entity in the UK; Top-notch working equipment - working comfortably means working well. You will get a MacBook Pro, a phone, and a sign-up bonus of 500 GBP gross (to be paid with your first payroll) to set up your home office or whatever else is needed to give your best; The chance to make an impact in a high-transparency culture - open feedback and no politics are things we value a lot at DATAPAO. Additionally, you'll get the chance to work in the field of data & AI and shape the future of a rapidly growing tech company. IMPORTANT NOTE: Given that we are still sorting our ways out in the UK, this list will likely get an update in the following months, and we're also committed to growing it with us over time. The gross salary for this position ranges from 70.000 to 100.000 GBP/year, depending on your assessed seniority level during the selection process. Please note that currently we are unable to support transfer or offer full sponsorship for Skilled Worker visas as we're just setting foot into the UK. Want to know more about us? DATAPAO is a data engineering and AI company that covers the entire data transformation from architecture to implementation. Beyond delivering solutions, we also provide data and AI training and enablement. We are backed by Databricks - the creators of Apache Spark, and act as a delivery partner and training provider for them in Europe. Additionally, we are Microsoft Gold Partners in delivering cloud migration and data architecture on Azure. Our delivery partnerships enable us to work in a wide range of industries and with some of the most prominent global companies, such as Norsk-Hydro, Richter, Bayer, Schufa, GetYourGuide, TechnoAlpin, and Logically, to name just a few. As a training provider, we deliver onsite and online courses globally for Databricks and on our own. We have been teaching professionals at Apple, Amazon, Uber, Microsoft, T-Mobile, GE, Ericsson, and many more to improve their impact with data. For even more insights, check the links below: You can also follow us on LinkedIn for all the good stuff or just hit our recruitment team at We're firm believers in scaling up a team without judgment or prejudice. What we really care about is working with the best people out there, no matter their background. And you should also not worry if you don't tick every box in the requirements. If you're passionate about data and learning new things, you'll fit right in, and we'd love to hear back from you. When we hear back from you, we'd like you to know that we are committed to your privacy and keeping your data safe. We do not share your data with any third parties (except the ones we use to run our recruitment process) and keep your application for two years unless you ask us otherwise. We use your data solely for recruitment purposes, such as letting you know about new career opportunities at DATAPAO and/or managing your application. But if you want to know more about how we store and manage your data, check our privacy policy . Create a Job Alert Interested in building your career at DATAPAO? Get future opportunities sent straight to your email. Accepted file types: pdf, doc, docx, txt, rtf Enter manually Accepted file types: pdf, doc, docx, txt, rtf LinkedIn profile Website/GitHub How did you hear about DATAPAO? Select How did you hear about this specific job? Select Why are the role and DATAPAO of interest to you? What best describes your legal work status in the United Kingdom? Select What is your desired compensation package? By checking this box, I agree to allow DATAPAO to store and process my data for the purpose of considering my eligibility regarding my current application for employment. By checking this box . click apply for full job details
05/06/2026
Full time
We are currently looking for aSenior Data Engineer to join us remotely in the UK as we plan to set up a hub in the UK in the following 6-12 months to enable our GTM strategy. You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles. "As a Data Engineer at DATAPAO, you will have the unique opportunity to push the boundaries of technology and lead the way in how data transforms the world. We work with customers who want to innovate and change their industries. So it never gets boring! Sorting out a complex technical puzzle, setting up a new data architecture from scratch, or guiding our customers through adopting the latest technologies is our routine here. Hence, we'd expect you to be more than just a (data) engineer. We'd expect you to breathe and live data, to thrive for knowledge and excellence, and to be keen to build something enduring and impactful for our customers. We'd expect you to be a (data) Paoneer!" (Máté Gulyás, CEO) What will you do? As a Senior Data Engineer, you are expected to deliver (across industries) on some of our most complex projects - individually or by leading small delivery teams. Although we work for the biggest multinational companies where years-long behemoth projects are the norm, our projects are fast-paced, typically 2 to 4 months long. Most are delivered using Apache Spark/Databricks on AWS/Azure and require you to directly manage the customer relationship alone or in collaboration with a Project Manager. Additionally, at this seniority level, we expect you to compound your impact across the team and the organization - by supporting our pre-sales process, mentoring more junior engineers, and contributing to hiring best-in-class data talent. What does it take to fit the bill? Technical Expertise You (ideally) have 5+ years of experience in Data Engineering, with a focus on cloud platforms (AWS, Azure, GCP); You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog); You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.); You're proficient in SQL and Python, using them to transform and optimize data like a pro; You know your way around CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep); You've hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker). Consulting & Client-Facing Skills Ideally, you bring a proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders. If you bring a product company background with you, that's also fine as long as you can show a good consulting mindset and desire to be customer-facing; You've successfully delivered projects like Data Lakehouse buildouts and cloud data migrations; You excel in explaining technical concepts to non-technical audiences and drive decision-making. Operational Readiness & Soft Skills You're (almost) ready to hit the ground running, immediately contributing to live client projects; In a fast-paced consulting environment, where no two days are the same, flexibility and problem-solving comes naturally to you. Furthermore, resilience and thriving on challenges are essential traits in our industry; Your communication skills are on point-whether you're writing, speaking, or collaborating with stakeholders, you know how to keep everyone in the loop. What do we offer? You'll have the rare opportunity to join DATAPAO at a time when you can still meaningfully impact our growth trajectory and organizational success. Furthermore, you'll also get to spearhead our regional expansion. Surely, we know everyone needs a little something to do their best work. Here is a list of some other extras we offer: The chance to work remotely - as we don't have a physical office in the UK yet, we offer a fully remote setup for the time being. However, given our strong community emphasis, we'd expect you to spend one month in our Budapest hub during onboarding and visit the office for one week every quarter; World-class educational benefits - there's no shortage of learning opportunities at DATAPAO, meaning that you'll get access to Databricks' public and internal courses to learn all the tricks of Distributed Data Processing, MLOps, Apache Spark, Databricks, and Cloud Migration from the best. Additionally, we'll pay for various data & cloud certifications, you'll get dedicated time for learning during work hours, and access to our internal library; Flexible PTO days - we're flexible with how many days you take off if that does not conflict with customer success and the work getting done; 4 weeks of paternity leave - because we think it's important for both parents to be there when it matters the most; Employee Assistance Program (EAP) - life always happens! And we'd like to be there for you when it counts the most. Through EAP, we offer our employees access to psychology, financial, and legal consulting services via phone or in person; Pension scheme enrollment and a comprehensive private health insurance plan - offered via our EOR (Employer of Record) provider, Remote will be your official employer in the UK for the foreseeable future until we establish our own legal entity in the UK; Top-notch working equipment - working comfortably means working well. You will get a MacBook Pro, a phone, and a sign-up bonus of 500 GBP gross (to be paid with your first payroll) to set up your home office or whatever else is needed to give your best; The chance to make an impact in a high-transparency culture - open feedback and no politics are things we value a lot at DATAPAO. Additionally, you'll get the chance to work in the field of data & AI and shape the future of a rapidly growing tech company. IMPORTANT NOTE: Given that we are still sorting our ways out in the UK, this list will likely get an update in the following months, and we're also committed to growing it with us over time. The gross salary for this position ranges from 70.000 to 100.000 GBP/year, depending on your assessed seniority level during the selection process. Please note that currently we are unable to support transfer or offer full sponsorship for Skilled Worker visas as we're just setting foot into the UK. Want to know more about us? DATAPAO is a data engineering and AI company that covers the entire data transformation from architecture to implementation. Beyond delivering solutions, we also provide data and AI training and enablement. We are backed by Databricks - the creators of Apache Spark, and act as a delivery partner and training provider for them in Europe. Additionally, we are Microsoft Gold Partners in delivering cloud migration and data architecture on Azure. Our delivery partnerships enable us to work in a wide range of industries and with some of the most prominent global companies, such as Norsk-Hydro, Richter, Bayer, Schufa, GetYourGuide, TechnoAlpin, and Logically, to name just a few. As a training provider, we deliver onsite and online courses globally for Databricks and on our own. We have been teaching professionals at Apple, Amazon, Uber, Microsoft, T-Mobile, GE, Ericsson, and many more to improve their impact with data. For even more insights, check the links below: You can also follow us on LinkedIn for all the good stuff or just hit our recruitment team at We're firm believers in scaling up a team without judgment or prejudice. What we really care about is working with the best people out there, no matter their background. And you should also not worry if you don't tick every box in the requirements. If you're passionate about data and learning new things, you'll fit right in, and we'd love to hear back from you. When we hear back from you, we'd like you to know that we are committed to your privacy and keeping your data safe. We do not share your data with any third parties (except the ones we use to run our recruitment process) and keep your application for two years unless you ask us otherwise. We use your data solely for recruitment purposes, such as letting you know about new career opportunities at DATAPAO and/or managing your application. But if you want to know more about how we store and manage your data, check our privacy policy . Create a Job Alert Interested in building your career at DATAPAO? Get future opportunities sent straight to your email. Accepted file types: pdf, doc, docx, txt, rtf Enter manually Accepted file types: pdf, doc, docx, txt, rtf LinkedIn profile Website/GitHub How did you hear about DATAPAO? Select How did you hear about this specific job? Select Why are the role and DATAPAO of interest to you? What best describes your legal work status in the United Kingdom? Select What is your desired compensation package? By checking this box, I agree to allow DATAPAO to store and process my data for the purpose of considering my eligibility regarding my current application for employment. By checking this box . click apply for full job details
Senior Data Engineer
Wrisk Limited Edinburgh, Midlothian
As a Senior Data Engineer with Atto, you will be part of our Data Science & Engineering team, helping our customers use transactional intelligence to drive smarter financial decisions and build impactful products. You'll play a key role in designing and delivering scalable, production-ready analytical solutions that turn complex data into meaningful insights. You will own and improve the systems that ingest, transform, and serve large-scale transactional data sets. You will be responsible for designing resilient data pipelines, implementing robust data models, deploying real-time and batch processing systems, and introducing observability, testing and automation to keep our data trustworthy at scale. You will work closely with the data science and product teams to understand customer needs and the direction of internal strategy, producing measurable data engineering outcomes. We're looking for someone who's passionate about technology, curious about data infrastructure, and excited to solve real problems. You'll need a strong foundation in data engineering, a creative mindset, and the ability to communicate clearly with both technical and non-technical stakeholders. You'll be supported with training and development opportunities to deepen your expertise and stay ahead of industry trends. Responsibilities Design, build, and operate data ingestion and ETL/ELT pipelines for our data systems that power Atto products and customer-facing applications. Build and maintain our data platform architecture and infrastructure, including data pipelines, warehouses that power analytics and product features and reporting. Implement data modelling, schema design, and data contracts to make datasets easy to consume. Introduce and maintain observability, data quality checks, and automated testing for our production data flows. Driving impact at scale by improving data workflows, service reliability, and making Atto's capabilities faster, more reliable and widely accessible. Collaborate with product managers and cross-functional teams to translate market signals and customers' needs into innovative data-driven solutions. Create new systems and approaches, while continuously improving and scaling existing ones for performance, reliability, and efficiency. Conduct deep analysis of transactional datasets to validate data models, surface data quality issues, and propose engineering fixes. Optimise performance and cost of data processing and storage across cloud services. Communicate technical findings and recommendations clearly to both technical and non-technical stakeholders across the business. Stay current with industry developments, emerging technologies, and best practices in data engineering. Qualifications A Bachelor's degree in Computer Science, Data/Software Engineering, or a related discipline. 5+ years of hands-on experience in data engineering with a proven track record of delivering scalable, production-grade data platforms and data models. Strong SQL skills and proven experience designing, building and optimising data pipelines and data warehouse schemas. Strong proficiency in Python for production data engineering with a focus on building maintainable, testable and clean code. Track record of implementing data quality, observability, monitoring and testing practices. Solid experience with at least one cloud provider (Azure, AWS or GCP), and their managed data services. Experience with CI/CD, infrastructure-as-code and working in containerised environments. Familiarity with modern data stack tools: Databricks, Snowflake or RedShift, etc. Experience working with reporting and modelling tools such as Power BI, including designing performant data models and supporting self-serve analytics. Advanced experience in pattern recognition with the ability to translate complex data into actionable insights. A results-oriented mindset, able to take concepts from ideation through to tangible outputs. Comfortable working in a fast-paced, delivery-focused environment, balancing multiple priorities with agility. A proactive and collaborative approach, with a willingness to iterate, share knowledge, and challenge assumptions constructively Bonus Points (We're getting greedy) Experience building or scaling data platforms in large-scale, regulated data environments. Experience with DevOps for data, platform engineering, or building large data pipelines and real-time data streaming systems. Exposure to working in a high-growth, evolving environment where the customer is at the heart of product and engineering decisions A team of passionate, interesting people committed to your development and success £70-£80k gross/pension Personal training and Continuous Professional Development budget (CPD) Uncapped bike to work scheme Half-day Fridays every last week of the month to recharge Wellness partnerships In-person and virtual team events and workshops Volunteering (Social Good Connect partnership) 33 days holiday allowance to take when you want £200 home working contribution to make sure you have everything you need to do your best work (get comfy - we want you to stay) Ask us about our remote-first, flexible culture - this is core to who we are, and we're rated one of Scotland's most flexible employers Creating a more predictable future for lenders We are on a mission to enable our customers across the globe to effortlessly make use of real-time transaction data to better understand their customers, grow their business, revolutionise their offerings and delight with customer service. At Atto, you will be working for a business that is creating a more predictable future for lenders through our real-time transaction data platform. We use today's data to better predict tomorrow. This is an exciting stage in our growth, and we'd love you to be part of the story. Don't speculate. Calculate.
05/06/2026
Full time
As a Senior Data Engineer with Atto, you will be part of our Data Science & Engineering team, helping our customers use transactional intelligence to drive smarter financial decisions and build impactful products. You'll play a key role in designing and delivering scalable, production-ready analytical solutions that turn complex data into meaningful insights. You will own and improve the systems that ingest, transform, and serve large-scale transactional data sets. You will be responsible for designing resilient data pipelines, implementing robust data models, deploying real-time and batch processing systems, and introducing observability, testing and automation to keep our data trustworthy at scale. You will work closely with the data science and product teams to understand customer needs and the direction of internal strategy, producing measurable data engineering outcomes. We're looking for someone who's passionate about technology, curious about data infrastructure, and excited to solve real problems. You'll need a strong foundation in data engineering, a creative mindset, and the ability to communicate clearly with both technical and non-technical stakeholders. You'll be supported with training and development opportunities to deepen your expertise and stay ahead of industry trends. Responsibilities Design, build, and operate data ingestion and ETL/ELT pipelines for our data systems that power Atto products and customer-facing applications. Build and maintain our data platform architecture and infrastructure, including data pipelines, warehouses that power analytics and product features and reporting. Implement data modelling, schema design, and data contracts to make datasets easy to consume. Introduce and maintain observability, data quality checks, and automated testing for our production data flows. Driving impact at scale by improving data workflows, service reliability, and making Atto's capabilities faster, more reliable and widely accessible. Collaborate with product managers and cross-functional teams to translate market signals and customers' needs into innovative data-driven solutions. Create new systems and approaches, while continuously improving and scaling existing ones for performance, reliability, and efficiency. Conduct deep analysis of transactional datasets to validate data models, surface data quality issues, and propose engineering fixes. Optimise performance and cost of data processing and storage across cloud services. Communicate technical findings and recommendations clearly to both technical and non-technical stakeholders across the business. Stay current with industry developments, emerging technologies, and best practices in data engineering. Qualifications A Bachelor's degree in Computer Science, Data/Software Engineering, or a related discipline. 5+ years of hands-on experience in data engineering with a proven track record of delivering scalable, production-grade data platforms and data models. Strong SQL skills and proven experience designing, building and optimising data pipelines and data warehouse schemas. Strong proficiency in Python for production data engineering with a focus on building maintainable, testable and clean code. Track record of implementing data quality, observability, monitoring and testing practices. Solid experience with at least one cloud provider (Azure, AWS or GCP), and their managed data services. Experience with CI/CD, infrastructure-as-code and working in containerised environments. Familiarity with modern data stack tools: Databricks, Snowflake or RedShift, etc. Experience working with reporting and modelling tools such as Power BI, including designing performant data models and supporting self-serve analytics. Advanced experience in pattern recognition with the ability to translate complex data into actionable insights. A results-oriented mindset, able to take concepts from ideation through to tangible outputs. Comfortable working in a fast-paced, delivery-focused environment, balancing multiple priorities with agility. A proactive and collaborative approach, with a willingness to iterate, share knowledge, and challenge assumptions constructively Bonus Points (We're getting greedy) Experience building or scaling data platforms in large-scale, regulated data environments. Experience with DevOps for data, platform engineering, or building large data pipelines and real-time data streaming systems. Exposure to working in a high-growth, evolving environment where the customer is at the heart of product and engineering decisions A team of passionate, interesting people committed to your development and success £70-£80k gross/pension Personal training and Continuous Professional Development budget (CPD) Uncapped bike to work scheme Half-day Fridays every last week of the month to recharge Wellness partnerships In-person and virtual team events and workshops Volunteering (Social Good Connect partnership) 33 days holiday allowance to take when you want £200 home working contribution to make sure you have everything you need to do your best work (get comfy - we want you to stay) Ask us about our remote-first, flexible culture - this is core to who we are, and we're rated one of Scotland's most flexible employers Creating a more predictable future for lenders We are on a mission to enable our customers across the globe to effortlessly make use of real-time transaction data to better understand their customers, grow their business, revolutionise their offerings and delight with customer service. At Atto, you will be working for a business that is creating a more predictable future for lenders through our real-time transaction data platform. We use today's data to better predict tomorrow. This is an exciting stage in our growth, and we'd love you to be part of the story. Don't speculate. Calculate.
The Portfolio Group
Senior AI Engineer
The Portfolio Group
We are partnering with an established organisation currently investing significantly in its AI and generative search capabilities. They are looking to appoint a Senior AI Engineer to play a key role in designing and delivering production-grade AI systems focused on accuracy, scalability, and real-world impact. This position sits within a growing AI function and will focus heavily on Retrieval-Augmented Generation (RAG), agentic workflows, evaluation frameworks, and LLM optimisation. Key Responsibilities: Design and develop scalable RAG pipelines and generative AI workflows Build solutions using LangChain, LangGraph, and LlamaIndex Implement retrieval strategies including reranking, chunking, and retrieval fusion Develop agentic workflows with a focus on robustness and maintainability Contribute to experimentation, evaluation, and AI quality frameworks Support fine-tuning, instruction tuning, and model optimisation initiatives Mentor junior engineers and contribute to technical best practices Key Requirements: Strong Python engineering experience Commercial experience building production-grade AI/ML systems Hands-on experience with RAG architectures and LLM workflows Experience with LangChain, LangGraph, and/or Llama Index Understanding of evaluation methodologies for generative AI Experience working within scalable cloud environments (AWS preferred) Ability to operate in a senior or technical leadership capacity Desirable: Graph-RAG experience Databricks exposure Experience deploying customer-facing AI systems This is an excellent opportunity to join a forward-thinking organisation where AI is a genuine strategic priority and engineering quality is highly valued. 51752MS INDLON The Portfolio Group are acting on behalf of our client in recruiting for this position.
04/06/2026
Full time
We are partnering with an established organisation currently investing significantly in its AI and generative search capabilities. They are looking to appoint a Senior AI Engineer to play a key role in designing and delivering production-grade AI systems focused on accuracy, scalability, and real-world impact. This position sits within a growing AI function and will focus heavily on Retrieval-Augmented Generation (RAG), agentic workflows, evaluation frameworks, and LLM optimisation. Key Responsibilities: Design and develop scalable RAG pipelines and generative AI workflows Build solutions using LangChain, LangGraph, and LlamaIndex Implement retrieval strategies including reranking, chunking, and retrieval fusion Develop agentic workflows with a focus on robustness and maintainability Contribute to experimentation, evaluation, and AI quality frameworks Support fine-tuning, instruction tuning, and model optimisation initiatives Mentor junior engineers and contribute to technical best practices Key Requirements: Strong Python engineering experience Commercial experience building production-grade AI/ML systems Hands-on experience with RAG architectures and LLM workflows Experience with LangChain, LangGraph, and/or Llama Index Understanding of evaluation methodologies for generative AI Experience working within scalable cloud environments (AWS preferred) Ability to operate in a senior or technical leadership capacity Desirable: Graph-RAG experience Databricks exposure Experience deploying customer-facing AI systems This is an excellent opportunity to join a forward-thinking organisation where AI is a genuine strategic priority and engineering quality is highly valued. 51752MS INDLON The Portfolio Group are acting on behalf of our client in recruiting for this position.
Software Engineer
Cirata City, Belfast
Software Engineer Cirata Symphony Engineering Team 2+ years experience Full-time Hybrid (3 days office based) Seniority: Engineer Languages: Java or Go Experience: 2+ years About the Role Cirata Symphony is an intelligent data orchestration platform that moves petabytes of data across on premises, cloud, and multi cloud environments - continuously, securely, and without disruption. We work with regulated enterprises in financial services, telecoms, and automotive who cannot afford downtime or data loss. As an Engineer on the Symphony team, you will contribute to the core services that power real time data movement, replication, and orchestration. You will work alongside experienced engineers building reliable, high throughput systems that customers trust with their most critical data. We are an AI forward team. We actively embrace AI assisted development - from coding assistants and AI powered code review to MCP connected tooling that integrates directly into customer workflows. We don't block these tools; we build with them. If you're curious about how AI can make you a more effective engineer, you'll fit right in. What You'll Work On Backend services in Java and Go that orchestrate live data flows across HDFS, S3, ADLS, GCS, Apache Iceberg, Databricks, and Snowflake Replication and synchronisation pipelines that handle petabyte scale volumes with low latency Governance and audit subsystems ensuring compliance grade security, lineage tracking, and access controls Internal tooling and automation that improves reliability, observability, and developer experience Unit, integration, and performance tests to maintain confidence in a zero downtime product MCP/AI workflows that unlock customer data Requirements 2+ years of professional experience writing production Java, Go, or both Solid understanding of concurrent programming and OOP principles Experience designing or consuming REST APIs and understanding HTTP semantics Comfortable working with Git, code reviews, and CI/CD workflows Strong communication skills Experience working in Linux environments Comfortable using AI coding assistants (GitHub Copilot, Claude, Cursor, or similar) as part of your day to day workflow Nice to Have Experience with Apache Hadoop, HDFS, or similar large scale data platforms Familiarity with at least one cloud storage platform (AWS S3, Azure ADLS, or Google Cloud Storage) Familiarity with Apache Iceberg, Delta Lake, or open table formats Exposure to Apache Kafka or other message streaming systems Knowledge of Kubernetes, Docker, or container orchestration Experience building or integrating MCP (Model Context Protocol) servers or AI tool use pipelines What We Offer The chance to work on genuine enterprise scale systems Mentorship from experienced engineers Flexible hybrid working with a collaborative, low ego engineering culture Access to the latest AI developer tooling - we invest in tools that make engineers more effective Competitive salary and benefits package
04/06/2026
Full time
Software Engineer Cirata Symphony Engineering Team 2+ years experience Full-time Hybrid (3 days office based) Seniority: Engineer Languages: Java or Go Experience: 2+ years About the Role Cirata Symphony is an intelligent data orchestration platform that moves petabytes of data across on premises, cloud, and multi cloud environments - continuously, securely, and without disruption. We work with regulated enterprises in financial services, telecoms, and automotive who cannot afford downtime or data loss. As an Engineer on the Symphony team, you will contribute to the core services that power real time data movement, replication, and orchestration. You will work alongside experienced engineers building reliable, high throughput systems that customers trust with their most critical data. We are an AI forward team. We actively embrace AI assisted development - from coding assistants and AI powered code review to MCP connected tooling that integrates directly into customer workflows. We don't block these tools; we build with them. If you're curious about how AI can make you a more effective engineer, you'll fit right in. What You'll Work On Backend services in Java and Go that orchestrate live data flows across HDFS, S3, ADLS, GCS, Apache Iceberg, Databricks, and Snowflake Replication and synchronisation pipelines that handle petabyte scale volumes with low latency Governance and audit subsystems ensuring compliance grade security, lineage tracking, and access controls Internal tooling and automation that improves reliability, observability, and developer experience Unit, integration, and performance tests to maintain confidence in a zero downtime product MCP/AI workflows that unlock customer data Requirements 2+ years of professional experience writing production Java, Go, or both Solid understanding of concurrent programming and OOP principles Experience designing or consuming REST APIs and understanding HTTP semantics Comfortable working with Git, code reviews, and CI/CD workflows Strong communication skills Experience working in Linux environments Comfortable using AI coding assistants (GitHub Copilot, Claude, Cursor, or similar) as part of your day to day workflow Nice to Have Experience with Apache Hadoop, HDFS, or similar large scale data platforms Familiarity with at least one cloud storage platform (AWS S3, Azure ADLS, or Google Cloud Storage) Familiarity with Apache Iceberg, Delta Lake, or open table formats Exposure to Apache Kafka or other message streaming systems Knowledge of Kubernetes, Docker, or container orchestration Experience building or integrating MCP (Model Context Protocol) servers or AI tool use pipelines What We Offer The chance to work on genuine enterprise scale systems Mentorship from experienced engineers Flexible hybrid working with a collaborative, low ego engineering culture Access to the latest AI developer tooling - we invest in tools that make engineers more effective Competitive salary and benefits package
Principal Data and AI Architect
428 Salesforce UK Limited
Overview of the Role As an AI and Data Technical Architect, you will act as a senior, hands on technical leader and trusted advisor to our customers. You will be responsible for designing, validating, and operationalizing enterprise grade data and AI architectures centered on Salesforce D360 and the Agentforce platform. This role sits at the intersection of data engineering, platform architecture, and applied AI, requiring you to guide customer Chief Data Officers and Enterprise Architects through emerging AI solutions. You will work side by side with Account Executives and Product teams to ensure customers realize the full value of the platform by designing scalable, secure solutions that integrate D360 into complex enterprise ecosystems-including hyperscalers, data lakes, and governance frameworks. Responsibilities Lead pre sales technical design by analyzing customer needs and recommending solutions aligned with Agentforce capabilities and integration with external agent frameworks. Shape best practices around generative AI, agent interoperability, prompt engineering, Data Cloud, and cross platform integrations. Collaborate with AEs and SEs to build hands on prototypes and demos using Agentforce and integrated external agents. Develop thought leadership content-demo templates, whitepapers, enablement sessions-focused on agent lifecycle, integration strategy, and technical effectiveness. Act as a central technical knowledge resource, proactively addressing internal technical inquiries and facilitating deep technical enablement. Understand Agent Interoperability-map and integrate external agents from hyperscalers (e.g., Copilot, Gemini) into Agentforce via open standards (MCP, A2A); design how these systems collaborate. Enable Conversational & Background Agents-use Agentforce Studio and Agent Builder to configure chat and background agents; integrate with external channels including voice via hyperscaler APIs. Drive Prompt Engineering & Lifecycle Strategy-lead prompt design, testing, monitoring, and iteration; define agent lifecycle best practices from development through refinement. Build Hands On Demos & Prototypes-co create quick prototypes ( Lead Pre Sales Workshops-facilitate whiteboarding, deep dive sessions, and quick enablement for customers and internal teams. Advise on Data & Integration-integrate Data Cloud (D360), CRM, MuleSoft APIs, and external agent endpoints ensuring cohesive architectures that align with compliance and governance policies. Support Early Adoption-occasionally assist in proof of value engagements post sale by tuning agents and guiding customers toward self sufficient enablement. Own Technical Architecture Decisions-oversee data modeling, identity resolution, real time vs. batch patterns, data graph design, and activation strategies within D360. Own Technical Enablement-create and manage accessible technical documentation, knowledge bases, and FAQ resources to rapidly resolve internal technical inquiries, empowering specialist teams. Required Qualifications Technical Pre Sales/Consulting - 7+ years of hands on experience designing and delivering data, analytics, and AI architectures in enterprise environments. Salesforce Expertise - Hands on experience with Salesforce Agentforce and deep fluency with D360 and core Salesforce platform services. External Ecosystem Knowledge - Strong understanding of external agent ecosystems and interoperability. Proven Track Record - Experience in prompt engineering, agent lifecycle management, and hands on prototype development. AI & ML Expertise - Experience with machine learning concepts (predictive and generative AI), plus the ability to communicate value to diverse audiences. Data Stack Knowledge - Deep expertise in modern cloud data platforms (Snowflake, Databricks, BigQuery, Redshift) and data ingestion patterns (batch, streaming, CDC). Hands On Development - Proficiency in programming (e.g., JavaScript, Python, SQL, R) and data frameworks like pandas or Jupyter. Excellent Communication - Strong presentation skills; adept at explaining complex ideas and guiding stakeholders toward impactful solutions. Curiosity & Continuous Learning - Passion for exploring new AI frameworks, sharing insights, and experimenting with cutting edge technologies. Education - BS in Computer Science, Engineering, Data Science, or equivalent technical field. Preferred Qualifications Advanced Integration - Experience integrating Salesforce with external agents via APIs and open standards (MCP, A2A). Governance & Observability - Familiarity with prompt governance, observability, and monitoring frameworks. Cross Platform Background - Background in cross platform integrations (e.g., Hyperscaler SDKs to Salesforce Flows). Multimodal Pipelines - Prior exposure to conversational voice pipelines or multimodal integrations via hyperscaler services. Advanced AI/ML Frameworks - Exposure to frameworks (TensorFlow, PyTorch), MLOps practices, and cloud AI platforms like Google Vertex AI or AWS SageMaker. Education - BS in Computer Science, Engineering, Data Science, or equivalent technical field. Benefits Unleash Your Potential. When you join Salesforce, you'll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we'll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Accommodations If you need a reasonable accommodation during the application or the recruiting process, please submit a request via this Accommodations Request Form. Please note that Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and evaluate candidates' resumes and qualifications throughout the recruiting process. Humans will always make any candidate selection and hiring decisions. Please see our Candidate Privacy Statement for more information about how we use your personal data and your rights, including with regard to use of AI tools and opt out options. We are a recognised Disability Confident member under the UK Government Disability Confident employer scheme. We are committed to providing an inclusive recruitment process and will offer an interview to disabled applicants who meet the essential criteria for the role. Applicants are welcome to opt in to the interview scheme as part of the application process. If you would like to apply under the scheme, please click the link to the Accommodations Request Form above and scroll to the UK Disability Confident Scheme section within the form. Posting Statement Salesforce is an equal opportunity employer and maintains a policy of non discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that's inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications - without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.
04/06/2026
Full time
Overview of the Role As an AI and Data Technical Architect, you will act as a senior, hands on technical leader and trusted advisor to our customers. You will be responsible for designing, validating, and operationalizing enterprise grade data and AI architectures centered on Salesforce D360 and the Agentforce platform. This role sits at the intersection of data engineering, platform architecture, and applied AI, requiring you to guide customer Chief Data Officers and Enterprise Architects through emerging AI solutions. You will work side by side with Account Executives and Product teams to ensure customers realize the full value of the platform by designing scalable, secure solutions that integrate D360 into complex enterprise ecosystems-including hyperscalers, data lakes, and governance frameworks. Responsibilities Lead pre sales technical design by analyzing customer needs and recommending solutions aligned with Agentforce capabilities and integration with external agent frameworks. Shape best practices around generative AI, agent interoperability, prompt engineering, Data Cloud, and cross platform integrations. Collaborate with AEs and SEs to build hands on prototypes and demos using Agentforce and integrated external agents. Develop thought leadership content-demo templates, whitepapers, enablement sessions-focused on agent lifecycle, integration strategy, and technical effectiveness. Act as a central technical knowledge resource, proactively addressing internal technical inquiries and facilitating deep technical enablement. Understand Agent Interoperability-map and integrate external agents from hyperscalers (e.g., Copilot, Gemini) into Agentforce via open standards (MCP, A2A); design how these systems collaborate. Enable Conversational & Background Agents-use Agentforce Studio and Agent Builder to configure chat and background agents; integrate with external channels including voice via hyperscaler APIs. Drive Prompt Engineering & Lifecycle Strategy-lead prompt design, testing, monitoring, and iteration; define agent lifecycle best practices from development through refinement. Build Hands On Demos & Prototypes-co create quick prototypes ( Lead Pre Sales Workshops-facilitate whiteboarding, deep dive sessions, and quick enablement for customers and internal teams. Advise on Data & Integration-integrate Data Cloud (D360), CRM, MuleSoft APIs, and external agent endpoints ensuring cohesive architectures that align with compliance and governance policies. Support Early Adoption-occasionally assist in proof of value engagements post sale by tuning agents and guiding customers toward self sufficient enablement. Own Technical Architecture Decisions-oversee data modeling, identity resolution, real time vs. batch patterns, data graph design, and activation strategies within D360. Own Technical Enablement-create and manage accessible technical documentation, knowledge bases, and FAQ resources to rapidly resolve internal technical inquiries, empowering specialist teams. Required Qualifications Technical Pre Sales/Consulting - 7+ years of hands on experience designing and delivering data, analytics, and AI architectures in enterprise environments. Salesforce Expertise - Hands on experience with Salesforce Agentforce and deep fluency with D360 and core Salesforce platform services. External Ecosystem Knowledge - Strong understanding of external agent ecosystems and interoperability. Proven Track Record - Experience in prompt engineering, agent lifecycle management, and hands on prototype development. AI & ML Expertise - Experience with machine learning concepts (predictive and generative AI), plus the ability to communicate value to diverse audiences. Data Stack Knowledge - Deep expertise in modern cloud data platforms (Snowflake, Databricks, BigQuery, Redshift) and data ingestion patterns (batch, streaming, CDC). Hands On Development - Proficiency in programming (e.g., JavaScript, Python, SQL, R) and data frameworks like pandas or Jupyter. Excellent Communication - Strong presentation skills; adept at explaining complex ideas and guiding stakeholders toward impactful solutions. Curiosity & Continuous Learning - Passion for exploring new AI frameworks, sharing insights, and experimenting with cutting edge technologies. Education - BS in Computer Science, Engineering, Data Science, or equivalent technical field. Preferred Qualifications Advanced Integration - Experience integrating Salesforce with external agents via APIs and open standards (MCP, A2A). Governance & Observability - Familiarity with prompt governance, observability, and monitoring frameworks. Cross Platform Background - Background in cross platform integrations (e.g., Hyperscaler SDKs to Salesforce Flows). Multimodal Pipelines - Prior exposure to conversational voice pipelines or multimodal integrations via hyperscaler services. Advanced AI/ML Frameworks - Exposure to frameworks (TensorFlow, PyTorch), MLOps practices, and cloud AI platforms like Google Vertex AI or AWS SageMaker. Education - BS in Computer Science, Engineering, Data Science, or equivalent technical field. Benefits Unleash Your Potential. When you join Salesforce, you'll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we'll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Accommodations If you need a reasonable accommodation during the application or the recruiting process, please submit a request via this Accommodations Request Form. Please note that Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and evaluate candidates' resumes and qualifications throughout the recruiting process. Humans will always make any candidate selection and hiring decisions. Please see our Candidate Privacy Statement for more information about how we use your personal data and your rights, including with regard to use of AI tools and opt out options. We are a recognised Disability Confident member under the UK Government Disability Confident employer scheme. We are committed to providing an inclusive recruitment process and will offer an interview to disabled applicants who meet the essential criteria for the role. Applicants are welcome to opt in to the interview scheme as part of the application process. If you would like to apply under the scheme, please click the link to the Accommodations Request Form above and scroll to the UK Disability Confident Scheme section within the form. Posting Statement Salesforce is an equal opportunity employer and maintains a policy of non discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that's inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications - without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.
Data Engineer, Data Cloud
P2P
Location London Employment Type Full time Location Type Remote Department R&D Data Products The engineering team at Chainalysis is inspired by solving the hardest technical challenges and creating products that build trust in cryptocurrencies. We're a global organization with teams in the UK, Denmark, Canada, and the USA who thrive on the challenging work we do and doing it with other exceptionally talented teammates. Our industry changes every day and our job is to build a flexible platform that will allow us to adapt to those rapid changes. We're looking for Data Engineers to join our Data Cloud team. This group accelerates innovation & helps unlock new business lines, by empowering anyone at Chainalysis to quickly and reliably discover, access, analyze, and build on top of any and all data. You'll be a key player in creating and optimizing our data platform and data processing systems. If you're passionate about infrastructure automation, cloud services, and building scalable platforms to enable next gen real time streaming data applications, we want you to join our talented and growing team! In this role, you'll: Design, develop, and optimize high-performance, scalable data platforms, with a strong focus on streaming data processing, large data volumes, and cloud infrastructure Implement and maintain infrastructure automation and self service using Terraform, ensuring reliable and repeatable environments for both development and production, and creating robust CI/CD pipelines Build seamless integrations between Data Cloud and various relational and noSQL OLTP databases Design and build frameworks and abstractions to accelerate the development of data pipelines while embedding data engineering best practices Establish and maintain observability, security, and data governance solutions to ensure high quality and reliability of data pipelines We're looking for candidates who have: 3+ years of experience as a Data Platform Engineer or Software Engineer or Infrastructure Engineer, with hands on expertise in building and maintaining cloud based data platforms Solid experience with AWS services, a good understanding of cloud architecture, and proficiency with Terraform for provisioning and managing cloud infrastructure Experience building streaming data pipelines using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake, DBT, Airflow, Debezium, Delta/Iceberg, and comfort with Python/Java and SQL Experience with networking and security concepts within AWS, including VPCs, subnets, routing, security groups, IAM, etc. Nice to have Experience: Exposure to or interest in the cryptocurrency technology ecosystem Experience working with different blockchain technologies is a plus Experience with a SaaS or FinTech company Technologies we use: AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS Data Lakehouse: Kafka, Flink, Spark, Databricks, DBT, Debezium About Chainalysis Blockchain technology is powering a growing wave of innovation. Businesses and governments around the world are using blockchains to make banking more efficient, connect with their customers, and investigate criminal cases. As adoption of blockchain technology grows, more and more organizations seek access to all this ecosystem has to offer. That's where Chainalysis comes in. We provide complete knowledge of what's happening on blockchains through our data, services, and solutions. With Chainalysis, organizations can navigate blockchains safely and with confidence. You belong here. At Chainalysis, we believe that diversity of experience and thought makes us stronger. With both customers and employees around the world, we are committed to ensuring our team reflects the unique communities around us. We're ensuring we keep learning by committing to continually revisit and reevaluate our diversity culture. We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more. If you need any accommodations to make our interview process more accessible to you due to a disability, don't hesitate to let us know. You can learn more here. We can't wait to meet you.
04/06/2026
Full time
Location London Employment Type Full time Location Type Remote Department R&D Data Products The engineering team at Chainalysis is inspired by solving the hardest technical challenges and creating products that build trust in cryptocurrencies. We're a global organization with teams in the UK, Denmark, Canada, and the USA who thrive on the challenging work we do and doing it with other exceptionally talented teammates. Our industry changes every day and our job is to build a flexible platform that will allow us to adapt to those rapid changes. We're looking for Data Engineers to join our Data Cloud team. This group accelerates innovation & helps unlock new business lines, by empowering anyone at Chainalysis to quickly and reliably discover, access, analyze, and build on top of any and all data. You'll be a key player in creating and optimizing our data platform and data processing systems. If you're passionate about infrastructure automation, cloud services, and building scalable platforms to enable next gen real time streaming data applications, we want you to join our talented and growing team! In this role, you'll: Design, develop, and optimize high-performance, scalable data platforms, with a strong focus on streaming data processing, large data volumes, and cloud infrastructure Implement and maintain infrastructure automation and self service using Terraform, ensuring reliable and repeatable environments for both development and production, and creating robust CI/CD pipelines Build seamless integrations between Data Cloud and various relational and noSQL OLTP databases Design and build frameworks and abstractions to accelerate the development of data pipelines while embedding data engineering best practices Establish and maintain observability, security, and data governance solutions to ensure high quality and reliability of data pipelines We're looking for candidates who have: 3+ years of experience as a Data Platform Engineer or Software Engineer or Infrastructure Engineer, with hands on expertise in building and maintaining cloud based data platforms Solid experience with AWS services, a good understanding of cloud architecture, and proficiency with Terraform for provisioning and managing cloud infrastructure Experience building streaming data pipelines using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake, DBT, Airflow, Debezium, Delta/Iceberg, and comfort with Python/Java and SQL Experience with networking and security concepts within AWS, including VPCs, subnets, routing, security groups, IAM, etc. Nice to have Experience: Exposure to or interest in the cryptocurrency technology ecosystem Experience working with different blockchain technologies is a plus Experience with a SaaS or FinTech company Technologies we use: AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS Data Lakehouse: Kafka, Flink, Spark, Databricks, DBT, Debezium About Chainalysis Blockchain technology is powering a growing wave of innovation. Businesses and governments around the world are using blockchains to make banking more efficient, connect with their customers, and investigate criminal cases. As adoption of blockchain technology grows, more and more organizations seek access to all this ecosystem has to offer. That's where Chainalysis comes in. We provide complete knowledge of what's happening on blockchains through our data, services, and solutions. With Chainalysis, organizations can navigate blockchains safely and with confidence. You belong here. At Chainalysis, we believe that diversity of experience and thought makes us stronger. With both customers and employees around the world, we are committed to ensuring our team reflects the unique communities around us. We're ensuring we keep learning by committing to continually revisit and reevaluate our diversity culture. We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more. If you need any accommodations to make our interview process more accessible to you due to a disability, don't hesitate to let us know. You can learn more here. We can't wait to meet you.
CapGemini
Databricks Data Engineer: Hybrid, Impactful Analytics
CapGemini
# Senior Databricks Technical EngineerWoking, Bristol, Manchester, BirminghamApply for this job Permanent Experienced Professionals Cloud Infrastructure Management ID 473229-en\_GB About the job you're considering To support the continued growth of our data led operations and insight capabilities, Capgemini is expanding its data engineering community. We are seeking a Data Engineer with a strong focus on the implementation, configuration, and use of Databricks to deliver scalable, secure data platforms and actionable insights.You will design and build data analytics solutions that enable both internal teams and clients to visualise, understand, and act on their data. The role is focused on turning raw operational and business data into meaningful insights, supporting improved decision making, service performance, and operational efficiency. Hybrid working : The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time. Your role This role includes the following responsibilities: Developing and maintaining data pipelines to ingest, transform, and curate data from multiple sources. Using Databricks, SQL, and analytical tools to create high quality datasets suitable for insight and visualisation. Producing internal and client facing dashboards and visualisations that provide operational insight and business value. Working with stakeholders to understand reporting and analytics requirements and translating them into effective data solutions. Supporting the use of data to improve operational performance, service quality, and decision making. Ensuring data solutions align to security, governance, and data quality standards. Collaborating with architects, platform teams, and operations teams to ensure solutions are scalable and supportable. Supporting the evolution of data platforms, including optimisation, cost control, and performance improvement. Contributing to documentation, standards, and best practices for data engineering and analytics.You can bring your whole self to work. At Capgemini building an inclusive future is part of everyday life and will be part of your working reality. We have built a representative and welcoming environment, for everyone. Your skills and experience Proven Data Engineer experience in enterprise/client environments, with strong Databricks expertise Solid understanding of data lakehouse architectures and analytical platforms Advanced SQL skills for transforming and analysing large datasets Experience designing data models and datasets for reporting tools (e.g. Power BI) Skilled in working with diverse data sources and applying data governance, security, and quality principles Strong collaboration, communication, and agile delivery experience, with ability to explain data to non-technical stakeholders We are a Disability Confident Employer Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government's Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who: Declare they have a disability, and Meet the minimum essential criteria for the role.Please opt in during the application process. Your security clearance and pre-employment checks To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance.To obtain SC clearance, the successful applicant must have resided continuously within the United Kingdom for the last 5 years, along with other criteria and requirements.Throughout the recruitment process, you will be asked questions about your security clearance eligibility such as, but not limited to, country of residence and nationality.Some posts are restricted to sole UK Nationals for security reasons; therefore, you may be asked about your citizenship in the application process. Make it real - what does it mean for you? Flexibility to work your way You will be encouraged to have a positive work-life balance. Our hybrid-first way of working means we embed hybrid working in all that we do and make flexible working arrangements the day-to-day reality for our people. All UK employees are eligible to request flexible working arrangements. Your wellbeing You'd be joining an accredited Great Place to work for Wellbeing in 2024. Employee wellbeing is vitally important to us as an organisation. We see a healthy and happy workforce a critical component for us to achieve our organisational ambitions. To help support wellbeing we have trained 'Mental Health Champions' across each of our business areas, and we have invested in wellbeing apps such as Thrive and Peppy. Shape your path You will be empowered to explore, innovate, and progress. You will benefit from Capgemini's 'learning for life' mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard ManageMentor, Cybersecurity qualifications and much more. Shared energy You'll be bringing your unique skills and perspectives to the team, inspiring and taking inspiration from your teammates as you unlock value in everything you do. You'll be joining a professional community of experts, who have got your back and will support you, every step of the way. Why should you consider Capgemini? Growing clients' businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you'll join a thriving company and become part of a collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what's possible. It's why, together, we seek out opportunities that will transform the world's leading businesses, and it's how you'll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you'll build the skills you want. You'll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is. About Capgemini Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organisations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of over 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2025 global revenues of €22.5 billion. Make it real
04/06/2026
Full time
# Senior Databricks Technical EngineerWoking, Bristol, Manchester, BirminghamApply for this job Permanent Experienced Professionals Cloud Infrastructure Management ID 473229-en\_GB About the job you're considering To support the continued growth of our data led operations and insight capabilities, Capgemini is expanding its data engineering community. We are seeking a Data Engineer with a strong focus on the implementation, configuration, and use of Databricks to deliver scalable, secure data platforms and actionable insights.You will design and build data analytics solutions that enable both internal teams and clients to visualise, understand, and act on their data. The role is focused on turning raw operational and business data into meaningful insights, supporting improved decision making, service performance, and operational efficiency. Hybrid working : The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time. Your role This role includes the following responsibilities: Developing and maintaining data pipelines to ingest, transform, and curate data from multiple sources. Using Databricks, SQL, and analytical tools to create high quality datasets suitable for insight and visualisation. Producing internal and client facing dashboards and visualisations that provide operational insight and business value. Working with stakeholders to understand reporting and analytics requirements and translating them into effective data solutions. Supporting the use of data to improve operational performance, service quality, and decision making. Ensuring data solutions align to security, governance, and data quality standards. Collaborating with architects, platform teams, and operations teams to ensure solutions are scalable and supportable. Supporting the evolution of data platforms, including optimisation, cost control, and performance improvement. Contributing to documentation, standards, and best practices for data engineering and analytics.You can bring your whole self to work. At Capgemini building an inclusive future is part of everyday life and will be part of your working reality. We have built a representative and welcoming environment, for everyone. Your skills and experience Proven Data Engineer experience in enterprise/client environments, with strong Databricks expertise Solid understanding of data lakehouse architectures and analytical platforms Advanced SQL skills for transforming and analysing large datasets Experience designing data models and datasets for reporting tools (e.g. Power BI) Skilled in working with diverse data sources and applying data governance, security, and quality principles Strong collaboration, communication, and agile delivery experience, with ability to explain data to non-technical stakeholders We are a Disability Confident Employer Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government's Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who: Declare they have a disability, and Meet the minimum essential criteria for the role.Please opt in during the application process. Your security clearance and pre-employment checks To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance.To obtain SC clearance, the successful applicant must have resided continuously within the United Kingdom for the last 5 years, along with other criteria and requirements.Throughout the recruitment process, you will be asked questions about your security clearance eligibility such as, but not limited to, country of residence and nationality.Some posts are restricted to sole UK Nationals for security reasons; therefore, you may be asked about your citizenship in the application process. Make it real - what does it mean for you? Flexibility to work your way You will be encouraged to have a positive work-life balance. Our hybrid-first way of working means we embed hybrid working in all that we do and make flexible working arrangements the day-to-day reality for our people. All UK employees are eligible to request flexible working arrangements. Your wellbeing You'd be joining an accredited Great Place to work for Wellbeing in 2024. Employee wellbeing is vitally important to us as an organisation. We see a healthy and happy workforce a critical component for us to achieve our organisational ambitions. To help support wellbeing we have trained 'Mental Health Champions' across each of our business areas, and we have invested in wellbeing apps such as Thrive and Peppy. Shape your path You will be empowered to explore, innovate, and progress. You will benefit from Capgemini's 'learning for life' mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard ManageMentor, Cybersecurity qualifications and much more. Shared energy You'll be bringing your unique skills and perspectives to the team, inspiring and taking inspiration from your teammates as you unlock value in everything you do. You'll be joining a professional community of experts, who have got your back and will support you, every step of the way. Why should you consider Capgemini? Growing clients' businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you'll join a thriving company and become part of a collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what's possible. It's why, together, we seek out opportunities that will transform the world's leading businesses, and it's how you'll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you'll build the skills you want. You'll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is. About Capgemini Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organisations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of over 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2025 global revenues of €22.5 billion. Make it real
Manager, Senior Platform Software Engineer
Baringa Partners LLP
Manager, Senior Platform Software Engineer London, United Kingdom Baringa is a global consulting firm that partners with leaders to drive change and create value. With deep industry expertise, and enabled by advanced technology, the firm helps clients to deliver with greater confidence and certainty. With over 2,000 people across the UK, Europe, North America, Asia and Australia, the firm combines global insight with local understanding. The firm works across energy and resources, financial services, government and public sector, consumer products and retail, pharmaceuticals and life sciences, manufacturing, and technology, media and telecoms, with capabilities spanning strategy, transformation and operational excellence - all powered by advanced technology, data, AI and digital innovation. Clients value Baringa's collaborative approach and the way its teams integrate seamlessly - all working with a shared understanding of what matters most. The firm is known for its kind, curious experts who listen closely and care deeply about client success as they help clients transform energy markets, modernise financial platforms, expand telecoms and digital networks through advanced data analytics, enable digital services in government, and unlock growth in consumer sectors. Certified as a Great Place to Work around the world, Baringa has been recognised by the Financial Times in 22 categories of its UK Leading Management Consultants rankings, and by Forbes for four consecutive years as one of the World's Best Management Consulting Firms. Our Energy Products Practice is looking for an experienced (job title/level) to join the team. Baringa are world leaders in modelling energy markets and using the insights generated through these models to drive change in a decarbonising energy industry. The Energy Products practice specialises in the development and innovation of our analytical models and supporting technology ecosystem underpinned by our deep expertise in the energy markets. Our staff come from diverse backgrounds, based across multiple geographies, and building models that utilise highly varied data sources - everything from kilobytes of academic papers to terabytes of hourly scenario projections for 50+ years. They need rapid access to data, analytics outputs, and highly scalable data processing infrastructure. Our scale and model complexity has reached a point that to continue to achieve our business vision, we are building a dedicated global Data and Processing Platform team. Come and join us to be part of the energy transition, the defining challenge of our lifetimes, where your technical skills and experience can have real impact. What you will be doing You will help shape the design, implementation and ongoing support of a greenfield Data and Processing Platform and its supporting software products. You will support the Engineering Lead to engage with internal developers, energy system modellers, client-facing energy experts, and users across the business to build capabilities that enable them to work more effectively and better serve our clients. You will help drive engineering best practices, ensuring that quality, reliability and observability are built into our products from inception. You will design and implement robust CI/CD automation flows, continually evolving our processes to improve the engineering experience for ourselves and the teams we support. You will take an active role in all stages of the team's agile development approach, from refinement through to delivery, supporting the iterative improvement of our team processes. Your skills and experience You are passionate about building the 'right' solution to problems, with a desire to understand the problems at their core and 'why' a solution is fit for purpose. You will have practical experience as a senior engineer in high-performing engineering teams, collaborating closely with colleagues and taking pride in what you create. You are strong at solving complex problems and can flexibly consider different technologies/engineering approaches to achieve this. You have advanced working knowledge of a general programming language (e.g. Python, Java, C#, Typescript etc.) and understand both domain modelling and application programming. You have working knowledge of data management technologies (SQL, NoSQL, Databricks etc.). You have working knowledge of modern software engineering tools (Git, CI/CD pipelines), cloud technologies (e.g. AWS, Azure) and Infrastructure as Code (e.g. Terraform, Pulumi). You have worked across the technology stack with experience of established frameworks (e.g. React/Angular/Vue/Blazor frontends and/or FastAPI/SpringBoot/.NET backends). You have experience building and supporting different architectural approaches and are confident in justifying your technology and architectural choices. You are passionate about communicating complex concepts succinctly to both technical and non-technical audiences to reach a common understanding. You have experience working with agile methodologies (e.g. Scrum/Kanban), with an understanding of the key principles that underpin their effective use. We've seen research that says some candidates will not apply to a role if they don't meet every requirement, but please do not let this put you off. If you think you are a good overall match please do get in touch - we look carefully at all applications, and you may well be our ideal candidate. What a career at Baringa will give you Putting People First. Baringa is a People First company and wellbeing is at the forefront of our culture. We recognise the importance of work-life balance and flexible working and provide our staff with amazing benefits. Some of these benefits include: Generous Annual Leave Policy: We recognise everyone needs a well-deserved break. We provide our employees with 5 weeks of annual leave, fully available at the start of each year. In addition to this, we have introduced our 5-Year Recharge benefit which allows all employees an additional 2 weeks of paid leave after 5 years continuous service. Flexible Working: We know that the 'ideal' work-life balance will vary from person to person and change at different stages of our working lives. To accommodate this, we have implemented a hybrid working policy and introduced more flexibility around taking unpaid leave. Corporate Responsibility Days: Our world is important to us, so all our employees get 3 every year to help social and environmental causes and increase our impact on the communities that mean the most to us. Wellbeing Fund: We want to encourage all employees to take charge and prioritise their own wellbeing. We've introduced our annual People Fund to support this by offering every individual a fund to support and manage their wellbeing through an activity of their choice. Profit Share Scheme: All employees participate in the Baringa Group Profit Share Scheme so everyone has a stake in the company's success. Diversity and Inclusion We are proud to be an Equal Opportunity Employer. We believe that creating an environment where everyone feels a sense of belonging is central to our culture and that diversity is paramount to driving creativity, innovation, and value for our clients and for our people. You can be a part of our 'Great Place to Work' - with our commitment to women and well-being in the workplace for all. Click here to see some of our recent awards and how we've achieved this. Using business as a force for good. We maintain high standards of environmental performance and transparency, which can be seen through our commitment to Net Zero with our SBTI-verified Scope 1, 2 and 3 emissions reduction targets and our support of the Better Business Act. We report our progress publicly and ensure that we are also externally assessed and scored through organisations like CDP and EcoVadis - helping us to continually identify where we can improve. We have a long legacy of supporting the communities in which we work, and offer a variety of ways to contribute, by putting people first and creating impact that lasts. Our Corporate Social Responsibility (CSR) agenda is about giving back to the communities in which we live and work by sharing our skills, talent and time. In essence, we aim to empower and encourage everyone in the firm to contribute to the things we care about, and support registered charities and organisations with a clear social or environmental purpose to increase the positive impact they can have. All applications received will be reviewed by a member of our Talent Acquisition team. We never rely solely on automated screening or AI tools to make hiring decisions. Your application will be considered for employment without regard to race, ethnicity, religion, gender, gender identity or expression, sexual orientation, nationality, disability, age, faith or social background. We do not filter applications by university background and encourage those who have taken alternative educational and career paths to apply. We would like to actively encourage applications from those who identify with less represented and minority groups. We operate an inclusive recruitment process, ensuring reasonable adjustments where needed. Please contact a member of our Recruitment Team to discuss further.
04/06/2026
Full time
Manager, Senior Platform Software Engineer London, United Kingdom Baringa is a global consulting firm that partners with leaders to drive change and create value. With deep industry expertise, and enabled by advanced technology, the firm helps clients to deliver with greater confidence and certainty. With over 2,000 people across the UK, Europe, North America, Asia and Australia, the firm combines global insight with local understanding. The firm works across energy and resources, financial services, government and public sector, consumer products and retail, pharmaceuticals and life sciences, manufacturing, and technology, media and telecoms, with capabilities spanning strategy, transformation and operational excellence - all powered by advanced technology, data, AI and digital innovation. Clients value Baringa's collaborative approach and the way its teams integrate seamlessly - all working with a shared understanding of what matters most. The firm is known for its kind, curious experts who listen closely and care deeply about client success as they help clients transform energy markets, modernise financial platforms, expand telecoms and digital networks through advanced data analytics, enable digital services in government, and unlock growth in consumer sectors. Certified as a Great Place to Work around the world, Baringa has been recognised by the Financial Times in 22 categories of its UK Leading Management Consultants rankings, and by Forbes for four consecutive years as one of the World's Best Management Consulting Firms. Our Energy Products Practice is looking for an experienced (job title/level) to join the team. Baringa are world leaders in modelling energy markets and using the insights generated through these models to drive change in a decarbonising energy industry. The Energy Products practice specialises in the development and innovation of our analytical models and supporting technology ecosystem underpinned by our deep expertise in the energy markets. Our staff come from diverse backgrounds, based across multiple geographies, and building models that utilise highly varied data sources - everything from kilobytes of academic papers to terabytes of hourly scenario projections for 50+ years. They need rapid access to data, analytics outputs, and highly scalable data processing infrastructure. Our scale and model complexity has reached a point that to continue to achieve our business vision, we are building a dedicated global Data and Processing Platform team. Come and join us to be part of the energy transition, the defining challenge of our lifetimes, where your technical skills and experience can have real impact. What you will be doing You will help shape the design, implementation and ongoing support of a greenfield Data and Processing Platform and its supporting software products. You will support the Engineering Lead to engage with internal developers, energy system modellers, client-facing energy experts, and users across the business to build capabilities that enable them to work more effectively and better serve our clients. You will help drive engineering best practices, ensuring that quality, reliability and observability are built into our products from inception. You will design and implement robust CI/CD automation flows, continually evolving our processes to improve the engineering experience for ourselves and the teams we support. You will take an active role in all stages of the team's agile development approach, from refinement through to delivery, supporting the iterative improvement of our team processes. Your skills and experience You are passionate about building the 'right' solution to problems, with a desire to understand the problems at their core and 'why' a solution is fit for purpose. You will have practical experience as a senior engineer in high-performing engineering teams, collaborating closely with colleagues and taking pride in what you create. You are strong at solving complex problems and can flexibly consider different technologies/engineering approaches to achieve this. You have advanced working knowledge of a general programming language (e.g. Python, Java, C#, Typescript etc.) and understand both domain modelling and application programming. You have working knowledge of data management technologies (SQL, NoSQL, Databricks etc.). You have working knowledge of modern software engineering tools (Git, CI/CD pipelines), cloud technologies (e.g. AWS, Azure) and Infrastructure as Code (e.g. Terraform, Pulumi). You have worked across the technology stack with experience of established frameworks (e.g. React/Angular/Vue/Blazor frontends and/or FastAPI/SpringBoot/.NET backends). You have experience building and supporting different architectural approaches and are confident in justifying your technology and architectural choices. You are passionate about communicating complex concepts succinctly to both technical and non-technical audiences to reach a common understanding. You have experience working with agile methodologies (e.g. Scrum/Kanban), with an understanding of the key principles that underpin their effective use. We've seen research that says some candidates will not apply to a role if they don't meet every requirement, but please do not let this put you off. If you think you are a good overall match please do get in touch - we look carefully at all applications, and you may well be our ideal candidate. What a career at Baringa will give you Putting People First. Baringa is a People First company and wellbeing is at the forefront of our culture. We recognise the importance of work-life balance and flexible working and provide our staff with amazing benefits. Some of these benefits include: Generous Annual Leave Policy: We recognise everyone needs a well-deserved break. We provide our employees with 5 weeks of annual leave, fully available at the start of each year. In addition to this, we have introduced our 5-Year Recharge benefit which allows all employees an additional 2 weeks of paid leave after 5 years continuous service. Flexible Working: We know that the 'ideal' work-life balance will vary from person to person and change at different stages of our working lives. To accommodate this, we have implemented a hybrid working policy and introduced more flexibility around taking unpaid leave. Corporate Responsibility Days: Our world is important to us, so all our employees get 3 every year to help social and environmental causes and increase our impact on the communities that mean the most to us. Wellbeing Fund: We want to encourage all employees to take charge and prioritise their own wellbeing. We've introduced our annual People Fund to support this by offering every individual a fund to support and manage their wellbeing through an activity of their choice. Profit Share Scheme: All employees participate in the Baringa Group Profit Share Scheme so everyone has a stake in the company's success. Diversity and Inclusion We are proud to be an Equal Opportunity Employer. We believe that creating an environment where everyone feels a sense of belonging is central to our culture and that diversity is paramount to driving creativity, innovation, and value for our clients and for our people. You can be a part of our 'Great Place to Work' - with our commitment to women and well-being in the workplace for all. Click here to see some of our recent awards and how we've achieved this. Using business as a force for good. We maintain high standards of environmental performance and transparency, which can be seen through our commitment to Net Zero with our SBTI-verified Scope 1, 2 and 3 emissions reduction targets and our support of the Better Business Act. We report our progress publicly and ensure that we are also externally assessed and scored through organisations like CDP and EcoVadis - helping us to continually identify where we can improve. We have a long legacy of supporting the communities in which we work, and offer a variety of ways to contribute, by putting people first and creating impact that lasts. Our Corporate Social Responsibility (CSR) agenda is about giving back to the communities in which we live and work by sharing our skills, talent and time. In essence, we aim to empower and encourage everyone in the firm to contribute to the things we care about, and support registered charities and organisations with a clear social or environmental purpose to increase the positive impact they can have. All applications received will be reviewed by a member of our Talent Acquisition team. We never rely solely on automated screening or AI tools to make hiring decisions. Your application will be considered for employment without regard to race, ethnicity, religion, gender, gender identity or expression, sexual orientation, nationality, disability, age, faith or social background. We do not filter applications by university background and encourage those who have taken alternative educational and career paths to apply. We would like to actively encourage applications from those who identify with less represented and minority groups. We operate an inclusive recruitment process, ensuring reasonable adjustments where needed. Please contact a member of our Recruitment Team to discuss further.
Energy Trading - Principal Software Engineer London
Indicium Tech
Energy Trading - Principal Software Engineer London About Indicium AI Indicium AI is trusted by the world's leading enterprises to deliver AI into production at scale. We are a global AI-native consultancy with proven experience across Financial Services, Energy & Utilities, Healthcare & Life Sciences, Retail & CPG, and Manufacturing. From strategy, to build, to business outcomes, we unlock value from AI with unmatched clarity, speed, and capability. Powered by 600+ AI experts serving 50+ enterprise clients from 5 global locations, we work side by side with top partners - including Anthropic, Databricks, AWS, OpenAI, and Microsoft - to deliver modern AI with speed and measurable impact. Overview Indicium AI are seeking an exceptional Principal Software Engineer to lead delivery of exciting engagements within our Energy & Commodities Trading sector. This role demands a unique combination of hands on technical excellence and deep domain expertise in trading environments. You will architect and implement critical solutions that power real time trading decisions, while mentoring teams and driving client relationships at the highest level. You will go toe to toe with senior engineering stakeholders in fast paced trading environments, influencing architecture, operating models, and data strategy. Key Responsibilities: Technical Leadership Architect and deploy complex, distributed systems, with high performance data architectures, real time streaming, APIs, etc and drive technical decision making across complex, multi system trading environments Lead the development of near real time and intraday solutions pipelines supporting trading operations across multiple asset classes Architect solutions which are able to integrate market data feeds, position management systems, market fundamentals, P&L Risk and Back Office solutions. Establish software engineering best practices and coding standards for trading applications, upskilling more junior members of our delivery teams Partner with client CTOs, Heads of Data, and Engineering Leads to align technical delivery with trading objectives and roadmaps and design and implement scalable AI and data solutions for leading trading organisations. Lead Front, Middle or Back Office transformation projects through to production delivery Act as the point of contact for all technical matters related to our engagements, owning the relationship with our client stakeholders alongside our Client Director Support industry thought leadership and Indicium AI's GTM proposition based on your experience of the sector and our work to date Navigate the nuances of physical and financial trading flows, data latency constraints, reliability and regulatory obligations Technical Expertise This is a hands on role requiring deep technical execution alongside strategic leadership. The ideal candidate brings proven expertise across the following areas: Data Engineering: Proven experience with streaming platforms (e.g. Kafka), real time processing frameworks and modern data stack tools Architecture: Demonstrated ability to design low latency, high throughput data systems with microsecond level performance requirements Cloud Platforms: Hands on experience with AWS and or Azure, including managed services for data processing and storage Databases: Deep knowledge of both transactional (PostgreSQL, SQL Server) and analytical databases (ClickHouse, MongoDB, etc.), with particular emphasis on time series data. Additional experience that would be useful but not required includes Kubernetes, pricing & risk engines, working with quants, emerging technologies like AI in trading, AI engineering Why Indicium AI Fast growing start up organisation with huge opportunity for career growth Highly competitive salary package along with company bonus A hugely collaborative working environment where every person's viewpoint is considered - a chance to make your mark on the business from day one! Financially backed business meaning security and support for new initiatives and global market expansion Pick your own Gear! Macbooks, PCs, Accessories! Drive your development with a personal learning budget
03/06/2026
Full time
Energy Trading - Principal Software Engineer London About Indicium AI Indicium AI is trusted by the world's leading enterprises to deliver AI into production at scale. We are a global AI-native consultancy with proven experience across Financial Services, Energy & Utilities, Healthcare & Life Sciences, Retail & CPG, and Manufacturing. From strategy, to build, to business outcomes, we unlock value from AI with unmatched clarity, speed, and capability. Powered by 600+ AI experts serving 50+ enterprise clients from 5 global locations, we work side by side with top partners - including Anthropic, Databricks, AWS, OpenAI, and Microsoft - to deliver modern AI with speed and measurable impact. Overview Indicium AI are seeking an exceptional Principal Software Engineer to lead delivery of exciting engagements within our Energy & Commodities Trading sector. This role demands a unique combination of hands on technical excellence and deep domain expertise in trading environments. You will architect and implement critical solutions that power real time trading decisions, while mentoring teams and driving client relationships at the highest level. You will go toe to toe with senior engineering stakeholders in fast paced trading environments, influencing architecture, operating models, and data strategy. Key Responsibilities: Technical Leadership Architect and deploy complex, distributed systems, with high performance data architectures, real time streaming, APIs, etc and drive technical decision making across complex, multi system trading environments Lead the development of near real time and intraday solutions pipelines supporting trading operations across multiple asset classes Architect solutions which are able to integrate market data feeds, position management systems, market fundamentals, P&L Risk and Back Office solutions. Establish software engineering best practices and coding standards for trading applications, upskilling more junior members of our delivery teams Partner with client CTOs, Heads of Data, and Engineering Leads to align technical delivery with trading objectives and roadmaps and design and implement scalable AI and data solutions for leading trading organisations. Lead Front, Middle or Back Office transformation projects through to production delivery Act as the point of contact for all technical matters related to our engagements, owning the relationship with our client stakeholders alongside our Client Director Support industry thought leadership and Indicium AI's GTM proposition based on your experience of the sector and our work to date Navigate the nuances of physical and financial trading flows, data latency constraints, reliability and regulatory obligations Technical Expertise This is a hands on role requiring deep technical execution alongside strategic leadership. The ideal candidate brings proven expertise across the following areas: Data Engineering: Proven experience with streaming platforms (e.g. Kafka), real time processing frameworks and modern data stack tools Architecture: Demonstrated ability to design low latency, high throughput data systems with microsecond level performance requirements Cloud Platforms: Hands on experience with AWS and or Azure, including managed services for data processing and storage Databases: Deep knowledge of both transactional (PostgreSQL, SQL Server) and analytical databases (ClickHouse, MongoDB, etc.), with particular emphasis on time series data. Additional experience that would be useful but not required includes Kubernetes, pricing & risk engines, working with quants, emerging technologies like AI in trading, AI engineering Why Indicium AI Fast growing start up organisation with huge opportunity for career growth Highly competitive salary package along with company bonus A hugely collaborative working environment where every person's viewpoint is considered - a chance to make your mark on the business from day one! Financially backed business meaning security and support for new initiatives and global market expansion Pick your own Gear! Macbooks, PCs, Accessories! Drive your development with a personal learning budget
Searchability
Data Engineer - Real-Time Pipelines, Databricks & AWS
Searchability Manchester, Lancashire
Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via About the client Due to continued growth, we're seeking a skilled Data Engineer to join an established organisation at the forefront of building modern, data-driven platforms. The business is investing heavily in its data ecosystem and is focused on delivering real-time insights and trusted analytics that support teams across product, finance, marketing, and compliance. This is an excellent opportunity to work with modern cloud data technologies and play a key role in shaping a scalable, secure, and high-performance data platform. What will you be doing? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed data that supports analytics, reporting, and operational decision making. You'll also play a key role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability, and cost optimisation will also form part of your responsibilities as you contribute to the ongoing development of the organisation's data ecosystem. Our benefits Competitive basic salary Discretionary bonus scheme Company shares option plan Contributory pension scheme Life insurance (4x basic salary) Health cash plan Generous holiday allowance including bank holidays Study support and clear progression opportunities Employee assistance programme available 24/7 Collaborative office environment with regular social and charity events And Much More Data Engineer - Essential Skills Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands on experience with Kafka (MSK) and real time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Solid AWS experience including services such as S3, Glue, Lambda, Batch, and IAM Proficiency in Python and SQL for data engineering and analytics Experience implementing CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) Strong Git and version control practices Experience tuning and optimising Spark workloads To be considered Please either apply by clicking online or emailing me directly . By applying to this role you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Key skills Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data
03/06/2026
Full time
Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via About the client Due to continued growth, we're seeking a skilled Data Engineer to join an established organisation at the forefront of building modern, data-driven platforms. The business is investing heavily in its data ecosystem and is focused on delivering real-time insights and trusted analytics that support teams across product, finance, marketing, and compliance. This is an excellent opportunity to work with modern cloud data technologies and play a key role in shaping a scalable, secure, and high-performance data platform. What will you be doing? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed data that supports analytics, reporting, and operational decision making. You'll also play a key role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability, and cost optimisation will also form part of your responsibilities as you contribute to the ongoing development of the organisation's data ecosystem. Our benefits Competitive basic salary Discretionary bonus scheme Company shares option plan Contributory pension scheme Life insurance (4x basic salary) Health cash plan Generous holiday allowance including bank holidays Study support and clear progression opportunities Employee assistance programme available 24/7 Collaborative office environment with regular social and charity events And Much More Data Engineer - Essential Skills Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands on experience with Kafka (MSK) and real time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Solid AWS experience including services such as S3, Glue, Lambda, Batch, and IAM Proficiency in Python and SQL for data engineering and analytics Experience implementing CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) Strong Git and version control practices Experience tuning and optimising Spark workloads To be considered Please either apply by clicking online or emailing me directly . By applying to this role you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Key skills Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data
Searchability
Data Engineer
Searchability Manchester, Lancashire
Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via About the client Due to continued growth, we're seeking a skilled Data Engineer to join an established organisation at the forefront of building modern, data-driven platforms. The business is investing heavily in its data ecosystem and is focused on delivering real-time insights and trusted analytics that support teams across product, finance, marketing, and compliance. This is an excellent opportunity to work with modern cloud data technologies and play a key role in shaping a scalable, secure, and high-performance data platform. What will you be doing? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed data that supports analytics, reporting, and operational decision making. You'll also play a key role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability, and cost optimisation will also form part of your responsibilities as you contribute to the ongoing development of the organisation's data ecosystem. Our benefits Competitive basic salary Discretionary bonus scheme Company shares option plan Contributory pension scheme Life insurance (4x basic salary) Health cash plan Generous holiday allowance including bank holidays Study support and clear progression opportunities Employee assistance programme available 24/7 Collaborative office environment with regular social and charity events And Much More Data Engineer - Essential Skills Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands on experience with Kafka (MSK) and real time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Solid AWS experience including services such as S3, Glue, Lambda, Batch, and IAM Proficiency in Python and SQL for data engineering and analytics Experience implementing CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) Strong Git and version control practices Experience tuning and optimising Spark workloads To be considered Please either apply by clicking online or emailing me directly . By applying to this role you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Key skills Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data
03/06/2026
Full time
Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via About the client Due to continued growth, we're seeking a skilled Data Engineer to join an established organisation at the forefront of building modern, data-driven platforms. The business is investing heavily in its data ecosystem and is focused on delivering real-time insights and trusted analytics that support teams across product, finance, marketing, and compliance. This is an excellent opportunity to work with modern cloud data technologies and play a key role in shaping a scalable, secure, and high-performance data platform. What will you be doing? As a Data Engineer, you will design, build, and optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed data that supports analytics, reporting, and operational decision making. You'll also play a key role in enabling business intelligence through high-performance data models and integrations with reporting tools. You'll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability, and cost optimisation will also form part of your responsibilities as you contribute to the ongoing development of the organisation's data ecosystem. Our benefits Competitive basic salary Discretionary bonus scheme Company shares option plan Contributory pension scheme Life insurance (4x basic salary) Health cash plan Generous holiday allowance including bank holidays Study support and clear progression opportunities Employee assistance programme available 24/7 Collaborative office environment with regular social and charity events And Much More Data Engineer - Essential Skills Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands on experience with Kafka (MSK) and real time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Solid AWS experience including services such as S3, Glue, Lambda, Batch, and IAM Proficiency in Python and SQL for data engineering and analytics Experience implementing CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps) Strong Git and version control practices Experience tuning and optimising Spark workloads To be considered Please either apply by clicking online or emailing me directly . By applying to this role you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Key skills Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data
Octopus Energy
Data Engineer
Octopus Energy
What we do. Electric Car Leasing Why we do it. Greener. Fairer. Future. At Octopus Electric Vehicles we're developing a data platform that provides data services to all areas of our business. The aim of the platform is to enable self-service of data analytics to data hungry internal users as well as automation of all our data workflows - from simple ETL jobs to (future) ML training and prediction. The data team at OEV is a newly established team and is growing at speed. We have invested time and resources on establishing a core data platform, and are now leveraging technology to automate processes and reporting, so we can focus on solving interesting problems and answering complex questions across the whole customer domain - from customer operations to financial modelling. We are looking for an experienced data engineer that is equally passionate about using technology to grow the business and decarbonise the UK's fleet. This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way customers travel sustainably. What you'll do Build and optimise the platform used by the data team to transform raw data into business insights Build new data sources and data pipelines that deliver key data and insights to the business (this will include integration with third party systems and ingestion through APIs) Scope and deliver new data engineering projects in collaboration with business stakeholders Develop and deploy ML infrastructure to help build out our ever-growing AI requirements and use cases Collaborate closely with our dev teams to build seamless integrations between our back-end databases and our data platform Shape the direction of our growing team and coach team members on best practices What you'll have You don't need experience with electric vehicles/leasing (we can teach you that!), but having worked in similar Start-Up/Scale Up environments might be a bonus. First and foremost, a passion for decarbonisation A passion for writing high quality code and building lean processes Experience with distributed data processing Experience with monitoring, testing, and data quality Ability to work with ambiguity and own problems end-to-end Experience building robust pipelines from diverse sources e.g. SQL & no-SQL databases, API endpoints It would be helpful to have experience/expertise/knowledge in the following: Airflow AWS Kubernetes Spark & distributed computing dbt Terraform Databricks (desirable but not required) MLOps implementation (desirable but not required) Distributed system optimisation techniques Governance Why else you'll love it here Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit! Octopus Energy Group is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! Visit our perks hub - Octopus Employee Benefits Octopus Electric Vehicles, part of the Octopus Energy Group, won the Sunday Times best company to work for in 2024. We were named 6th out of the top 100 start-ups to work for by Tempo in 2025 and on Glassdoor we were voted 50 best places to work in 2022. Our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We've also been placed in the top 10 companies for senior leadership Things to note Just to let you know, we are dog friendly company so you may see our 4 legged friends in the offices - feel free to bring yours! Rest assured though, we've taken lots of precautions for those who have allergies We use AI to help us assess applications fairly and objectively. We're totally fine with you using AI as a tool to help prepare too. That said, when we get to the interview and assessment stage, we're really interested in hearing your unique perspective and real-world stories. That's the stuff we can't get from a bot or a prompt! About us The electric revolution has arrived - and from 2035 you'll no longer be able to buy a new petrol or diesel car in the UK. We're building a whole new way for drivers to join the electric charge and not only learn about and shop for their EV online, but experience a 'lease for life' through an industry changing customer experience. This is the chance to join one of the UK's most exciting start-ups - making it easy for individuals and businesses to go electric by getting their car, charger and energy all in one cracking deal. Octopus Electric Vehicles launched in 2018 to make it seamless to switch to cleaner, greener driving. Our mission is to drive sustainable change, decarbonise the planet and provide our customers with fair pricing and a fantastic experience. We're an Octopus Energy company-an innovative new energy supplier. We are part of the Octopus Energy Group, which seeks to improve the lives of millions of people by transforming the industries we operate in. The Octopus Group incorporates Octopus Energy, Octopus Healthcare, Octopus Investments, Octopus Property, Octopus Ventures and Octopus Labs. If this sounds like you then we'd love to hear from you. Are you ready for a career with us? We want to ensure you have all the tools and environment you need to unleash your potential. Need any specific accommodations? Whether you require specific accommodations or have a unique preference, let us know, and we'll do what we can to customise your interview process for comfort and maximum magic! Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.
03/06/2026
Full time
What we do. Electric Car Leasing Why we do it. Greener. Fairer. Future. At Octopus Electric Vehicles we're developing a data platform that provides data services to all areas of our business. The aim of the platform is to enable self-service of data analytics to data hungry internal users as well as automation of all our data workflows - from simple ETL jobs to (future) ML training and prediction. The data team at OEV is a newly established team and is growing at speed. We have invested time and resources on establishing a core data platform, and are now leveraging technology to automate processes and reporting, so we can focus on solving interesting problems and answering complex questions across the whole customer domain - from customer operations to financial modelling. We are looking for an experienced data engineer that is equally passionate about using technology to grow the business and decarbonise the UK's fleet. This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way customers travel sustainably. What you'll do Build and optimise the platform used by the data team to transform raw data into business insights Build new data sources and data pipelines that deliver key data and insights to the business (this will include integration with third party systems and ingestion through APIs) Scope and deliver new data engineering projects in collaboration with business stakeholders Develop and deploy ML infrastructure to help build out our ever-growing AI requirements and use cases Collaborate closely with our dev teams to build seamless integrations between our back-end databases and our data platform Shape the direction of our growing team and coach team members on best practices What you'll have You don't need experience with electric vehicles/leasing (we can teach you that!), but having worked in similar Start-Up/Scale Up environments might be a bonus. First and foremost, a passion for decarbonisation A passion for writing high quality code and building lean processes Experience with distributed data processing Experience with monitoring, testing, and data quality Ability to work with ambiguity and own problems end-to-end Experience building robust pipelines from diverse sources e.g. SQL & no-SQL databases, API endpoints It would be helpful to have experience/expertise/knowledge in the following: Airflow AWS Kubernetes Spark & distributed computing dbt Terraform Databricks (desirable but not required) MLOps implementation (desirable but not required) Distributed system optimisation techniques Governance Why else you'll love it here Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit! Octopus Energy Group is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! Visit our perks hub - Octopus Employee Benefits Octopus Electric Vehicles, part of the Octopus Energy Group, won the Sunday Times best company to work for in 2024. We were named 6th out of the top 100 start-ups to work for by Tempo in 2025 and on Glassdoor we were voted 50 best places to work in 2022. Our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We've also been placed in the top 10 companies for senior leadership Things to note Just to let you know, we are dog friendly company so you may see our 4 legged friends in the offices - feel free to bring yours! Rest assured though, we've taken lots of precautions for those who have allergies We use AI to help us assess applications fairly and objectively. We're totally fine with you using AI as a tool to help prepare too. That said, when we get to the interview and assessment stage, we're really interested in hearing your unique perspective and real-world stories. That's the stuff we can't get from a bot or a prompt! About us The electric revolution has arrived - and from 2035 you'll no longer be able to buy a new petrol or diesel car in the UK. We're building a whole new way for drivers to join the electric charge and not only learn about and shop for their EV online, but experience a 'lease for life' through an industry changing customer experience. This is the chance to join one of the UK's most exciting start-ups - making it easy for individuals and businesses to go electric by getting their car, charger and energy all in one cracking deal. Octopus Electric Vehicles launched in 2018 to make it seamless to switch to cleaner, greener driving. Our mission is to drive sustainable change, decarbonise the planet and provide our customers with fair pricing and a fantastic experience. We're an Octopus Energy company-an innovative new energy supplier. We are part of the Octopus Energy Group, which seeks to improve the lives of millions of people by transforming the industries we operate in. The Octopus Group incorporates Octopus Energy, Octopus Healthcare, Octopus Investments, Octopus Property, Octopus Ventures and Octopus Labs. If this sounds like you then we'd love to hear from you. Are you ready for a career with us? We want to ensure you have all the tools and environment you need to unleash your potential. Need any specific accommodations? Whether you require specific accommodations or have a unique preference, let us know, and we'll do what we can to customise your interview process for comfort and maximum magic! Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.

Modal Window

  • Home
  • Contact
  • About Us
  • FAQs
  • Terms & Conditions
  • Privacy
  • Employer
  • Post a Job
  • Search Resumes
  • Sign in
  • Job Seeker
  • Find Jobs
  • Create Resume
  • Sign in
  • IT blog
  • Facebook
  • Twitter
  • LinkedIn
  • Youtube
© 2008-2026 IT Job Board