Test Engineer (Data & Automation)
Overview
We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation, data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.
This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working across complex data platforms.
Key Responsibilities
- Design, develop, and maintain automated test frameworks to improve testing efficiency and coverage
- Analyse and interpret test results, identifying risks, issues, and areas for improvement
- Produce clear reports on testing activities, outcomes, and associated risks
- Automate data validation and application testing processes across distributed systems
- Investigate production issues using data analysis to identify root causes
- Work with orchestration tools (eg, Apache Airflow) to monitor workflows and troubleshoot failures
- Validate data using tools such as Jupyter Notebooks and Amazon Athena
- Analyse data across multiple formats to ensure integrity and correctness of new functionality
- Support CI/CD practices using Git-based workflows and pipeline automation
- Participate in infrastructure and deployment activities, including containerisation and Infrastructure as Code
- Collaborate with cross-functional teams to translate business requirements into testable solutions
- Mentor and guide team members on testing methodologies and best practices
Key Skills & ExperienceTechnical Skills- Proficiency in Python, SQL, and at least one additional programming language (eg, Java)
- Experience with Scripting languages such as Bash
- Strong understanding of automated testing frameworks and methodologies
- Hands-on experience with Apache Airflow and log analysis
- Familiarity with data processing tools such as Apache Spark
- Experience working with cloud platforms and services, including:
- Monitoring and logging tools
- Storage and data services
- Compute and container services
- Experience with CI/CD pipelines and version control systems (eg, GitLab)
- Knowledge of Infrastructure as Code (eg, Terraform)
- Familiarity with Docker and containerised environments
Data & Analytics- Strong data analysis skills, including working with structured and semi-structured data
- Experience validating and querying data using tools such as Athena and notebooks
- Understanding of data modelling concepts, including dimensional models and slowly changing dimensions
- Ability to generate realistic test data for various scenarios
Additional Knowledge- Understanding of distributed data platforms and big data environments (eg, EMR)
- Knowledge of encryption principles (client-side and Server Side)
- Awareness of production system monitoring and incident analysis
Soft Skills- Strong analytical and problem-solving abilities
- Excellent communication skills, with the ability to present findings clearly
- Proactive approach to identifying and mitigating risks
- Ability to mentor and support less experienced team members
- Collaborative mindset with experience working in agile delivery environments
Working Arrangements- UK-based role with flexible location
- Occasional travel required for team collaboration sessions and workshops