Senior Data Engineer - Responsibilities
As a technical expert within our Data Services team, you'll design and build robust data pipelines that transform raw data into high-quality, business-ready data assets. Working across a wide range of business functions, you'll collaborate with data owners, drive adoption of data products, and ensure our data platform remains scalable, cost-effective, and aligned with governance standards.
- Lead the discovery, design, development and deployment of robust, scalable data pipelines and high-quality data assets that support strategic and operational business needs.
- Collaborate with data owners, suppliers and governance stakeholders to ensure data solutions are secure, compliant and aligned to business requirements.
- Support the prioritisation and delivery of the Data Sourcing Roadmap, providing technical expertise and effort estimates to inform planning and decision-making.
- Monitor, investigate and resolve data pipeline and data quality issues, identifying opportunities for continuous improvement and long term optimisation.
- Drive the adoption and re-use of data assets across the business, helping to unlock efficiencies, reduce costs and create value through data driven decision making.
- Provide technical leadership, mentoring and support to Data Engineers and the wider data community, championing engineering standards, best practices and continuous learning.
- Build strong relationships with stakeholders across LNER and the wider rail industry, fostering innovation and enabling Data Engineering, Analytics, Data Science and AI use cases through expert advice and collaboration.
- Act as a technical subject matter expert for LNER's Data Lake and wider data platform, providing expert guidance and promoting best practice data engineering and target architecture principles.
What you'll need Essential
- Proven experience as a Data Engineer, with a track record of designing, building and supporting scalable, reliable data pipelines and high-quality data assets.
- Hands on experience developing and deploying data solutions within an AWS based data lake environment, including technologies such as S3, Glue, Lambda, GitHub and Terraform.
- Knowledge of data governance, metadata management and data lineage principles and tools.
- Experience working with a range of analytics and business intelligence tools, with strong SQL skills and an understanding of data science, reporting and visualisation platforms.
- Strong attention to detail, with experience testing, validating and reviewing data solutions to ensure quality and reliability.
- Excellent documentation skills, with the ability to create clear technical documentation and requirements within tools such as Confluence and JIRA.
- Strong stakeholder management and communication skills, able to explain complex technical concepts to both technical and non technical audiences.
- A collaborative approach, with a passion for sharing knowledge, promoting best practice and fostering a data driven culture.
Desirable
- Experience with AWS Lake Formation and real time data streaming technologies such as Kinesis and Firehose.
- Knowledge of data warehousing concepts and experience working with AWS Redshift.
- Experience within transport, travel, leisure or other customer focused industries.
How you'll work
This role can be based in either our London or York office and operates on a hybrid basis with an expectation that at least 60% of your time will be spent in the office. You'll work alongside passionate colleagues who collaborate to put our customers first, embrace change and continually strive to deliver better journeys and experiences for all.
You'll enjoy
- Free travel on LNER, plus 75% off other companies' tickets (for you and your dependents).
- Discounted international train tickets (after one year's service).
- 50% discount on LNER tickets for friends and family.
- Generous pension scheme.
- Annual cycle to work schemes/electric vehicle scheme.
- Discount, savings and cashback scheme from top retailers.
- Health and wellbeing schemes and discounts.
- A host of training opportunities to help further your career.
- Rewards and awards to recognise when you shine.