Salary: £15,000 - 20,000 per year
Requirements
- Strong hands on experience in building production grade data pipelines and orchestration using Python
- Expert level skills in analytical SQL, query optimization, and data modeling
- Familiarity with Azure Functions, Azure Data Factory, Azure Storage, and cloud security fundamentals
- In depth understanding of data architecture principles and scalable enterprise data design
- Proficient in Git, CI/CD, automated testing, and modern engineering practices
- Experience with API ingestion, SFTP ingestion, and resilient pipeline design
- Exceptional problem solving and architectural thinking abilities
- Strong communication and stakeholder collaboration skills
- Capability to lead and provide clarity in complex technical environments
- Experience in regulated or high assurance data environments is desirable
Responsibilities
- Lead the design and implementation of scalable data architectures using Bronze/Silver/Gold layered models
- Shape the platforms architectural roadmap, ensuring alignment with cutting edge engineering practices
- Develop secure and observable ingestion and transformation pipelines
- Spearhead the migration from legacy ETL tools to modern Azure based pipelines
- Build and maintain high performance SQL transformations, curated layers, and reusable data models
- Embed CI/CD, testing, version control, and observability into workflows
- Ensure robust data validation, reconciliation, profiling, and auditability across platform layers
- Collaborate with business stakeholders to guarantee analytical and operational needs are met
- Mentor fellow data engineers, fostering technical growth within the ICDP team
- Collaborate with Product teams, IT&D, and external partners to achieve high quality outcomes
- Serve as a technical authority on engineering approaches, patterns, and standards
Technologies
- API
- Azure
- CI/CD
- Cloud
- ETL
- Git
- Python
- SQL
- Security
- AI
- Data Warehouse
- Databricks
- Support
- REST
More
We are an employment consultancy dedicated to enhancing everyones chances of joining the workforce, valuing diversity and inclusivity. We are looking for a Senior Data Engineer for a 3-month temporary role in Warwick, where you will play a crucial role in improving our clients Interconnectors Data Platform. This hybrid role offers a rate of £500-£550 per day, and you will be part of a transformative journey in the Utilities sector that impacts decision making at every level.