Job Title: Senior Data Engineer (Microsoft Fabric & Azure)
Contract: 6 Months Initial (Likely Extension)
Location: London (Hybrid - 2-3 days onsite)
Day Rate: Competitive
IR35: Outside IR35
The Role
We're supporting a client in Leeds looking to appoint a Senior Data Engineer on a contract basis to support the design, build and evolution of a modern enterprise data platform, driving analytics, automation and AI-led insight across the business.
This role will play a key part in developing scalable data pipelines, data models and integration solutions using Microsoft Fabric, Azure Data Lake and Azure Synapse Analytics, while supporting a strategic migration to Fabric using a Medallion architecture approach.
You'll work across data engineering, analytics and platform optimisation, integrating internal and third-party data sources, enabling business intelligence through Power BI, and contributing to predictive analytics and AI use cases.
Key Responsibilities
- Design, build and implement scalable data pipelines, models and analytics solutions in Microsoft Fabric
- Support migration from Azure Synapse Analytics to Fabric using Medallion architecture while maintaining the existing production environment
- Integrate multiple internal and third-party data sources via APIs into the enterprise data platform
- Design, develop and optimise ETL workflows, including transformation, validation and loading processes
- Develop solutions using SQL, Python, PySpark and Spark SQL to transform and enrich data
- Support storage and processing of large datasets within Azure Data Lake and Fabric
- Automate upstream and downstream workflows using Power Automate and Power Apps
- Develop and manage dashboards and reporting solutions in Power BI
- Support predictive analytics and use of Machine Learning tools and models
- Use AI tools to support build and release processes while maintaining ownership of the underlying codebase
Skills & Experience
- Strong data engineering experience within Azure environments
- Hands-on expertise with Microsoft Fabric
- Experience with Azure Synapse Analytics and Azure Data Lake
- Strong ETL and data integration experience
- Advanced SQL skills
- Python, PySpark and Spark SQL expertise
- Strong Power BI experience
- API integration experience
- Exposure to Power Automate and Power Apps
- Experience with AI / predictive analytics would be beneficial
- Desirable: Wealth Management experience, including understanding of the IFA and financial planning lifecycle
- Knowledge of regulatory frameworks such as Consumer Duty, Senior Managers and Certification Regime and MiFID II
- Experience in regulated environments
Rates depend on experience and client requirements.