We're looking for an experienced Senior Data Engineer to join an innovative AI & Data team, building modern, scalable data platforms that power analytics, reporting, and AI/ML initiatives.
Location: Hybrid (2days in office) - London | Woking | South Cerney | Fareham
Employment Type: Permanent
Key Responsibilities:
- 8-12+ years of Data Engineering experience.
- Strong hands-on expertise with Databricks, PySpark, SQL, and Python.
- Experience designing Lakehouse architectures using Medallion Architecture.
- Deep knowledge of Delta Live Tables, Unity Catalog, Delta Sharing, and Databricks Workflows.
- Familiarity with newer Databricks capabilities such as Lakeflow Connect, Lakebase, Metric Views, and Genie.
- Experience with Microsoft Fabric and the broader Azure ecosystem.
- Strong data warehousing expertise, including Star Schema, Fact & Dimension modelling, SCD, and CDC.
- Proficient with Azure DevOps, Git, and CI/CD pipelines.
- Experience delivering scalable data platforms that support BI, analytics, and machine learning workloads
Required Skills:
- Databricks & Apache Spark (PySpark)
- Python & SQL
- Microsoft Fabric (preferred)
- Delta Live Tables, Unity Catalog, Delta Sharing, Workflows
- Medallion Architecture & Lakehouse concepts
- Data Warehouse design (Star Schema, Fact & Dimension Modelling, SCD, CDC)
- Azure DevOps, Git & CI/CD Pipelines
- Pandas and Databricks Notebooks
Nice to Have:
Azure Certifications (AZ-900, DP-203, DP-500)
Databricks Lakehouse Data Engineer Associate/Professional Certifications