Databricks Data Engineer (SC Cleared)
Contract: 3 months
Rate: £400 per day
Location: Fully Remote (UK)
Clearance: Active SC Clearance Required
We're supporting a secure cloud data programme and are looking for an experienced Databricks Data Engineer to join a high-performing team on an initial 3-month contract.
This role requires strong hands-on Databricks experience, with a particular focus on platform administration, security, governance, infrastructure automation and AWS-hosted Databricks environments. You'll work closely with engineering, platform and delivery teams to help maintain, optimise and enhance a critical data platform.
Key Responsibilities
- Develop, maintain and optimise data solutions within Databricks.
- Administer Databricks workspaces and account-level configurations.
- Manage permissions, governance and security controls using Unity Catalog.
- Support identity and access management, including user, group and role-based access controls.
- Work with AWS networking teams to ensure secure connectivity and platform access.
- Support disaster recovery planning, testing and documentation.
- Build and maintain Infrastructure as Code using Terraform.
- Develop and support GitHub CI/CD pipelines for platform and engineering deployments.
- Troubleshoot platform, deployment and access-related issues.
- Produce and maintain technical documentation and operational runbooks.
- Support knowledge transfer and platform enablement activities with client teams.
Essential Skills
- Strong commercial experience as a Data Engineer working with Databricks.
- Experience administering Databricks environments at workspace and account level.
- Strong understanding of Unity Catalog and Databricks security models.
- Experience with Databricks on AWS.
- Terraform and Infrastructure as Code experience.
- Experience building and maintaining GitHub CI/CD pipelines.
- Knowledge of cloud networking, access controls and platform governance.
- Strong troubleshooting and problem-solving skills.
- Excellent documentation and stakeholder communication skills.
- Active SC Clearance.
Desirable
- Experience within government, defence or other regulated environments.
- Azure Databricks exposure.
- Experience supporting platform migrations or cloud transformation programmes.
- Knowledge of disaster recovery and business continuity planning.