Data Platform Engineer
Greater Manchester (Hybrid - 2 days onsite)
Salary up to 60K
We are a Manchester-based technology and market research company looking for a Data Platform Engineer to join our growing team!
What you'll do as a Data Platform Engineer:
- Proactively identify opportunities to improve the data platform, including performance, architecture and design, and take ownership of implementation.
- Design, architect and build internal platform tooling to support best practice development and delivery of data products.
- Develop scalable cloud native solutions using AWS technologies.
- Build and maintain backend services and infrastructure using Python.
- Work with Apache Spark and Apache Airflow for data orchestration pipelines.
- Implement infrastructure as code using Terraform and/or AWS CloudFormation.
- Manage IAM setups and contribute to cloud security best practices.
- Collaborate closely with engineering, product and operations teams to align on scope and deliverables.
Key requirements:
- 3+ years of professional Python engineering experience focused on AWS based data platforms.
- Strong experience with DevOps, cloud engineering and running production data platforms.
- Hands on experience provisioning and managing Apache Airflow.
- Experience with CI/CD pipelines, automated testing and agile software development practices.
- Comfortable working with large and complex datasets while breaking down challenging technical problems collaboratively.
- Exposure to AI assisted development tools to enhance coding, reviews, productivity and documentation.
Benefits:
Salary up to 60K, Hybrid working (2 days a week onsite), 25 days holiday + bank holidays, Life assurance and workplace pension, + much more!