Job Description
Data Engineer
London, Edinburgh or Manchester - Remote Initially
What is a Data Engineer?
Dufrain consider a data engineer to be a multi-skilled individual with experience in delivering solutions across the technical data landscape. Our data engineers have expertise in technical delivery, technologies and concepts in areas such as Data Storage, Data Ingestion, Data Integration, Data Warehousing, Data Preparation and Cloud Infrastructure.
A suitable candidate will also have a wider understanding of how their role and delivery contributes to wider business outcomes and be able to concisely articulate to stakeholders and interested parties their role and solutions in a way that can be easily understood.
Essential Requirements:
• 2+ years of experience in a data engineer role
• Expert SQL Skills
• Experience working with the Hadoop ecosystem (Spark, Hive/Impala, Databricks)
• Strong Programming background in Java, Scala, R or Python
• Experience in designing, developing and managing data pipelines to process large amounts of dataExperience of cloud based big data offerings such as Amazon EMR, Azure HDInsights or Google Dataproc
• Experience of cloud platforms such as Azure, AWS or GCP
• Experience working with an ETL tool e.g. Azure Data Factory, SSIS & Talend
• Understanding of data modelling techniques e.g. Kimball
• Experience working with data streams e.g. Kafka
• Experience working with large, structured and unstructured datasets
• Experience with database technologies (relational, NoSQL, graph)
• Expertise with version control e.g. git
• Flexibility to travel to and work on client sites within the UK and occasionally Europe.
• Excellent track record in executive stakeholder and sponsor management and maintaining valuable relationships.
Key Skills:
• Takes ownership and accountability for mission critical initiatives and deliverables both internally and for clients
• A proven leader of people having significant influence on the careers and aspirations of those working in proximity
• Awareness of current market trends in data having the ability to influence opinion and decisioning across the Data Management spectrum
#LifeAtDufrain #GetBusyLiving
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
