Lead Data Engineer

Lead Data Engineer
Leeds / Hybrid
3 months with strong change of extension
Competitive daily rate, Outside IR35

Why Apply?
This is a fantastic opportunity for a Contract Lead Data Engineer to work on a Proof of Concept project with a leading organisation. You'll be the data SME on a high impact initiative, shaping the way business critical data is extracted, transformed, and analysed.

Lead Data Engineer Responsibilities

• Lead a POC project to determine the most effective approach for enabling data analysis from an Azure Data Lake.
• Explore and implement solutions using Databricks, Synapse, and other big data technologies.
• Design processes to filter, extract, and export Parquet files for business user investigation.
• Collaborate with architects, project managers, and business stakeholders as the data subject matter expert.
• Provide accurate technical input into project updates and status reporting.

Lead Data Engineer Requirements

• Proven experience as a Lead Data Engineer on enterprise-scale cloud data projects.
• Strong hands on knowledge of Azure Data Lake environments.
• Expertise in Databricks and/or Synapse, with additional exposure to Apache Spark and Hadoop.
• Solid experience with Parquet file formats and data engineering best practices.
• Proficiency in SQL, Python, and PySpark.
• Excellent analytical skills with the ability to design pragmatic solutions in evolving environments.
• Strong communication and stakeholder engagement skills, with the confidence to act as the data SME.

We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, sex, disability, religion/belief, sexual orientation or age.