Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry
Lead Data Engineer
Salary: £70-90k
Location: Reading – Hybrid
Benefits: Competitive
Role Overview:
As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. You will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis.
Key Responsibilities:
• Lead and manage a team of data engineers.
• Design, build, and maintain data infrastructure and systems.
• Ensure effective use of Microsoft Fabric and Synapse analytics platform.
• Collaborate with various stakeholders, including Data and Systems owners, Data Analysts, Data Architects, Infrastructure Architects, and external suppliers.
Experience required
• Dynamic and hands-on leader who excels in managing and coaching a team.
• Thrives in a collaborative environment and adapts to changing priorities with ease.
• Excellent communication and presentation skills, capable of conveying complex ideas to both technical and non-technical stakeholders.
• Deep understanding of DataLake, Lakehouse, and Warehouse paradigms.
• Extensive experience in developing and maintaining data pipelines for ELT/ETL from various data sources, including databases, APIs, text files, and Parquet.
• Expert knowledge of theMicrosoft Fabric Analytics Platform(Azure SQL, Synapse, PowerBI).
• Proficient in Python for data engineering tasks, including data ingestion from APIs, creation and management of Parquet files, and execution of ML models.
• Strong SQL skills, enabling support for Data Analysts with efficient and performant queries.
• Skilled in optimizing data ingestion and query performance for MSSQL or other RDBMS.
• Familiar with data processing frameworks such as Apache Spark.
• Highly analytical and tenacious in solving complex problems.
