Lead Data Engineer

Description

Key Responsibilities

• 
  
• Design, build, and maintain robust ETL processes for large-scale datasets (500,000+ customers).
  
• Develop and optimise SQL queries, ensuring performance and efficiency.
  
• Work closely with stakeholders to translate business needs into technical solutions.
  
• Manage cloud-based data infrastructure, preferably in AWS (S3, Athena, Lambda).
  
• Maintain and enhance Microsoft SQL Server technologies (SSRS, SSIS, SSAS).
  
• Document processes, data pipelines, and best practices to ensure clarity and maintainability.
  
• Mentor junior data engineers and ensure high coding standards across the team.
  
• Contribute to the strategic roadmap for data architecture and technology improvements.
  

Skills Knowledge and Expertise

• 
  
• 5+ years of hands-on experience working with large relational databases (500,000+ customers).
  
• Strong Python skills for data manipulation and automation.
  
• Deep understanding of relational database concepts (data types, joins, sub-queries, primary/foreign keys, indexing, normalisation).
  
• Experience with Microsoft SQL Server technologies (SSRS, SSIS, SSAS).
  
• Proficiency in cloud technologies, preferably AWS (S3, Athena, Lambda).
  
• Ability to translate non-technical business requirements into effective technical specifications.
  
• Proven ability to produce clear and structured documentation for data processes.
  

Benefits

• 
  
• Annual Leave: 25 days + bank holidays
  
• Ability to buy and sell holiday days as well as the ability to bank days (tenure dependent) 
  
• Flexible working options: we are operating a hybrid working model with 3 days a week from the office
  
• Pension: Hargreaves Lansdown – 6% matched contribution 
  
• Employee share scheme
  
• Generous family friendly cover
  
• Private healthcare - Bupa 
  
• Income protection
  
• Critical illness cover
  
• Life insurance cover
  
• Dental cover
  
• Optical cover
  
• Yulife app for access to employee wellbeing and discounts 
  
• Perks at Work, cashback/discount shopping site
  
• Employee referral scheme 
  
• Salary sacrifice program which includes cycle to work scheme, electric car scheme and season ticket loans
  
• Volunteering program
  
• Company events i.e. Christmas party, all-company event and other social/hosted events during the year (we have an active social committee!)
  
• Team socials