Jobs

Lead Data Engineer


Job details
  • JobLookup
  • London
  • 4 days ago

SR2 have just partnered with aUK based consultancywho are urgently looking to hire severalLead Data Engineers.


Make sure to read the full description below, and please apply immediately if you are confident you meet all the requirements.

Location:Central London (2 - 3 days a week onsite).

Salary:£95,000 - 105,0000 (dependant on experience).

Tech / Tools:Python, PySpark, SQL, ELT, Azure DataBricks, Data Factory, Snowflake, CI/CD.

Key responsibilities:

  • Lead technical delivery of strategic programmes, taking ownership for designing and building innovative data solutions.
  • Work with the data engineering team to help deliver key projects on time.
  • Create robust, performant data pipelines.
  • Work on messy, complex real-world data challenges.
  • Implement CI/CD practices for data pipelines to improve efficiency and quality of data processing.
  • Demonstrate strong programming / scripting skills in Python.
  • Build robust ETL processes to extract, transform, and load data from diverse sources.
  • Ensure data integrity, security, privacy, and compliance across all data workflows.
  • Continuously monitor system performance and implement strategies to enhance efficiency.
  • You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP).
  • Support in setting the direction and vision of the Data Engineering team.

Ideal background:

  • 6+ years in a Data Engineering position.
  • Excellent knowledge of PySpark, Python and SQL fundamentals.
  • Good experience with Azure DataBricks, Data Factory, Snowflake, CI/CD.
  • Ability to work on messy, complex real-world data challenges.
  • Experience working for a consultancy / large organisation would be a big plus.
  • Must have strong client-facing experience.
  • Be comfortable working in a fast-paced environment, working across several different projects.

You must be eligible for SC clearance.

If interested, please apply with your updated CV and we’ll line up a call to discuss the details.

Look forward to hearing from you all!

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Lead Data Engineer - SC Cleared

Lead Data Engineer – SC Cleared (or Clearable)Location: LondonSalary: Up to £80,000Start Date: ASAPAbout the RoleJoin a dynamic Digital Transformation Consultancy as a Lead Data Engineer and play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You’ll be responsible for designing and implementing robust ETL pipelines,...

Paddington

Lead Data Engineer - GCP

We're seeking a Lead Data Engineer, experienced in GCP, to join our Technology team here at N Brown Group! This role is a balance of hands-on data engineering alongside technical leadership and coaching, working within an agile operating environment. What will you do as a Lead Data Engineer at N...

Manchester

Lead Data Engineer

Lead Data EngineerSalary/Rate: £100,000 - £110,000 per annum + BonusLocation: North LondonCompany: RetelligenceAbout RetelligenceRetelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions....

Highbury

Lead Data Engineer in London - PA Consulting (Basé à London)

This is a job posted by our partner JoobleSkills and ExperienceDesigning and deploying production-grade data pipelines (batch and streaming) within a big data architecture using tools like Python,Scala,Spark, and SQL.Expertise in either AWS or Azure cloud platforms, with hands-on experience in key services such as:Location108 E 16th Street, New York,...

Jobleads Holloway

Lead Data Engineer in London - PA Consulting

This is a job posted by our partner JoobleSkills and ExperienceDesigning and deploying production-grade data pipelines (batch and streaming) within a big data architecture using tools like Python,Scala,Spark, and SQL.Expertise in either AWS or Azure cloud platforms, with hands-on experience in key services such as:Location108 E 16th Street, New York,...

Jobleads London

Lead Data Engineer

Lead Data Engineer, SC Clearance required, outside IR35, travel once/ twice a month to Newcastle.Role Overview:We are seeking a Lead Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and frameworks that support data-driven decision-making. You will work collaboratively...

BrightBox Group Ltd