Lead Data Engineer

Holborn and Covent Garden
3 weeks ago
Create job alert

Lead Data Engineer ( Databricks )
London - Hybrid - Remote
Permanent
£100,000 - £130,000 plus up to 20% bonus based on performance and commercial contribution

About the Role

We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements.

This is a senior client-facing leadership role, blending hands-on technical delivery with architectural design and pre-sales influence.

You'll be leading high-performing squads, guiding complex transformations, and working directly with senior stakeholders to bridge business needs and engineering excellence — particularly in industries like manufacturing, utilities, and aviation.

This is a key hire to support our clients expanding Databricks practice, to build capacity for future growth.

What You’ll Be Doing

  • Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks.

  • Architect robust, scalable data platforms using the medallion architecture.

  • Translate business requirements into scalable workflows, advising on data governance, quality, and security.

  • Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog.

  • Guide teams in implementing best practices across engineering, DevOps, and model deployment.

  • Support pre-sales activity, including shaping proposals, estimates, and technical roadmaps.

  • Provide technical leadership, mentorship, and oversight to squads of Senior and Associate Engineers.

  • Collaborate closely with Platform Engineers and Platform Architects to align infrastructure with data needs.

  • Contribute to growing the Databricks capability – from delivery frameworks to internal tooling and capability development.

  • Lead a team of data engineers, fostering a collaborative and growth-oriented environment.

  • Evaluate new data engineering technologies and strategies, assessing their relevance and fit for the organisation’s strategic goals.

  • Work closely with the commercial team to scope projects and develop proposals that align technical capabilities with client requirements.

    Essential Skills & Experience

  • 8+ years in data engineering, with at least 2+ in a technical leadership role

  • Proven experience designing and leading Databricks-based data platforms

  • Deep understanding of the medallion architecture, data lakehouse design, and transformation workflows

  • Hands-on expertise with DLT, Unity Catalog, and model deployment frameworks

  • Strong communication and consulting skills – able to lead client conversations and manage stakeholders

  • Experience in agile delivery environments and cross-functional teams

  • Commercial awareness – comfortable contributing to pre-sales, growing accounts, and engaging with commercial targets

    Desirable Skills

  • Experience in physical asset-heavy industries (e.g. utilities, manufacturing, aviation)

  • Familiarity with platform and DevOps collaboration, especially on AWS or Azure

  • Certifications in Databricks or cloud platforms (AWS/Azure)

  • Background in consulting or client delivery environments

    Why Join?

  • Join a consultancy that’s doubling down on Databricks with enterprise-grade delivery

  • Be the go-to technical leader on projects with real-world business impact

  • Shape the future of our Databricks workforce strategy and delivery model

  • Career progression into Delivery Lead, Practice Lead, or Pre-Sales Specialist

  • Competitive compensation and strong bonus structure, aligned with delivery and commercial impact

    To find out more about this high profile Lead Data Engineering position, click apply

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead data Engineer - Financial Markets - Day rate

Lead Data Engineer AWS

Lead Data Engineer

Lead Data Developer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Negotiating Your Data Science Job Offer: Equity, Bonuses & Perks Explained

Data science has rapidly evolved from a niche specialty to a cornerstone of strategic decision-making in virtually every industry—from finance and healthcare to retail, entertainment, and AI research. As a mid‑senior data scientist, you’re not just running predictive models or generating dashboards; you’re shaping business strategy, product innovation, and customer experiences. This level of influence is why employers are increasingly offering compensation packages that go beyond a baseline salary. Yet, many professionals still tend to focus almost exclusively on base pay when negotiating a new role. This can be a costly oversight. Companies vying for data science talent—especially in the UK, where demand often outstrips supply—routinely offer equity, bonuses, flexible work options, and professional development funds in addition to salary. Recognising these opportunities and effectively negotiating them can have a substantial impact on your total earnings and long-term career satisfaction. This guide explores every facet of negotiating a data science job offer—from understanding equity structures and bonus schemes to weighing crucial perks like remote work and ongoing skill development. By the end, you’ll be well-equipped to secure a holistic package aligned with your market value, your life goals, and the tremendous impact you bring to any organisation.

Data Science Jobs in the Public Sector: Exploring Opportunities Across GDS, NHS, MOD, and More

Data science has emerged as one of the most influential fields in the 21st century, transforming how organisations make decisions, improve services, and solve complex problems. Nowhere is this impact more visible than in the UK public sector. From the Government Digital Service (GDS) to the National Health Service (NHS) and the Ministry of Defence (MOD), government departments and agencies handle vast amounts of data daily to support the well-being and security of citizens. For data enthusiasts looking to make a meaningful contribution, data science jobs in the public sector can offer rewarding roles that blend innovation, large-scale impact, and societal benefit. In this comprehensive guide, we’ll explore why data science is so pivotal to government, the roles you might find, the skills needed, salary expectations, and tips on how to succeed in a public sector data science career.

Contract vs Permanent Data Science Jobs: Which Pays Better in 2025?

Data science sits at the intersection of statistics, machine learning, and domain expertise, driving crucial business decisions in almost every sector. As UK organisations leverage AI for predictive analytics, customer insights, and automation, data scientists have become some of the most in-demand professionals in the tech job market. By 2025, data scientists with expertise in deep learning, natural language processing (NLP), and MLOps are commanding top-tier compensation packages. However, deciding whether to become a day‑rate contractor, a fixed-term contract (FTC) employee, or a permanent member of an organisation can be challenging. Each path offers a unique blend of earning potential, career progression, and work–life balance. This guide will walk you through the UK data science job market in 2025, examine the differences between these three employment models, present sample take‑home pay scenarios, and offer strategic considerations to help you determine the best fit for your career.