Head of Data Engineering

Cornwallis Elt Ltd
London
2 days ago
Create job alert

Head of Data Engineering – Azure, Databricks, Private Markets

A global Private Equity firm are seeking an experienced Head of Data Engineering as part of a critical data transformation and modernisation programme, moving towards a data-first approach. They are currently in the process of replacing a legacy data-warehouse setup with a platform as a service model using Databricks hosted on Azure, which this role will be responsible for leading, taking line management responsibilities for their Data Engineering team.

You will take ownership for progressing their Databricks setup, from its current PoC/incubator phase through to production, ensuring a high level of optimisation and scalability to operate at a global scale.

This will also involve implementing a semantic layer within the platform for effective data management and organisation, as well as the development of associated data pipelines and real-time reporting & visualization capabilities.

Once the platform is in place, the business will then look to apply Data Science techniques with the aim of building a best-in-class data function that works in partnership with the Investment Team and actively provides deep, actionable insights to enable business growth.

The ideal candidate will demonstrate:

  • A technical background in data engineering with experience of technologies including Python, Spark, Databricks and Azure cloud.
  • Previous experience in managing the end-to-end build of an Azure Databricks platform
  • Passionate about all aspects of data (data governance, data quality management etc.) and the positive impact ‘good data’ can bring to a business
  • An understanding of Data Science techniques (ML, NLP, AI etc.) would be beneficial
  • Demonstrable experience in setting up and managing high-performing technology teams, establishing and driving best practises and being able to still engage at a technical level
  • Able to credibly and confidently engage with the business at all levels
  • A background in Financial Services (Private Markets, Investment Banking, Investment Management) is critical

If you are a data enthusiast with experience in leading high-performing teams to develop modern data platforms, then this is a genuinely exciting time to join a growing business transitioning to a data-first approach.

J-18808-Ljbffr

Related Jobs

View all jobs

Head of Data Engineering

Head of Data Engineering

Head of Data Engineering

Head of Data Engineering

Head of Data Engineering (Tech4Good) | £90,000 - £110,000 + Bonus |

Head of Data Engineering (Azure) - £90,000 - £100,000 |

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

Global vs. Local: Comparing the UK Data Science Job Market to International Landscapes

How to evaluate salaries, opportunities, and work culture in data science across the UK, the US, Europe, and Asia Data science has proven to be more than a passing trend; it is now a foundational pillar of modern decision-making in virtually every industry—from healthcare and finance to retail and entertainment. As the volume of data grows exponentially, organisations urgently need professionals who can transform raw information into actionable insights. This high demand has sparked a wave of new opportunities for data scientists worldwide. In this article, we’ll compare the UK data science job market to those in the United States, Europe, and Asia. We’ll explore hiring trends, salary benchmarks, and cultural nuances to help you decide whether to focus your career locally or consider opportunities overseas or in fully remote roles. Whether you’re a fresh graduate looking for your first data science position, an experienced data professional pivoting from analytics, or a software engineer eager to break into machine learning, understanding the global data science landscape can be a game-changer. By the end of this overview, you’ll be better equipped to navigate the expanding world of data science—knowing which skills and certifications matter most, how salaries differ between regions, and what to expect from distinct work cultures. Let’s dive in.

Careers

Data Science Leadership for Managers: Strategies to Motivate, Mentor, and Set Realistic Goals in Data-Driven Teams

Data science has become a linchpin in modern business, transforming oceans of raw data into actionable insights that guide strategy, product development, and personalised customer experiences. With this surge in data-centric operations, the need for effective data science leadership has never been more critical. Guiding a team of data scientists, analysts, and machine learning engineers requires not only technical acumen but also the ability to foster collaboration, champion ethical practices, and align complex modelling efforts with overarching business goals. This article provides practical guidance for managers and aspiring leaders aiming to excel in data-driven environments. By exploring strategies to motivate data science professionals, develop mentoring frameworks, and set achievable milestones, you will be better prepared to steer your team towards meaningful, evidence-based outcomes.

Jobs Careers

10 Essential Books to Read to Nail Your Data Science Career in the UK

Data science continues to be one of the most exciting and rapidly evolving fields in tech. With industries across the UK—ranging from finance and healthcare to e-commerce and government—embracing data-driven decision-making, the demand for skilled data scientists has soared. Whether you're a recent graduate looking for your first role or a professional aiming to advance your career, staying updated through books is crucial. In this article, we explore ten essential books every data science job seeker in the UK should read. Each book provides valuable insights into core concepts, practical applications, and industry-standard tools, helping you build skills employers are actively looking for.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.