National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior Data Engineer (Data Governance, Databricks, PySpark)

PEXA
Leeds
1 week ago
Create job alert

1 week ago Be among the first 25 applicants

This range is provided by PEXA. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Hi, we’re Smoove, part of the PEXA Group.

Our vision is to simplify and revolutionise the home moving and ownership experience for everyone. We are on a mission to deliver products and services that remove the pain, frustration, uncertainty, friction and stress that the current process creates.

We are a leading provider of tech in the property sector - founded in 2003, our product focus has been our conveyancer two-sided marketplace, connecting consumers with a range of quality conveyancers to choose from at competitive prices via our easy-to-use tech platform. We are now building out our ecosystem so consumers can benefit from our services either via their Estate Agent or their Mortgage Broker, through smarter conveyancing platforms, making the home buying or selling process easier, quicker, safer and more transparent

Why join Smoove?

Great question! We pride ourselves on attracting, developing and retaining a diverse range of people in an equally diverse range of roles and specialisms – who together achieve outstanding results. Our transparent approach and open-door policy make Smoove a great place to work and as our business expands, we are looking for ambitious, talented people to join us.

We are looking for a technically proficient Senior Data Engineer to join our growing Data team.

Your primary focus will be on ensuring data quality, stability, and reliability — from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports.

You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready.

Our data platform is built using Databricks, with data pipelines written in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs.

This includes work with complex, nested data structures, ensuring they are reliably parsed and transformed. Experience in managing sensitive data (PII) and implementing GDPR policies is required.

You’ll work closely with analysts, engineers, and business stakeholders to ensure that datasets are not only accurate but also trusted.

You will collaborate with product and engineering teams to incorporate data from new products into our core business datasets, ensuring that these new sources meet our data standards and are quickly usable for business intelligence.

You’ll help put controls in place — such as access policies, metadata layers, and automated data quality checks — to ensure long-term stability. Experience with a data governance platform like Alation is desirable.

While predominantly remote / home based the team meet up to 20-25 days per year for meaningful collaboration in either Leeds or Thame.

Key Responsibilities

  • Ensure end-to-end data quality, from raw ingested data to business-ready datasets
  • Optimise PySpark-based data transformation logic for performance and reliability
  • Build scalable and maintainable pipelines in Databricks and Airflow
  • Implement and uphold GDPR-compliant processes around PII data
  • Collaborate with stakeholders to define what "business-ready" means, and confidently sign off datasets as fit for consumption
  • Put testing strategies in place to detect data issues early and often
  • Contribute to access management, metadata management, and wider data governance practices
  • Help shape our approach to reliable data delivery for internal and external customers


Skills & Experience Required

  • Extensive hands-on experience with PySpark, including performance optimisation
  • Deep working knowledge of Databricks (development, architecture, and operations)
  • Proven experience working with Airflow for orchestration
  • Proven track record in managing and securing PII data, with GDPR compliance in mind
  • Experience in data governance processes; Alation experience preferred, but similar toolswelcome
  • Strong SQL skills and experience optimising complex queries
  • Strong experience in handling and transforming semi-structured data
  • High competency in programming, with a focus on clean, efficient, and production-quality code
  • Demonstrated ability to work with stakeholders to understand data needs and guide the validation and delivery process
  • Experience implementing and maintaining data quality tests and monitoring solutions
  • Strong verbal and written communication skills
  • Ability to think holistically about data reliability and how it serves business decisions


Sound like you?

We at Smoove are ready so if this role sounds like you, apply today.

GDPR Compliance

Digital Completion UK Limited (trading name “PEXA”), Optima Legal Services Limited (trading name "Optima Legal") and Smoove Limited (a holding company which comprises of the following wholly owned trading Subsidiary companies: United Legal Services Limited, United Home Services Limited, Legal-Eye Limited, and Amity Law Limited) are all owned directly by DigCom UK Holdings Limited, which is a wholly owned Subsidiary of PEXA Group Limited in Australia (ACN 140 677 792; ASX: PXA) (referred to collectively as “PEXA Group”).

When we process your applicant personal data for recruitment purposes, we do so as a controller. If as part of the recruitment process, we share your personal data with another company within the PEXA Group, that company may process your personal data as either an independent controller or, in certain circumstances, a joint controller. By applying for this role, you consent to us processing your personal data in accordance with the UK General Data Protection Regulation ("UK GDPR") and the Data Protection Act 2018, and further information can be found in our privacy noticehttps://pexa.co.uk/applicant-policy/.Seniority level

  • Seniority levelNot Applicable

Employment type

  • Employment typeFull-time

Job function

  • Job functionInformation Technology
  • IndustriesInformation Services, Financial Services, and IT Services and IT Consulting

Referrals increase your chances of interviewing at PEXA by 2x

Get notified about new Senior Data Engineer jobs inLeeds, England, United Kingdom.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Jobs Skills Radar 2026: Emerging Tools, Languages & Platforms to Learn Now

The UK’s data science job market is evolving fast—from forecasting models and AI assistants to real-time decision systems. In 2026, data scientists aren’t just expected to build models—they’re responsible for shaping insights that fuel everything from patient care to predictive banking. Welcome to the Data Science Jobs Skills Radar 2026—your essential annual guide to the languages, tools, and platforms driving demand across the UK. Whether you’re entering the job market or reskilling mid-career, this roadmap helps you prioritise the skills that matter most right now.

How to Find Hidden Data Science Jobs in the UK Using Professional Bodies like the RSS, BCS & More

The data science job market in the UK is thriving—but also increasingly competitive. As organisations in finance, healthcare, retail, government, and tech accelerate digital transformation, the demand for data talent has soared. Yet many of the best data science jobs are never posted publicly. They’re shared behind closed doors—within professional networks, at invite-only events, or through member-only mailing lists and specialist interest groups. These “hidden” roles are often filled through referrals, collaborations, or direct outreach to trusted experts. In this guide, we’ll show you how to unlock these hidden opportunities by engaging with key UK professional bodies such as the Royal Statistical Society (RSS), BCS (The Chartered Institute for IT), and Turing Society, plus communities like PyData and AI UK. You’ll learn how to use directories, CPD events, and networks to move beyond job boards—and into roles where you’re approached, not just applying.

How to Get a Better Data Science Job After a Lay-Off or Redundancy

Redundancy can be tough to face, especially in a competitive field like data science. But it’s important to know: your experience, analytical thinking, and modelling skills are still in demand. Across sectors like healthcare, finance, e-commerce, government and AI startups, UK employers continue to seek data scientists who can deliver value through insight, prediction, and automation. This guide will walk you through how to bounce back from redundancy with purpose and clarity—whether you're a data analyst looking to step up, a mid-level data scientist, or a machine learning specialist seeking a better-aligned opportunity.