Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Lead Data Quality Engineer (Azure Fabric)

The Ebrd
London
2 days ago
Create job alert

Own the quality frontier of data and analytics. We're seeking a Principal Quality Engineer for Data & Analytics to lead quality engineering strategy and execution across next‑generation data platforms. In this role, you'll embed quality at the core of Microsoft Fabric, Azure Integration Services, IDMC and Tibco EBX, weaving automated data validation, lineage checks, and regression testing directly into CI/CD pipelines. You'll pressure‑test resilience with failover scenarios, validate mission‑critical dataflows, and ensure that every pipeline, from raw ingestion to business‑ready insights, is robust, reliable, and built for scale. This is your opportunity to set the bar for quality engineering in enterprise analytics. You'll apply advanced automation, AI/ML‑driven assurance, and shift‑left/shift‑right practices to accelerate delivery without compromising control. Leveraging T‑SQL, Python, Playwright, Postman, PySpark, Power Query (M), DAX, XMLA, Fabric Notebooks, Delta Lake, Fabric Data Pipelines, Azure Data Factory, Data Pipelines, Azure DevOps CI/CD, and REST/Graph APIs, you'll bring deep technical expertise while aligning to frameworks like NIST CSF, DORA, and ITIL v4. If you thrive at the intersection of data, DevOps, and quality engineering, and want to shape the reliability of modern Data and Analytics ecosystems in a fast‑moving, high‑stakes environment, this role will give you the chance to leave your mark.


Accountability and Responsibility

  • Integrates Agile and DevOps principles across data integration pipelines, aligning with ITIL v4 and DataOps for quality‑centric operational delivery in enterprise analytics ecosystems.
  • Embeds data quality checks and lineage validation directly into CI/CD workflows using Azure DevOps pipelines for Azure Data Factory (ADF), Informatica Intelligent Cloud Services (IICS), and SAP HANA native development.
  • Implements regression testing and data comparison strategies across multi‑environment ADF pipelines and Informatica mappings, including use of snapshot‑based reconciliation for critical data flows into SAP HANA.
  • Applies resilience and failover validation scenarios to critical dataflows, including simulated connector outages, queue backlogs, and timeout conditions in ADF and Informatica to ensure business continuity and alert responsiveness.
  • Holds ISTQB Advanced Test Manager or an equivalent recognised certification in test management, or demonstrable experience.
  • Qualification in IT Service Management, such as ITIL v3 or v4 Foundation or equivalent.
  • Familiar with NIST cybersecurity framework (CSF) and EU Digital Operational Resilience Act (DORA).
  • Demonstrates comprehensive QA leadership across advanced automation, performance, shift‑left, or shift‑right testing.
  • Demonstrable experience in Quality Engineering management and operations within an agile, product focused IT department, ideally within a financial institution.
  • Experienced in advanced AI/ML approaches for improving quality efficiency and effectiveness, analytics, defect identification, understanding how AI can enhance quality processes.
  • Demonstrable experience in testing data platform configuration and setup, data feeds, inputs and outputs from a modern Data Analytics platform based on MS Fabric “Medallion Architecture” and Azure Data Lake Gen2, alongside more traditional SQL / Datawarehouse skills.
  • Extensive experience in testing and validation of code requiring dev level T‑SQL, Python, Azure Data Factory, PowerQuery (M), XMLA, DAX skills will be required.
  • Proficiency in writing testing queries in T‑SQL / Python for data validation purposes, ability to run Data Factory Pipelines / Data flows (Gen2) and DAX / XMLA for Tabular model data validation / testing would be mandatory.
  • Experienced in testing Data Platforms and Data Engineering solutions on Microsoft Intelligent Data Platform including Microsoft Fabric experience, Azure Databricks, Agile delivery (ideally Azure DevOps).
  • Extensive experience as a technical testing specialist with MS Data Engineering and ideally Power BI / Analytics skills.

Our agile and innovative approach is what makes life at the EBRD a unique experience! You will be part of a pioneering and diverse international organisation, and use your talents to make a real difference to people's lives and help shape the future of the regions we invest in.


At EBRD, our Values – Inclusiveness, Innovation, Trust, and Responsibility – are at the heart of how we work. We bring these to life through our Workplace Behaviours: listening well and speaking up, collaborating smartly, acting decisively with full commitment, and simplifying to amplify our impact. These principles shape our culture and define our success. We seek individuals who not only share these values but are also committed to embedding them in their daily work, fostering a positive and high‑performing environment.


The EBRD environment provides you with:

  • Varied, stimulating and engaging work that gives you an opportunity to interact with a wide range of experts in the financial, political, public and private sectors across the regions we invest in.
  • A working culture that embraces inclusion and celebrates diversity. Our workforce reflects a broad range of backgrounds, perspectives, and experiences, bringing fresh ideas, energy, and innovation and enhancing our ability to serve our clients, shareholders, and counterparties effectively.
  • We offer hybrid and flexible working arrangements and believe we operate at our best when collaborating 3 days a week in person (minimum).
  • An environment that places sustainability, equality and digital transformation at the heart of what we do.
  • A workplace that prioritises employee wellbeing and provides a comprehensive suite of competitive benefits.

Diversity is one of the Bank's core values which are at the heart of everything it does. As such, the EBRD seeks to ensure that everyone is treated with respect and given equal opportunities and works in an inclusive environment. The EBRD encourages all qualified candidates who are nationals of the EBRD member countries to apply regardless of their racial, ethnic, religious and cultural background, gender, gender identity, sexual orientation, age, socio‑economic background or disability.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Quality Engineer

Lead Data Engineer

AI Data Quality & Engineering Lead

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data science hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise rigorous problem framing, high‑quality analytics & modelling, experiment/causality, production awareness (MLOps), governance/ethics, and measurable product or commercial impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for product/data scientists, applied ML scientists, decision scientists, econometricians, growth/marketing analysts, and ML‑adjacent data scientists supporting LLM/AI products. Who this is for: Product/decision/data scientists, applied ML scientists, econometrics & causal inference specialists, experimentation leads, analytics engineers crossing into DS, ML generalists with strong statistics, and data scientists collaborating with platform/MLOps teams in the UK.

Why Data Science Careers in the UK Are Becoming More Multidisciplinary

Data science once meant advanced statistics, machine learning models and coding in Python or R. In the UK today, it has become one of the most in-demand professions across sectors — from healthcare to finance, retail to government. But as the field matures, employers now expect more than technical modelling skills. Modern data science is multidisciplinary. It requires not just coding and algorithms, but also legal knowledge, ethical reasoning, psychological insight, linguistic clarity and human-centred design. Data scientists are expected to interpret, communicate and apply data responsibly, with awareness of law, human behaviour and accessibility. In this article, we’ll explore why data science careers in the UK are becoming more multidisciplinary, how these five disciplines intersect with data science, and what job-seekers & employers need to know to succeed in this transformed field.

Data Science Team Structures Explained: Who Does What in a Modern Data Science Department

Data science is one of the most in-demand, dynamic, and multidisciplinary areas in the UK tech and business landscape. Organisations from finance, retail, health, government, and beyond are using data to drive decisions, automate processes, personalise services, predict trends, detect fraud, and more. To do that well, companies don’t just need good data scientists; they need teams with clearly defined roles, responsibilities, workflows, collaboration, and governance. If you're aiming for a role in data science or recruiting for one, understanding the structure of a data science department—and who does what—can make all the difference. This article breaks down the key roles, how they interact across the lifecycle of a data science project, what skills and qualifications are typical in the UK, expected salary ranges, challenges, trends, and how to build or grow an effective team.