Lead Data Engineer

Searchability NS&D
Gloucester
7 months ago
Create job alert

3 days ago Be among the first 25 applicants

This range is provided by Searchability NS&D. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Direct message the job poster from Searchability NS&D

Lead Consultant placing Security Cleared DevOps, Cloud, Data, Cyber, and Infrastructure candidates in the Southwest

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Lead Data Engineer in Gloucester

  • Gloucester location – hybrid working when possible
  • Must hold active Enhanced DV Clearance (West)
  • Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus
  • Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership

Who Are We?

Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth.

What will the Lead Data Engineer be Doing?

You will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing and implementing sophisticated data pipelines to connect operational systems with analytics and business intelligence platforms.

Responsibilities include:

  • Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment
  • Develop data-streaming and ETL solutions (e.g. NiFi)
  • Model databases and integrate data from diverse sources
  • Ensure data quality, consistency, and security
  • Monitor and optimise system performance
  • Apply systems integration expertise within agile teams
  • Decompose user needs into epics and stories
  • Promote reuse of data flows and best practices across teams

The Lead Data Engineer Should Have:

  • Active eDV clearance (West)
  • Willingness to work full-time on-site in Gloucester when required.

Required experience in the following:

  • SQL and NoSQL databases (e.g. MongoDB)
  • ETL processing languages such as Groovy, Python or Java
  • Understand and interpret technical and business stakeholder needs
  • Manage expectations through clear, proactive communication
  • Lead and support challenging conversations with teams and senior stakeholders

To be Considered:

Please either apply by clicking online or emailing me directly to . For further information please call me on / - I can make myself available outside of normal working hours to suit from 7am until 10pm. If unavailable, please leave a message and either myself or one of my colleagues will respond. By applying for this role, you give express consent for us to process & submit (subject to required skills) your application to our client in conjunction with this vacancy only. Also feel free to follow me on Twitter @SearchableHenry or connect with me on LinkedIn, just search Henry Clay-Davies (searchability). I look forward to hearing from you.

KEY SKILLS:

DATA ENGINEER / DATA ENGINEERING / DEFENCE / NATIONAL SECURITY / DATA STRATEGY / DATA PIPELINES / DATA GOVERNANCE / SQL / NOSQL / APACHE / NIFI / KAFKA / ETL / GLOUCESTER / DV / SECURITY CLEARED / DV CLEARANCE

Seniority level

  • Seniority levelMid-Senior level

Employment type

  • Employment typeFull-time

Job function

  • Job functionInformation Technology and Consulting
  • IndustriesData Infrastructure and Analytics, Technology, Information and Media, and Information Services

Referrals increase your chances of interviewing at Searchability NS&D by 2x

Sign in to set job alerts for “Data Engineer” roles.

Gloucestershire, England, United Kingdom 4 days ago

Gloucestershire, England, United Kingdom 2 months ago

Worcester, England, United Kingdom 3 days ago

Gloucester, England, United Kingdom 4 hours ago

Worcester, England, United Kingdom 1 month ago

Stroud, England, United Kingdom 4 hours ago

Gloucester, England, United Kingdom 1 week ago

Gloucestershire, England, United Kingdom 4 days ago

System Reliability Engineer - Quantum Computing

Cambridge, England, United Kingdom 6 months ago

Software Support Engineer - Labyrinth Screening

Gloucester, England, United Kingdom 2 days ago

Gloucestershire, England, United Kingdom 1 week ago

Stroud, England, United Kingdom 3 weeks ago

Cambridge, England, United Kingdom 6 months ago

Cambridge, England, United Kingdom 1 month ago

Brockworth, England, United Kingdom 2 weeks ago

Research Software Engineer - Quantum Software

Cambridge, England, United Kingdom 2 months ago

Gloucester, England, United Kingdom 5 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.


#J-18808-Ljbffr

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer (AWS & Snowflake)

Lead Data/Head of Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

New Data Science Employers to Watch in 2026: UK and International Companies Leading Analytics and AI Innovation

Data science has emerged as one of the most transformative forces across industries, turning raw information into actionable insights, predictive models, and AI-powered solutions. In 2026, the UK is witnessing a surge in organisations where data science is not just a support function but the core of their products and services. For professionals exploring opportunities on www.DataScience-Jobs.co.uk , identifying these employers early can provide a competitive advantage in a market with high demand for advanced analytics and machine learning expertise. This article highlights new and high-growth data science employers to watch in 2026, focusing on UK startups, scale-ups, and global firms expanding their data science operations locally. All of the companies included have recently raised investment, won high-profile contracts, or significantly scaled their analytics teams.

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.