Lead Data Engineer

Kainos
Dartford
3 days ago
Applications closed

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer / Architect – Databricks Active - SC Cleared

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Join Kainos and Shape the Future

At Kainos, we’re problem solvers, innovators, and collaborators - driven by a shared mission to create real impact. Whether we’re transforming digital services for millions, delivering cutting-edge Workday solutions, or pushing the boundaries of technology, we do it together.


We believe in a people-first culture, where your ideas are valued, your growth is supported, and your contributions truly make a difference. Here, you’ll be part of a diverse, ambitious team that celebrates creativity and collaboration.


Ready to make your mark? Join us and be part of something bigger.


As a Lead Data Engineer (Consultant) at Kainos you will be responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Lead Data Engineers provide strong development leadership for team members and take responsibility for the quality of the codebase as well as the match to user needs.


Your responsibilities will include:



  • Taking responsibility for the development of whole components or subsystems within a team. Development incorporates design, code, test and defect resolution.
  • Focusing on hands‑on design and development, using open source and commercial platforms.
  • Defining and enforcing development best practice and coaching team members to ensure consistency.
  • Working with project architects, taking responsibility for non‑functional needs of ETL/ELT data processing pipelines such as robustness and performance.
  • Taking responsibility for standards and execution of unit and integration testing done within the team.
  • Taking responsibility for software product due diligence and integration.
  • Leading troubleshooting and tuning of activities.
  • Working with Operations teams to ensure the application software is operationally ready.
  • Working with Security Architects and accreditors to ensure compliance with relevant legal and security requirements.
  • Advising customers and managers and other team members of the estimated effort and technical implications of user stories and user journeys.
  • Contributing to technical proposals as part of the sales process.
  • Managing, coaching and developing a small number of staff, with a focus on managing employee performance and assisting in their career development. You’ll also provide direction for your team as you solve problems together.

Minimum (essential) requirements:



  • Experience of leading a team of engineers in the implementation of data‑intensive system components
  • Experience of applying standards for design (patterns), development, (style guides) and operational readiness (automation, deployment)
  • Proficient software development experience in one of J ava, Scala, or Python
  • Software development experience withdata‑processing platforms from vendors including Informatica, Azure Databricks or any relevant ETL tools
  • Expert in SQL or SQL extensions for analytical use case
  • Expert understanding of distributed data stores and data processing frameworks
  • Ability to simply and clearly communicate technical design both written and verbally
  • Proficient in designing analytical and operational data models
  • A keen interest in AI technologies

Desirable:



  • Comfortable with Data Warehouse methods and techniques
  • Actively shares their thoughts and views on data practices
  • AWS/Azure/GCP Certified in Data Services
  • Expertise in continuous improvement and sharing input on data best practice
  • Participation in development and/or technology communities
  • Practical experience with AI technologies, tools, processes and delivery

Who you are

Our vision is to enable outstanding people to create digital solutions that have a positive impact on people’s lives. Our values aren't abstract; they are the behaviours we expect from each other every day, and underpin everything that we do. We expect everyone to display our values by being determined in how obstacles are overcome; honest when dealing with others; respectful of how you treat others; creative to find solutions to complex problems and cooperative by sharing information, knowledge and experience.


These values, applied collectively, help to produce an outstanding Kainos person, team and culture.


About us

Kainos is a high‑growth IT services company providing digital technology solutions and agile software development to enterprise customers. Across our 30‑year history, we have worked on transformational projects across government, NHS and a myriad of private sector clients.


Embracing our differences

At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive. We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are. We also believe every candidate deserves a level playing field.


Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out.


We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.



#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data science in your 30s, 40s or 50s? You’re far from alone. Across the UK, businesses are investing in data science talent to turn data into insight, support better decisions and unlock competitive advantage. But with all the hype about machine learning, Python, AI and data unicorns, it can be hard to separate real opportunities from noise. This article gives you a practical, UK-focused reality check on data science careers for mid-life career switchers — what roles really exist, what skills employers really hire for, how long retraining typically takes, what UK recruiters actually look for and how to craft a compelling career pivot story. Whether you come from finance, marketing, operations, research, project management or another field entirely, there are meaningful pathways into data science — and age itself is not the barrier many people fear.

How to Write a Data Science Job Ad That Attracts the Right People

Data science plays a critical role in how organisations across the UK make decisions, build products and gain competitive advantage. From forecasting and personalisation to risk modelling and experimentation, data scientists help translate data into insight and action. Yet many employers struggle to attract the right data science candidates. Job adverts often generate high volumes of applications, but few applicants have the mix of analytical skill, business understanding and communication ability the role actually requires. At the same time, experienced data scientists skip over adverts that feel vague, inflated or misaligned with real data science work. In most cases, the issue is not a lack of talent — it is the quality and clarity of the job advert. Data scientists are analytical, sceptical of hype and highly selective. A poorly written job ad signals unclear expectations and immature data practices. A well-written one signals credibility, focus and serious intent. This guide explains how to write a data science job ad that attracts the right people, improves applicant quality and positions your organisation as a strong data employer.

Maths for Data Science Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for data science jobs in the UK, the maths can feel like a moving target. Job descriptions say “strong statistical knowledge” or “solid ML fundamentals” but they rarely tell you which topics you will actually use day to day. Here’s the truth: most UK data science roles do not require advanced pure maths. What they do require is confidence with a tight set of practical topics that come up repeatedly in modelling, experimentation, forecasting, evaluation, stakeholder comms & decision-making. This guide focuses on the only maths most data scientists keep using: Statistics for decision making (confidence intervals, hypothesis tests, power, uncertainty) Probability for real-world data (base rates, noise, sampling, Bayesian intuition) Linear algebra essentials (vectors, matrices, projections, PCA intuition) Calculus & gradients (enough to understand optimisation & backprop) Optimisation & model evaluation (loss functions, cross-validation, metrics, thresholds) You’ll also get a 6-week plan, portfolio projects & a resources section you can follow without getting pulled into unnecessary theory.