Senior Data Engineer

Kainos
Belfast
1 month ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Join Kainos and Shape the Future

At Kainos, we’re problem solvers, innovators, and collaborators - driven by a mission to create real impact. Whether we’re transforming digital services for millions, delivering cutting‑edge Workday solutions, or pushing the boundaries of technology, we do it together.

We believe in a people-first culture, where your ideas are valued, your growth is supported, and your contributions truly make a difference. Here, you’ll be part of a diverse, ambitious team that celebrates creativity and collaboration.

Ready to make your mark? Join us and be part of something bigger.

Main purpose of the role & responsibilities in the business

As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems. You will work within a multi-skilled agile team to design and develop large‑scale data processing software to meet user needs in demanding production environments.

Your responsibilities will include:
  • Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution.
  • Working with Architects and Lead Engineers to ensure the software supports non‑functional needs.
  • Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality.
  • Working with operations teams to ensure operational readiness.
  • Advising customers and managers on the estimated effort and technical implications of user stories and user journeys.
  • Coaching and mentoring team members.
Minimum (Essential) Requirements
  • Strong software development experience in one of Java, Scala, or Python.
  • Software development experience with data‑processing platforms from vendors such as AWS, Azure, GCP, Databricks.
  • Experience of developing substantial components for large‑scale data processing solutions and deploying into a production environment.
  • Proficient in SQL and SQL extensions for analytical queries.
  • Solid understanding of ETL/ELT data processing pipelines and design patterns.
  • Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats.
  • Able to write quality, testable code and has experience of automated testing.
  • Experience with Continuous Integration and Continuous Deployment techniques.
  • A Keen interest in AI Technologies.
Desirable Requirements
  • Experience of performance tuning.
  • Experience of data visualisation and complex data transformations.
  • Experience with steaming and event‑processing architectures including technologies such as Kafka and change‑data‑capture (CDC) products.
  • Expertise in continuous improvement and sharing input on data best practice.
  • Practical experience with AI technologies, tools, processes and delivery.
Embracing our differences

At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive. We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are. We also believe every candidate deserves a level playing field.

Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out.

We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.