Senior Data Engineer

Scott Logic
Bristol
1 month ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Overview

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our data engineers help clients make the best use of their data by building data platforms and pipelines that support diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create processes to access operational data, and transform siloed datasets into integrated data models that inform business performance and ML model training.

These are hands-on, client-facing roles at senior or lead levels. You may be leading teams, setting technical direction, advising clients or solving challenging engineering problems. Some time on-site with clients in the London area on an ad-hoc basis is expected. We combine a strong software engineering approach with solid data fundamentals and experience using modern tools. We are technology agnostic and open-minded about your existing skillset.

Responsibilities
  • Apply software engineering discipline to design and build robust data platforms and data pipelines that ingest, transform and expose analytical data.
  • Collaborate with clients to understand requirements, set technical direction and solve engineering challenges.
  • Deliver hands-on data engineering work in client environments, contributing to data lakes/warehouses and end-to-end data models.
  • Work on-site with clients in the London area on an ad-hoc basis as needed.
Requirements
  • Good experience with technologies and approaches typical in modern data engineering and reporting, including storage, data ingestion/transform pipelines, and querying/ reporting of analytical data.
  • Experience with Python, Spark, SQL, PySpark, Power BI, and related tools.
  • Background in software engineering, including front-end technologies such as JavaScript.
  • Strong problem-solving ability, pragmatically exploring options and delivering effective solutions.
  • Ability to design and build well-structured, maintainable systems.
  • Strong communication skills and a collaborative approach to work.
  • Willingness to learn and grow your skills and experience.
Nice to have
  • Experience with cloud services in AWS, Azure or GCP.
  • Experience working in an Agile environment.
  • Experience with vendor products such as Snowflake or Databricks.
  • Experience with CI/CD tooling.
Benefits
  • 25 days’ annual leave, rising to 30 days with service.
  • Generous family leave policies.
  • Employer pension scheme, private medical services and Group Life Assurance.
  • Optional benefits such as discounted gym membership and cycle-to-work scheme.
  • Meaningful performance evaluation and feedback.

At Scott Logic, we value flexible remote working while encouraging time with colleagues and clients. Our offices feature employee-led clubs and events, as well as free games, books and refreshments. We are a B Corp and value diversity, believing it drives innovation and that everyone can contribute regardless of race, religion, colour, national origin, gender, sexual orientation, age, marital status or disability.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.