Senior Big Data Engineer

Scrumconnect Consulting
Edinburgh, United Kingdom
2 months ago
Applications closed

Related Jobs

View all jobs

Data Platform Solutions Architect (Professional Services) - Emerging Enterprise & DNB

Databricks London, United Kingdom

Senior Solutions Architect - Lakewatch

Databricks London, United Kingdom

Senior Data Analyst (Power BI |Data Transformation) | Hertfordshire

Avanti Recruitment Watford, Hertfordshire, United Kingdom
£50,000 – £75,000 pa Hybrid

Data Analyst (Power BI SQL Azure | Data Transformation)

Avanti Recruitment East Barnet, London, EN4 8TB, United Kingdom
£65,000 pa Hybrid

Global Account Manager - Pharmaceutical Industry

Databricks London, United Kingdom
On-site

Manager, Delivery Solutions Architects

Databricks London, United Kingdom
Posted
13 Mar 2026 (2 months ago)

About Scrumconnect Consulting:
Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. With a strong commitment to user-centred design and agile delivery, and more to deliver innovative digital services that matter.

Role Description
As a Senior Big Data Engineer, you will lead the engineering of complex data solutions across Google Cloud Platform environment. You will architect and implement high-performance data pipelines integrating multiple internal and external data sources. You will apply strong data modelling and warehousing principles using BigQuery and Cloud SQL, embed governance through Dataplex and ensure automated orchestration via Airflow. You will provide technical leadership to ensure resilience, scalability and compliance across data services that underpin critical national infrastructure programmes.

Preferred Tech Stack Expertise
Google Cloud Platform including BigQuery, Cloud SQL and Cloud Composer, Apache Airflow, Dataplex, Dataform, Great Expectations or similar data quality tools, Terraform, Python and SQL

Responsibilities

  • Lead design and delivery of enterprise-scale data pipelines

  • Define data modelling standards and ...

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Where to Advertise Data Science Jobs in the UK (2026 Guide)

Where to advertise data science jobs UK in 2026: the specialist boards, communities and channels that actually reach senior and lead data science talent. Data science spans a broad and often misunderstood spectrum — from statistical modelling and experimental design through to machine learning engineering, product analytics and AI research. The strongest candidates identify firmly with specific subdisciplines and are frustrated by adverts that conflate data scientist with data analyst, business intelligence developer or machine learning engineer. General job boards produce high application volumes for data roles but consistently fail to match specialist data science profiles with the right opportunities. This guide, published by DataScienceJobs.co.uk, covers where to advertise data science roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Data Science Jobs UK 2026: What to Expect Over the Next 3 Years

Data Science Jobs UK 2026: roles, salaries and the trends shaping UK data science hiring over the next three years — from MLE crossover to GenAI workflows. Data science has spent the past decade being described as the sexiest job of the twenty-first century. By 2026, the reality is both more nuanced and more interesting than that label ever suggested. The discipline has matured, fragmented, deepened, and in some respects reinvented itself — and the jobs market has changed with it in ways that create genuine opportunity for those who understand what employers actually want, and genuine difficulty for those still operating on assumptions formed five years ago. The data science jobs market of 2026 is not simply a larger version of what it was three years ago. The generalist data scientist — equally comfortable wrangling data, building models, and presenting insights to the board — is giving way to a more specialised landscape where employers know exactly what problem they are trying to solve and are looking for candidates with the specific depth to solve it. Machine learning engineering, causal inference, experimentation, AI product development, and domain-specific applied science have all emerged as distinct career tracks within what was previously a single, loosely defined profession. At the same time, the arrival of large language models and the broader AI capability wave has both threatened and created data science roles in equal measure. Some of the work that junior data scientists spent their early careers doing — data cleaning, exploratory analysis, basic model building — is being partially automated by AI tooling. But the demand for practitioners who can evaluate AI systems rigorously, apply statistical thinking to complex business problems, and build the data foundations on which AI depends has grown considerably. The candidates who will thrive over the next three years are those who understand where the discipline is heading — which specialisms are attracting the most investment, which technologies are reshaping what data scientists are expected to build and know, and how to position a data science career that will remain valuable as the field continues to evolve around them. This article breaks down what the UK data science jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.

New Data Science Employers to Watch in 2026: UK and International Companies Leading Analytics and AI Innovation

New Data Science Employers to Watch in 2026: a UK and international shortlist of analytics and AI companies hiring data scientists, ML engineers and analysts. Data science has emerged as one of the most transformative forces across industries, turning raw information into actionable insights, predictive models, and AI-powered solutions. In 2026, the UK is witnessing a surge in organisations where data science is not just a support function but the core of their products and services. For professionals exploring opportunities on www.DataScience-Jobs.co.uk , identifying these employers early can provide a competitive advantage in a market with high demand for advanced analytics and machine learning expertise. This article highlights new and high-growth data science employers to watch in 2026, focusing on UK startups, scale-ups, and global firms expanding their data science operations locally. All of the companies included have recently raised investment, won high-profile contracts, or significantly scaled their analytics teams.