Senior Data Engineer

Spitalfields and Banglatown
1 day ago
Create job alert

We believe in better. And we make it happen.
Better content. Better products. And better careers.
Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products, content and services millions of people love.
And we do it all right here at Sky.

Within the Communications & Infrastructure group, RTA ( Real-Time Analytics ) is a platform that offers every team and every individual in Sky Technology a managed service of Sky's Telco telemetry data assets and enables data anal ytics at scale.

We are looking for a promising and seasoned Sr. Data Engineer who will act as a technical leader within the data engineering team, shaping the future of our data platform and enabling data-driven decision-making across the organisation.

This role goes beyond coding- it's about influencing strategy, fostering collaboration, and driving excellence in data lifecycle management.

What you'll do Lead technical decisions and shape the data platform's long-term vision for efficiency, scalability, and compliance.

Define and deliver the data platform roadmap, collaborating with stakeholders to align with business objectives .

Oversee and contribute to the end-to-end delivery of data processing capabilities - including design, development, and support - with a distributed team.

Drive continuous improvement in ways of working and foster innovation by exploring new technologies and methodologies.

Implement robust data lifecycle management and automation to ensure data quality, security, accessibility, and compliance.

What you'll bring Graduate degree (BSc) in Computer Science, Electrical Engineering, or related field, coupled with extensive experience in data engineering.

Cloud & Infrastructure-as-Code: Deep expertise in architecting on major cloud platforms (GCP/AWS) using Terraform for infrastructure automation and Git for robust version control and CI/CD workflows.

Big Data Processing & Engineering: Advanced proficiency in Python and SQL to build scalable batch and streaming ETL/ELT pipelines using distributed frameworks like Spark or Beam.

Data Architecture & Storage: Extensive experience managing diverse data ecosystems, including Relational/NoSQL databases, high-performance Data Warehouses, and complex storage for structured and unstructured data

Data Governance & Security: Hands-on experience implementing data quality frameworks, security protocols, and full data lifecycle management.

Proven ability to lead and motivate teams in dynamic environments, ideally in Telecom or similar industries where software is always-on and customer experience is critical.

Collaborative Problem Solving: A "lead by influence" mindset that values diverse perspectives and proactively removes roadblocks to ensure team success.

Adaptability in High-Stakes Environments: Proven resilience in dynamic, "always-on" industries (like Telecom), where system uptime and customer experience are mission-critical.

Technology Stack Apache Airflow / Kafka

GCP ( BigQuery , GCS, Composer, IAM)

Python

Terraform

Linux / Bash

Team overview

Looking to be part of non-stop innovation? Join our Group Communications and Infrastructure team and you'll work alongside experts in broadband, telephony, mobile, cloud and infrastructure. We're the team that designs, builds, supports and maintains the telecoms networks across the whole Sky Group. Together, we help Sky broadband, mobile and TV enter new markets by creating a single and secure infrastructure for the amazing content and services that keep our customers coming back for more.

The rewards

There's one thing people can't stop talking about when it comes to #LifeAtSky: the perks. Here's a taster: Sky Q, for the TV you love all in one place

The magic of Sky Glass at an exclusive rate

A generous pension package

Private healthcare

Discounted mobile and broadband

A wide range of Sky VIP rewards and experiences

Inclusion & how you'll work

We are a Disability Confident Employer, and welcome and encourage applications from all candidates. We will look to ensure a fair and consistent experience for all, and will make reasonable adjustments to support you where" appropriate . Please flag any adjustments you need to your recruiter as early as you can.

We've "embraced hybrid working and split our time between unique office spaces and the convenience of working from home. You'll find out more about what hybrid working looks like for your role later in the recruitment process.

Your office space

Brick Lane

Our Brick Lane office is in the heart of the East End of London. It's part of a vibrant and varied community; close to street food, cafes, and shops.

The closest tube station is Aldgate East and Liverpool Street is about a 10-minute walk.

We'd love to hear from you

Inventive, forward-thinking minds come together to work in Tech, Product and Data at Sky. It's a place where you can explore what if, how far, and what next.

But better doesn't stop at what we do, it's how we do it, too. We embrace each other's differences. We support our community and contribute to a sustainable future for our business and the planet.

If you believe in better, we'll back you all the way.

Just so you know: if your application is successful, we'll ask you to complete a criminal record check. And depending on the role you have applied for and the nature of any convictions you may have, we might have to withdraw the offer

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Maths for Data Science Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for data science jobs in the UK, the maths can feel like a moving target. Job descriptions say “strong statistical knowledge” or “solid ML fundamentals” but they rarely tell you which topics you will actually use day to day. Here’s the truth: most UK data science roles do not require advanced pure maths. What they do require is confidence with a tight set of practical topics that come up repeatedly in modelling, experimentation, forecasting, evaluation, stakeholder comms & decision-making. This guide focuses on the only maths most data scientists keep using: Statistics for decision making (confidence intervals, hypothesis tests, power, uncertainty) Probability for real-world data (base rates, noise, sampling, Bayesian intuition) Linear algebra essentials (vectors, matrices, projections, PCA intuition) Calculus & gradients (enough to understand optimisation & backprop) Optimisation & model evaluation (loss functions, cross-validation, metrics, thresholds) You’ll also get a 6-week plan, portfolio projects & a resources section you can follow without getting pulled into unnecessary theory.

Neurodiversity in Data Science Careers: Turning Different Thinking into a Superpower

Data science is all about turning messy, real-world information into decisions, products & insights. It sits at the crossroads of maths, coding, business & communication – which means it needs people who see patterns, ask unusual questions & challenge assumptions. That makes data science a natural fit for many neurodivergent people, including those with ADHD, autism & dyslexia. If you’re neurodivergent & thinking about a data science career, you might have heard comments like “you’re too distracted for complex analysis”, “too literal for stakeholder work” or “too disorganised for large projects”. In reality, the same traits that can make traditional environments difficult often line up beautifully with data science work. This guide is written for data science job seekers in the UK. We’ll explore: What neurodiversity means in a data science context How ADHD, autism & dyslexia strengths map to common data science roles Practical workplace adjustments you can request under UK law How to talk about your neurodivergence in applications & interviews By the end, you’ll have a clearer sense of where you might thrive in data science – & how to turn “different thinking” into a real career advantage.

Data Science Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data science hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise rigorous problem framing, high‑quality analytics & modelling, experiment/causality, production awareness (MLOps), governance/ethics, and measurable product or commercial impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for product/data scientists, applied ML scientists, decision scientists, econometricians, growth/marketing analysts, and ML‑adjacent data scientists supporting LLM/AI products. Who this is for: Product/decision/data scientists, applied ML scientists, econometrics & causal inference specialists, experimentation leads, analytics engineers crossing into DS, ML generalists with strong statistics, and data scientists collaborating with platform/MLOps teams in the UK.