Data Engineer

BT Group
Belfast
2 days ago
Create job alert

Select how often (in days) to receive an alert:

Riverside Tower, Belfast (N.I), United Kingdom

All Locations: London, Belfast

Working Style: 3 days a week in office, 2 days from anywhere

Why this job matters

Data is a vital part of our business and with your help, we can improve the services that we provide to our customers through engineering excellence of our data products. You’ll be working on exciting data products which support TV, Broadband, Digital Voice and market leading technologies like Unbreakable Wi-Fi. We deliver these critical services using the latest cloud technologies on AWS, GCP and Cloudera.

When you join us as a lead data engineer, you’ll have the opportunity to be part of our Data & AI Enablement Team where you will help to design, build, and support high quality engineering products from our extensive data sources and multi-cloud environment.

As a team we believe in the agile principles of openness, transparency and continuous improvement, which underpin strong relationships with our business stakeholders.

There will be lots of opportunities to explore new technologies, develop new skills, innovate and grow as an engineer.

What you’ll be doing
  • Design, develop, and maintain end-to-end data pipelines using Ab Initio (GDE, PDL, Conduct>IT, Express>IT).
  • Build scalable batch and streaming workloads using Apache Spark (PySpark/Scala).
  • Develop and orchestrate data ingestion flows using Apache NiFi for real-time and near-real-time use cases.
  • Optimize ETL/ELT jobs for scalability, throughput, and resource efficiency.
  • Perform bottleneck analysis and tuning for Spark jobs, NiFi processors, and Ab Initio graphs.
  • Demos and knowledge transfers to stakeholders around product developments.
  • Spread your experience and knowledge to junior engineers.
  • Improve automated testing and deployments using CI/CD pipelines.
  • Expectation to line manage small team of junior data engineers.
  • Continual learning through internal and external training.
What you'll bring
  • Proficient in building Big Data solutions using Hadoop or GCP or AWS.
  • Skilled in technologies such as Scala, Java, Python, Spark (PySpark/Scala), Kafka, Kinesis, BigQuery, Dataflow, BigTable, Terraform, and SQL.
  • Experience with Terraform, Kafka, Kinesis, SQL are nice to have
  • Strong expertise in Ab Initio (GDE, PDL, Conduct>IT, Express>IT, EME) with a focus on parallel processing and component optimisation.
  • Hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and performance tuning.
  • Practical experience with Apache NiFi for flow design, processor tuning, error handling, and security configurations.
  • Good understanding of Infrastructure as Code toolsets.
  • Experienced in implementing Continuous Integration and Deployment strategies.
  • Proficient in using Atlassian tools such as Confluence and JIRA.
  • Experienced in version control using Git or SVN.
  • Able to clearly present technical issues, progress, and outcomes to team members and Product Owners.
  • Demonstrates enthusiasm for learning and applying new technologies.
  • Experience or interest in managing and developing team members.
  • Capable of building new solutions as well as supporting existing data products and platforms.
What's in it for you?
  • 10% on target bonus
  • Life Assurance Cover
  • Exclusive colleague discounts on our latest and greatest BT broadband packages, BT TV with TNT Sports and NOW Entertainment
  • Equal family leave: receive 18 weeks at full pay, 8 weeks at half pay and 26 weeks at the statutory rate. It’s for all parents, no matter how your family is made up.
  • Enhanced women’s health support: including help with menopause symptoms, cancer screenings, period care and more.
  • 25 days annual leave (not including bank holidays), increasing with service
  • 24/7 private virtual GP appointments for UK colleagues
  • 2 weeks carer’s leave
  • World-class training and development opportunities
  • Option to join BT Shares Saving schemes
  • EE Broadband – from £10/month for 150Mb and £20 for 900Mb – lower than any other provider.
  • EE Mobile – Save 50% on Mobile & SIM-only plans or pay just £10/month for an EE SIM.
  • EE TV – Enjoy premium content like Netflix and TNT Sports, with the flexibility to swap packages monthly, starting from just £10/month.
  • Combine Broadband, TV, and Mobile from just £30/month and unlock extra savings when you take both Broadband and Mobile.

About us

BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we have reached an inflection point in the transformation of our business.

Over the next two years, we will complete the UK’s largest and most successful digital infrastructure project – connecting more than 25 million premises to full fibre broadband. Together with our heavy investment in 5G, we play a central role in revolutionising how people connect with each other.

While we are through the most capital-intensive phase of our fibre investment, meaning we can reward our shareholders for their commitment and patience, we are absolutely focused on how we organise ourselves in the best way to serve our customers in the years to come. This includes radical simplification of systems, structures, and processes on a huge scale. Together with our application of AI and technology, we are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies.

Change on the scale we will all experience in the coming years is unprecedented. BT Group is committed to being the driving force behind improving connectivity for millions and there has never been a more exciting time to join a company and leadership team with the skills, experience, creativity, and passion to take this company into a new era.

Although these roles are listed as full-time, if you’re a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch.

We will also offer reasonable adjustments for the selection process if required, so please do not hesitate to inform us.

Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.

Provider

Description

Enabled

SAP as service provider

  • "route" is used for session stickiness
  • "careerSiteCompanyId" is used to send the request to the correct data centre
  • "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.