National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior Data Engineer

Teamtailor
London
4 weeks ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

🌍 London, Hybrid

⭐️ Our Perks












  • Personalised Learning and Development Budget










  • Hybrid working hours – Each team has their own Smart Working Charter that empowers you to do your work in the best way you can










  • 25 Holiday Days + your local bank holidays










  • 1 Birthday day – it only happens once a year!










  • 3 So Giving Days - spend these days giving back to your chosen cause










  • Religious Celebrations Leave










  •  Mental Healthcare – Sessions with Unmind










  • Enhanced Family Leave










🤝Values-driven culture – we’re really proud of our culture.

So Energy

Who we are:

So Energy was created in 2015 because we knew energy suppliers could be better. Since then, we’ve grown rapidly but sustainably, with 300,000 customers and over 450 Energists (what we call our people). But we’re not done. We’re on the road to a net zero future, and thanks to our partnership with ESB, we’re well on the way. We’re customer-centric, tech-led, and passionate about sustainability.

We want to do the best we can for our customers, each other, and our planet, so we’ve created a workplace that's encouraging, supportive, and offers the opportunity for growth. As a company, we live by six core values that guide everything we do:












  • Clear










  • Honest










  • Ambitious










  • Inquisitive










  • Caring










  • Sustainable












The RoleSenior Data Engineer at SO ENERGY

As a Senior Data Engineer, you will play a key role in the development and maintenance of our data infrastructure, ensuring efficient and scalable data pipelines. You will be responsible for hands-on implementation and optimization of data systems on the Google Cloud Platform (GCP), contributing to critical projects while mentoring junior Engineers. This role focuses on delivering technical solutions, applying best practices, and driving innovation within the data engineering team.

Reporting into our Interim Head of Data, Nethin Maharaj 👋


What you’ll be getting up to:


  • Design, develop, and maintain scalable data pipelines using modern data engineering tools and technologies on our GCP stack.

  • Build and optimize our lake house on Google Cloud Platform (GCP).

  • Implement data ingestion, transformation, and loading processes for various data sources (e.g., databases, APIs, cloud storage).

  • Ensure data quality, consistency, and security throughout the data pipeline.

  • Leverage GCP services (e.g., Dataflow, Dataproc, BigQuery, Cloud Storage) to build and maintain cloud-native data solutions.

  • Implement infrastructure as code (IaC) principles using Terraform to automate provisioning and configuration.

  • Manage and optimize cloud resources to ensure cost-efficiency and performance.

  • Design and implement efficient data models following a star schema approach to support analytical and operational workloads.

  • Collaborate with data analysts to develop advanced analytics solutions.

  • Conduct data quality analysis to drive better data management on outputs in our Curated Layer.

  • Mentor junior data engineers and provide technical guidance.

  • Contribute to the development of data engineering best practices and standards.

  • Collaborate with cross-functional teams to deliver complex data projects.

This role will be a great fit if:



  • Expert in GCP services including BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Storage, and Cloud Functions. GCP Professional Data Engineer Certification is highly favourable.
  • Advanced knowledge of SQL for complex data transformation and query optimization.
  • Proven experience in Python for scalable data pipeline development and orchestration following best practices.
  • Experience implementing Terraform for Infrastructure as Code (IaC) to automate GCP resource management.
  • Knowledge of CI/CD pipelines and automated deployment practices.
  • Experience with containerization technologies (e.g., Docker, Kubernetes)
  • Experience building and optimizing batch and streaming data pipelines.
  • Understanding of data governance principles, GCP security (IAM, VPC), and compliance requirements.

  • Demonstrates a growth mindset by actively seeking to learn from peers and stakeholders, fostering a culture of open communication and shared knowledge.
  • Works effectively across teams, including Data Science, Engineering, and Analytics, to understand their needs and deliver impactful data solutions.
  • Actively participates in design discussions, brainstorming sessions, and cross-functional projects, always striving for continuous improvement and innovation.
  • Builds strong relationships across the organization, using empathy and active listening to ensure alignment on goals and deliverables.
  • Approaches challenges with a growth mindset, viewing obstacles as opportunities to innovate and improve processes.
  • Applies a structured and analytical approach to solving complex problems, balancing immediate needs with long-term scalability and efficiency.
  • Demonstrates resilience under pressure, maintaining a positive and solution-focused attitude when faced with tight deadlines or ambiguity.
  • Actively seeks feedback and lessons learned from past projects to continuously refine problem-solving strategies and improve outcomes.
  • Shares expertise generously, guiding team members in adopting best practices and helping them overcome technical challenges.
  • Leads by example, demonstrating how to approach complex problems pragmatically while promoting curiosity and a willingness to explore new tools and technologies.


Research shows that some people are less likely to apply for a role
unless they are 100% qualified.Your experience, skills and passion will set you apart so tell us about your achievements, irrespective of whether they are personal or work-related, tell us about your journey, and about what you learnt.

So, if this role excites you, don’t let our role description hold you back, get applying!

APPLICATIONS CLOSE ON 05 JUNE 2025

Hiring Process


  1. 📞 30 minute Phone Screening with the Talent Team

  2. First Stage interview with Head of Data & BI Lead 

  3. Second Stage interview with Staff Data Engineer & Data Engineer - Technical exercise
  4.  Final Stage Cultural fit interview with Tech Director and People Partner 

Support –If you have a medical condition or an individual need for an adjustment to our process, and you believe this may affect your ability to be at your best – please let us know so we can talk about how we can best support you and make any adjustments that may be needed.

Our Values

We look for people who share our values and can add to our culture. Values are shared beliefs that guide our decision-making, culture is how we function as a group and how we live our values as individuals.

Clear - The energy industry can be pretty complex so we strive to provide clear communication to our customers and colleagues

Honest - Transparency is key, Whether that's providing clear bills to our customers or trusting our staff to do the right thing.

Ambitious - All of us are ambitious about the future of So Energy and what we can contribute to it.

Inquisitive - We are also questioning the Status Quo to see if there is a better way to do things for our customers

Caring - We care about the work we are doing, our customers and our colleagues
Sustainable - As a renewable energy company we are providing sustainable products but we also care about sustainable careers. That's why learning and continuous development is so important to us.

Diversity, Equity, Inclusion & Belonging

At So Energy, we’re committed to cultivating an environment that promotes diversity, equity, inclusion and belonging. We are a global community and we believe our unique qualities should be celebrated as they are critical to our innovation. It’s essential to us that you bring your authentic self to work every single day, no matter your age, ethnicity, religion, citizenship, gender identity, sexual orientation, disability status, caring responsibilities, neurodiversity, or otherwise. Inclusion isn’t just an initiative at So Energy. We strive to embed it not just into our values but throughout our entire culture.

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

LinkedIn Profile Checklist for Data Science Jobs: 10 Tweaks to Elevate Recruiter Engagement

Data science recruiters often sift through dozens of profiles to find candidates skilled in Python, machine learning, statistical modelling and data visualisation—sometimes before roles even open. A generic LinkedIn profile won’t suffice in this data-driven era. This step-by-step LinkedIn for data science jobs checklist outlines ten targeted tweaks to elevate recruiter engagement. Whether you’re an aspiring junior data scientist, a specialist in MLOps, or a seasoned analytics leader, these optimisations will sharpen your profile’s search relevance and demonstrate your analytical impact.

Part-Time Study Routes That Lead to Data Science Jobs: Evening Courses, Bootcamps & Online Masters

Data science sits at the intersection of statistics, programming and domain expertise—unearthing insights that drive business decisions, product innovation and research breakthroughs. In the UK, organisations from fintech and healthcare to retail and public sector are investing heavily in data-driven strategies, fuelling unprecedented demand for data scientists, machine learning engineers and analytics consultants. According to recent projections, data science roles will grow by over 40% in the next five years, offering lucrative salaries and varied career paths. Yet many professionals hesitate to leave their current jobs or pause personal commitments for full-time study. The good news? A vibrant ecosystem of part-time learning routes—Evening Courses, Intensive Bootcamps and Flexible Online Master’s Programmes—empowers you to learn data science while working. This comprehensive guide explores every pathway: foundational CPD units and short courses, hands-on bootcamps, accredited online MScs, plus funding options, planning strategies and a real-world case study. Whether you’re an analyst looking to formalise your skills, a software developer pivoting into data or a manager seeking to harness data-driven decision-making, you’ll find the right route to fit your schedule, budget and career goals.

The Ultimate Assessment-Centre Survival Guide for Data Science Jobs in the UK

Assessment centres for data science positions in the UK are designed to replicate the multifaceted challenges of real-world analytics teams. Employers combine psychometric assessments, coding tests, statistical reasoning exercises, group case studies and behavioural interviews to see how you interpret data, build models, communicate insights and collaborate under pressure. Whether you’re specialising in predictive modelling, NLP or computer vision, this guide provides a step-by-step roadmap to excel at every stage and secure your next data science role.