Data Engineer

So Energy
London
1 month ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer - UK Perm - London Hrbrid

Oracle Java8 Scala Spring Data Engineer London £575d insideIR35

Data Engineer, DE55

UK, Hybrid


Our Perks

Values-driven culture – we’re really proud of our culture.

Drive your own experience

  • Personalised Learning and Development Budget
  • Hybrid working hours – Each team has their own Smart Working Charter that empowers you to do your work in the best way you can
  • Technology – Your choice of Mac or Windows

Empowering you to be your most authentic self

  • 25 Holiday Days + your local bank holidays
  • 1 Birthday day – it only happens once a year!
  • 3 So Giving Days - spend these days giving back to your chosen cause
  • Religious Celebrations Leave
  • Mental Healthcare – Sessions with Unmind
  • Enhanced Family Leave

So Energy

Who we are

So Energy was created in 2015 because we knew energy suppliers could be better. Since then, we’ve grown rapidly but sustainably, with 350,000 customers and over 450 Energists (what we call our people). But we’re not done. We’re on the road to a net zero future, and thanks to our partnership with ESB, we’re well on the way. We’re customer-centric, tech-led, and passionate about sustainability.

We want to do the best we can for our customers, each other, and our planet, so we’ve created a workplace that's encouraging, supportive, and offers the opportunity for growth. As a company, we live by six core values that guide everything we do:


  • Clear
  • Honest
  • Ambitious
  • Inquisitive
  • Caring
  • Sustainable

The RoleData Engineer at SO ENERGY

We are looking for someone who has experience building analytics platform with tens of different sources of data, someone that can leverage modern tools and programming languages to build ETL pipelines and extract intelligence out of the data.

Our users (external but also internal) are extremely important to us. Understanding how their experience is throughout the various touch points is very important. Being able to apply data intelligence best practices to be able to understand and later forecast behaviour and trends is the main objective.

Reporting to our Data Manager

What you’ll be getting up to:

  • Work closely with internal business teams gathering data requirements; translating them to technical artifacts and mapping them to Google Platform.
  • Responsible for building the ETL data pipelines.
  • Technical ownership: Developing and supporting the Data Lake and Data Warehouse within GCP.
  • Candidates must have strong GCP knowledge and hands-on experience in Data Engineering space.
  • Build real-time & batch data processing pipelines to publish the data in GCP to match the evolving needs of the product and business.
  • Providing technical support to internal teams within the organisation, and to external when required.
  • Coding elegant strategic solutions which are reusable and easily maintainable.
  • Producing clear concise documentation where required.
  • Working closely with the Lead Data Engineer to apply the data strategy, ratifying before creating any ETL pipelines.
  • Pro-actively implementing solutions to better understand how internal and external users perform.


This role will be a great fit if:

  • An innovator who is not afraid to put forward ideas for improving team processes or suggest new features to the team.
  • In-depth experience in implementing Data & Analytics applications in Google Cloud Platform.
  • Help to deliver GCP data development projects (including: development/coding, testing and deployment into Production).
  • Provision data for analytics, data science and machine learning purposes.
  • Expertise in design of data solutions for BigQuery.
  • Expertise in logical and physical data modelling.
  • Hands-on experience using Google Dataflow, GCS, cloud functions, BigQuery, DataProc, Apache Beam (Python) in designing data transformation rules for batch and data streaming.
  • Solid Python programming skills and using Apache Beam (Python).
  • Structure of CI / CD for data pipelines.
  • Maintaining technical documents and procedures in Confluence.
  • Experience with Agile development methodologies.
  • Good communication skills, including the ability to translate technical descriptions into something that can be understood by a non-technical business-facing team member.

Research shows that some people are less likely to apply for a roleunless they are 100% qualified.Your experience, skills and passion will set you apart so tell us about your achievements, irrespective of whether they are personal or work-related, tell us about your journey, and about what you learnt.

So, if this role excites you, don’t let our role description hold you back, get applying!

Want to tailor your application?

Hiring Process

  • Talent interview with the Head of Talent.
  • Technical interview with our Staff Data Engineer.
  • Culture interview with our Tech Director.

Support –If you have a medical condition or an individual need for an adjustment to our process, and you believe this may affect your ability to be at your best – please let us know so we can talk about how we can best support you and make any adjustments that may be needed.

Our Values

We look for people who share our values and can add to our culture. Values are shared beliefs that guide our decision-making, culture is how we function as a group and how we live our values as individuals.

Clear - The energy industry can be pretty complex so we strive to provide clear communication to our customers and colleagues.

Honest - Transparency is key, Whether that's providing clear bills to our customers or trusting our staff to do the right thing.

Ambitious - All of us are ambitious about the future of So Energy and what we can contribute to it.

Inquisitive - We are also questioning the Status Quo to see if there is a better way to do things for our customers.

Caring - We care about the work we are doing, our customers and our colleagues.

Sustainable - As a renewable energy company we are providing sustainable products but we also care about sustainable careers. That's why learning and continuous development is so important to us.

Diversity, Equity, Inclusion & Belonging

At So Energy, we’re committed to cultivating an environment that promotes diversity, equity, inclusion and belonging. We are a global community and we believe our unique qualities should be celebrated as they are critical to our innovation. It’s essential to us that you bring your authentic self to work every single day, no matter your age, ethnicity, religion, citizenship, gender identity, sexual orientation, disability status, caring responsibilities, neurodiversity, or otherwise. Inclusion isn’t just an initiative at So Energy. We strive to embed it not just into our values but throughout our entire culture.

#J-18808-Ljbffr

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Tips for Staying Inspired: How Data Science Pros Fuel Creativity and Innovation

Data science sits at the dynamic intersection of statistics, computer science, and domain expertise, driving powerful innovations in industries ranging from healthcare to finance, and from retail to robotics. Yet, the daily reality for many data scientists can be a far cry from starry-eyed talk of AI and machine learning transformations. Instead, it often involves endless data wrangling, model tuning, and scrutiny over metrics. Maintaining a sense of creativity in this environment can be an uphill battle. So, how do successful data scientists continue to dream big and innovate, even when dealing with the nitty-gritty of data pipelines, debugging code, or explaining results to stakeholders? Below, we outline ten practical strategies to help data analysts, machine learning engineers, and research scientists stay inspired and push their ideas further. Whether you’re just starting out or looking to reinvigorate a long-standing career, these pointers can help you find fresh sparks of motivation.

Top 10 Data Science Career Myths Debunked: Key Facts for Aspiring Professionals

Data science has become one of the most sought-after fields in the tech world, promising attractive salaries, cutting-edge projects, and the opportunity to shape decision-making in virtually every industry. From e-commerce recommendation engines to AI-powered medical diagnostics, data scientists are the force behind innovations that drive productivity and improve people’s lives. Yet, despite the demand and glamour often associated with this discipline, data science is also shrouded in misconceptions. Some believe you need a PhD in mathematics or statistics; others assume data science is exclusively about machine learning or coding. At DataScience-Jobs.co.uk, we’ve encountered a wide array of myths that can discourage talented individuals or mislead those exploring a data science career. This article aims to bust the top 10 data science career myths—providing clarity on what data scientists actually do and illuminating the true diversity and inclusiveness of this exciting field. Whether you’re a recent graduate, a professional looking to pivot, or simply curious about data science, read on to discover the reality behind the myths.

Global vs. Local: Comparing the UK Data Science Job Market to International Landscapes

How to evaluate salaries, opportunities, and work culture in data science across the UK, the US, Europe, and Asia Data science has proven to be more than a passing trend; it is now a foundational pillar of modern decision-making in virtually every industry—from healthcare and finance to retail and entertainment. As the volume of data grows exponentially, organisations urgently need professionals who can transform raw information into actionable insights. This high demand has sparked a wave of new opportunities for data scientists worldwide. In this article, we’ll compare the UK data science job market to those in the United States, Europe, and Asia. We’ll explore hiring trends, salary benchmarks, and cultural nuances to help you decide whether to focus your career locally or consider opportunities overseas or in fully remote roles. Whether you’re a fresh graduate looking for your first data science position, an experienced data professional pivoting from analytics, or a software engineer eager to break into machine learning, understanding the global data science landscape can be a game-changer. By the end of this overview, you’ll be better equipped to navigate the expanding world of data science—knowing which skills and certifications matter most, how salaries differ between regions, and what to expect from distinct work cultures. Let’s dive in.