Senior Backend Engineer - Data Engineer

Our Energy client seeks a Senior Backend Engineer - Data Engineer to join their team in Mayfair, London.

We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions.

Hybrid working is in play, with 3 days in the office and 2 days at home.

Senior Backend Engineer - Data Engineer - About the role:

My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications, user tools, and automated trading workflows.

You will collaborate closely with analysts, data scientists, and business stakeholders to translate requirements into robust, scalable backend solutions. You’ll be responsible for designing and developing services, APIs, data pipelines, and internal applications that integrate analytics and enable better decision-making and operational efficiency.

This is a hands-on role for someone who thrives in a fast-paced, build-first culture without multiple tiers of management. You should be excited to take full ownership of backend development, lead on best practices, and coach others in a collaborative, delivery-focused team.

Experience in retail or wholesale electricity and gas markets is helpful, but a willingness to become an expert in this field is essential. Our success is based on understanding the subject matter from first principles.

Senior Backend Engineer - Data Engineer - Key Responsibilities:

• Architect, design, develop and maintain backend systems for analytics-driven applications, user tools, and automation workflows.
  
  
• Build and manage APIs and internal services using Python (FastAPI, Flask) and cloud-native tooling.
  
  
• Develop and manage data pipelines, backend components, and supporting infrastructure.
  
  
• Manage server resources and backend processing environments to ensure reliability and scalability.
  
  
• Monitor and maintain application performance, availability, and data quality across production systems.
  
  
• Implement and maintain CI/CD pipelines, testing frameworks, and DevOps practices to enable robust delivery.
  
  
• Write, test, and document code in line with quality standards and engineering best practices.
  
  
• Collaborate with operations, analytics and commercial teams to gather requirements and translate them into scalable technical solutions.
  
  
• Support analysts and data scientists in deploying and operationalising analytics tools and models.
  
  
• Lead or support the data engineering team, help structure development workflows, and mentor junior team members.
  
  
• Stay current with technological advancements and promote a culture of continuous improvement.
  
  
• Present technical solutions to stakeholders and train non-technical users on tools and workflows.
  
  Senior Backend Engineer - Data Engineer - Skills Required:
  
  
• Python (FastAPI, Flask)
  
  
• REST API development
  
  
• Containerisation: Docker, Kubernetes
  
  
• CI/CD: Azure DevOps, GitHub Actions
  
  
• Software testing and documentation practices
  
  
• SQL, PySpark, Databricks
  
  
• Relational databases and data lake architecture
  
  
• Model and data pipeline integration (e.g. MLflow)
  
  
• Streamlit or other lightweight UI frameworks
  
  
• Microsoft Azure (Functions, Storage, Compute)
  
  
• Monitoring tools (Grafana, Prometheus, etc.)
  
  
• Performance optimisation and resource management
  
  
• Agile delivery practices (Jira, Azure Boards, etc.)
  
  
• Strong communication with technical and business teams
  
  
• Mentoring and knowledge sharing within the team
  
  Desirable Skills:
  
  
• Experience in energy supply or trading
  
  
• Familiarity with dbt or modular analytics tooling
  
  
• Exposure to forecasting or optimisation workflows
  
  
• Knowledge of React or frontend tools for internal apps
  
  
• Networking or IoT integration experience
  
  What they offer:
  
  
• A high-autonomy role in a flat, delivery-focused team
  
  
• Ownership of backend systems for real-time analytics and automation
  
  
• A fast-moving, hands-on culture with meaningful technical challenges
  
  
• The opportunity to apply software and data engineering to real-world energy problems