National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior Data Engineer

Insight Global
Sheffield
3 weeks ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer (SQL Server / AWS)

Senior Data Engineer - Snowflake - £100,000 - London - Hybrid

Senior Data Engineer

Insight Global is seeking a Azure Data Engineers to join a prestigious energy client based in London. The successful candidates will be responsible for designing, implementing, and managing live data streaming pipelines for the client’s Energy Trading team. This role involves designing data pipelines for Crude and Products trading data from on-premise DB2 databases to an Azure Cloud environment.


This is an Inside IR35 contract role and the individual must sit out of the UK.


Key Responsibilities:

  • Pipeline Management: Design, implement, and manage live data streaming pipelines using Azure Databricks to ensure seamless data flow and real-time processing.
  • Process Evaluation: Assess and optimize on-premise to cloud data exchange processes for accuracy, efficiency, and scalability.
  • Code Review and Debugging: Conduct thorough code reviews and debugging sessions, providing guidance and mentorship to junior data engineers to ensure high-quality code and best practices.
  • Problem Solving: Develop innovative solutions to address computing and cost challenges, leveraging advanced technologies and methodologies.


Must Haves:

  • Data Engineering experience
  • Deep expertise with Azure Databricks (Delta Live Tables, Data Streaming , Unity Catalogue etc.)
  • Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables)
  • Expert with Apache Spark and PySpark (ability to review quality of code and debug issues)
  • Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.)
  • Proficient with SQL
  • Proven ability to problem solve and think outside the box


Plusses:

  • Background in Trading domain, specifically energy commodities trading
National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Data Science Jobs UK 2025: 50 Companies Hiring Now

Bookmark this guide—refreshed every quarter—so you always know who’s really expanding their data‑science teams. Budgets for predictive analytics, GenAI pilots & real‑time decision engines keep climbing in 2025. The UK’s National AI Strategy, tax relief for R&D & a sharp rise in cloud adoption mean employers need applied scientists, ML engineers, experiment designers, causal‑inference specialists & analytics leaders—right now. Below you’ll find 50 organisations that have advertised UK‑based data‑science vacancies or announced head‑count growth during the past eight weeks. They’re grouped into five quick‑scan categories so you can jump straight to the kind of employer—& culture—that suits you. For every company you’ll see: Main UK hub Example live or recent vacancy Why it’s worth a look (tech stack, mission, culture) Search any employer on DataScience‑Jobs.co.uk to view current ads, or set up a free alert so fresh openings land straight in your inbox.

Careers Jobs

Return-to-Work Pathways: Relaunch Your Data Science Career with Returnships, Flexible & Hybrid Roles

Returning to work after an extended break can feel like stepping into a whole new world—especially in a dynamic field like data science. Whether you paused your career for parenting, caring responsibilities or another life chapter, the UK’s data science sector now offers a variety of return-to-work pathways. From structured returnships to flexible and hybrid roles, these programmes recognise the transferable skills and resilience you’ve gained and provide mentorship, upskilling and supportive networks to ease your transition back. In this guide, you’ll discover how to: Understand the current demand for data science talent in the UK Leverage your organisational, communication and analytical skills in data science roles Overcome common re-entry challenges with practical solutions Refresh your technical knowledge through targeted learning Access returnship and re-entry programmes tailored to data science Find roles that fit around family commitments—whether flexible, hybrid or full-time Balance your career relaunch with caring responsibilities Master applications, interviews and networking specific to data science Learn from inspiring returner success stories Get answers to common questions in our FAQ section Whether you aim to return as a data analyst, machine learning engineer, data visualisation specialist or data science manager, this article will map out the steps and resources you need to reignite your data science career.

Jobs

LinkedIn Profile Checklist for Data Science Jobs: 10 Tweaks to Elevate Recruiter Engagement

Data science recruiters often sift through dozens of profiles to find candidates skilled in Python, machine learning, statistical modelling and data visualisation—sometimes before roles even open. A generic LinkedIn profile won’t suffice in this data-driven era. This step-by-step LinkedIn for data science jobs checklist outlines ten targeted tweaks to elevate recruiter engagement. Whether you’re an aspiring junior data scientist, a specialist in MLOps, or a seasoned analytics leader, these optimisations will sharpen your profile’s search relevance and demonstrate your analytical impact.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.