Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer (contract)

Methods Business and Digital Technology Ltd
Ledbury
3 weeks ago
Create job alert
Overview

Senior Data Engineer — On-site — Full time

Methods Business and Digital Technology Limited is a UK-based IT Services Consultancy with a strong focus on transforming public sector operations and data solutions for central government departments and agencies.

Methods was acquired by the Alten Group in early 2022.

Responsibilities

We are seeking a seasoned Senior Data Engineer to design, build, and maintain sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments. The role involves deploying and managing scalable data operations that support advanced analytics and data-driven decision-making, contributing to organisational growth and innovation.

  • Develop and Manage Data Pipelines: design, construct, and maintain efficient and reliable data pipelines using Python/Go/Azure Data Factory, supporting streaming and batch processing across structured, semi-structured, and unstructured data in on-premises and Azure environments.
  • Hybrid Cloud and Data Storage Solutions: implement and manage data storage solutions leveraging on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms.
  • Containerisation and Orchestration: utilise Docker for containerisation and Kubernetes for orchestration to enable scalable deployment across cloud and on-premises environments.
  • Workflow Automation: use tools such as Azure Data Factory to automate data flows and manage complex workflows within hybrid environments.
  • Event Streaming Experience: utilise event-driven technologies such as Kafka and NATS to handle real-time data streams.
  • Security and Compliance: manage security setups and access controls, including tools like Keycloak to protect data integrity and comply with legal standards.
  • Database Development: design and develop PostgreSQL databases with high performance and availability across deployment scenarios.
Essential Skills and Experience
  • Strong Python Skills: expertise in Python for scripting and automating data processes across varied environments.
  • Experience with ETL/ELT: demonstrable experience in developing and optimizing ETL or ELT workflows in hybrid (on-premises and Azure) environments.
  • Expertise in Hybrid Cloud Data Architecture: knowledge of integrating on-premises infrastructure with Azure cloud services.
  • Containerisation and Orchestration Expertise: solid experience with Docker, GitHub and Kubernetes in managing applications across on-premises and cloud platforms.
  • Proficiency in Workflow Automation Tools: practical experience with Azure Data Factory in relevant environments.
  • Experience in Event Streaming: proven ability in managing and deploying event streaming platforms like Kafka and NATS.
  • Data Security Knowledge: experience with implementing security practices and tools, including Keycloak, across multiple platforms.
  • Search and Database Development Skills: strong background in Elasticsearch and PostgreSQL across on-premises and cloud infrastructures.
Your Impact

You will empower business leaders to make informed decisions by delivering timely, accurate, and actionable data insights from a robust, hybrid infrastructure. You will champion adoption of modern data architectures, mentor team members, and advance engineering practices to cultivate a data-driven culture within the organisation.

Desirable Skills and Experience
  • Azure and Other Relevant Certifications: cloud and on-premises certifications are beneficial.
  • Data Engineering Experience: minimum of 5 years in data engineering with significant exposure to on-premises and cloud infrastructure.
  • DevOps Experience: some DevOps engineering experience would be preferable.


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data science hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise rigorous problem framing, high‑quality analytics & modelling, experiment/causality, production awareness (MLOps), governance/ethics, and measurable product or commercial impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for product/data scientists, applied ML scientists, decision scientists, econometricians, growth/marketing analysts, and ML‑adjacent data scientists supporting LLM/AI products. Who this is for: Product/decision/data scientists, applied ML scientists, econometrics & causal inference specialists, experimentation leads, analytics engineers crossing into DS, ML generalists with strong statistics, and data scientists collaborating with platform/MLOps teams in the UK.

Why Data Science Careers in the UK Are Becoming More Multidisciplinary

Data science once meant advanced statistics, machine learning models and coding in Python or R. In the UK today, it has become one of the most in-demand professions across sectors — from healthcare to finance, retail to government. But as the field matures, employers now expect more than technical modelling skills. Modern data science is multidisciplinary. It requires not just coding and algorithms, but also legal knowledge, ethical reasoning, psychological insight, linguistic clarity and human-centred design. Data scientists are expected to interpret, communicate and apply data responsibly, with awareness of law, human behaviour and accessibility. In this article, we’ll explore why data science careers in the UK are becoming more multidisciplinary, how these five disciplines intersect with data science, and what job-seekers & employers need to know to succeed in this transformed field.

Data Science Team Structures Explained: Who Does What in a Modern Data Science Department

Data science is one of the most in-demand, dynamic, and multidisciplinary areas in the UK tech and business landscape. Organisations from finance, retail, health, government, and beyond are using data to drive decisions, automate processes, personalise services, predict trends, detect fraud, and more. To do that well, companies don’t just need good data scientists; they need teams with clearly defined roles, responsibilities, workflows, collaboration, and governance. If you're aiming for a role in data science or recruiting for one, understanding the structure of a data science department—and who does what—can make all the difference. This article breaks down the key roles, how they interact across the lifecycle of a data science project, what skills and qualifications are typical in the UK, expected salary ranges, challenges, trends, and how to build or grow an effective team.