(Senior) Lead Data Engineer

IFS
Staines-upon-Thames
1 month ago
Applications closed

Related Jobs

View all jobs

Legal Recruitment Consultant

Recruitment Consultant

Recruitment Consultant

Operational Analyst Consultant

Senior Operational Analyst

Trainee Coding and Programmer - No Experience Required

Job Description

Are you ready to make waves in the world of AI? We're on the hunt for a Senior/Lead Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always chasing that next level of excellence.

You'll be at the forefront of infusing cutting-edge advanced analytics and AI into IFS Cloud, revolutionizing Enterprise Resource Planning, Asset Management, and Field Service Management. Get ready to tackle high-stakes challenges like IIoT, predictive maintenance, forecasting, anomaly detection, optimization, and unleashing generative AI. Your data engineer wizardry will power our solutions, crafting efficient data pipelines, expanding our data platform capabilities, and pushing the envelope of data-driven innovation across our product lineup.

Your sharp critical thinking and knack for real-world business dilemmas will be instrumental in orchestrating end-to-end solutions. From spotting opportunities on the horizon to delivering high-performance, scalable data solutions, you'll play a pivotal role in our success.

If you're a maestro of mapping business processes and deciphering complex data, if advanced analytics and AI are your jam, and if you take pride in building top-tier data pipelines for production environments, we want to hear from you.

How Will You Shape the Future?

This role is all about hands-on technical prowess, and we expect you to bring your A-game. You'll be in the driver's seat, working with autonomy, accountability, and technical brilliance. Your mission includes:

Spotting high-value data opportunity within our IFS offerings, translating raw data into powerful features and reusable data assets. Serving as our data expert, guiding us towards the latest and greatest data technology and platform trends. You'll be the guru driving our data platform evolution and providing data project estimates. Leading the Data Engineering team in crafting and integrating data projects from the ground up. From framing problems and experimenting with new data sources and tools to the grand finale of data pipeline implementation and deployment. You will ensure scalability and top-tier performance. Locking arms with ML Engineers, Data Scientists, Architects, and Product/Program Managers. Together, you'll define, create, deploy, monitor, and document data pipelines to power advanced AI solutions. Becoming our data technology evangelist. Get ready to shine on the conference stage, host webinars, and pen compelling white papers and blogs. Share your discoveries with clients and internal stakeholders, offering actionable insights that drive change.

Qualifications

To succeed in this role, you'll need:

7+ years of data engineering experience, skilled in scalable solutions like Data Lakes/Lakehouse, Graph and Vector Databases (, ADLS, Elasticsearch, MongoDB, Azure AI search, etc.).

Proficient in data pipelines across cloud/on-premises, using Azure and other technologies. Experienced in orchestrating data workflows and Kubernetes clusters on AKS using Airflow, Kubeflow, Argo, Dagster or similar. Skilled with data ingestion tools like Airbyte, Fivetran, etc. for diverse data sources. Expert in large-scale data processing with Spark or Dask. Strong in Python, Scala, C# or Java, cloud SDKs and APIs. AI/ML expertise for pipeline efficiency, familiar with TensorFlow, PyTorch, AutoML, Python/R, and MLOps (MLflow, Kubeflow). Solid in DevOps, CI/CD automation with Bitbucket Pipelines, Azure DevOps, GitHub. Automate deployment of data pipelines and applications using Bash, PowerShell, or Azure CLI, Terraform, Helm Chats etc. Experienced in leveraging Azure AI Search, MongoDB, Elasticsearch or other hybrid/vector stores for content analysis and indexing, with a focus on creating advanced RAG (Retrieval Augmented Generation) applications. Proficiency in building IoT data pipelines, encompassing real-time data ingestion, transformation, security, scalability, and seamless integration with IoT platforms. Design, develop, and monitor streaming data applications using Kafka and related technologies.

Ready to make your mark? Join us on this exhilarating journey, where you'll be a vital part of our AI revolution. Let's transform the future together!

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

McKinsey & Company Data‑Science Jobs in 2025: Your Complete UK Guide to Turning Data into Impact

When CEOs need to unlock billion‑pound efficiencies or launch AI‑first products, they often call McKinsey & Company. What many graduates don’t realise is that behind every famous strategy deck sits a global network of data scientists, engineers and AI practitioners—unified under QuantumBlack, AI by McKinsey. From optimising Formula One pit stops to reducing NHS wait times, McKinsey’s analytics teams turn messy data into operational gold. With the launch of the McKinsey AI Studio in late 2024 and sustained demand for GenAI strategy, the firm is growing its UK analytics headcount faster than ever. The McKinsey careers portal lists 350+ open analytics roles worldwide, over 120 in the UK, spanning data science, machine‑learning engineering, data engineering, product management and AI consulting. Whether you love Python notebooks, Airflow DAGs, or white‑boarding an LLM governance roadmap for a FTSE 100 board, this guide details how to land a McKinsey data‑science job in 2025.

Data Science vs. Data Mining vs. Business Intelligence Jobs: Which Path Should You Choose?

Data Science has evolved into one of the most popular and transformative professions of the 21st century. Yet as the demand for data-related roles expands, other fields—such as Data Mining and Business Intelligence (BI)—are also thriving. With so many data-centric career options available, it can be challenging to determine where your skills and interests best align. If you’re browsing Data Science jobs on www.datascience-jobs.co.uk, you’ve no doubt seen numerous listings that mention machine learning, analytics, or business intelligence. But how does Data Science really differ from Data Mining or Business Intelligence? And which path should you follow? This article demystifies these three interrelated yet distinct fields. We’ll define the core aims of Data Science, Data Mining, and Business Intelligence, highlight where their responsibilities overlap, explore salary ranges, and provide real-world examples of each role in action. By the end, you’ll have a clearer sense of which profession could be your ideal fit—and how to position yourself for success in this ever-evolving data landscape.

UK Visa & Work Permits Explained: Your Essential Guide for International Data Science Talent

Data science has rapidly evolved into a driving force for businesses and organisations worldwide. In the United Kingdom, companies across sectors—including finance, retail, healthcare, tech start-ups, and government agencies—are turning to data-driven insights to boost competitiveness and innovation. Whether you specialise in statistical modelling, machine learning, or advanced analytics, data scientists are in high demand throughout the UK’s vibrant tech ecosystem. If you’re an international data scientist aiming to launch or grow your career in the UK, one essential part of the journey is navigating the country’s visa and work permit system. From understanding how to secure sponsorship as a Skilled Worker to exploring the Global Talent Visa for leading experts, this article will help you understand the most relevant routes, criteria, and practical steps for your move. Let’s delve into everything you need to know about working in data science in the UK as an international professional.