Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer Microsoft Fabric

Simpson Associates
North Yorkshire
1 day ago
Create job alert

Simpson Associates transforms raw data into actionable insights that drive positive change.


Our Microsoft data expertise, specialist sector knowledge, and innovative and trusted advice and guidance are just some of the reasons clients choose to work with us.


Our mission is to help purpose‑led organisations from within the public and private sectors harness data as a lever for change and enable them to realise business value more quickly. We provide the full range of services to support organisations on their data transformation journey, from advisory support and data strategy to developing Data & AI solutions right through to providing a range of managed services.


We are a Microsoft Solutions Partner holding Specialisations in AI Platform on Microsoft Azure, Analytics on Microsoft Azure, Data Warehouse Migration to Microsoft Azure and Migrate Enterprise Applications to Microsoft Azure, as well as holding Solutions Partner designations in Data & AI (Azure); Digital & App Innovation (Azure); Infrastructure (Azure) and Security.


But it’s not just about the badges. We are proud to be recognised as the winner of the 2024 Microsoft Community Response Partner of the Year award, reflecting our dedication to using technology for positive change.


We are also a Databricks partner and an IBM Gold Partner specialising in Cognos Analytics and Planning Analytics.


With offices in York and Sheffield and a team based throughout the UK we champion creativity, innovation and collaboration in the workplace.


Join our UK consulting team as an experienced Data Engineer specialising in Spark‑based data platforms such as Microsoft Fabric or Databricks.


The Role

This remote role offers the opportunity to design and deliver integrated analytics solutions using Microsoft Fabric’s cutting‑edge Spark ecosystem, including Lakehouse data pipelines and Power BI. You’ll collaborate closely with our agile delivery team, contributing to technical backlogs, participating in daily stand‑ups and engaging directly with clients to deliver scalable, high‑quality data solutions.


Key Responsibilities

  • Build and maintain data pipelines, lakes and warehouses using Fabric and/or Databricks components.
  • Implement ETL/ELT processes, data modelling and analytics workflows to support BI and AI initiatives.
  • Serve as a technical expert in data engineering recognised by both internal teams and customers.
  • Provide advanced support across the business through deep expertise in data engineering practices.
  • Act as a go‑to resource for complex and modern architectural and implementation challenges.
  • Deliver high‑quality solutions aligned with the latest data engineering methodologies and technologies.
  • Contribute to the design and execution of key data functions that drive business and customer success.
  • Collaborate with cross‑functional teams to prioritise and execute technical backlog items.
  • Participate in agile ceremonies, including stand‑ups, sprint reviews and customer demos.
  • Troubleshoot data issues, optimise performance and ensure data accuracy and reliability.
  • Document architectures, pipelines and operational procedures for team knowledge sharing.

Required Skills & Experience

  • Expertise in Microsoft Fabric specific features: OneLake, Dataflows, Pipelines and Power BI integration (incl. Direct Lake).
  • Or expertise in Databricks features: Autoloader, etc.
  • Strong programming skills in PySpark, Python and SQL.
  • Familiarity with Azure cloud services and DevOps tools (Git, CI/CD pipelines).
  • Proven experience in agile methodologies and backlog management tools (Jira, Azure DevOps Boards).
  • Advanced SQL/SparkSQL skills for querying, modelling and integration.

Nice to Have

  • 3 years in Data Engineering with at least 12 months of hands‑on experience in Microsoft Fabric or Databricks.

Qualifications

  • Microsoft certifications such as Fabric Analytics Engineer Associate or Azure Data Engineer Associate (preferred).
  • Or Databricks Certifications.
  • Reasonable proficiency in English for effective technical and client communication.

Soft Skills

  • Strong problem‑solving and attention to detail.
  • Excellent collaboration and communication abilities.
  • Adaptability to fast‑paced agile team environments.
  • Proactive mindset with a focus on continuous improvement and value delivery.

The successful candidate will be required to obtain Security Clearance and NPPV Level 3.


Employment Type: Employee


Vacancy: 1


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer - Fabric - Azure - London - Hybrid - 70k

Data Engineer — Scale Enterprise Data Platform (Microsoft Fabric)

Data Engineer - Azure Fabric Migration (Hybrid)

Data Engineer: Scalable Fabric Platform & CI/CD

Data Engineer

Data Engineer: Cloud Pipelines (Fabric/Databricks) – Remote UK

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data science hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise rigorous problem framing, high‑quality analytics & modelling, experiment/causality, production awareness (MLOps), governance/ethics, and measurable product or commercial impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for product/data scientists, applied ML scientists, decision scientists, econometricians, growth/marketing analysts, and ML‑adjacent data scientists supporting LLM/AI products. Who this is for: Product/decision/data scientists, applied ML scientists, econometrics & causal inference specialists, experimentation leads, analytics engineers crossing into DS, ML generalists with strong statistics, and data scientists collaborating with platform/MLOps teams in the UK.

Why Data Science Careers in the UK Are Becoming More Multidisciplinary

Data science once meant advanced statistics, machine learning models and coding in Python or R. In the UK today, it has become one of the most in-demand professions across sectors — from healthcare to finance, retail to government. But as the field matures, employers now expect more than technical modelling skills. Modern data science is multidisciplinary. It requires not just coding and algorithms, but also legal knowledge, ethical reasoning, psychological insight, linguistic clarity and human-centred design. Data scientists are expected to interpret, communicate and apply data responsibly, with awareness of law, human behaviour and accessibility. In this article, we’ll explore why data science careers in the UK are becoming more multidisciplinary, how these five disciplines intersect with data science, and what job-seekers & employers need to know to succeed in this transformed field.

Data Science Team Structures Explained: Who Does What in a Modern Data Science Department

Data science is one of the most in-demand, dynamic, and multidisciplinary areas in the UK tech and business landscape. Organisations from finance, retail, health, government, and beyond are using data to drive decisions, automate processes, personalise services, predict trends, detect fraud, and more. To do that well, companies don’t just need good data scientists; they need teams with clearly defined roles, responsibilities, workflows, collaboration, and governance. If you're aiming for a role in data science or recruiting for one, understanding the structure of a data science department—and who does what—can make all the difference. This article breaks down the key roles, how they interact across the lifecycle of a data science project, what skills and qualifications are typical in the UK, expected salary ranges, challenges, trends, and how to build or grow an effective team.