Senior Data Engineer

Xcede
London
3 weeks ago
Create job alert

Senior Data Engineer

Salary- Up to £90k

Location- London (Hybrid)


This is an exciting opportunity to work with cutting-edge cloud-native data platforms (AWS, Azure, Databricks) and technologies like Spark, Delta, Kafka, and Terraform. You’ll collaborate with cross-functional teams, mentor junior engineers, and drive best practices in data engineering.


Key Responsibilities:

  • Design & Build Data Pipelines: Develop and optimize batch and real-time data pipelines using Python, SQL, Spark, and Delta.
  • Data Transformation & Processing: Implement ELT workflows to ingest, enrich, and publish data for analytics and AI/ML.
  • Security & Compliance: Ensure data privacy, governance, and regulatory compliance.
  • Performance Optimization: Tune queries and pipelines for cost-efficiency and speed.
  • Monitoring & Observability: Integrate real-time monitoring to detect and resolve issues proactively.
  • CI/CD & DevOps: Implement Terraform, GitHub, and DevOps pipelines for automation and deployment.
  • Collaboration & Mentorship: Work closely with product owners, analysts, and data scientists, while mentoring junior engineers.
  • Research & Innovation: Stay ahead of the curve with the latest data technologies and best practices.


What We’re Looking For:

  • Strong experience in Python & SQL for Databricks and Spark (including Delta, Delta Live Tables, PyTest, Great Expectations).
  • Expertise in batch and streaming data processing using Kafka, AWS Kinesis, or Azure Stream Analytics.
  • Hands-on experience in cloud-native data platforms (AWS, Azure, or Databricks).
  • Knowledge of data governance, privacy laws (e.g., GDPR), and security best practices.
  • Experience with DevOps for data engineering – Terraform, GitHub, CI/CD.
  • Agile mindset – experience working in Scrum/Kanban teams.
  • Ability to mentor junior engineers and conduct code reviews (PR reviews).


Please reach out to- for more information!


Unfortunately, they do not offer sponsorship

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Snowflake & AWS

Senior Data Engineer - Snowflake - £90,000 - London - Hybrid

Senior Data Engineer - Remote - £70k

Senior Data Engineer - MS Fabric - Remote - £70k - £75k

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Jobs in the Public Sector: Exploring Opportunities Across GDS, NHS, MOD, and More

Data science has emerged as one of the most influential fields in the 21st century, transforming how organisations make decisions, improve services, and solve complex problems. Nowhere is this impact more visible than in the UK public sector. From the Government Digital Service (GDS) to the National Health Service (NHS) and the Ministry of Defence (MOD), government departments and agencies handle vast amounts of data daily to support the well-being and security of citizens. For data enthusiasts looking to make a meaningful contribution, data science jobs in the public sector can offer rewarding roles that blend innovation, large-scale impact, and societal benefit. In this comprehensive guide, we’ll explore why data science is so pivotal to government, the roles you might find, the skills needed, salary expectations, and tips on how to succeed in a public sector data science career.

Contract vs Permanent Data Science Jobs: Which Pays Better in 2025?

Data science sits at the intersection of statistics, machine learning, and domain expertise, driving crucial business decisions in almost every sector. As UK organisations leverage AI for predictive analytics, customer insights, and automation, data scientists have become some of the most in-demand professionals in the tech job market. By 2025, data scientists with expertise in deep learning, natural language processing (NLP), and MLOps are commanding top-tier compensation packages. However, deciding whether to become a day‑rate contractor, a fixed-term contract (FTC) employee, or a permanent member of an organisation can be challenging. Each path offers a unique blend of earning potential, career progression, and work–life balance. This guide will walk you through the UK data science job market in 2025, examine the differences between these three employment models, present sample take‑home pay scenarios, and offer strategic considerations to help you determine the best fit for your career.

Data Science Jobs for Non‑Technical Professionals: Where Do You Fit In?

Beyond Jupyter Notebooks Ask most people what a data‑science career looks like and they’ll picture Python wizards optimising XGBoost hyper‑parameters. The truth? Britain’s data‑driven firms need storytellers, strategists, ethicists and project leaders every bit as much as they need statisticians. The Open Data Institute’s UK Data Skills Gap 2024 places demand for non‑technical data talent at 42 % of all data‑science vacancies—roles focused on turning model outputs into business value and trustworthy decisions. This guide highlights the fastest‑growing non‑coding roles, the transferable skills many professionals already have, and a 90‑day action plan to land a data‑science job—no pandas required.