Data Engineer

TechYard
Liverpool
2 weeks ago
Create job alert

Data Engineer – Databricks


About the Role

We’re looking for a Data Engineer to design, build, and optimize data pipelines using Databricks. You’ll work with clients and internal teams to deliver scalable, efficient data solutions tailored to business needs.


Key Responsibilities

  • Develop ETL/ELT pipelines with Databricks and Delta Lake
  • Integrate and process data from diverse sources
  • Collaborate with data scientists, architects, and analysts
  • Optimize performance and manage Databricks clusters
  • Build cloud-native solutions (Azure preferred, AWS/GCP also welcome)
  • Implement data governance and quality best practices
  • Automate workflows and maintain CI/CD pipelines
  • Document architecture and processes


What We’re Looking For


Required:

  • 3+ years in data engineering with hands-on Databricks experience
  • Proficient in Databricks, Delta Lake, Spark, Python, SQL
  • Cloud experience (Azure preferred, AWS/GCP a plus)
  • Strong problem-solving and communication skills


Preferred:

  • Experience with MLflow, Power BI/Tableau
  • Cloud/Data engineering certifications
  • Familiarity with CI/CD and data automation tools

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Jobs in the Public Sector: Exploring Opportunities Across GDS, NHS, MOD, and More

Data science has emerged as one of the most influential fields in the 21st century, transforming how organisations make decisions, improve services, and solve complex problems. Nowhere is this impact more visible than in the UK public sector. From the Government Digital Service (GDS) to the National Health Service (NHS) and the Ministry of Defence (MOD), government departments and agencies handle vast amounts of data daily to support the well-being and security of citizens. For data enthusiasts looking to make a meaningful contribution, data science jobs in the public sector can offer rewarding roles that blend innovation, large-scale impact, and societal benefit. In this comprehensive guide, we’ll explore why data science is so pivotal to government, the roles you might find, the skills needed, salary expectations, and tips on how to succeed in a public sector data science career.

Contract vs Permanent Data Science Jobs: Which Pays Better in 2025?

Data science sits at the intersection of statistics, machine learning, and domain expertise, driving crucial business decisions in almost every sector. As UK organisations leverage AI for predictive analytics, customer insights, and automation, data scientists have become some of the most in-demand professionals in the tech job market. By 2025, data scientists with expertise in deep learning, natural language processing (NLP), and MLOps are commanding top-tier compensation packages. However, deciding whether to become a day‑rate contractor, a fixed-term contract (FTC) employee, or a permanent member of an organisation can be challenging. Each path offers a unique blend of earning potential, career progression, and work–life balance. This guide will walk you through the UK data science job market in 2025, examine the differences between these three employment models, present sample take‑home pay scenarios, and offer strategic considerations to help you determine the best fit for your career.

Data Science Jobs for Non‑Technical Professionals: Where Do You Fit In?

Beyond Jupyter Notebooks Ask most people what a data‑science career looks like and they’ll picture Python wizards optimising XGBoost hyper‑parameters. The truth? Britain’s data‑driven firms need storytellers, strategists, ethicists and project leaders every bit as much as they need statisticians. The Open Data Institute’s UK Data Skills Gap 2024 places demand for non‑technical data talent at 42 % of all data‑science vacancies—roles focused on turning model outputs into business value and trustworthy decisions. This guide highlights the fastest‑growing non‑coding roles, the transferable skills many professionals already have, and a 90‑day action plan to land a data‑science job—no pandas required.