Databricks Data Engineer

Promade Solutions Ltd
Manchester
6 days ago
Create job alert

As Promade Solutions continues to grow and deliver cutting-edge data and analytics solutions to both existing and new customers, we are looking for experienced Databricks Data Engineers who are passionate about building scalable, reliable, and high-performance data platforms.


As a Databricks Data Engineer, you will play a key role in designing, developing, and optimising modern data pipelines and lakehouse architectures. You will work closely with analytics, product, and engineering teams to deliver trusted, production-ready datasets that power reporting, advanced analytics, and data-driven decision-making.


We are looking for engineers with an inquisitive mindset, a strong understanding of data engineering best practices, and a passion for continuous learning. You should be comfortable taking ownership, influencing technical decisions, and contributing ideas as part of a collaborative and growing engineering team.


We value close collaboration over excessive documentation, so strong communication and interpersonal skills are essential. To succeed in this agile and forward-thinking environment, you should have solid experience with Databricks, cloud platforms, and modern data engineering tools and architectures.


Key Responsibilities

  • Design, build, and maintain scalable ETL/ELT pipelines for batch and streaming data workloads
  • Develop and optimise Databricks Lakehouse solutions using Apache Spark and Delta Lake
  • Design and maintain data models, data warehouses, and lake/lakehouse architectures
  • Implement data quality, validation, observability, and monitoring frameworks
  • Optimise data pipelines for performance, reliability, and cost efficiency
  • Collaborate with cross-functional teams to deliver trusted, production-grade datasets
  • Work extensively with Azure cloud services, including Azure Databricks, Azure Data Factory, Azure SQL DB, Azure Synapse, and Azure Storage
  • Develop and manage stream-processing systems using tools such as Kafka and Azure Stream Analytics
  • Write clean, maintainable Python and SQL code and develop high-quality Databricks notebooks
  • Support CI/CD pipelines, source control, and automated deployments for data workloads
  • Contribute to improving data engineering standards, frameworks, and best practices across the organisation

Essential Skills & Experience

  • 7+ years of experience in Data Engineering roles
  • Strong hands-on experience with Databricks and Apache Spark
  • Mandatory: Databricks Certified Professional credential
  • Excellent proficiency in SQL and Python
  • Strong understanding of distributed data processing, data modelling, and modern data architectures
  • Experience working with cloud data platforms such as Azure Synapse, Snowflake, Redshift, or BigQuery
  • Hands-on experience with batch and streaming data pipelines
  • Experience with orchestration and transformation tools such as Airflow, dbt, or similar
  • Solid understanding of CI/CD, Git, and DevOps practices for data platforms
  • Ability to work autonomously, take ownership, and deliver high-quality solutions
  • Strong communication skills with the ability to explain technical concepts clearly to both technical and non-technical stakeholders

Desirable Skills

  • Experience with real-time data streaming and event-driven architectures
  • Exposure to data governance, security, and access control in cloud environments
  • Experience across multiple cloud platforms (AWS, Azure, GCP)
  • Familiarity with DataOps, MLOps, or analytics engineering practices


#J-18808-Ljbffr

Related Jobs

View all jobs

Databricks Data Engineer

Databricks Data Engineer – Lakehouse & GenAI Powerhouse

Databricks Data Engineer - Cloud Pipelines

Databricks Data Engineer: Lakehouse & Pipelines

Azure/Databricks Data Engineer

Senior Data Engineer, Databricks, Data Modelling, Home Based

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.

Data Science Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data science in your 30s, 40s or 50s? You’re far from alone. Across the UK, businesses are investing in data science talent to turn data into insight, support better decisions and unlock competitive advantage. But with all the hype about machine learning, Python, AI and data unicorns, it can be hard to separate real opportunities from noise. This article gives you a practical, UK-focused reality check on data science careers for mid-life career switchers — what roles really exist, what skills employers really hire for, how long retraining typically takes, what UK recruiters actually look for and how to craft a compelling career pivot story. Whether you come from finance, marketing, operations, research, project management or another field entirely, there are meaningful pathways into data science — and age itself is not the barrier many people fear.