Senior Data Engineer - Databricks

Primus Connect
London
1 month ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Microsoft Fabric

Senior Data Engineer / Consultant (Databricks)Fully remote - UK£70,(Apply online only),000 (DOE) + Excellent benefitsData ignites passion, community fuels collaboration, and growth knows no bounds. Recognized for innovation and rapid growth, this esteemed Consultancy have been named Databricks EMEA Emerging Business Partner of the Year and achieved a second consecutive appearance on the Financial Times FT1000 list.Looking for Senior Data Engineers to join remotely in the UK. Be the first to have an influential impact on the UK hub."As a Data Engineer, you will have the unique opportunity to push the boundaries of technology and lead the way in how data transforms the world. We work with customers who want to innovate and change their industries. So it never gets boring! Sorting out a complex technical puzzle, setting up a new data architecture from scratch, or guiding our customers through adopting the latest technologies is our routine here. Hence, we'd expect you to be more than just a (data) engineer. We'd expect you to breathe and live data, to thrive for knowledge and excellence, and to be keen to build something enduring and impactful for our customers."Technical Expertise * You will have 5+ years of experience in Data Engineering, with a focus on cloud platforms ( ANY of the following: Azure, AWS, GCP) * You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog); * You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.); * You’re proficient in SQL and Python, using them to transform and optimize data like a pro; * You know your way around CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep); * You’ve hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker).Consulting & Client-Facing Skills * Proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders. I * You’ve successfully delivered projects like Data Lakehouse buildouts and cloud data migrations; * You excel in explaining technical concepts to non-technical audiences and drive decision-making.What they offer?You'll have the rare opportunity to join at a time when you can still meaningfully impact our growth trajectory and organizational success. * The chance to work remotely (European Travel to head office is there for the taking and a chance to spend time with others!) * World-class educational benefits - there’s no shortage of learning opportunities, meaning that you'll get access to Databricks' public and internal courses to learn all the tricks of Distributed Data Processing, MLOps, Apache Spark, Databricks, and Cloud Migration from the best. Additionally, we'll pay for various data & cloud certifications, you'll get dedicated time for learning during work hours, and access to our internal library; * Flexible Annual leave days - we’re flexible with how many days you take off if that does not conflict with customer success and the work getting done * 4 weeks of paternity leave - because we think it’s important for both parents to be there when it matters the most; * Employee Assistance Program (EAP) - life always happens! And we'd like to be there for you when it counts the most. Through EAP, we offer our employees access to psychology, financial, and legal consulting services via phone or in person; * Pension scheme enrollment and a comprehensive private health insurance plan * Top-notch working equipment - working comfortably means working well. You will get a MacBook Pro, a phone, and a sign-up bonus of 1000 GBP gross (to be paid with your first payroll) to set up your home office or whatever else is needed to give your best; * The chance to make an impact in a high-transparency culture - open feedback and no politics are things we value a lot. Additionally, you'll get the chance to work in the field of data & AI and shape the future of a rapidly growing tech company.Click 'Apply now' and share your CV.Interviews taking place from next week

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Best UK Universities for Data Science Degrees (2025 Guide)

Discover ten of the strongest UK universities for Data Science degrees in 2025. Compare entry requirements, course content, research strength and industry links to choose the right programme for you. Data is the currency of the modern economy, and professionals who can wrangle, model and interpret vast datasets are in demand across every sector—from biotechnology and finance to sport and public policy. UK universities have been at the forefront of statistics, artificial intelligence and large-scale computing for decades, making the country a prime destination for aspiring data scientists. Below, we profile ten institutions whose undergraduate or postgraduate pathways excel in data science. Although league tables vary each year, these universities have a proven record of excellence in teaching, research and industry collaboration.

Veterans in Data Science: A Military‑to‑Civilian Pathway into Analytical Careers

Introduction The UK Government’s National AI Strategy projects that data‑driven innovation could add £630 billion to the economy by 2035. Employers across healthcare, defence, and fintech are scrambling for professionals who can turn raw data into actionable insights. In 2024 alone, job‑tracker Adzuna recorded a 42 % year‑on‑year rise in data‑science vacancies, with average advertised salaries surpassing £65k. For veterans, that talent drought is a golden opportunity. Whether you plotted artillery trajectories, decrypted enemy comms, or managed aircraft engine logs, you have already practised the fundamentals of hypothesis‑driven analysis and statistical rigour. This guide explains how to translate your military experience into civilian data‑science language, leverage Ministry of Defence (MoD) transition programmes, and land a rewarding role building predictive models that solve real‑world problems. Quick Win: Take a peek at our live Junior Data Scientist roles to see who’s hiring this week.

Quantum-Enhanced AI in Data Science: Embracing the Next Frontier

Data science has undergone a staggering transformation in the past decade, evolving from a niche academic discipline into a linchpin of modern industry. Across every sector—finance, healthcare, retail, manufacturing—data scientists have become indispensable, leveraging statistical methods and machine learning to turn raw information into actionable insights. Yet as datasets grow ever larger and machine learning models become more computationally expensive, there are genuine questions about how far current methods can be pushed. Enter quantum computing, a nascent but promising technology grounded in the counterintuitive principles of quantum mechanics. Often dismissed just a few years ago as purely experimental, quantum computing is quickly gaining traction as prototypes evolve into cloud-accessible machines. When paired with artificial intelligence—particularly in the realm of data science—the results could be game-changing. From faster model training and complex optimisation to entirely new forms of data analysis, quantum-enhanced AI stands poised to disrupt established practices and create new opportunities. In this article, we will: Explore how data science has reached its current limits in certain areas, and why classical hardware might no longer suffice. Provide an accessible overview of quantum computing concepts and how they differ from classical systems. Examine the potential of quantum-enhanced AI to solve key data science challenges, from data wrangling to advanced machine learning. Highlight real-world applications, emerging job roles, and the skills you need to thrive in this new landscape. Offer actionable steps for data professionals eager to stay ahead of the curve in a rapidly evolving field. Whether you’re a practising data scientist, a student weighing up your future specialisations, or an executive curious about the next technological leap, read on. The quantum era may be closer than you think, and it promises to radically transform the very fabric of data science.