Senior Staff Software Engineer - Unity Catalog Runtime Enforcement

Databricks
London, United Kingdom
3 weeks ago
Seniority
Senior
Posted
9 Apr 2026 (3 weeks ago)

RDQ127R176

At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started.

Our engineering teams build highly technical products that fulfill real, important needs in the world. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

Unity Catalog is our platform native unified and open governance for data and AI. It eliminate silos, simplify governance and accelerate insights at scale. We are looking for a Senior Staff Software Engineer to come tech lead Unity Catalog Runtime Enforcement. We build and harden the runtime enforcement layer for Unity Catalog, ensuring secure, consistent authorization and data access across Databricks compute, engines, and clouds. This reduces incidents and simplifies customer choices by unifying enforcement semantics.

The impact you will have:

  • Lead and grow and engineering team delivering runtime enforcement outcomes in a high-severity, cross-org domain; establish scope, SLAs, and phased roadmaps.
  • Establish single-source-of-truth scope, operating model, and durable mechanisms for enforcement.
  • Lead multi-year, multi-team initiatives that shape how Databricks enforces Unity Catalog at runtime across compute types and engines.
  • Introduce tools to allow greater automation and operability of services.
  • Use your deep experience to help prevent and investigate production issues.
  • Plan and lead complicated technical projects that work with several teams within the company.
  • Contribute as a technical team lead by mentoring others, lead sprint planning, delegating work and assignments to team members and participate in project planning.

What we look for:

  • 15+ years industry experience building and supporting large-scale distributed systems.
  • Comfortable working towards a multi-year vision with incremental deliverables.
  • Extensive experience building and maintaining distributed systems.
  • Security first mindset.
  • Cross-org leadership in ambiguous, incident-heavy environments; disciplined rollout and ops maturity.
  • Motivated by delivering customer value and impact.
  • Experience driving company initiatives towards customer satisfaction.
  • BS/MS/PhD in Computer Science or related majors, or equivalent experience.

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

Benefits

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Related Jobs

View all jobs

Senior/Staff Software Engineer, Back End Leaning

Synthesia London, United Kingdom
£70,000 – £120,000 pa Remote

Senior Staff Software Engineer - Delta

Databricks London, United Kingdom

Software Engineer (Principal level)

Synthesia London, United Kingdom
Hybrid

(Alignment) Research Engineer/Research Scientist - Red Team

AI Security Institute London, United Kingdom

Principal Engineer, Data Platforms

Just Eat Takeaway.com London, United Kingdom
£120,000 – £150,000 pa Hybrid

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Where to Advertise Data Science Jobs in the UK (2026 Guide)

Advertising data science jobs in the UK requires a different approach to most technical hiring. Data science spans a broad and often misunderstood spectrum — from statistical modelling and experimental design through to machine learning engineering, product analytics and AI research. The strongest candidates identify firmly with specific subdisciplines and are frustrated by adverts that conflate data scientist with data analyst, business intelligence developer or machine learning engineer. General job boards produce high application volumes for data roles but consistently fail to match specialist data science profiles with the right opportunities. This guide, published by DataScienceJobs.co.uk, covers where to advertise data science roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Data Science Jobs UK 2026: What to Expect Over the Next 3 Years

Data science has spent the past decade being described as the sexiest job of the twenty-first century. By 2026, the reality is both more nuanced and more interesting than that label ever suggested. The discipline has matured, fragmented, deepened, and in some respects reinvented itself — and the jobs market has changed with it in ways that create genuine opportunity for those who understand what employers actually want, and genuine difficulty for those still operating on assumptions formed five years ago. The data science jobs market of 2026 is not simply a larger version of what it was three years ago. The generalist data scientist — equally comfortable wrangling data, building models, and presenting insights to the board — is giving way to a more specialised landscape where employers know exactly what problem they are trying to solve and are looking for candidates with the specific depth to solve it. Machine learning engineering, causal inference, experimentation, AI product development, and domain-specific applied science have all emerged as distinct career tracks within what was previously a single, loosely defined profession. At the same time, the arrival of large language models and the broader AI capability wave has both threatened and created data science roles in equal measure. Some of the work that junior data scientists spent their early careers doing — data cleaning, exploratory analysis, basic model building — is being partially automated by AI tooling. But the demand for practitioners who can evaluate AI systems rigorously, apply statistical thinking to complex business problems, and build the data foundations on which AI depends has grown considerably. The candidates who will thrive over the next three years are those who understand where the discipline is heading — which specialisms are attracting the most investment, which technologies are reshaping what data scientists are expected to build and know, and how to position a data science career that will remain valuable as the field continues to evolve around them. This article breaks down what the UK data science jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.

New Data Science Employers to Watch in 2026: UK and International Companies Leading Analytics and AI Innovation

Data science has emerged as one of the most transformative forces across industries, turning raw information into actionable insights, predictive models, and AI-powered solutions. In 2026, the UK is witnessing a surge in organisations where data science is not just a support function but the core of their products and services. For professionals exploring opportunities on www.DataScience-Jobs.co.uk , identifying these employers early can provide a competitive advantage in a market with high demand for advanced analytics and machine learning expertise. This article highlights new and high-growth data science employers to watch in 2026, focusing on UK startups, scale-ups, and global firms expanding their data science operations locally. All of the companies included have recently raised investment, won high-profile contracts, or significantly scaled their analytics teams.