Databricks Consultant

Osmii
Sheffield
1 year ago
Applications closed

Related Jobs

View all jobs

Senior Consultant - AI & Data, Financial Services, Data Platforms, Data Engineer, BCM, Edinburgh

Senior Consultant Data Analyst

Senior Consultant - AI & Data, Financial Services, Data Platforms, Data Engineer, BCM, Edinburgh

Senior Consultant_ Data Analyst_ UK

Senior Consultant, Data Engineer, AI&Data, UKI, London

Senior Consultant_ Data Analyst

Databricks Subject Matter Expert (SME)

London (Hybrid Working)

6-Month Contract

As a Databricks SME, you will focus on delivering expert insights and hands-on leadership to build and optimize a robust Unified Data Platform. You’ll provide guidance on data architecture, pipeline development, system performance, and the integration of diverse data sources. Partnering with internal teams and vendors, you’ll ensure that solutions align with business objectives and technical best practices.

Key Responsibilities

  • Platform Expertise: Serve as the primary SME for Databricks, driving the adoption and optimization of its capabilities across the organization.
  • Architect and Design: Contribute to the design and development of the Unified Data Platform, ensuring it is scalable, efficient, and aligned with organizational goals.
  • Pipeline Development: Build and optimize scalable, efficient data pipelines using Databricks and other tools, ensuring consistent code quality and deployment processes.
  • System Integration: Guide the integration of Databricks with other systems, enabling unified access to diverse data sources.
  • Vendor Collaboration: Collaborate with third-party providers to enhance and scale platform resources effectively.
  • Legacy Migration: Provide expertise in migrating legacy data systems to Databricks, ensuring smooth transitions and the decommissioning of outdated infrastructure.

Essential Skills and Experience

  • Databricks Mastery: Deep expertise in Databricks, with a proven track record of designing and managing scalable, high-performance data platforms.
  • Data Engineering Tools: Advanced proficiency in PySpark and Python for creating and optimizing data pipelines and transformations.
  • SQL Proficiency: Expertise in SQL for querying and managing large, complex datasets.
  • Azure Ecosystem Knowledge: Extensive experience with Azure data services, including Azure Data Factory, Azure Synapse Analytics, and Azure Storage.
  • Data Strategy: Strong ability to bridge the gap between business needs and technical solutions, delivering impactful data architecture strategies.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.

Data Science Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data science in your 30s, 40s or 50s? You’re far from alone. Across the UK, businesses are investing in data science talent to turn data into insight, support better decisions and unlock competitive advantage. But with all the hype about machine learning, Python, AI and data unicorns, it can be hard to separate real opportunities from noise. This article gives you a practical, UK-focused reality check on data science careers for mid-life career switchers — what roles really exist, what skills employers really hire for, how long retraining typically takes, what UK recruiters actually look for and how to craft a compelling career pivot story. Whether you come from finance, marketing, operations, research, project management or another field entirely, there are meaningful pathways into data science — and age itself is not the barrier many people fear.