Jobs

Databricks Consultant


Job details
  • Osmii
  • Liverpool
  • 2 weeks ago
Applications closed

Databricks Subject Matter Expert (SME)

London (Hybrid Working)

6-Month Contract

As a Databricks SME, you will focus on delivering expert insights and hands-on leadership to build and optimize a robust Unified Data Platform. You’ll provide guidance on data architecture, pipeline development, system performance, and the integration of diverse data sources. Partnering with internal teams and vendors, you’ll ensure that solutions align with business objectives and technical best practices.

Key Responsibilities

  • Platform Expertise: Serve as the primary SME for Databricks, driving the adoption and optimization of its capabilities across the organization.
  • Architect and Design: Contribute to the design and development of the Unified Data Platform, ensuring it is scalable, efficient, and aligned with organizational goals.
  • Pipeline Development: Build and optimize scalable, efficient data pipelines using Databricks and other tools, ensuring consistent code quality and deployment processes.
  • System Integration: Guide the integration of Databricks with other systems, enabling unified access to diverse data sources.
  • Vendor Collaboration: Collaborate with third-party providers to enhance and scale platform resources effectively.
  • Legacy Migration: Provide expertise in migrating legacy data systems to Databricks, ensuring smooth transitions and the decommissioning of outdated infrastructure.

Essential Skills and Experience

  • Databricks Mastery: Deep expertise in Databricks, with a proven track record of designing and managing scalable, high-performance data platforms.
  • Data Engineering Tools: Advanced proficiency in PySpark and Python for creating and optimizing data pipelines and transformations.
  • SQL Proficiency: Expertise in SQL for querying and managing large, complex datasets.
  • Azure Ecosystem Knowledge: Extensive experience with Azure data services, including Azure Data Factory, Azure Synapse Analytics, and Azure Storage.
  • Data Strategy: Strong ability to bridge the gap between business needs and technical solutions, delivering impactful data architecture strategies.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Mid - Senior Data Engineers

£45,000 - £100,000 | Data Engineer Consultant | Full Time | Newcastle | | Azure | Databricks | Python |SR2 have partnered with a fast growing consultancy based in the North East. They are a newly created joint venture with one of the largest management consulting firms worldwide, and they...

SR2 | Socially Responsible Recruitment | Certified B Corporation Newcastle upon Tyne

Data Consultant/Scientist

Data Scientist/Consultant need by my global client. Due to a major workload increase my client is looking for a skilled Data Scientist/consultant that has solid Data skills around Azure and Databricks with solid exposure to artificial intelligence(AI). The client has been through many acquisitions over the last 48 months and...

Kingdom People London

Databricks Solutions Architect

Job DescriptionAs a Databricks Solutions Architect at [DI] you will work on a variety of impactful customer technical projects, including designing and building reference architectures and productionalising customer use cases within Capital Markets.What you will be doing:Define end-to-end data architectures, ensuring best practices for data governance, access control, and cost...

Data Intellect London

Data Engineer

If you need support in completing the application or if you require a different format of this document, please get in touch withator callTCS London Office numberwith the subject line: “Application Support RequestRole:Data EngineerJob Type:PermanentLocation:UK (Stevenage/London-Hybrid)Number of hours:40 hours per week – full timeAre you passionate aboutscalable systems, solving data...

Tata Consultancy Services Stevenage

Senior / Lead Data Engineer - £100k - Eligible for SC Clearance - AWS or Azure - Belfast

Senior / Lead Data Engineer - Consultancy - Eligible for SC Clearance - AWS or Azure - BelfastI’m looking for an experienced Senior / Lead Data Engineer to join a successful, multinational Consultancy in their Belfast office working on high profile client projects.As a Senior Data Engineer, you'll design and...

Avanti Belfast

Senior Data Engineer

My client is a successful multi-domain data consultancy business headquartered in Edinburgh and operating with offices in both London and Bristol. Employees can be located throughout the UK.The team are obsessive about delivering value for clients and working in a collaborative, engaged and creative way with colleagues and partner businesses.This...

Kleboe Jardine Ltd London