Data Engineer Expert/Manager

Teamtailor
Edinburgh
3 weeks ago
Create job alert

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and enhancing real-time reporting.

Our Microsoft Data Engineering Practice delivers end-to-end data platforms and engineering pipelines across Microsoft Fabric, Azure Synapse Analytics and Azure Data Bricks, alongside strategic guidance and governance support across a wide range of industries.

As an expert Data Engineer Consultant, you’ll play a pivotal role in shaping Data Engineering strategy, mentor and manage delivery teams, driving platform adoption, and ensuring high-quality outcomes for our clients. This is an exciting opportunity for an experienced consultant who thrives on variety and strategic work but is still happy to get hands-on with all aspects of Data Engineering from Data Modelling and design through to developing in Spark and SQL.

Role Responsibilities 




  • Lead end-to-end Data Engineering solution delivery on complex engagements, ensuring technical excellence and business value.
  • Mentor and guide Data Engineering teams, fostering a culture of knowledge sharing, continuous improvement, and high-quality delivery.
  • Own and drive pre-sales engagements, collaborating with sales teams to develop compelling proposals and solutions.
  • Ensure best practices in data engineering, governance, security, and compliance.
  • Collaborate closely with clients to understand their business needs and translate them into robust technical solutions.
  • Act as a subject matter expert in Microsoft Fabric, advising both internal teams and clients on best practices and strategic implementations.
  • Conduct technical presentations, demonstrations, and workshops to showcase solutions to potential clients.
  • Foster a culture of innovation, collaboration, and continuous improvement within the team.
  • Facilitate requirements workshops and design sessions, engaging both technical and non-technical stakeholders to co-create solutions.
  • Support revenue generation and brand building activity, including presenting demos to external stakeholders and scoping client needs to support the commercial process.
  • Own and drive delivery plans, structuring high-quality work, managing risks and dependencies, and communicating effectively with senior stakeholders to ensure alignment with strategic goals.

Skills and experience required 


  • Proven experience in Data Engineering, with hands-on expertise with Spark (hands on experience of Microsoft Fabric is beneficial), some of which should be in a consulting professional services capacity.
  • Strong leadership skills, with experience managing teams in a consulting or enterprise environment.
  • Ability to drive and lead pre-sales discussions, including solution design, estimation, and proposal writing.
  • Extensive experience in designing and implementing data pipelines, data lakes, and data warehouses.
  • Strong knowledge of ETL processes, data modelling, and cloud-based solutions.
  • Excellent stakeholder management and communication skills.
  • Experience working with Azure Data Services, SQL, Python, and/or other relevant technologies.
  • Ability to thrive in a fast-paced environment and manage multiple projects simultaneously.

Desirable Qualifications:


  • Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
  • Microsoft Certified: Fabric Data Engineer Associate (DP-700)
  • Databricks Data Engineer Associate
  • Databricks Data Engineer Professional

What to do next

If you’re passionate about data, and you’re looking to join a leading data and analytics company based in the UK, you could find your dream role at Dufrain.

Please submit your CV highlighting your relevant experience and certifications. Applicants must have the right to work in the UK and not require sponsorship now or in the future.Visa sponsorship is not available.

We are an equal opportunity employer and value diversity at our company.. We do not discriminate on the basis of race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other status protected by law. All qualified applicants will receive consideration for employment without regard to these factors. We encourage applications from individuals of all backgrounds and experiences.


Related Jobs

View all jobs

Data Engineer Expert/Manager

Data Engineer

Senior Data Engineer

Business Intelligence Engineer - Locations considered: London, Paris, Madrid, Milan, Munich, Berlin, EU Heavy and Bulky Services

Manager Data Engineer - D&ET - Technology Consulting - Belfast & Derry/Londonderry

Data Science Manager

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Best UK Universities for Data Science Degrees (2025 Guide)

Discover ten of the strongest UK universities for Data Science degrees in 2025. Compare entry requirements, course content, research strength and industry links to choose the right programme for you. Data is the currency of the modern economy, and professionals who can wrangle, model and interpret vast datasets are in demand across every sector—from biotechnology and finance to sport and public policy. UK universities have been at the forefront of statistics, artificial intelligence and large-scale computing for decades, making the country a prime destination for aspiring data scientists. Below, we profile ten institutions whose undergraduate or postgraduate pathways excel in data science. Although league tables vary each year, these universities have a proven record of excellence in teaching, research and industry collaboration.

Veterans in Data Science: A Military‑to‑Civilian Pathway into Analytical Careers

Introduction The UK Government’s National AI Strategy projects that data‑driven innovation could add £630 billion to the economy by 2035. Employers across healthcare, defence, and fintech are scrambling for professionals who can turn raw data into actionable insights. In 2024 alone, job‑tracker Adzuna recorded a 42 % year‑on‑year rise in data‑science vacancies, with average advertised salaries surpassing £65k. For veterans, that talent drought is a golden opportunity. Whether you plotted artillery trajectories, decrypted enemy comms, or managed aircraft engine logs, you have already practised the fundamentals of hypothesis‑driven analysis and statistical rigour. This guide explains how to translate your military experience into civilian data‑science language, leverage Ministry of Defence (MoD) transition programmes, and land a rewarding role building predictive models that solve real‑world problems. Quick Win: Take a peek at our live Junior Data Scientist roles to see who’s hiring this week.

Quantum-Enhanced AI in Data Science: Embracing the Next Frontier

Data science has undergone a staggering transformation in the past decade, evolving from a niche academic discipline into a linchpin of modern industry. Across every sector—finance, healthcare, retail, manufacturing—data scientists have become indispensable, leveraging statistical methods and machine learning to turn raw information into actionable insights. Yet as datasets grow ever larger and machine learning models become more computationally expensive, there are genuine questions about how far current methods can be pushed. Enter quantum computing, a nascent but promising technology grounded in the counterintuitive principles of quantum mechanics. Often dismissed just a few years ago as purely experimental, quantum computing is quickly gaining traction as prototypes evolve into cloud-accessible machines. When paired with artificial intelligence—particularly in the realm of data science—the results could be game-changing. From faster model training and complex optimisation to entirely new forms of data analysis, quantum-enhanced AI stands poised to disrupt established practices and create new opportunities. In this article, we will: Explore how data science has reached its current limits in certain areas, and why classical hardware might no longer suffice. Provide an accessible overview of quantum computing concepts and how they differ from classical systems. Examine the potential of quantum-enhanced AI to solve key data science challenges, from data wrangling to advanced machine learning. Highlight real-world applications, emerging job roles, and the skills you need to thrive in this new landscape. Offer actionable steps for data professionals eager to stay ahead of the curve in a rapidly evolving field. Whether you’re a practising data scientist, a student weighing up your future specialisations, or an executive curious about the next technological leap, read on. The quantum era may be closer than you think, and it promises to radically transform the very fabric of data science.