Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer - Databricks

Dufrain
London
8 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Dufrain_LinkedIn_Banners_AW_5.jpg

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time reporting, and managing data from mergers and acquisitions.

At Dufrain we prides ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency.

Our mission is to inspire, shape and deliver the data capabilities of tomorrow.

We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy.


Our Data Engineers 

  • Possess a broad range of data engineering skills, with a focus on Microsoft Azure, although experience with other cloud platforms is also desirable.
  • Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues.
  • Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment.
  • Delivering high-quality pieces of work, proven ability to escalate problems to client / senior team members where necessary and propose possible solutions.
  • Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge-sharing activities, and data services.


Essential technical experience you will demonstrate

  • Strong experience designing and delivering data solutions in the Databricks Data Intelligence platform, either on Azure or AWS.
  • Good working knowledge of Databricks components: DeltaLake, Unity Catalog, ML Flow, etc. Expertise in SQL, Python and Spark (Scala or Python)
  • Experience working with relational SQL databases either on premises or in the cloud.
  • Experience delivering multiple solutions using key techniques such as Governance, Architecture, Data Modelling, ETL / ELT, Data Lakes, Data Warehousing, Master Data, and BI.
  • A solid understanding of key processes in the engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines.
  • Experience working with one or more of Kafka, Snowflake, Azure Data Factory, Azure Synapse or Microsoft Fabric is highly desirable.
  • Knowledge of data modelling and data architectures: Inmon, Kimball, DataVault

About You

  • A high level of drive with the ability to work to tight deadlines.
  • Experience of providing insightful solutions
  • The ability to participate effectively in meetings with senior stakeholders
  • A team player who supports, encourages and shares knowledge with others
  • A self-starter with the ability to work under pressure and with limited supervision
  • A track record of accurate output and responsibility for elements of project delivery
  • The ability to work as part of an integrated team or on an individual basis
  • Awareness of industry standards, regulations and developments

What we offer you

We have a working culture that rewards high performance and nurtures talent, while providing exciting opportunities and challenges to generate positive change for our clients.

You can expect guaranteed investment to your personal development. We have structed learning paths on a number of platform including Udemy and not to mention the in house knowledge that is shared by all of our consultants, our lunch and learn sessions are regular fixtures in the calendar.

 

Benefits

  • Competitive base salary
  • Annual Performance related bonus
  • Hybrid home/onsite/office working – Edinburgh, Manchester & London
  • 25 days annual leave (plus bank and public holidays)
  • Birthday day off – celebrate with an extra holiday
  • Career progress programme - guaranteed learning and development investment and your own career coach
  • Life insurance
  • Private medical health insurance
  • Contributory pension
  • Health and wellbeing group
  • And many more.

 

If you’re passionate about data, and you’re looking to join a leading data and analytics company based, you could find your dream role at Dufrain. Please submit your CV highlighting your relevant experience and certifications. Applicants must have the right to work in the UK and not require sponsorship now or in the future. Visa sponsorship is not available for this role.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, or disability status.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why the UK Could Be the World’s Next Data Science Jobs Hub

Data science is arguably the most transformative technological field of the 21st century. From powering artificial intelligence algorithms to enabling complex business decisions, data science is essential across sectors. As organisations leverage data more rapidly—from retailers predicting customer behaviour to health providers diagnosing conditions—demand for proficiency in data science continues to surge. The United Kingdom is particularly well-positioned to become a global data science jobs hub. With world-class universities, a strong tech sector, growing AI infrastructure, and supportive policy environments, the UK is poised for growth. This article delves into why the UK could emerge as a leading destination for data science careers, explores the job market’s current state, outlines future opportunities, highlights challenges, and charts what must happen to realise this vision.

The Best Free Tools & Platforms to Practise Data Science Skills in 2025/26

Data science continues to be one of the most exciting, high-growth career paths in the UK and worldwide. From predicting customer behaviour to detecting fraud and driving healthcare innovations, data scientists are at the forefront of digital transformation. But breaking into the field isn’t just about having a degree. Employers are looking for candidates who can demonstrate practical data science skills — analysing datasets, building machine learning models, and presenting insights that solve real business problems. The best part? You don’t need to spend thousands on premium courses or expensive software. There are dozens of high-quality, free tools and platforms that allow you to practise data science in 2025. This guide explores the best ones to help you learn, experiment, and build portfolio-ready projects.

Top 10 Skills in Data Science According to LinkedIn & Indeed Job Postings

Data science isn’t just a buzzword — it’s the engine powering innovation in sectors across the UK, from finance and healthcare to retail and public policy. As organisations strive to turn data into insight and action, the need for well-rounded data scientists is surging. But what precise skills are employers demanding right now? Drawing on trends seen in LinkedIn and Indeed job ads, this article reveals the Top 10 data science skills sought by UK employers in 2025. You’ll get guidance on showcasing these in your CV, acing interviews, and building proof of your capabilities.