Jobs

Data Engineer - Databricks


Job details
  • Dufrain
  • Edinburgh
  • 1 month ago

Dufrain_LinkedIn_Banners_AW_5.jpg

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time reporting, and managing data from mergers and acquisitions.

At Dufrain we prides ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency.

Our mission is to inspire, shape and deliver the data capabilities of tomorrow.

We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy.


Our Data Engineers 

  • Possess a broad range of data engineering skills, with a focus on Microsoft Azure, although experience with other cloud platforms is also desirable.
  • Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues.
  • Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment.
  • Delivering high-quality pieces of work, proven ability to escalate problems to client / senior team members where necessary and propose possible solutions.
  • Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge-sharing activities, and data services.


Essential technical experience you will demonstrate

  • Strong experience designing and delivering data solutions in the Databricks Data Intelligence platform, either on Azure or AWS.
  • Good working knowledge of Databricks components: DeltaLake, Unity Catalog, ML Flow, etc. Expertise in SQL, Python and Spark (Scala or Python)
  • Experience working with relational SQL databases either on premises or in the cloud.
  • Experience delivering multiple solutions using key techniques such as Governance, Architecture, Data Modelling, ETL / ELT, Data Lakes, Data Warehousing, Master Data, and BI.
  • A solid understanding of key processes in the engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines.
  • Experience working with one or more of Kafka, Snowflake, Azure Data Factory, Azure Synapse or Microsoft Fabric is highly desirable.
  • Knowledge of data modelling and data architectures: Inmon, Kimball, DataVault

About You

  • A high level of drive with the ability to work to tight deadlines.
  • Experience of providing insightful solutions
  • The ability to participate effectively in meetings with senior stakeholders
  • A team player who supports, encourages and shares knowledge with others
  • A self-starter with the ability to work under pressure and with limited supervision
  • A track record of accurate output and responsibility for elements of project delivery
  • The ability to work as part of an integrated team or on an individual basis
  • Awareness of industry standards, regulations and developments

What we offer you

We have a working culture that rewards high performance and nurtures talent, while providing exciting opportunities and challenges to generate positive change for our clients.

You can expect guaranteed investment to your personal development. We have structed learning paths on a number of platform including Udemy and not to mention the in house knowledge that is shared by all of our consultants, our lunch and learn sessions are regular fixtures in the calendar.

 

Benefits

  • Competitive base salary
  • Annual Performance related bonus
  • Hybrid home/onsite/office working – Edinburgh, Manchester & London
  • 25 days annual leave (plus bank and public holidays)
  • Birthday day off – celebrate with an extra holiday
  • Career progress programme - guaranteed learning and development investment and your own career coach
  • Life insurance
  • Private medical health insurance
  • Contributory pension
  • Health and wellbeing group
  • And many more.

 

If you’re passionate about data, and you’re looking to join a leading data and analytics company based, you could find your dream role at Dufrain. Please submit your CV highlighting your relevant experience and certifications. Applicants must have the right to work in the UK and not require sponsorship now or in the future. Visa sponsorship is not available for this role.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, or disability status.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer - £125,000 - Snowflake - London - Hybrid

Data Engineer - £125,000 - Snowflake - London - HybridCompany Overview:My client is a leading global commodities merchant and infrastructure asset investor, specialising in the physical and financial trading of energy commodities. They leverage advanced data analytics and cutting-edge technology to optimise trading strategies and asset management. With a strong...

City of London

Data Engineering Manager

Data Engineering Manager – Financial Services | Cloud | SnowflakeHead of Data Engineering / Lead Data EngineerFlexible Hybrid working | Competitive Salary & BenefitsAre you an experienced Data Engineering Leader looking for a strategic role in a high-growth, data-driven organization?We are seeking a Senior Data Engineering Manager to lead a...

Loughton, Milton Keynes

Data Engineer / Architect - £68,500 - Remote

Data Engineer / Architect - £68,500 - RemoteRole Overview:This role would be perfect for a Senior Data Engineer, or junior architect looking to take a huge step up into a more enterprise role. You will have the opportunity to define and implement the enterprise data strategy for the organisation, leading...

Glasgow

Data Engineer

Data EngineerAre you ready to take ownership of a brand-new role and make a real impact?This is your chance to join a leader in high-tech eCommerce and logistics solutions their first ever Data Engineer.They're on an exciting journey, upgrading a major platform, and need a data expert to help shape...

Southampton

Data Engineer 70k

Job Title: Data EngineerLocation: BirminghamSalary: £50,000 - £70,000 per year + BonusBenefits:Private Health-careGenerous Bonus SchemeFlexible Working Options (Remote/Hybrid)About the Role:My client, a leading organisation in manufacturing, is seeking a skilled Data Engineer to join their growing team. This is an exciting opportunity for a data enthusiast with experience in designing,...

Birmingham

Data Engineer - DOORS implementation

Location: Yeovil (mostly onsite)Duration: 6 month contractRate: Inside IR35Role profile:Our client, a leading aerospace company, are looking for a data specialist to to support the implementation of the DOORS toolset.The specialist will play a crucial role in supporting the implementation of the DOORS toolset for the NMH Pre-contract & Programme...

Yeovil