Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

Vp plc
Harrogate
1 month ago
Create job alert

Reporting to the Head of Data and Analytics, the Data Engineer will be responsible for delivering, maintaining, and supporting Vp's cloud data platform. This includes implementing data pipelines (batch, micro-batch, and streaming), managing a data lakehouse, and supporting data consumption workloads such as data visualization and future AI initiatives.

The Data Engineer will be a key member of the Group Data Team, working closely with technical and business colleagues to deliver data solutions that drive value and help Vp achieve its strategic outcomes. They will collaborate with stakeholders to aid decision-making and serve as a trusted point of contact between the Group Data Analytics team, Infrastructure, and Development teams.

Key Responsibilities

  • Develop low-level design documentation based on architecture artefacts.
  • Collaborate with cloud infrastructure and development teams for optimized delivery.
  • Work within a Software Development Lifecycle (SDLC) to maintain quality and control.
  • Partner with data analysts and system owners to define and document data transformation rules and data extraction processes, including interface contracts for each ingested data source.
  • Support data modelling efforts, including capturing and maintaining transformation rules.
  • Implement ETL/ELT batch and micro-batch pipelines using AWS Glue; integrate data quality assessment via AWS Glue Data Quality Services and AWS Databrew.
  • Build streaming pipelines using AWS Kinesis Data Streams, Firehose, and Kafka (MSK).
  • Maintain metadata and enforce quality standards using AWS Glue Data Catalog.
  • Define and administer the data platform using AWS LakeFormation.
  • Use Snowflake to develop modeled data sources and products for end users.

What We're Looking For

  • Experience delivering ETL/ELT pipelines with tools like AWS Glue.
  • Proficiency in SQL and Python.
  • Strong knowledge of cloud-based data architectures, including data lakes, lakehouses, and warehouses.
  • Familiarity with AWS services such as S3, DynamoDB, Aurora, RDS, Glue, Athena, and EMR.
  • Understanding of data lakehouse storage formats (e.g., Parquet, Delta, Iceberg).
  • Experience with Snowflake and modern data platform practices.
  • Knowledge of data modelling methods (Inmon and Kimball).
  • Strong communication skills and the ability to adapt style to different audiences.
  • Ability to produce high-quality documentation (e.g., low-level designs, runbooks).
  • Desirable: experience with streaming technologies (Kinesis, Firehose, Kafka, Flink); working knowledge of infrastructure as code (CloudFormation, Terraform); AWS Certified Data Engineer; degree in a relevant field.

What We Can Offer You

  • Salary sacrifice pension
  • 25 days holiday FTE, plus bank holidays
  • Additional holiday purchase scheme
  • Private Health Insurance (employee and partner)
  • Free Tool Hire
  • Life Assurance cover 3x salary
  • Employee Assistance Programme
  • Virtual GP Service
  • Will Writing & Funeral Concierge Service
  • Share save scheme
  • Eye care vouchers
  • Recommend a friend scheme
  • Learning & Development - structured in-house and external training
  • Cycle to work scheme
  • Long service recognition
  • My Vp discounts on brands
  • Discounts on HP products
  • EE mobile contract discounts
  • Gym discounts
  • Health Shield health care plan
  • Regit Assist accident helpline

A Little Bit About Us

Established in 1954, Vp plc has evolved into a group specializing in equipment rental across multiple divisions, serving industries such as construction, civil engineering, rail, water, oil and gas, outdoor events, and housebuilding.

We are committed to diversity and equal opportunities, making employment decisions based on experience and skills.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Best Free Tools & Platforms to Practise Data Science Skills in 2025/26

Data science continues to be one of the most exciting, high-growth career paths in the UK and worldwide. From predicting customer behaviour to detecting fraud and driving healthcare innovations, data scientists are at the forefront of digital transformation. But breaking into the field isn’t just about having a degree. Employers are looking for candidates who can demonstrate practical data science skills — analysing datasets, building machine learning models, and presenting insights that solve real business problems. The best part? You don’t need to spend thousands on premium courses or expensive software. There are dozens of high-quality, free tools and platforms that allow you to practise data science in 2025. This guide explores the best ones to help you learn, experiment, and build portfolio-ready projects.

Top 10 Skills in Data Science According to LinkedIn & Indeed Job Postings

Data science isn’t just a buzzword — it’s the engine powering innovation in sectors across the UK, from finance and healthcare to retail and public policy. As organisations strive to turn data into insight and action, the need for well-rounded data scientists is surging. But what precise skills are employers demanding right now? Drawing on trends seen in LinkedIn and Indeed job ads, this article reveals the Top 10 data science skills sought by UK employers in 2025. You’ll get guidance on showcasing these in your CV, acing interviews, and building proof of your capabilities.

The Future of Data Science Jobs: Careers That Don’t Exist Yet

Data science has rapidly evolved into one of the most important disciplines of the 21st century. Once a niche field combining elements of statistics and computer science, it is now at the heart of decision-making across industries. Businesses, governments, and charities rely on data scientists to uncover insights, forecast trends, and build predictive models that shape strategy. In the UK, data science has become central to economic growth. From the NHS using data to improve patient outcomes to financial institutions modelling risk, the applications are endless. The UK’s thriving tech hubs in London, Cambridge, and Manchester are creating high demand for data talent, with salaries often outpacing other technology roles. Yet despite its current importance, data science is still in its infancy. Advances in artificial intelligence, quantum computing, automation, and ethics will transform what data scientists do. Many of the most vital data science jobs of the next two decades don’t exist yet. This article explores why new careers are emerging, the roles likely to appear, how current jobs will evolve, why the UK is well positioned, and how professionals can prepare now.