Jobs

Senior Data Engineer


Job details
  • Vitesse PSP
  • 1 month ago
Applications closed

Join a growing Product and Technology team which has more than double in size in the last 12 month. Your role will be to help architect and build a robust, secure and scalable data architecture to support real-time observability and reporting. This will entail the design and construction of data engineering solutions on AWS, as well as the design and construction of data service API's. You will be supporting key internal and external stakeholders that require access to real-time and curated data.

In this role, you will be working closely with internal stakeholders across the organisation, rapidly becoming a subject matter expert of the data generated by Vitesse and our ELT pipelines as well as drive data architecture strategy and Terraform deployment.

The successful person will have experience building complex data frameworks in other early-stage businesses. They will have experience with cloud platforms, ideally AWS.

Applicants with the following technology experience will be preferred:

  • AWS
  • Airflow
  • Databricks
  • GitHub
  • Great Expectations
  • PyTest
  • Kafka
  • Mosaic AI
  • Terraform
  • Tableau

 

Your Responsibilities

  • Design, build, and maintain scalable data pipelines and architectures to handle large volumes of structured and unstructured data
  • Develop, enhance, and optimize ELT processes for ingesting, processing, and distributing data across multiple platforms in real time
  • Build and manage data warehouses (to support advanced analytics, reporting, and machine learning
  • Implement data governance, quality checks, and validation processes to ensure the accuracy, consistency, observability, and security of data
  • Optimize query performance and data storage costs through techniques like partitioning, indexing, vacuuming, and compression
  • Build monitoring and alerting systems for data pipelines to proactively detect and resolve issues before they impact business operations
  • Optimize existing data pipelines for better performance, cost-efficiency, and scalability
  • Work with data scientists, analysts, and business stakeholders to understand data needs and ensure availability of relevant data
  • Continuously research and integrate cutting-edge data technologies, tools, and practices to improve data engineering processes
  • Team up with product engineers to identify, root cause, and resolve bugs
  • Update documentation to help users navigate our data products
  • Ensure our data platform performs well and is always available for our blue-chip clients

Requirements

  • Experience with data pipeline orchestration tools such as Airflow, Luigi, or similar
  • Experience with version control systems and CI/CD best practices using GitHub Actions
  • Knowledge of data governance, privacy regulations (e.g., GDPR), and security best practices
  • Proficiency with SQL and experience with distributed data processing tools such as Apache Spark
  • Strong understanding of relational and NoSQL databases (e.g., PostgreSQL, MongoDB, Impala, Cassandra)
  • Experience with cloud infrastructure (Docker and Kubernetes, Terraform)
  • Experience in AWS platform architecture and cloud services
  • A collaborative team member with Agile experience
  • Familiarity with stream processing technologies either Kafka or Kinesis

Nice to have

  • Experience with machine learning frameworks and pipelines.
  • Experience with Delta Live Tables
  • Familiarly with Great Expectations
  •   Experience of search optimisers (ElasticSearch/Lucene), REST alternatives (GraphQL, AsyncAPI etc.), data science kits (Jupyter, Anaconda)

Benefits

    • 25 days Holiday per year (increasing by 1 day per years' service, up to 30 days) + Bank Holidays  
    • Hybrid working arrangements – minimum 2 days in the office, Tuesday - Thursday 
    • Contributory pension scheme  
    • Enhanced Parental leave   
    • Cycle to Work Scheme  
    • Private Medical Insurance with AXA 
    • Unlimited access to therapy sessions through our partner, Oliva   
    • Discounted Gym membership through Gympass 
    • Financial Coaching with Octopus Wealth  
    • 2 days of volunteering leave per year  
    • Sabbatical after 5 years’ service   
    • Life Assurance - MetLife (UK employees only)
    • Ongoing Learning and Development to support you reach your career goals  

We are Vitesse – the payment provider of choice for the insurance and treasury industry.  

Formed in 2014 by a team of proven FinTech entrepreneurs, we are an FCA regulated payments business that is driven to be the payment partner of choice for the insurance market, by providing global payment services and treasury optimisation.  Operating one of the largest domestic banking and payment settlement networks in the world, we give our customers direct access to more than 170 countries and territories, covering over 110 currencies. Through a single integration, insurers can use this network to pay claims in as fast as 45 seconds, delivering a better customer experience to their claimants.  Our market-leading treasury optimisation service brings complete control and transparency to insurers and allows them to have their money in the right place, at the right time, to make that all important payment - fast, and when their customers need it most.   

With now over 160 employees across Europe and our London headquarters, $26m series B funding in 2022 in the bag and approaching £8bn in processed transactions, we are only just getting started.     

We are collaborative, customer centric and work with integrity, whilst partnering with some of the biggest insurance leaders including Lloyd’s of London and Many Pets. We take huge pride in our company culture, ensuring that everyone has a part to play, an opportunity to be heard, be involved, and the ability to make a real difference.   

As we continue to scale up, we want like-minded humans to join us on this exciting journey.  Are you ready?  

Vitesse at our best – our values 

The Vitesse values are a true reflection of what it takes to thrive in our business, so it’s important to us that any employee who joins our business is aligned with these 3 attributes 

Confident Humility 

We don’t do ego and we know that unless we all win, none of us win. We admit when we’re wrong, ask for help and always think about the wider business before ourselves.

Driven to Succeed 

We see the opportunity ahead of us and we won’t stop until we fulfil the potential we know we have. We hold ourselves to high standards and deliver high quality outcomes for Vitesse and our customers.  

Tenacious Responsibility 

We take ownership for our actions and decisions, and face into the challenges that come our way. We are committed to seeing things through to completion, even in the face of adversity. 

We are an Equal Opportunity Employer  We are committed to creating an inclusive environment that enables everyone to perform at their best, where we recognise the rights of all individuals to mutual respect and where there is an unbiased acceptance of others. Our policies and practices aim to promote an environment that is free from all forms of Unfair discrimination and values the diversity of all people. At the heart of our policy, we seek to treat people fairly and with dignity and respect.  

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer

Senior Data Engineer - Global Insurance Company - Outside IR35Location: London (Hybrid - 2 days in-office)Contract Length: 6 months (High potential for extension)Day Rate: Up to £750 per day (Outside IR35)Start Date: ASAPA leading global insurance company is seeking a skilled Senior Data Engineer to join their data transformation team...

Bishopsgate

Senior Data Engineer

Senior Data Engineer - Up to £50,000 - Hybrid (Cardiff Based)The OpportunityYolk Recruitment Public Sector & Not-for-Profit team is working with an essential not-for-profit organisation to recruit a Senior Data Engineer.This role is ideal if you have experience building a variety of ETL pipelines, especially in Azure. If you can...

Marshfield

Senior Data Engineer

Senior Data EngineerMy client are seeking an experienced data engineer to join the team on an initial 12 month contract. They need someone with a strong skillset in ETL but who can also do hands on testing workRequirements7+ Years Experience in Data Engineering/AnalysisStrong Experience in Testing, writing test scripts /...

Dublin

Senior Data Engineer

Senior Data EngineerLocation: Great Billing, Northampton, NN3 9EX.Salary: £60,000 to £70,000 DOE.Contract: Full time, permanent. 28 days per annum +3 bank holidays (Christmas, Boxing Day, NYD).Billing Finance is a family-owned vehicle financing Company based on the outskirts of Northampton. We focus on customers with non-standard credit profiles that may not...

Great Billing

Senior Data Engineer (MongoDB, Python, AWS) Remote, £70k

Are you Data Engineering enthusiast who thrives from designing and implementing robust ETL processes, highly scalabale data structures and data pipelines within a truly enterprise-scale environment?If so - look no further.This is your chance to help my client build their new Data Infrastructure and essentially help them to leverage the...

Nottingham

Senior Data Engineer

Are you an experienced Data Engineer familiar with data extraction and modelling? Do you have SQL, Tableau and/or PowerBI skills? If so the following permanent role might be for you…My client is a privately owned business which operates in the scrap recycling sector who are looking to expand their talent...

Great Sankey