Senior Database & Cloud Data Engineer

Conferma
Manchester
1 month ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Data Engineer - (Python, SQL, Machine Learning) - Robotics

Data Engineer

Senior Data Engineer

Lead Data/Head of Data Engineer

Conferma is a global payment technology company who combine innovation and expertise to push the boundaries of what can be achieved in the world of virtual payments. We were created in 2005 and were more recently acquired by Sabre, with additional investment from Mastercard. Over the past decade, the Conferma ecosystem has grown, enabling us to become the world's largest payments platform for virtual cards.


We've engineered connectivity to over 90 of the world's best commercial card partners, over 400 travel management companies and over 150 travel technology partners. Every day, our team members work together to make it easier for travellers to connect with people and places. Our teams include passionate people dedicated to providing an environment that encourages partnership, a place where you feel like you belong, and where you are empowered to succeed. We look forward to having you join our journey - and seeing how far we can go, together!


The position :

We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. This role plays a key part in modernising our data infrastructure, optimising data pipelines, and ensuring the integrity, availability, and performance of the critical data assets.


You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms, streamline ETL / ELT processes, and implement best practices for data governance, quality, and security.


The responsibilities include :
Data Engineering & Development :

  • Design, build and maintain high-performance data pipelines for ingestion, transformation, and storage using modern data tools and frameworks.
  • Develop scalable solutions for structured and unstructured data across hybrid environments (on-premises databases and cloud).
  • Maintain / implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric)
  • Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability.
  • Migrate and modernise legacy databases to cloud-based architectures.

Database Administration

  • Administer, monitor, and optimise database systems (e.g. SQL Server).
  • Ensure high availability, backup, recovery, and disaster recovery planning for critical databases.
  • Manage database security, access control, and compliance with data governance policies.
  • Automate routine database tasks using scripts or DevOps tooling.

Cloud & Infrastructure

  • Architect and implement cloud solutions using services such as Azure Data Factory or Azure Data Lake.
  • Integrate data from various cloud and on-premises sources into unified analytical platforms.
  • Collaborate with DevOps teams to manage CI / CD pipelines for data workloads.

Data Quality, Governance & Security

  • Develop and enforce data validation, cleansing, and quality monitoring processes.
  • Ensure adherence to GDPR and other data privacy regulations.
  • Working closely with Data Governance and Compliance teams to implement data stewardship practices.

Collaboration & Leadership

  • Mentor junior data engineers and provide technical leadership across projects.
  • Partner with business teams to translate requirements into technical data solutions.
  • Stay current with emerging technologies in cloud, data engineering, and database management.

What you'll have :

  • Educated to degree level or the equivalent in Computer Science, Information Systems, Data Engineering, or a related discipline.
  • Hands-on experience in database or data engineering roles.
  • Proven track record in designing and implementing cloud-based data solutions (preferably in Azure).
  • Expert-level SQL and database design (normalisation, indexing, query optimisation).
  • Strong experience with ETL / ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc.
  • Experience with Python, PySpark, or Scala for data processing.
  • Familiarity with CI / CD practices.
  • Experience with Data lake, Data warehouse and Medallion architectures.
  • Understanding of API integrations and streaming technologies (event hub).
  • Version control (Git), Agile Delivery, and DevOps best practices.
  • Excellent communication and stakeholder management skills.
  • Collaborative mindset with mentoring capabilities.
  • Relevant certifications are advantageous (e.g. Microsoft Certified : Azure).

Compensation :

Salary & Bonus : Dependent on experience and skills


Benefits at Conferma :

At Conferma we understand that our people are what make us great. We have set out to provide a comprehensive benefits package that includes everything you would expect, as well as providing flexibility for you and your family.



  • A salary sacrifice pension to maximise your contributions
  • Life Assurance cover to provide peace of mind
  • Enhanced Company sick pay to put your mind at rest
  • Single cover private medical scheme, with the flexibility to add family members at your own cost
  • 25 days paid annual leave plus bank holidays, allowing you to focus on what's important to you outside of work
  • The ability to purchase up to 10 additional days holiday each year to enable additional time off
  • Additional paid time off for life events, such as moving house or getting married
  • An additional days leave on or around your birthday
  • Enhanced paid parental leave on the birth or adoption of your child
  • A confidential Employee Assistance program (EAP) available to all 24 / 7
  • Access a range of fantastic additional rewards, such as Cycle 2Work, Gym Membership, Tech Scheme and discounted shopping and Cinema tickets, via Conferma Rewards

Diversity, Equity and Inclusion

We are committed to ensuring equal opportunity for all. We intend that no job applicant or employee shall receive less favorable treatment, nor be disadvantaged by any conditions or requirements which are irrelevant.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.