Principal Data Engineer

83data
City of London
8 months ago
Applications closed

Related Jobs

View all jobs

Principal Data Engineer

Principal Data Engineer (GCP)

Principal Data Engineer (MS Azure)

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Job Title:

Principal Data Engineer
Location:

London, UK – Hybrid (Liverpool Street office)
Department:

Data & Engineering
Reports To:

Head of Data Science
Employment Type:

Permanent

A leading global

payments and fintech platform , empowering clients to innovate and scale. Their mission is to create

frictionless, secure, and intelligent payment solutions

that unlock value across banking, financial services, and digital assets.

As they continue to scale their

data infrastructure , they’re seeking a seasoned

Principal Data Engineer

to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines.

The ideal candidate will bring both

technical depth

and

strategic thinking , with the ability to communicate effectively across business and technical teams.

Key Responsibilities
Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics.
Define and drive the long-term architecture and

data strategy

in alignment with business goals.
Own orchestration of ETL/ELT workflows using

Apache Airflow , including scheduling, monitoring, and alerting.
Collaborate with cross-functional teams (Product, Engineering, Data Science, Compliance) to define data requirements and build reliable data flows.
Champion best practices in data modelling, governance, and DevOps for data engineering (CI/CD, IaC).
Serve as a key communicator between technical teams and business stakeholders, translating complex data needs into actionable plans.
Mentor and lead data engineers, fostering continuous learning and technical excellence.
Ensure compliance with

data security , privacy, and regulatory standards (e.g.,

PCI-DSS ,

GDPR ).

Essential:
7+ years in Data Engineering, with 2+ years in a Principal or Lead role.
Proven experience designing and delivering

enterprise data strategies .
Exceptional communication and stakeholder management skills.
Expertise in enterprise-grade data warehouses (Snowflake, BigQuery, Redshift).
Hands-on experience with

Apache Airflow

(or similar orchestration tools).
Strong proficiency in

Python

and

SQL

for pipeline development.
Deep understanding of data architecture, dimensional modelling, and metadata management.
Experience with cloud platforms (AWS, GCP, or Azure).
Familiarity with version control,

CI/CD , and

Infrastructure-as-Code

(Terraform or similar).

Desirable:
Background in fintech or payments.
Knowledge of

streaming frameworks

(Kafka, Kinesis).
Experience with

dbt

and data quality frameworks (e.g.,

Great Expectations ).

What’s on Offer
Competitive base salary + bonus
Flexible hybrid working model (Liverpool Street office)
Private healthcare & wellness benefits
Learning and development support
The opportunity to shape the future of payments data infrastructure

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

Jobs

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

Education

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.