National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Principle Data Engineer ( AWS & Airflow )

London
5 days ago
Create job alert

Job Title: Principal Data Engineer

Location: London, UK - Hybrid (Liverpool Street office)

Department: Data & Engineering

Reports To: Head of Data Science

Employment Type: Permanent

A leading global payments and fintech platform, empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital assets.

As they continue to scale their data infrastructure, they're seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines.

The ideal candidate will bring both technical depth and strategic thinking, with the ability to communicate effectively across business and technical teams.

Key Responsibilities

Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics.
Define and drive the long-term architecture and data strategy in alignment with business goals.
Own orchestration of ETL/ELT workflows using Apache Airflow, including scheduling, monitoring, and alerting.
Collaborate with cross-functional teams (Product, Engineering, Data Science, Compliance) to define data requirements and build reliable data flows.
Champion best practices in data modelling, governance, and DevOps for data engineering (CI/CD, IaC).
Serve as a key communicator between technical teams and business stakeholders, translating complex data needs into actionable plans.
Mentor and lead data engineers, fostering continuous learning and technical excellence.
Ensure compliance with data security, privacy, and regulatory standards (e.g., PCI-DSS, GDPR).

Essential:

7+ years in Data Engineering, with 2+ years in a Principal or Lead role.
Proven experience designing and delivering enterprise data strategies.
Exceptional communication and stakeholder management skills.
Expertise in enterprise-grade data warehouses (Snowflake, BigQuery, Redshift).
Hands-on experience with Apache Airflow (or similar orchestration tools).
Strong proficiency in Python and SQL for pipeline development.
Deep understanding of data architecture, dimensional modelling, and metadata management.
Experience with cloud platforms (AWS, GCP, or Azure).
Familiarity with version control, CI/CD, and Infrastructure-as-Code (Terraform or similar).

Desirable:

Background in fintech or payments.
Knowledge of streaming frameworks (Kafka, Kinesis).
Experience with dbt and data quality frameworks (e.g., Great Expectations).

What's on Offer

Competitive base salary + bonus
Flexible hybrid working model (Liverpool Street office)
Private healthcare & wellness benefits
Learning and development support
The opportunity to shape the future of payments data infrastructure

Related Jobs

View all jobs

Senior Data Science Director, London

Finished Production Specialist (Process)

Finished Production Specialist (Validation)

Azure Data Engineer - Remote (Permanent)

Senior Azure Data Engineer - UK remote

Senior Azure Data Engineer - Remote (East London)

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

LinkedIn Profile Checklist for Data Science Jobs: 10 Tweaks to Elevate Recruiter Engagement

Data science recruiters often sift through dozens of profiles to find candidates skilled in Python, machine learning, statistical modelling and data visualisation—sometimes before roles even open. A generic LinkedIn profile won’t suffice in this data-driven era. This step-by-step LinkedIn for data science jobs checklist outlines ten targeted tweaks to elevate recruiter engagement. Whether you’re an aspiring junior data scientist, a specialist in MLOps, or a seasoned analytics leader, these optimisations will sharpen your profile’s search relevance and demonstrate your analytical impact.

Part-Time Study Routes That Lead to Data Science Jobs: Evening Courses, Bootcamps & Online Masters

Data science sits at the intersection of statistics, programming and domain expertise—unearthing insights that drive business decisions, product innovation and research breakthroughs. In the UK, organisations from fintech and healthcare to retail and public sector are investing heavily in data-driven strategies, fuelling unprecedented demand for data scientists, machine learning engineers and analytics consultants. According to recent projections, data science roles will grow by over 40% in the next five years, offering lucrative salaries and varied career paths. Yet many professionals hesitate to leave their current jobs or pause personal commitments for full-time study. The good news? A vibrant ecosystem of part-time learning routes—Evening Courses, Intensive Bootcamps and Flexible Online Master’s Programmes—empowers you to learn data science while working. This comprehensive guide explores every pathway: foundational CPD units and short courses, hands-on bootcamps, accredited online MScs, plus funding options, planning strategies and a real-world case study. Whether you’re an analyst looking to formalise your skills, a software developer pivoting into data or a manager seeking to harness data-driven decision-making, you’ll find the right route to fit your schedule, budget and career goals.

The Ultimate Assessment-Centre Survival Guide for Data Science Jobs in the UK

Assessment centres for data science positions in the UK are designed to replicate the multifaceted challenges of real-world analytics teams. Employers combine psychometric assessments, coding tests, statistical reasoning exercises, group case studies and behavioural interviews to see how you interpret data, build models, communicate insights and collaborate under pressure. Whether you’re specialising in predictive modelling, NLP or computer vision, this guide provides a step-by-step roadmap to excel at every stage and secure your next data science role.