Principal Data Engineer

Epam
London
8 months ago
Create job alert

Description

About the role



Are you a Principal Data Engineer with a passion for big data? Do you keep up to date with cutting-edge technologies within D&A?

If so, then you have a fantastic opportunity to join a multi-disciplinary team of engineers, architects, designers, and strategists as we continue to grow our Data & Analytics practice across Europe.
Were looking for a Principal Data Engineer with Azure, Databricks and PySpark to join our team in London. The ideal candidate will have a strong background in data engineering, extensive experience with Azure cloud services, and experience leading a technical team on the implementation.

Responsibilities

Lead, mentor and manage a team of Azure data engineers Drive the team's technical execution Collaborate with cross-functional teams including data scientists, analysts and business stakeholders ensuring a quality single version of truth Passionate engineer, very keen on building end to end pipelines to support enterprise-wide analytics Design, develop and implement scalable and secure data lake solutions on Azure Ensure best practices in data engineering, data integration and ETL processes Prepared to code complicated aspects of our pipeline Ensure the ongoing maturity of our SVOT framework Monitor performance and scalability of the SVOT platform updating the framework and code to ensure the business has highly available accessible product

Requirements

Minimum of 8 years of experience in data engineering At least 5 years of hands-on experience with Azure data services (Apache Spark, Azure Data Factory, Synapse Analytics, RDBMS experience (prefer SQL Server) Proven experience in leading and managing a team of data engineers Proficiency in programming languages specifically PySpark, Python (with Pandas if no PySpark), Continuous Integration (DevOps, PRs, Branching), T-SQL & SparkSQL Strong understanding of data modeling, ETL processes and data warehousing concepts Knowledge of CI/CD pipelines and version control (e.g., Git) Excellent problem-solving and analytical skills Strong communication and collaboration abilities Ability to manage multiple projects and meet deadlines Certifications in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect)

Nice to Have

Hands-on experience with Scala for Apache Spark Knowledge or experience working with other Clouds such as AWS or GCP

Our Benefits Include

A competitive group pension plan and protection benefits including life assurance, income protection and critical illness cover Private medical insurance and dental care Cyclescheme, Techscheme and season ticket loans Employee assistance program Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications, well-being programs, LinkedIn Learning Solutions and much more EPAM Employee Stock Purchase Plan (ESPP) Various perks such as gym discounts, free Wednesday lunch in-office, on-site massages and regular social events Certain benefits and perks may be subject to eligibility requirements and may be available only after you have passed your probationary period

About EPAM

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential

Related Jobs

View all jobs

Principal Data Engineer

Principal Data Scientist - Marketing

Principal Data Scientist - NLP

Principal Data Scientist

Principal Data Scientist (Remote)

Principal Data Scientist (Remote)

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Data Science Jobs in the Public Sector: Exploring Opportunities Across GDS, NHS, MOD, and More

Data science has emerged as one of the most influential fields in the 21st century, transforming how organisations make decisions, improve services, and solve complex problems. Nowhere is this impact more visible than in the UK public sector. From the Government Digital Service (GDS) to the National Health Service (NHS) and the Ministry of Defence (MOD), government departments and agencies handle vast amounts of data daily to support the well-being and security of citizens. For data enthusiasts looking to make a meaningful contribution, data science jobs in the public sector can offer rewarding roles that blend innovation, large-scale impact, and societal benefit. In this comprehensive guide, we’ll explore why data science is so pivotal to government, the roles you might find, the skills needed, salary expectations, and tips on how to succeed in a public sector data science career.

Jobs

Contract vs Permanent Data Science Jobs: Which Pays Better in 2025?

Data science sits at the intersection of statistics, machine learning, and domain expertise, driving crucial business decisions in almost every sector. As UK organisations leverage AI for predictive analytics, customer insights, and automation, data scientists have become some of the most in-demand professionals in the tech job market. By 2025, data scientists with expertise in deep learning, natural language processing (NLP), and MLOps are commanding top-tier compensation packages. However, deciding whether to become a day‑rate contractor, a fixed-term contract (FTC) employee, or a permanent member of an organisation can be challenging. Each path offers a unique blend of earning potential, career progression, and work–life balance. This guide will walk you through the UK data science job market in 2025, examine the differences between these three employment models, present sample take‑home pay scenarios, and offer strategic considerations to help you determine the best fit for your career.

Jobs

Data Science Jobs for Non‑Technical Professionals: Where Do You Fit In?

Beyond Jupyter Notebooks Ask most people what a data‑science career looks like and they’ll picture Python wizards optimising XGBoost hyper‑parameters. The truth? Britain’s data‑driven firms need storytellers, strategists, ethicists and project leaders every bit as much as they need statisticians. The Open Data Institute’s UK Data Skills Gap 2024 places demand for non‑technical data talent at 42 % of all data‑science vacancies—roles focused on turning model outputs into business value and trustworthy decisions. This guide highlights the fastest‑growing non‑coding roles, the transferable skills many professionals already have, and a 90‑day action plan to land a data‑science job—no pandas required.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.