Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Lead Data Engineer - Python, Pyspark & AWS

J.P. Morgan
Glasgow
2 days ago
Create job alert

Join us to shape the future of payments technology and regulatory reporting. You will have the opportunity to work with cutting‑edge cloud platforms and data engineering tools, making a real impact on our business and your career growth. We value your expertise and encourage you to bring your ideas to a team that thrives on innovation and collaboration. At JPMorgan Chase, you will be part of a culture that supports diversity, inclusion, and continuous learning. Take the next step in your journey with us and help deliver trusted technology solutions.


Job Summary

As a Lead Data Engineer in the Payments Technology Regulatory Reporting team, you will design and deliver secure, scalable cloud technology products. You will collaborate with agile teams to create solutions that support our business objectives and drive continuous improvement. Your work will span multiple technical areas, allowing you to contribute to both team and firm‑wide goals. You will help foster a culture of inclusion, respect, and opportunity while advancing your skills in a dynamic environment.


Job Responsibilities

  • Execute software solutions, design, development, and technical troubleshooting
  • Create secure, high‑quality production code and maintain efficient algorithms
  • Produce architecture and design artifacts for complex applications
  • Gather, analyze, and synthesize data to develop visualizations and reporting
  • Identify hidden problems and patterns in data to drive system improvements
  • Work individually or as part of a distributed team to deliver projects on time
  • Contribute to software engineering communities and explore emerging technologies
  • Promote a team culture of diversity, inclusion, and respect

Required Qualifications, Capabilities, and Skills

  • Hands‑on experience in system design, application development, testing, and operational stability
  • Proficiency in Python, PySpark, Databricks, or similar data engineering platforms
  • Experience with both relational and NoSQL databases
  • Knowledge across the data lifecycle
  • Ability to develop, debug, and maintain code in large corporate environments
  • Understanding of the Software Development Life Cycle
  • Familiarity with agile methodologies, including CI/CD, application resiliency, and security
  • Demonstrated knowledge of software applications and technical processes within disciplines such as cloud, AI, machine learning, or mobile

Preferred Qualifications, Capabilities, and Skills

  • Exposure to cloud technologies including Databricks, AWS MSK, EC2, EKS, S3, RDS, and Lambdas
  • Experience with payment domain streaming systems
  • Familiarity with payment regulatory reporting

Why Join Us?

At JPMorgan Chase, you will be part of a team that values your growth, encourages innovation, and supports a diverse and inclusive workplace. We offer opportunities to work on impactful projects and advance your career in a collaborative environment.


#J-18808-Ljbffr

Related Jobs

View all jobs

Lead Data engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer - Up to £130k

Lead Data Engineer

Lead Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data science hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise rigorous problem framing, high‑quality analytics & modelling, experiment/causality, production awareness (MLOps), governance/ethics, and measurable product or commercial impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for product/data scientists, applied ML scientists, decision scientists, econometricians, growth/marketing analysts, and ML‑adjacent data scientists supporting LLM/AI products. Who this is for: Product/decision/data scientists, applied ML scientists, econometrics & causal inference specialists, experimentation leads, analytics engineers crossing into DS, ML generalists with strong statistics, and data scientists collaborating with platform/MLOps teams in the UK.

Why Data Science Careers in the UK Are Becoming More Multidisciplinary

Data science once meant advanced statistics, machine learning models and coding in Python or R. In the UK today, it has become one of the most in-demand professions across sectors — from healthcare to finance, retail to government. But as the field matures, employers now expect more than technical modelling skills. Modern data science is multidisciplinary. It requires not just coding and algorithms, but also legal knowledge, ethical reasoning, psychological insight, linguistic clarity and human-centred design. Data scientists are expected to interpret, communicate and apply data responsibly, with awareness of law, human behaviour and accessibility. In this article, we’ll explore why data science careers in the UK are becoming more multidisciplinary, how these five disciplines intersect with data science, and what job-seekers & employers need to know to succeed in this transformed field.

Data Science Team Structures Explained: Who Does What in a Modern Data Science Department

Data science is one of the most in-demand, dynamic, and multidisciplinary areas in the UK tech and business landscape. Organisations from finance, retail, health, government, and beyond are using data to drive decisions, automate processes, personalise services, predict trends, detect fraud, and more. To do that well, companies don’t just need good data scientists; they need teams with clearly defined roles, responsibilities, workflows, collaboration, and governance. If you're aiming for a role in data science or recruiting for one, understanding the structure of a data science department—and who does what—can make all the difference. This article breaks down the key roles, how they interact across the lifecycle of a data science project, what skills and qualifications are typical in the UK, expected salary ranges, challenges, trends, and how to build or grow an effective team.