Lead Data Engineer (AWS)

Synechron
London
2 months ago
Applications closed

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer - Azure Synapse

Lead Data Engineer - Hadoop - Spark - Python

Lead Data/Head of Data Engineer

Lead Data Engineer

About Synechron:

Synechron is a leading digital transformation consulting firm specializing in banking, financial markets, and insurance. We deliver innovative solutions to complex business challenges through cutting-edge technologies and agile methodologies. Join our talented team and contribute to building impactful data solutions within a dynamic environment.



We are seeking a talented and motivated Data Engineer to join our UK team. In this role, you will design, develop, and maintain scalable data pipelines and architectures that support our clients' data-driven initiatives, particularly within the financial domain. You will work closely with business stakeholders and technical teams to translate requirements into efficient data solutions, leveraging modern cloud-based tools and frameworks.



Key Responsibilities

  • Design and develop scalable, testable data pipelines utilizing Python and Apache Spark.
  • Orchestrate data workflows using AWS services including Glue, EMR Serverless, Lambda, and S3.
  • Apply industry-standard software engineering practices such as version control, CI/CD, modular design, and automated testing.
  • Contribute to the development of a lakehouse architecture leveraging Apache Iceberg for efficient data storage and management.
  • Collaborate with business teams to understand requirements and deliver insightful, data-driven solutions.
  • Enhance data pipeline observability and implement basic data quality checks.
  • Participate in code reviews, pair programming, and architecture discussions to promote best practices.
  • Continuously expand knowledge of the financial indices domain and share insights with team members.



What You’ll Bring

  • Proficiency in writing clean, maintainable Python code, ideally with type hints, linters, and testing frameworks like pytest.
  • Fundamental understanding of data engineering concepts: batch processing, schema evolution, and ETL pipeline development.
  • Eagerness to learn and work with Apache Spark for large-scale data processing.
  • Familiarity with AWS data stack components such as S3, Glue, Lambda, and EMR.
  • Strong interest in understanding business context and working collaboratively with stakeholders.
  • Ability to thrive in Agile team environments, valuing teamwork and shared success.



Nice-to-Have Skills

  • Experience with Apache Iceberg or similar table formats.
  • Knowledge of CI/CD tools like GitLab CI, Jenkins, or GitHub Actions.
  • Exposure to data quality frameworks such as Great Expectations or Deequ.
  • Curiosity about financial markets, index data, or investment analytics.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

Jobs

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

Education

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.