Lead Data Engineer - AWS

James Adams
Greater London
2 weeks ago
Create job alert

This range is provided by James Adams. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

James Adams is currently looking for an experienced Lead Data Engineer. This is a 3 month initial contract working hybrid remotely in London.

About the Role:

We are seeking a highly skilled Senior Data Engineer to join our team. This role is ideal for a data engineering expert with a deep understanding of Snowflake, AWS data tooling, data warehousing, and best practices in cloud-based data platforms. You will be instrumental in building and optimizing our data pipelines, ensuring scalability, efficiency, and reliability.

Key Responsibilities:

  • Design, develop, and maintain robust data ingestion pipelines using AWS services (S3, Lambda, ECR, ECS, DynamoDB).
  • Develop and optimize data transformation pipelines using a combination of SQL and Python.
  • Work with Snowflake as a data platform, ensuring efficient and scalable structures and patterns.
  • Implement best practices for data engineering, including performance tuning, security, and data governance.
  • Collaborate with data analysts, scientists, and other stakeholders to deliver high-quality data solutions.
  • Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
  • Ensure data quality, consistency, and integrity across multiple data sources.

Required Skills & Experience:

  • Proven experience as a Data Engineer with a strong background in data warehousing concepts.
  • Expert-level proficiency in SQL and Python, with a focus on simplicity and maintainability.
  • Hands-on experience with AWS services, specifically S3, Lambda, ECR, ECS, and DynamoDB.
  • Deep understanding of data modeling, including dimensional modeling and best practices for cloud-based data platforms.
  • Strong problem-solving skills with the ability to optimize queries and improve data performance.
  • Experience in handling large-scale datasets and implementing scalable data solutions.

Nice to Have:

  • Experience in document processing.
  • Experience with utilizing AI in the data engineering space.
  • Experience with Terraform for infrastructure as code.
  • Knowledge of CI/CD practices for automating deployment processes.
  • Familiarity with Data Vault modeling for data warehousing.
  • Experience in building ETL/ELT pipelines using modern data stack tools.

If of interest, please send your CV now to apply!

Seniority level

Mid-Senior level

Employment type

Contract

Job function

Information Technology

Industries

Staffing and Recruiting

#J-18808-Ljbffr

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Data Science Career Myths Debunked: Key Facts for Aspiring Professionals

Data science has become one of the most sought-after fields in the tech world, promising attractive salaries, cutting-edge projects, and the opportunity to shape decision-making in virtually every industry. From e-commerce recommendation engines to AI-powered medical diagnostics, data scientists are the force behind innovations that drive productivity and improve people’s lives. Yet, despite the demand and glamour often associated with this discipline, data science is also shrouded in misconceptions. Some believe you need a PhD in mathematics or statistics; others assume data science is exclusively about machine learning or coding. At DataScience-Jobs.co.uk, we’ve encountered a wide array of myths that can discourage talented individuals or mislead those exploring a data science career. This article aims to bust the top 10 data science career myths—providing clarity on what data scientists actually do and illuminating the true diversity and inclusiveness of this exciting field. Whether you’re a recent graduate, a professional looking to pivot, or simply curious about data science, read on to discover the reality behind the myths.

Global vs. Local: Comparing the UK Data Science Job Market to International Landscapes

How to evaluate salaries, opportunities, and work culture in data science across the UK, the US, Europe, and Asia Data science has proven to be more than a passing trend; it is now a foundational pillar of modern decision-making in virtually every industry—from healthcare and finance to retail and entertainment. As the volume of data grows exponentially, organisations urgently need professionals who can transform raw information into actionable insights. This high demand has sparked a wave of new opportunities for data scientists worldwide. In this article, we’ll compare the UK data science job market to those in the United States, Europe, and Asia. We’ll explore hiring trends, salary benchmarks, and cultural nuances to help you decide whether to focus your career locally or consider opportunities overseas or in fully remote roles. Whether you’re a fresh graduate looking for your first data science position, an experienced data professional pivoting from analytics, or a software engineer eager to break into machine learning, understanding the global data science landscape can be a game-changer. By the end of this overview, you’ll be better equipped to navigate the expanding world of data science—knowing which skills and certifications matter most, how salaries differ between regions, and what to expect from distinct work cultures. Let’s dive in.

Data Science Leadership for Managers: Strategies to Motivate, Mentor, and Set Realistic Goals in Data-Driven Teams

Data science has become a linchpin in modern business, transforming oceans of raw data into actionable insights that guide strategy, product development, and personalised customer experiences. With this surge in data-centric operations, the need for effective data science leadership has never been more critical. Guiding a team of data scientists, analysts, and machine learning engineers requires not only technical acumen but also the ability to foster collaboration, champion ethical practices, and align complex modelling efforts with overarching business goals. This article provides practical guidance for managers and aspiring leaders aiming to excel in data-driven environments. By exploring strategies to motivate data science professionals, develop mentoring frameworks, and set achievable milestones, you will be better prepared to steer your team towards meaningful, evidence-based outcomes.