Senior Lead Data Engineer

Karkidi
Exeter
1 month ago
Create job alert

Are you ready to make a significant impact on the future of data and engineering? We have an exciting Senior Lead position in our Data Engineering team, perfect for experienced, hands-on professionals in leading and innovating. As a 100% data-driven company, we pride ourselves on employing the best engineering practices across our products and solutions.

As direct report to the Head of Data Engineering, you will play a crucial role in driving the team’s vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions.

This is an exciting opportunity for highly skilled and motivated Senior Lead Data Engineers with strong expertise in data architecture, ETL pipelines, cloud technologies and big data solutions who are looking to keep crafting their technical leadership responsibilities and shape the future of data engineering within our organisation.

In this role, you will:

  1. Technical Leadership:Assist the Head of Data Engineering in overseeing the design, development, and optimisation of data software, data infrastructure and pipelines.
  2. Team Technical Leadership:Guide a team of talented data engineers to deliver cutting-edge solutions, mentor and coach them, ensuring that best practices in data engineering and software development are followed. Lead by example. Be hands-on.
  3. Lead by Example:We value leaders with exceptional technical expertise and hands-on coding skills. As a Senior Lead, you’ll set the standard by being directly involved and actively contributing to technical challenges. Be ready to roll up your sleeves when necessary and engage in real, impactful work alongside the team.
  4. Data Strategy & Solutions:Own the technical roadmap, aligning engineering efforts with broader business goals and ensuring timely delivery, quality control, and that architectural decisions are forward-thinking and scalable. Inspire the team by providing a clear vision for technical excellence and innovation in the data engineering strategy.
  5. Cloud:Optimise cloud-based data solutions, storage and processing systems, with hands-on experience in AWS or Azure.
  6. Technical Excellence:Lead the pursuit of technical excellence by championing best practices in coding, architecture, and performance. Foster a team culture focused on continuous improvement, where learning is encouraged.
  7. Leverage Big Data Technologies:Utilise tools such as Hadoop, Spark, and Kafka to design and manage large-scale on-prem data processing systems.
  8. Collaboration:Collaborate with cross-functional teams and stakeholders to deliver high-impact solutions that align with business objectives.
  9. Assemble Large, Complex Data Sets:Craft and manage data sets that meet both functional and non-functional business requirements.
  10. Monitoring & Troubleshooting:Ensure data quality, integrity, and availability by developing systems and solutions to monitor performance, quality and troubleshoot issues as they arise.
  11. Build Advanced Data Solutions:Develop the software and infrastructure for optimal data extraction, transformation, and loading using leading cloud technologies like Azure and AWS or Big Data ones.
  12. Ensure Cost Efficiency:Keep the Data Lakes and Data solutions within agreed cost models and budgets.
  13. Data Engineering Empowerment:Empower a high-performing engineering team to deliver innovative software while fostering a collaborative environment where ideas are valued. Act as a mentor, helping team members overcome technical challenges and grow in their roles.

About You

The Senior Lead Data Engineer will be a passionate leader with hands-on seniority in engineer with the ability to inspire, mentor, and bring a team along on the journey. The ideal candidate will possess:

  1. Depth of Expertise:seasoned hands-on experience in data engineering, with extensive experience in a leadership or mentoring role. Demonstrated track record of leading complex data engineering initiatives at scale. Extensive experience in designing, implementing, and optimizing data solutions, supported by a history of successfully managing technical teams and projects.
  2. Exceptional coding skills.
  3. Degree in Computer Science, Software Engineering, or similar (applied to Data. Data Specialisation).
  4. Extensive experience in data engineering, in both Cloud & On-prem Big Data and Data Lake environments.
  5. Expert knowledge in data technologies, data transformation tools, data governance techniques.
  6. Strong analytical and problem-solving abilities.
  7. Good understanding of Quality and Information Security principles.
  8. Effective communication, ability to explain technical concepts to a range of audiences.
  9. Able to provide coaching and training to less experienced members of the team.
  10. Essential skills:
  11. Programming Languages such as Spark, Java, Python, PySpark, Scala, etc (minimum 2)
  12. Extensive Big Data hands-on experience (coding/configuration/automation/monitoring/security/etc) is a must.
  13. Significant AWS or Azure hands-on experience (coding/configuration/automation/monitoring/security).
  14. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones.
  15. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse.
  16. Certifications AWS, Azure, or Cloudera certifications are a plus.

Nice to have skills:

  1. Geospatial data experience.
  2. Advanced Database and SQL skills.
  3. SQL or Data warehousing design patterns and implementation.

Join us and lead the charge in transforming the data landscape at Landmark, while advancing your career in a dynamic and forward-thinking environment.

#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Lead - Data Platform Engineer (Streaming)

Oracle Data Engineer

Assistant Data Engineer (Structured Cabling)

Senior Data Lead for the UK Human Functional Genomics Initiative

Data Architect (Multi-Cloud)

Senior Lead Software Engineer - Python / Credit Technology Data

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Data Science Career Myths Debunked: Key Facts for Aspiring Professionals

Data science has become one of the most sought-after fields in the tech world, promising attractive salaries, cutting-edge projects, and the opportunity to shape decision-making in virtually every industry. From e-commerce recommendation engines to AI-powered medical diagnostics, data scientists are the force behind innovations that drive productivity and improve people’s lives. Yet, despite the demand and glamour often associated with this discipline, data science is also shrouded in misconceptions. Some believe you need a PhD in mathematics or statistics; others assume data science is exclusively about machine learning or coding. At DataScience-Jobs.co.uk, we’ve encountered a wide array of myths that can discourage talented individuals or mislead those exploring a data science career. This article aims to bust the top 10 data science career myths—providing clarity on what data scientists actually do and illuminating the true diversity and inclusiveness of this exciting field. Whether you’re a recent graduate, a professional looking to pivot, or simply curious about data science, read on to discover the reality behind the myths.

Global vs. Local: Comparing the UK Data Science Job Market to International Landscapes

How to evaluate salaries, opportunities, and work culture in data science across the UK, the US, Europe, and Asia Data science has proven to be more than a passing trend; it is now a foundational pillar of modern decision-making in virtually every industry—from healthcare and finance to retail and entertainment. As the volume of data grows exponentially, organisations urgently need professionals who can transform raw information into actionable insights. This high demand has sparked a wave of new opportunities for data scientists worldwide. In this article, we’ll compare the UK data science job market to those in the United States, Europe, and Asia. We’ll explore hiring trends, salary benchmarks, and cultural nuances to help you decide whether to focus your career locally or consider opportunities overseas or in fully remote roles. Whether you’re a fresh graduate looking for your first data science position, an experienced data professional pivoting from analytics, or a software engineer eager to break into machine learning, understanding the global data science landscape can be a game-changer. By the end of this overview, you’ll be better equipped to navigate the expanding world of data science—knowing which skills and certifications matter most, how salaries differ between regions, and what to expect from distinct work cultures. Let’s dive in.

Data Science Leadership for Managers: Strategies to Motivate, Mentor, and Set Realistic Goals in Data-Driven Teams

Data science has become a linchpin in modern business, transforming oceans of raw data into actionable insights that guide strategy, product development, and personalised customer experiences. With this surge in data-centric operations, the need for effective data science leadership has never been more critical. Guiding a team of data scientists, analysts, and machine learning engineers requires not only technical acumen but also the ability to foster collaboration, champion ethical practices, and align complex modelling efforts with overarching business goals. This article provides practical guidance for managers and aspiring leaders aiming to excel in data-driven environments. By exploring strategies to motivate data science professionals, develop mentoring frameworks, and set achievable milestones, you will be better prepared to steer your team towards meaningful, evidence-based outcomes.