Lead Data Engineer – Big Data & Cloud | Shape the Future of Enterprise Data
Location:Remote - UK based
Type:Permanent
Salary:£80,000 + Bonus + Benefits
Are you a hands-on data engineer with a flair for leadership and a deep love for complex tech challenges? This is your chance to step into a pivotal role where innovation, scale, and speed all come together.
We’re working with a pioneering UK-based organisation at the heart of digital transformation in real estate, environment, and planning data. They’re on the hunt for aLead Data Engineer— a true technical expert and people leader who can own the end-to-end delivery of large-scale, cloud-native data solutions and inspire a team to do their best work under pressure.
The Role
This is not just another data engineering job. You’ll be:
- Leadingprojects and mentoring a team of talented engineers, ensuring quality code, collaborative culture, and technical excellence.
- Designingrobust, scalable data infrastructure that powers mission-critical products.
- Driving innovationin a big data environment using cloud tech (Azure or AWS), lakehouse architectures, and modern data tooling.
- Owning delivery, often in high-pressure, time-sensitive environments – this isn’t for the faint-hearted or those who just like whiteboard architecture. You’ll be deep in code and delivery.
- Shaping strategy, working closely with senior leaders to align engineering vision with business outcomes.
Tech You’ll Work With
This business doesn’t do “just one stack”. You’ll be expected to work across a broad tech landscape:
- Big Data & Distributed Systems:HDFS, Hadoop, Spark, Kafka
- Cloud:Azure or AWS
- Programming:Python, Java, Scala, PySpark – you’ll need two or more, Python preferred
- Data Engineering Tools:Azure Data Factory, Databricks, Delta Lake, Azure Data Lake
- SQL & Warehousing:Strong experience with advanced SQL and database design
- Bonus Points:Exposure to geospatial data or data science/ML pipelines
What They're Looking For
- Depth in delivery:You’ve delivered complex, production-grade data platforms – not just designed them.
- Hands-on leadership:You lead from the front, write production code, review PRs, and mentor engineers daily.
- Energy & adaptability:You thrive under pressure, juggle multiple streams, and embrace fast-paced environments.
- Cloud fluency:You’ve worked extensively with at least one major cloud platform (Azure or AWS).
- Big data mindset:You’re comfortable in distributed environments and have worked with large-scale, on-prem and cloud data ecosystems.
Why Apply?
- Work in a truly data-driven organisation that sees data engineering as the engine room of innovation.
- Influence major digital transformation programmes across real-world sectors.
- Get hands-on with cutting-edge cloud and big data tech – no red tape.
- Join a passionate team that values accountability, agility, and excellence.
If you're a technically gifted data engineer who thrives under pressure, loves solving real-world problems, and wants to lead from the front – this is the role for you.
Apply now for an informal chat or reach out to learn more. This is a high-priority hire with interviews happening quickly.
