National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Lead Big Data Engineer - Contract

Northrop Grumman
Greater London
9 months ago
Create job alert

Requisition ID: R10166531

Your Opportunity to Define Possible.Our Opportunity to Deliver the Nation’s Security. Together.

Role clearancetype:Must already hold highest level of government clearance.

Location:London

About Your Opportunity:

As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes.

On-site presence required a minimum of 4 days per week.

Your Benefits:

Flexible working schedules -we offer flexible and hybrid working arrangements. Talk to us at the application stage about any scheduling preferences you may have.Flexible Benefits Package– choose which NGUKL benefits you want to satisfy your personal needs. Core Benefits provided for you are Healthcare, Dental, Life Assurance and Pension. Benefits you can flex include Critical Illness Cover, Health Cash Plan, and Health Assessments.Employee Incentive Programme –exceptional performance is recognized through our annual incentive programme which is awarded to top performers who excel.Career Development –opportunity for ongoing professional development and career growth opportunities.

Your Responsibilities:

- Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.

- Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.

- Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.

- Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.

- Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.

- Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.

- Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy.

- Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively.

- Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.

- Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing.

- BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.

Your Experience:

- Proven experience in scripting languages such as Python, Bash, or similar.

- Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.

- Experience with integration testing and ensuring seamless tool integration.

- In-depth knowledge of Linux internals and system administration.

- Understanding of TCP/IP and OSI models.

- Hands-on experience with data pipeline tools like NiFi and Airflow.

- Proven ability to design scalable big data systems with a focus on security and GDPR compliance.

- Hybrid cloud experience, specifically with on-premise and AWS cloud environments.

- Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.

- Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.

- Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.

- Excellent communication and collaboration skills.

Preferred Experience:

- Certification in AWS or other cloud platforms.

- Experience with additional data orchestration tools.

- Familiarity with other big data tools and technologies. (Hadoop, Cloudera)

- Previous experience in a similar role within a dynamic and fast-paced environment.

Your Future Team:

The teams in this space work on some of the toughest challenges that are key to our client’s success, as such they carry a heavy load and require the ability to be able to dip in and share the workload. Success in this area requires flexibility in tasking, adapting to the problem at hand and picking up the skills along the way. This work is predominantly on client site and will vary between integrating with development and test teams, as well as taking on standalone tasks when needed.

We believe that creating a team that values diversity and fosters inclusion is essential to great performance. We know the best ideas come from diversity of thought, background, perspective, culture, gender, race, age and many other elements. We welcome candidates from all backgrounds and particularly from communities currently under-represented within our industry. We treat everyone with respect and foster safe and inclusive environments.

About Our Responsibilities:

Our customers operate in unique environments which offer new and exciting challenges every day, cultivating a place where you can learn and thrive, working alongside the best minds in industry. We’ll give you space to develop your career, where your ideas can shape the future of our dynamic business. 

We promote collaboration to achieve more than we could imagine, together. And within a respectful and inspirational environment, we value what you say and do.

How to Apply:

Interested in our opportunity?

Yes– then simply submit your application online. Your application will be reviewed by one of our expert recruiters who’ll then respond advising you of the outcome and next steps for successful candidates.

Possibly, I’d like to find out more– then connect direct with , where one of our recruitment business partners will be happy to support you with any enquires.

Background checks and potentially security clearance form part of the recruitment process, our team will inform you of the procedures when required.

Northrop Grumman UK:

Work with a global brand that makes a real contribution to our nation’s security and future. At Northrop Grumman UK, the brightest minds come together to push the boundaries and Define Possible. As leaders in the digital transformation of Aerospace, Defence and Intelligence we are providing ground-breaking outcomes for our customers.

UK Cyber & Intelligence Business:

Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.

#LI-CJ1

#LI-ONSITE

Northrop Grumman is committed to hiring and retaining a diverse workforce, and encourages individuals from all backgrounds and all abilities to apply and consider becoming a part of our diverse and inclusive workforce.

Related Jobs

View all jobs

Senior/Lead Big Data Engineer (Scala/Spark)

Big Data Engineer

Big Data Lead

Lead Data Engineer

Lead Architect - Data Engineering / Azure

Lead Architect - Data Engineering / Azure

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Jobs Skills Radar 2026: Emerging Tools, Languages & Platforms to Learn Now

The UK’s data science job market is evolving fast—from forecasting models and AI assistants to real-time decision systems. In 2026, data scientists aren’t just expected to build models—they’re responsible for shaping insights that fuel everything from patient care to predictive banking. Welcome to the Data Science Jobs Skills Radar 2026—your essential annual guide to the languages, tools, and platforms driving demand across the UK. Whether you’re entering the job market or reskilling mid-career, this roadmap helps you prioritise the skills that matter most right now.

How to Find Hidden Data Science Jobs in the UK Using Professional Bodies like the RSS, BCS & More

The data science job market in the UK is thriving—but also increasingly competitive. As organisations in finance, healthcare, retail, government, and tech accelerate digital transformation, the demand for data talent has soared. Yet many of the best data science jobs are never posted publicly. They’re shared behind closed doors—within professional networks, at invite-only events, or through member-only mailing lists and specialist interest groups. These “hidden” roles are often filled through referrals, collaborations, or direct outreach to trusted experts. In this guide, we’ll show you how to unlock these hidden opportunities by engaging with key UK professional bodies such as the Royal Statistical Society (RSS), BCS (The Chartered Institute for IT), and Turing Society, plus communities like PyData and AI UK. You’ll learn how to use directories, CPD events, and networks to move beyond job boards—and into roles where you’re approached, not just applying.

How to Get a Better Data Science Job After a Lay-Off or Redundancy

Redundancy can be tough to face, especially in a competitive field like data science. But it’s important to know: your experience, analytical thinking, and modelling skills are still in demand. Across sectors like healthcare, finance, e-commerce, government and AI startups, UK employers continue to seek data scientists who can deliver value through insight, prediction, and automation. This guide will walk you through how to bounce back from redundancy with purpose and clarity—whether you're a data analyst looking to step up, a mid-level data scientist, or a machine learning specialist seeking a better-aligned opportunity.