National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Big Data Engineer (Elastic Search)

Broadbean Technology
Greater London
1 week ago
Create job alert

UK CITIZENSHIP REQUIRED FOR THIS POSITION: Yes
RELOCATION ASSISTANCE: Relocation assistance may be available
CLEARANCE TYPE: UK-Highest Level of Government Clearance
TRAVEL: Yes, 10% of the Time
Salary: £77,400 - £116,000

Define Possible at Northrop Grumman UK

At Northrop Grumman UK, our mission is to solve the most complex challenges by shaping the technology and solutions of tomorrow. We call it Defining Possible.

This mind-set goes beyond our customer solutions; it's the foundation for your career development and the impact we have within the community. So, what's your possible?

Opportunity:

This is more than just a job; it's a mission.

As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes.

Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.

If you are looking for a career with meaning where you can make a difference to the nation's security and support critical missions, then look no further.

"My purpose; to lead a team of engineers with the brightest minds, to push the boundaries and define possible together."

Role responsibilities:

Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.

Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.

Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.

Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.

Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.

Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.

Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy

Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively

Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.

Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing

BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.

We are looking for:

Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.

Experience with integration testing and ensuring seamless tool integration.

In-depth knowledge of Linux internals and system administration.

Understanding of TCP/IP and OSI models.

Hands-on experience with data pipeline tools like NiFi and Airflow.

Proven ability to design scalable big data systems with a focus on security and GDPR compliance.

Hybrid cloud experience, specifically with on-premise and AWS cloud environments.

Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.

Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.

Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.

Excellent communication and collaboration skills.

Preferred Qualifications:

Certification in AWS or other cloud platforms.

Experience with additional data orchestration tools.

Familiarity with other big data tools and technologies.

Previous experience in a similar role within a dynamic and fast-paced environment.

Experience in Cloudera, Hadoop, Cloudera Data Science Workbench (CDSW), Cloudera Machine Learning (CML) would be highly desirable.

Work Environment:

Full time on-site presence required

If you don't meet every single requirement, we still encourage you to apply.

Sometimes, people hesitate to apply because they can't tick every box. We encourage you to apply if you believe the role will suit you well, even if you don't meet all the criteria. You might be exactly who we are looking for, either for this position or for our opportunities at Northrop Grumman UK. We are on an exciting growth trajectory and growing our teams across the UK.

Security clearance:

You must hold the highest level of UK Government security clearance. Our requirement team is on hand to answer any questions and we will guide you through the process: .

Benefits:

We can offer you a range of flexible working options to suit you, including optional compressed working schedule with every other Friday off. Our benefits including private health care, cash health plan, holiday buy and sell, career development opportunities and performance bonuses. For a comprehensive list of benefits, speak to our recruitment team.

Why join us?

A mission to believe in - Every day we contribute to building a more secure and connected world, expanding our reach from land, sea, and air to space and cyberspace. From engineering data and intelligence solutions, to developing maritime navigation and control systems and innovating command and control systems for the UK and NATO, what we do together matters.

A place to belong and thrive - Every voice matters at our table meaning you can bring your authentic self to work. From our Employee Resource Groups backed by thousands of employees to our partnerships with the Association For Black and Minority Ethnic Engineers, Forces Transition Group, Mind, and Women in Defence - we are passionate about growing and supporting our inclusive community where everyone can belong.

Your career, your way - Shape your career journey with diverse roles, mentorship, and development opportunities that fuel your curiosity, channel your expertise, and nurture your passion. Looking for flexibility? Balance your professional career with your personal life through our health and wellbeing benefits, discount schemes, and investment in your future development. Speak to our team to find the balance that's right for you.

Ready to apply?

Yes - Submit your application online. Your application will be reviewed by our team and we will be in touch.

Possibly, I'd like to find out more about this role - Reach out to our team for more information and support: .

No, I don't think this role is right for me - Our extensive UK growth means we have exciting, new opportunities opening all the time. Speak to our team to discuss your career goals.

Northrop Grumman is committed to hiring and retaining a diverse workforce, and encourages individuals from all backgrounds and all abilities to apply and consider becoming a part of our diverse and inclusive workforce.ZGFuaWVsLndvb2Rlci4yNDk1MS4xMjI3MUBub3J0aHJ1cG1hbi5hcGxpdHJhay5jb20.gif

Related Jobs

View all jobs

Big Data Engineer (Elastic Search)

Senior Data Architect

Data Engineer - Big Data

Data Warehouse Engineer

Senior Azure Data Engineer - UK remote

Data Engineering Lead

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Ultimate Assessment-Centre Survival Guide for Data Science Jobs in the UK

Assessment centres for data science positions in the UK are designed to replicate the multifaceted challenges of real-world analytics teams. Employers combine psychometric assessments, coding tests, statistical reasoning exercises, group case studies and behavioural interviews to see how you interpret data, build models, communicate insights and collaborate under pressure. Whether you’re specialising in predictive modelling, NLP or computer vision, this guide provides a step-by-step roadmap to excel at every stage and secure your next data science role.

Top 10 Mistakes Candidates Make When Applying for Data-Science Jobs—And How to Avoid Them

Trying to land your next data-science role? Avoid the ten most common mistakes UK candidates make—complete with practical fixes, expert tips and vetted resources to help you secure that offer. Introduction From real-time analytics teams in London fintechs to AI research labs in Cambridge, demand for data-science talent has never been hotter. Yet recruiters scanning CVs on boards like DataCareer’s UK data-engineering & data-science feed still reject most applicants long before interview—usually for mistakes that take minutes to fix. Below you’ll find the ten costliest errors we see, each paired with an actionable remedy and a trusted link for deeper reading. Bookmark this checklist before you press Apply.

Top 10 Best UK Universities for Data Science Degrees (2025 Guide)

Discover ten of the strongest UK universities for Data Science degrees in 2025. Compare entry requirements, course content, research strength and industry links to choose the right programme for you. Data is the currency of the modern economy, and professionals who can wrangle, model and interpret vast datasets are in demand across every sector—from biotechnology and finance to sport and public policy. UK universities have been at the forefront of statistics, artificial intelligence and large-scale computing for decades, making the country a prime destination for aspiring data scientists. Below, we profile ten institutions whose undergraduate or postgraduate pathways excel in data science. Although league tables vary each year, these universities have a proven record of excellence in teaching, research and industry collaboration.