Data Engineer

Location: London

BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments.

Data Engineer

GG10 - GG12

We offer a range of hybrid and flexible working arrangements – please speak to your recruiter about the options for this particular role.

• 
  
• Design, implement, and optimize robust ETL/ELT data pipelines using Apache Airflow as an orchestration tool.
  
• Build and manage data ingestion processes from internal systems and APIs, using tools like Kafka, Spark, or AWS native services.
  
• Develop and maintain data lakes and data warehouses (e.g., AWS S3 + Redshift).
  
• Ensure data quality, validation, and governance using automated testing tools.
  
• Monitor and debug data workflows, implement logging, alerting, and performance tuning.
  
• Handle schema evolution, partitioning, and efficient data modelling.
  
• Collaborate with DevOps to manage CI/CD pipelines for data deployments and ensure version control of DAGs and configs.
  
• Apply best practices in security and compliance, including data encryption, access control (IAM), and regulatory standards (GDPR).
  

• 
  
• Proficient in Python and SQL for data processing.
  
• Hands-on experience with Apache Airflow, writing Airflow DAGs and configuring Airflow jobs.
  
• Experience with AWS cloud platform and services like S3, Redshift.
  
• Familiarity with big data processing using Apache Spark.
  
• Knowledge of data modelling, schema design, and partitioning strategies.
  
• Understanding of batch vs streaming data paradigms and tools like Kafka.
  
• Experience of working with Docker or Kubernetes (containerization).
  

We work hard and often go the extra mile, but we recognise people’s efforts and that everyone has a life outside of work. We encourage people to speak up if they want to rotate to a new project.

As well as a competitive pension scheme, we offer employee share plan, an extensive range of flexible discounted health, wellbeing and lifestyle benefits including a green care scheme, private health plans and shopping discounts – you may also be eligible for an annual incentive.

This is a place where you’ll be able to make a real difference. You’ll be part of an inclusive culture which values diversity and merit, and you’ll be empowered to fulfil your potential. We welcome candidates from all backgrounds and particularly from under-represented groups including women, ethnic minorities, people with disabilities and LGBTQ+ individuals.

We are inclusive in our recruitment processes. If you have a disability or health condition that may affect your performance in certain assessments, please speak to your recruiter about potential reasonable adjustments.

Some roles at BAE Systems are subject to security and export control restrictions. These may restrict the roles you are able to perform within the organisation. All applicants must as a minimum achieve Baseline Personnel Security Standard. Higher levels of National Security Vetting may be required, which typically involves residency considerations.

We are embracing Hybrid Working to provide flexibility in where and when you work, including home, office, or client sites. Diversity and inclusion are integral to our culture, enabling teams with varied perspectives to collaborate effectively.

Referrals increase your chances of interviewing at BAE Systems Digital Intelligence.