Jobs

Lead Data Engineer


Job details
  • BrightBox Group Ltd
  • London
  • 4 weeks ago

Lead Data Engineer, SC Clearance required, outside IR35, travel once/ twice a month to Newcastle.


Role Overview:

We are seeking a Lead Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and frameworks that support data-driven decision-making. You will work collaboratively with cross-functional teams to ensure data integrity and accessibility while providing technical leadership to junior engineers. This position is outside IR35.


Responsibilities:

- Design and develop robust data pipelines using Quantexa and Databricks.

- Collaborate with data scientists and analysts to understand data requirements and provide solutions.

- Ensure the reliability, scalability, and performance of data systems.

- Lead and mentor a team of data engineers, fostering a culture of continuous improvement.

- Manage data integration processes and maintain data quality standards.

- Implement best practises for data governance and security.

- Participate in code reviews and contribute to architectural discussions.

- Maintain up-to-date documentation for data systems and processes.


Qualifications:

- Proven experience as a Data Engineer, with a strong background in data pipeline development.

- Expertise in Quantexa and Databricks.

- Experience in leading technical teams and projects.

- Strong understanding of data modelling and ETL processes.

- SC clearance is required for this role.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

- A degree in Computer Science, Engineering, or a related field is preferred.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Lead Data Engineer

Lead Data EngineerSalary/Rate: £100,000 - £110,000 per annum + BonusLocation: North LondonCompany: RetelligenceAbout RetelligenceRetelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions....

Highbury

Lead Data Engineer

Lead Data Engineer - AWS, Python, SQL, Kafka - Fully RemoteWe are looking for aLead Data Engineerwith expertise inAWS, Python, SQL, andKafkafor acloud-based data, software development company based in London. Their products allow data transformation into ultra-secure cloud based environments mainly used by large enterprises and government sectors.Please note: A...

Movement8 Bristol

Lead Data Engineer (Azure) - £80,000 + Benefits – Remote

Leading prop tech client now requires a Data Engineer to lead, own and ensure the reliability and scalability of their data products.This role will shape our client’s data architecture, pipelines and cloud technologies ensuring innovation across the wider business.Key responsibilities:Guide a team of data engineers in overseeing the design, development...

Ventula Consulting Manchester

Lead Data Engineer (Azure) - £80,000 + Benefits – Remote

Leading prop tech client now requires a Data Engineer to lead, own and ensure the reliability and scalability of their data products.This role will shape our client’s data architecture, pipelines and cloud technologies ensuring innovation across the wider business.Key responsibilities:Guide a team of data engineers in overseeing the design, development...

Ventula Consulting Leeds

Lead Data Engineer

️Role:Lead Data EngineerSeries B, TechBio StartupLocation: London, UK (hybrid)Salary: 70-100k + generous equityInterested to work for a protein design company creating the next wave of AI for drug discovery?Key Responsibilities:Develop and maintain data models, workflows, andautomations for LIMS,including sample tracking and result ingestion.Design ELT pipelines to transform lab data for...

GCS London

Lead Data Engineer

I am actively seeking a Lead Data Engineer to work for a key client of mine, who are undergoing a huge transformation project.Location:Central London (remote first working).Salary:£95,000 - 100,0000.Tech / Tools:Python, SQL, ELT/ETL, Jenkins, AWS.Experience in Public Cloud services, such as AWS is essential. Practical experience with core services such...

SR2 | Socially Responsible Recruitment | Certified B Corporation London