Lead Data Engineer, SC Clearance required, outside IR35, travel once/ twice a month to Newcastle.
Role Overview:
We are seeking a Lead Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and frameworks that support data-driven decision-making. You will work collaboratively with cross-functional teams to ensure data integrity and accessibility while providing technical leadership to junior engineers. This position is outside IR35.
Responsibilities:
- Design and develop robust data pipelines using Quantexa and Databricks.
- Collaborate with data scientists and analysts to understand data requirements and provide solutions.
- Ensure the reliability, scalability, and performance of data systems.
- Lead and mentor a team of data engineers, fostering a culture of continuous improvement.
- Manage data integration processes and maintain data quality standards.
- Implement best practises for data governance and security.
- Participate in code reviews and contribute to architectural discussions.
- Maintain up-to-date documentation for data systems and processes.
Qualifications:
- Proven experience as a Data Engineer, with a strong background in data pipeline development.
- Expertise in Quantexa and Databricks.
- Experience in leading technical teams and projects.
- Strong understanding of data modelling and ETL processes.
- SC clearance is required for this role.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- A degree in Computer Science, Engineering, or a related field is preferred.
The latest news, articles, and resources, sent to your inbox weekly.
Lead Data Engineer – SC Cleared (or Clearable)Location: LondonSalary: Up to £80,000Start Date: ASAPAbout the RoleJoin a dynamic Digital Transformation Consultancy as a Lead Data Engineer and play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You’ll be responsible for designing and implementing robust ETL pipelines,...
Paddington
We're seeking a Lead Data Engineer, experienced in GCP, to join our Technology team here at N Brown Group! This role is a balance of hands-on data engineering alongside technical leadership and coaching, working within an agile operating environment. What will you do as a Lead Data Engineer at N...
Manchester
Lead Data EngineerSalary/Rate: £100,000 - £110,000 per annum + BonusLocation: North LondonCompany: RetelligenceAbout RetelligenceRetelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions....
Highbury
This is a job posted by our partner JoobleSkills and ExperienceDesigning and deploying production-grade data pipelines (batch and streaming) within a big data architecture using tools like Python,Scala,Spark, and SQL.Expertise in either AWS or Azure cloud platforms, with hands-on experience in key services such as:Location108 E 16th Street, New York,...
Jobleads Holloway
This is a job posted by our partner JoobleSkills and ExperienceDesigning and deploying production-grade data pipelines (batch and streaming) within a big data architecture using tools like Python,Scala,Spark, and SQL.Expertise in either AWS or Azure cloud platforms, with hands-on experience in key services such as:Location108 E 16th Street, New York,...
Jobleads London
Lead Data Engineer, SC Clearance required, outside IR35, travel once/ twice a month to Newcastle.Role Overview:We are seeking a Lead Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and frameworks that support data-driven decision-making. You will work collaboratively...
BrightBox Group Ltd
