Big Data Engineer

Location:London

Salary:Up to £83,000 per annum

Experience:12+ years

Start Date:ASAP

Are you an experienced Big Data Engineer looking for your next challenge? Join a prestigious organization at the forefront of cutting-edge technology, delivering high-impact solutions across multiple sectors. This is a unique opportunity to leverage your technical expertise and work with a dynamic team in a fast-paced environment.

The Role

As a Big Data Engineer, you will play a critical role in designing, implementing, and maintaining robust data pipelines to process and analyze vast amounts of information. Collaborating closely with stakeholders, data architects, and data scientists, you will ensure data quality and support the delivery of key business objectives.

Key Responsibilities:

• Develop, debug, and optimize ETL pipelines to process large datasets efficiently.
• Work with modern ETL tools, including Apache Kafka, Spark, and Airflow.
• Build and implement data pipelines using AWS cloud-native services.
• Provide technical expertise on AWS services such as API Gateway, Lambda, Redshift, Glue, and CloudWatch.
• Maintain and enhance data quality through close collaboration with cross-functional teams.

What We’re Looking For:

• Strong hands-on experience with big data technologies.
• Proficient programming skills in Python, Scala, and SQL.
• Extensive knowledge of AWS cloud infrastructure and services.
• Proven ability to design and debug complex ETL workflows.
• Strong communication and collaboration skills.

Security Clearance:

Candidates must have SC clearance or be eligible to obtain it. Preference will be given to those already SC-cleared.

Eligibility Criteria for SC Clearance:

• British Citizenship or residency in the UK for at least five consecutive years.
• A detailed employment history covering the past 10 years or longer may be required

Why Join?

• Competitive salary and benefits package.
• Work on high-profile, impactful projects.
• Collaborative and inclusive work environment.
• Opportunities to develop and grow your career.