Data Engineer (SC Clearance)

Location: Remote

Work Pattern: Contract

Security Clearance: Required

The Company: 

At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff.

The Role:

We are seeking a highly skilled Data Engineer with strong expertise in AWS, EMR, Python, and PySpark to join our dynamic team. This role requires a self-starter who is confident in their technical abilities, thrives in a fast-paced environment, and has experience working within the public sector and consulting. You will play a key role in designing, building, and optimizing scalable data pipelines, working closely with cross-functional teams to deliver impactful data solutions.

Key Responsibilities:

Data Pipeline Development: Design, develop, and optimize ETL/ELT pipelines using AWS EMR, Python, and PySparkCloud Infrastructure: Build and manage scalable data processing solutions on AWS, leveraging services such as S3, Lambda, Glue, and RedshiftBig Data Processing: Work with large-scale datasetsin distributed computing environments, ensuring high performance and efficiencyAutomation & Optimization: Develop scripts to automate data ingestion, transformation, and validation processesCollaboration & Stakeholder Engagement: Work closely with clients, data scientists, and business analysts to understand requirements and deliver solutions that meet business needsConsulting & Public Sector Expertise: Provide strategic guidance on best practices in data engineering and analytics within the public sectorData Quality & Governance: Implement data validation, monitoring, and governance best practices to ensure data integrity and compliance

Requirements:

AWS Expertise: Strong experience with AWS EMR and other AWS data services (Glue, S3, Lambda, Redshift, Athena, etc.)

Programming: Proficiency in Python and PySpark for big data processing

Big Data Technologies: Hands-on experience working with distributed computing frameworks such as Spark

Self-Starter & Confident Communicator: Ability to take ownership of tasks, work autonomously, and engage confidently with stakeholders

Public Sector Experience: Previous experience working on government or public sector projects

Consulting Experience: Proven track record of working in client-facing consulting roles, delivering solutions to complex business challenges

Problem-Solving: Strong analytical and troubleshooting skills, with the ability to work under pressure in a fast-paced environment

Nice-to-Have:

Experience with Terraform, Kubernetes, or Docker for infrastructure automation.

Knowledge of SQL, NoSQL databases, and data warehousing solutions.

Familiarity with data security, governance, and compliance in the public sector.

Benefits:

Join a rapidly expanding start-up where personal growth is a part of our DNA. 

Benefit from a flexible work environment focused on deliverable outcomes. 

Receive private medical insurance through Aviva. 

Enjoy the benefits of a company pension plan through Nest. 

25 days of annual leave plus UK bank holidays. 

Access Perkbox, a global employee rewards platform offering discounts, perks, and wellness resources. 

Participate in a generous employee referral program. 

A highly collaborative and collegial environment with opportunities for career advancement. 

Be encouraged to take bold steps and embrace a mindset of experimentation. 

Choose your preferred device, PC or Mac.

Diversity & Inclusion:

Here at Amber Labs, we are dedicated to fostering an inclusive and equitable workplace for all. Our commitment to diversity, equality, and inclusion includes:
Valuing the unique experiences, perspectives, and backgrounds of all employees and creating an environment where everyone feels welcomed, respected, and valued.
Prohibiting all forms of harassment, bullying, discrimination, and victimisation and promoting a culture of dignity and respect for all.
Educating all new hires on our Diversity and Inclusion policies and ensuring they are aware of their rights and responsibilities to create a safe and inclusive workplace.
By taking these steps, we are dedicated to building a workplace that reflects and celebrates the diversity of our employees and communities.
This role at Amber Labs is a permanent position, and all employees are required to meet the Baseline Personnel Security Standard (BPSS). Please be advised that, at this time, we are unable to consider candidates who require sponsorship or hold a visa of any type.

What Happens Next?

Our Talent Acquisition Team will be in touch to advise you on the next steps. We have a two-stage interview process for most of our consultants. In certain cases, we may include a third and final stage, which is a conversation with the company Partners. This will only be considered if deemed necessary.