Senior Data Engineer

As aSenior Data Engineer, you will be an integral part of a cross-functional feature development squad, dedicated to delivering innovative data solutions on our leading analytics platform. You will utilize your diverse skill set to contribute to all aspects of data engineering, with a core focus in designing scalable and secure data architectures for data retrieval. Collaborating closely with other engineers, a scrum master, and business stakeholders, you will ensure a continuous delivery of value in an agile environment.

• Collaborate within the squad to define and deliver scalable, secure data features aligned with business goals.
• Architect high-performance data retrieval solutions (APIs, web scrapers, SFTP) with a focus on security, efficiency, and best practices.
• Oversee client data onboarding, ensuring swift, compliant, and secure integration processes.
• Provide expert support for complex issues, acting as a technical authority and ensuring secure coding standards through code reviews.
• Mentor junior engineers, promoting best practices in clean code, testing, and CI/CD.
• Drive continuous improvement in data feature development and stay updated on industry trends, implementing innovative tools and solutions.
• Proficient in Microsoft Azure (DevOps, Data Factory, Data Lake, Functions, Azure Container Instances, RBAC and Entra) and DevOps CI/CD.
• Proficient in Infrastructure as Code (Terraform), secure FTP configurations (SFTP/FTPS), and remediation of security vulnerabilities (DAST, Azure Defender).
• Expertise in Python for writing efficient code and maintaining reusable libraries.
• Experienced with microservice design patterns, and Databricks/Spark for big data processing.
• Strong knowledge of SQL/NoSQL databases corresponding ELT workflows.
• Excellent problem-solving, communication, and collaboration skills in fast-paced environments.

Requirements

• 3 years’ professional experience as a Data Engineer/ DevOps Engineer/ Systems Engineer.
• Advanced proficiency in Python for data retrieval, processing, automation, and integration tasks.
• Expertise on Microsoft Azure platform for data analytics, including design and deployment of infrastructure.
• Expertise in creating CI/CD pipelines.
• Experience in creating FTP (SFTP/FTPS) configurations.
• Experience in working with ETL/ELT workflows for data analytics.
• Degree in Computer Science, Mathematics or related subject.

Highly desirable skills & exposure:

• Working collaboratively as part of an Agile development squad.
• Experience and knowledge of the payments industry.
• Experience using Azure Databricks.
• Experience using containerised services such as Docker/ Kubernetes.
• Experience using IaC tools such as Terraform/Bicep.
• Experience using programming languages; Scala, Powershell, YAML.

Benefits

• Comprehensive, payments industry training by in-house and industry experts.
• Excellent performance-based earning opportunity, including OKR-driven bonuses.
• Future opportunity for equity, rewarded to high performers.
• Personal and professional learning opportunities and growth experiences aligned with your career aspirations.
• Quarterly values award for all employees – with a financial prize.
• Monthly Reimbursement of commuting costs
• Regular companywide socials and team building events.
• 22 vacation days + U.K. public holidays and discretionary office closure during Christmas.
• Competitive Pension plan, Vitality healthcare cover (after 6-months) and Cycle to work scheme.