Senior Data engineer

Job description

Duties of senior Data engineer

You will help build high-quality solutions that meet the highest technical standards and deliver value to our customers.

Working as part of an existing agile team to develop quality solutions within required deadline. Collaborating effectively to support and enhance the full product lifecycle. Reviewing proposals, evaluating alternatives, providing estimates and making recommendations. Shape and lead the infrastructure and security strategy and the technical roadmaps across the teams. Lead the design and implementation of scalable, secure, and compliant cloud solutions, collaborating across engineering, security, and business teams. Champion DevSecOps practices, CI/CD pipelines, and cloud-native tooling to enhance posture and reduce friction. Ensure operational coverage, whilst driving automation and innovation using modern engineering practices such as Infrastructure as Code and Policy as Code and engineering delivery and maintaining platform security posture.

Qualifications:

Degree, HND, or HNC in a software development discipline.

Required Skills:

• Experience of the full development lifecycle
• Strong communication skills with the ability to explain solutions to technical and non-technical audience
• Excellent attention to detail, with the ability to analyse problems and requirements.
• Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git
• Proficient with scripting language(s): Python (preferred), PowerShell , Configuration as Code principles and API integration
• Strong experience in Scala or Python development & with Spark Framework
• Strong experience with AWS and principles such as Lake Formation, IAM, Glue, EC2
• Experience with automated testing methodologies
• Commitment to staying updated with the latest terminology, concepts, and best practices.

Desired Skills:

• Understanding of Agile methodologies.
• AWS Developer Certification.
• Expertise in Python, Openshift/Kubernetes
• Proficiency with automated testing tools (e.g., Scalatest, pytest).
• Knowledge of RESTful and microservice architectures.
• Strong expertise in Terraform or CloudFormation.
• Familiarity with SonarQube and Veracode.

About Experian

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.