Jobs

Lead Data Engineer


Job details
  • LA International
  • London
  • 1 week ago

Lead Data Engineer
Outside IR35
SC Clearance required
2 days per week on site in Canary Wharf, 3 days working from Home
6months+

Key responsibilities will include:
* Perform updates and changes to the Physical Data Model
* Designing and building PostgreSQL functions called from the API tier
* Act as an SME on the Physical Data Model to become a trusted advisor to other teams that have data requirements and translate these into deployable changes
* Collaborate with the Data Architect to improve the PDM and surrounding processes
* Support and mentor members of the Physical Data Model team
* Keep appraised of latest technology changes and data best practices to be used by the team
* Work with the delivery manager to develop issues in Jira that are refined and detailed enough to be considered ready for development
* Working closely with the Logical Data Model (LDM) team on collaborative tasks and helping keep both teams aligned
* Lead data workshops with key stakeholders across business, data and system areas helping to formalise and document requirements. (Multi-Vendor Environment).
* Own data architecture and design artefacts aligned to CDIO standards.
* Refining of SQL queries and functions to be more performant
* Design and implement unit and regression tests on the database
* Co-own the CI/CD deployment pipeline with senior/lead DAL developer(s) deploying the PDM components as code, using Liqiubase
* Performing impact analysis on releases to pre-empt any issues these may cause and performing deployments.
* Ownership of cloud-based data platforms and their performance (e.g. Azure PostgreSQL Flexible Server)
* Reviews reference data changes for impact to coupled code

Job Requirements
* Experience of designing/working with generic/abstract data models
* Experience with data modelling tools - preferably SparxEA
* Experience creating and maintaining data and design artefacts
* Strong problem-solving abilities in the context of complex data models
* Strong experience with PostgreSQL
* Experience creating and tuning complex SQL queries (e.g. self-referencing hierarchies, KVP structures)
* Strong experience with Database as Code tools - preferably Liquibase
* Experience with cloud based database platforms - preferably Azure PostgreSQL Flexible Server
* Experience working in Agile delivery - particularly Scrum & SAFe.
* Experience with Microsoft Dataverse
* Experience creating data architecture artefacts/documentation
* Formal training/academic qualifications relevant to the role
* SAFe Agile qualifications (desirable)
* Any Microsoft data-based certifications (desirable)


Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Lead Data Engineer

Lead Data Engineer required by our market leading, award winning, retail sector client based in Avonmouth. Our client have recently migrated across to Microsoft Dynamics Business Central and require a Lead Data Engineer to lead the development, maintenance, support, and integration across an increasing array of data sources into an...

Avonmouth

Lead Data Engineer

Lead Data EngineerLondon 2 days a week£90,000 - £95,000 + Bonus & BenefitsMy client is a global ecommerce retailer based in London who are seeking a skilled and experienced Lead Data Engineer to join their dynamic Data Team. You'll be leading them to design, build and maintain their data pipelines...

London

Lead Data Engineer

Role : Lead Data Engineer (PET)Location: United KingdomOverview: We are seeking a highly skilled Lead Data Engineer to join our team for a critical project with NHS England. The project involves migrating Privacy Enhancement Technology (PET) from the existing Privitar system to IQVIA across multiple data platforms. The ideal candidate...

Reading

Lead Data engineer

Our client a global Fintech based in central London is looking for a Lead Data Engineer. The role will be looking after a team of Data analyst and will be looking after strategy. The Lead Data Engineer will be working on are Insurance analytic projects, Actuarial projects,Strategies and risk projects....

Clerkenwell

Lead Data Engineer

Lead Data EngineerLocation: CorkSalary: €(phone number removed) (DOE)HybridReperio are working with a major software company who are looking to add to their Data team ahead of a projected busy year in 2025. To facilitate this, they are looking for a Lead Data Engineer to play a crucial role in building...

Cork

Lead Data Engineer

Lead Data Engineer | Swindon (hybrid) | £60,000-£80,000Peaple Talent are very excited to have partnered with a leading financial services client, based in Swindon who are looking for a new Lead Data Engineer.As Lead Data Engineer, you'll provide technical leadership and mentorship of the Data Engineering team helping them in...

Peaple Talent Swindon