Jobs

Data Engineer


Job details
  • LA International
  • London
  • 2 weeks ago
Applications closed

Lead Data Engineer
Outside IR35
SC Clearance required
6months+

Key responsibilities will include:
* Perform updates and changes to the Physical Data Model
* Designing and building PostgreSQL functions called from the API tier
* Act as an SME on the Physical Data Model to become a trusted advisor to other teams that have data requirements and translate these into deployable changes
* Collaborate with the Data Architect to improve the PDM and surrounding processes
* Support and mentor members of the Physical Data Model team
* Keep appraised of latest technology changes and data best practices to be used by the team
* Work with the delivery manager to develop issues in Jira that are refined and detailed enough to be considered ready for development
* Working closely with the Logical Data Model (LDM) team on collaborative tasks and helping keep both teams aligned
* Lead data workshops with key stakeholders across business, data and system areas helping to formalise and document requirements. (Multi-Vendor Environment).
* Own data architecture and design artefacts aligned to CDIO standards.
* Refining of SQL queries and functions to be more performant
* Design and implement unit and regression tests on the database
* Co-own the CI/CD deployment pipeline with senior/lead DAL developer(s) deploying the PDM components as code, using Liqiubase
* Performing impact analysis on releases to pre-empt any issues these may cause and performing deployments.
* Ownership of cloud-based data platforms and their performance (e.g. Azure PostgreSQL Flexible Server)
* Reviews reference data changes for impact to coupled code

Job Requirements
* Experience of designing/working with generic/abstract data models
* Experience with data modelling tools - preferably SparxEA
* Experience creating and maintaining data and design artefacts
* Strong problem-solving abilities in the context of complex data models
* Strong experience with PostgreSQL
* Experience creating and tuning complex SQL queries (e.g. self-referencing hierarchies, KVP structures)
* Strong experience with Database as Code tools - preferably Liquibase
* Experience with cloud based database platforms - preferably Azure PostgreSQL Flexible Server
* Experience working in Agile delivery - particularly Scrum & SAFe.
* Experience with Microsoft Dataverse
* Experience creating data architecture artefacts/documentation
* Formal training/academic qualifications relevant to the role
* SAFe Agile qualifications (desirable)
* Any Microsoft data-based certifications (desirable)


Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer

Are you a Data Engineer who loves to experiment and brings empathy and creativity to your work?Then you’ll fit right in at this people-first, agile tech company. Where collaboration, creativity and a shared commitment to a continuous improvement drives it’s success.Guided by core values – Empathise, Enable, Empower, and Experiment...

Bishopsgate

Data Engineer - Azure - Altrincham - £70k

Data Engineer - Azure - Hybrid - Manchester - £70kThis is a fantastic opportunity for a data engineer to join an expanding IT consultancy based in Manchester! If you are an expert in the MS Azure tech stack, experienced overseeing a team of data professionals and building ETL pipelines, this...

Wilmslow

Data Engineer

Your new roleAs a Data Engineer, you will be working on multiple projects, including the design and implementation, gathering data and integrating into existing model for extension. You will have experience of SSIS, MS SQL, Datawarehouse and cubes. Power BI experience preferred.Whilst this role doesn't involve Azure, there are upcoming...

Coventry

Data Engineer

Data EngineerPermanentLocation: Home / Crawley (3 days a week on site)Salary: £75,000 - £85,000 (+ benefits)Skills: SQL, Postgre SQL, CockroachDB, Docker, Flyway, SC ClearanceWe are looking to recruit an SC Cleared Data Engineer for a leading software & solutions organisation. The Data Engineer will rive data enablement that underpins cutting-edge...

Crawley

Data Engineer

Contract Data Engineer (6 Months) - Azure Azure, Azure Functions, ADF, Azure databricks, PowerBi  We are seeking an experienced Data Engineer for a 6-month contract to design, develop, and deploy scalable, secure Azure solutions. This role offers the opportunity to work on cutting-edge cloud technologies and contribute to key business...

Northampton

Data Engineer

Data EngineerPermanentLocation: Home / Brighton (on site 6 days a month)Salary: £50,000 - £60,000 (+ excellent benefits including 28% employer pension contributions, + bonus)Skills: Cloud Data Platforms (Azure preferred), SQL, Azure Data Factory, AgileWe are looking to recruit a Data Engineer for a technology driven public sector organisation based in...

Brighton