Principal Data Engineer

Your new company
An exciting opportunity has arisen with a high-profile public sector client based in the HAPPIEST CITY in the UK. They are continually improving their ways of working and have a number of critical workstreams that they have embarked upon. As part of this initiative and anticipated change, they are seeking a seasoned, confident and reliable Principal Data Engineer to assist with the further development of their Azure platform.

Your new role
You will support the data engineering team to build the tools and processes to efficiently ingest data into the environment as well as support the wider data team with their transition to Databricks and the Azure platform. Furthermore, you will also introduce AI models into production with automated monitoring and alerting in place.

You will -

• Build and develop reusable pipelines
• Work with the team to improve operating efficiencies
• Deploy production AI models
• Work with the team to support ETL processes

What you'll need to succeed

• Seasoned knowledge of the Azure Databricks platform and associated functionalities
• Strong Python programming knowledge, ideally Pyspark
• A logical and analytical approach to problem-solving
• Awareness of the modern data stack and associated methodologies

What you'll get in re...