Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Azure Data Engineer

Axis
City of London
3 days ago
Create job alert
Overview

This is your opportunity to join AXIS Capital – a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client service, intelligent risk taking and superior risk adjusted returns for our shareholders. We also proudly maintain an entrepreneurial, disciplined and ethical corporate culture. As a member of AXIS, you join a team that is among the best in the industry.

At AXIS, we believe that we are only as strong as our people. We strive to create an inclusive and welcoming culture where employees of all backgrounds and from all walks of life feel comfortable and empowered to be themselves. This means that we bring our whole selves to work.

All qualified applicants will receive consideration for employment without regard to race, color, religion or creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin or ancestry, citizenship, physical or mental disability, age, marital status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process.

Responsibilities

The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will design, implement, and manage scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data architecture, ensuring efficient data integration, and enabling advanced analytics to support critical business decisions. This role will enhance the department's ability to deliver high-quality analytics and maintain robust data infrastructure.

What will you do in this role?

As a Senior Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data storage and processing solutions on the Azure platform. You will work with modern data warehouse (MDW) technologies, big data, and Lakehouse architectures to ensure our data solutions are secure, efficient, and optimized.

Key Responsibilities:

  • Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage.
  • Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. Automate loads using Databricks workflows and Jobs
  • Develop, test and build CI/CD pipelines using Azure DevOps to automate deployment and monitoring of data solutions to all environments. Provide knowledge sharing to data operations teams on release management and maintenance.
  • Manage platform administration, ensuring optimal performance, availability, and scalability of Azure data services.
  • Implement end-to-end data pipelines, ensuring data quality, data integrity and data security.
  • Troubleshoot and resolve data pipeline issues while ensuring data integrity and quality.
  • Implement and enforce data security best practices, including role-based access control (RBAC), encryption, and compliance with industry standards.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
  • Monitor and optimize Databricks performance, including cost management guidance and cluster tuning.
  • Stay up to date with Azure cloud innovations and recommend improvements to existing architectures.
  • Assist data analysts with technical input.

You may also be required to take on additional duties, responsibilities and activities appropriate to the nature of this role.

About YouRequired Skills & Experience
  • 5 plus years Azure & Data Engineering Expertise
  • Proven experience in designing and managing large-scale data solutions on Microsoft Azure.
  • Unity Catalog Mastery: In-depth knowledge of setting up, configuring, and utilizing Unity Catalog for robust data governance, access control, and metadata management in a Databricks environment.
  • Databricks Proficiency: Demonstrated ability to optimize and tune Databricks notebooks and workflows to maximize performance and efficiency. Experience with performance troubleshooting and best practices for scalable data processing is essential.
  • Strong problem-solving skills, ability to work in agile environments, and effective collaboration with cross-functional teams.
  • Experience with implementing a Data Lakehouse solution with Azure Databricks, data modeling, warehousing, and real-time streaming.
  • Knowledge of developing and processing full and incremental loads.
  • Experience of automated loads using Databricks workflows and Jobs
  • Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow.
  • Strong experience with Azure Data Factory (ADF) for data integration and orchestration.
  • Hands-on experience with Azure DevOps, including pipelines, repos, and infrastructure as code (IaC).
  • Solid understanding of platform administration, including monitoring, logging, and cost management.
  • Knowledge of data security, compliance, and governance in Azure, including Azure Active Directory (AAD), RBAC, and encryption.
  • Experience working with big data technologies (Spark, Python, Scala, SQL).
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication skills with the ability to collaborate with cross-functional teams to understand requirements, data solutions, data models and mapping documents.
Preferred Qualifications
  • Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect).
  • Experience with Terraform, ARM templates, or Bicep for infrastructure automation.
  • Experience integrating Azure Data Services with Power BI and AI/ML workflows.
Role Factors

The position is full-time with remote work options, requiring in-office presence three days per week

What we offer

You will be eligible for a comprehensive and competitive benefits package which includes medical plans for you and your family, health and wellness programs, retirement plans, tuition reimbursement, paid annual leave, and much more.


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Azure Data Engineer

Senior Azure Data Engineer

Senior Azure Data Engineer (Databricks)

Senior Data Engineer - (Azure/Databricks)

Azure Data Architect

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why Data Science Careers in the UK Are Becoming More Multidisciplinary

Data science once meant advanced statistics, machine learning models and coding in Python or R. In the UK today, it has become one of the most in-demand professions across sectors — from healthcare to finance, retail to government. But as the field matures, employers now expect more than technical modelling skills. Modern data science is multidisciplinary. It requires not just coding and algorithms, but also legal knowledge, ethical reasoning, psychological insight, linguistic clarity and human-centred design. Data scientists are expected to interpret, communicate and apply data responsibly, with awareness of law, human behaviour and accessibility. In this article, we’ll explore why data science careers in the UK are becoming more multidisciplinary, how these five disciplines intersect with data science, and what job-seekers & employers need to know to succeed in this transformed field.

Data Science Team Structures Explained: Who Does What in a Modern Data Science Department

Data science is one of the most in-demand, dynamic, and multidisciplinary areas in the UK tech and business landscape. Organisations from finance, retail, health, government, and beyond are using data to drive decisions, automate processes, personalise services, predict trends, detect fraud, and more. To do that well, companies don’t just need good data scientists; they need teams with clearly defined roles, responsibilities, workflows, collaboration, and governance. If you're aiming for a role in data science or recruiting for one, understanding the structure of a data science department—and who does what—can make all the difference. This article breaks down the key roles, how they interact across the lifecycle of a data science project, what skills and qualifications are typical in the UK, expected salary ranges, challenges, trends, and how to build or grow an effective team.

Why the UK Could Be the World’s Next Data Science Jobs Hub

Data science is arguably the most transformative technological field of the 21st century. From powering artificial intelligence algorithms to enabling complex business decisions, data science is essential across sectors. As organisations leverage data more rapidly—from retailers predicting customer behaviour to health providers diagnosing conditions—demand for proficiency in data science continues to surge. The United Kingdom is particularly well-positioned to become a global data science jobs hub. With world-class universities, a strong tech sector, growing AI infrastructure, and supportive policy environments, the UK is poised for growth. This article delves into why the UK could emerge as a leading destination for data science careers, explores the job market’s current state, outlines future opportunities, highlights challenges, and charts what must happen to realise this vision.