Azure Data Engineer

Hybrid Role with 2 days per week onsite in Central London.

Skillset required:

• Data Pipeline Expertise: Extensive experience in designing and implementing scalable ETL/ELT data pipelines in Azure Databricks, transforming raw data into usable datasets for analysis.
  
  
• Azure Databricks Proficiency: Strong knowledge of Spark (SQL, PySpark) for data transformation and processing within Databricks, along with experience building workflows and automation using Databricks Workflows.
  
  
• Azure Data Services: Hands-on experience with Azure services like Azure Data Lake, Azure Blob Storage, and Azure Synapse for data storage, processing, and publication.
  
  
• Data Governance & Security: Familiarity with managing data governance and security using Databricks Unity Catalog, ensuring data is appropriately organized, secured, and accessible to authorized users.
  
  
• Optimization & Performance Tuning: Proven experience in optimizing data pipelines for performance, cost-efficiency, and scalability, including partitioning, caching, and tuning Spark jobs.
  
  
• Cloud Architecture & Automation: Strong understanding of Azure cloud architecture, including best practices for infrastructure-as-code, automation, and monitoring in data environments.
  
  My client have limited interview slots and they are looking to fill this vacancy by then end of next month. I have limited slots for 1st stage interviews next week so if you're interest, get in touch ASAP with a copy of your most up to date CV and email me at (url removed) or call me on (phone number removed).
  
  Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship.
  
  You must have the right to work in the UK with no restrictions.
  
  Some of our roles may be subject to successful background checks including a DBS and Credit Check.
  
  TRG are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, the London Power BI User Group, Newcastle Power BI User Group and Newcastle Data Platform and Cloud User Group.
  
  To find out more and speak confidentially about your job search or hiring needs, please contact me directly at (url removed)