Principle Data Engineer

Description

Key Responsibilities

• 
  
• Collaborates with the Data Engineering Manager and the wider team to design and implement scalable data solutions that meet business needs. 
  
• Comfortable leading grooming sessions, ensuring alignment between technical teams and business stakeholders. 
  
• An expert in Microsoft Fabric, PySpark, SparkSQL, and T-SQL, with a strong understanding of data architecture and modern data engineering principles. 
  
• Works closely with business users to document information requirements and translate them into robust data models. 
  
• Leads the development of data streaming and real-time analytics systems. 
  
• Optimizes code and queries for high performance and efficient resource utilization. 
  
• Balances big-picture architecture decisions with deep technical expertise in data modeling and business logic to deliver robust solutions. 
  
• Pragmatic approach to delivering Minimum Viable Products (MVPs) while ensuring long-term scalability and maintainability. 
  
• Strong ability to prioritize and manage a busy workload, making strategic decisions about technical debt and feature development. 
  
• Exposure to machine learning (ML) and AI technologies is beneficial. 
  
• Champions attention to detail, clear communication, enthusiasm, and a willingness to learn. 
  
• Lead the design and maintenance of data pipelines and workflows, ensuring efficiency, scalability, and adherence to best practices. 
  
• Actively collaborate with the Data Engineering Manager to define and evolve long-term data strategies. 
  
• Comfortable leading backlog grooming sessions, facilitating discussions with data engineers and business stakeholders. 
  
• Work closely with stakeholders across BI Reporting, ERP, Marketing, and Data Protection to ensure business needs are met through data solutions. 
  
• Identify and onboard new data sources to expand the analytics capabilities of the business. 
  
• Support BAU operations, including scheduled data transfers, service desk requests, and incident resolution. 
  
• Take an MVP-driven approach to designing and iterating on data solutions while ensuring data integrity and accuracy. 
  
• Produce comprehensive documentation to support design, operations, system architecture, and compliance requirements. 
  
• Mentor Junior and Senior Data Engineers, sharing expertise and fostering professional development. 
  
• Provide leadership in the absence of the Data Engineering Manager, acting as Scrum Master when required. 
  
• Maintain data integrity, GDPR compliance, source control, backup processes, and deployment/testing of new data pipelines. 
  
• Promote a collaborative and supportive team environment, encouraging knowledge sharing and professional growth. 
  

Skills, Knowledge and Expertise

• 
  
• Degree-level education in anumerate subject(e.g., Computer Science, Mathematics, Engineering, or related). 
  
• 
  Microsoft Fabric, Azure, or BI certificationsare advantageous. 
  

• 
  
• 
  Data Engineering & Development:Strong proficiency inMicrosoft Fabric, PySpark, SparkSQL, and T-SQL. 
  
• 
  Cloud Data Architecture:Experience designing scalable solutions inAzure Data Lake, Synapse, Delta Lake, and Lakehouse architectures. 
  
• 
  Data Pipelines & Orchestration:Expertise inAzure Data Factory, Microsoft Fabric Pipelines, and Delta Live Tables. 
  
• 
  Programming & Automation:Proficiency inPythonandSQLfor automation, ETL processes, and analytics. 
  
• 
  Data Governance & Security:Knowledge ofGDPR, access control, metadata management, and audit logging. 
  
• 
  ML & AI Exposure:Familiarity withmachine learning models, AI-driven data analytics, and predictive modelingis a plus. 
  

• 
  
• 
  Strong attention to detail, ensuring data quality, accuracy, and consistency. 
  
• 
  Excellent communication skills, capable of explaining technical concepts to non-technical stakeholders. 
  
• 
  Ability to prioritize and manage a busy workload, balancing long-term goals with immediate business needs. 
  
• 
  Problem-solving mindset, able to diagnose and resolve complex data issues efficiently. 
  
• 
  Pragmatic and results-driven, capable of delivering MVP solutions while considering long-term scalability. 
  
• 
  Enthusiastic and proactive, eager to learn and explore new technologies. 
  
• 
  Collaboration and mentorship, fostering a culture of knowledge sharing and innovation. 
  

Benefits

• 
  
• Generous Staff Discount on all your favourite ELEMIS products and spa treatments, as well as discounts on L'OCCITANE Group products (including L'Occitane, Erborian and more)
  
• Excellent well-being policies including enhanced Maternity & Paternity policies, Income Protection, Life Assurance and more
  
• Generous Holiday Allowance, increasing with length of service
  
• Company Pension Scheme
  
• Healthcare Cash Plan (with Dental)
  
• Employee Assistance Programme for all Associates and their families
  
• Cycle to Work Scheme, Season Ticket Loan, Length of Service Awards
  
• Much, much more!