Senior Data Engineer

Aioi Nissay Dowa Europe
Epsom
3 weeks ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Microsoft Fabric

Do you have a can-do attitude and experience of the delivery and maintenance of Data.A little bit about us, we are MOTIX Connected:Harnessing our telematics expertise, we offer tailored solutions that support businesses leading the way in connected mobility, covering vehicle insights, driver behavior, claims, fraud prevention, and customer engagement.If you have what it takes to take our business to the next level, apply now!Responsibilities * You will work in the data team with connections to analitico and machine learning team. * The role is expected to provide the relevant deliverables to integrate with the platform to provide business value. * This role has project level authority on the development of algorithms, processes, and infrastructure (subject to manager sign-off) and is expected to drive improvements and management of projects. * Building data pipelines to load raw data into data lakes and data warehouses running in the cloud (AWS), making them available to be use from different teams (Analytics, ML.) * Developing new algorithms, processes and technologies within the business to maximise opportunity for cost efficiency, ETL performance and security. * Design, automate, build, and launch scalable, efficient and reliable data pipelines into production, to ensure that everyone in the business can retrieve and use the data in a secure and efficient way. * Support colleagues through sharing knowledge and examples. * Educate and encourage those outside of the department to the functionality and solutions available in the data warehouse platform.Knowledge, Experience and QualificationsTechnical Skills * Experience building modern Data Warehouses. * Experience in working with large data sets with real time streaming applications. * Experience in relational database (PostgreSQL, Redshift). * Experience in AWS Cloud Services (S3, Glue, Athena, Redshift). * Some experience writing Infrastructure-As-Code (we use Terraform). * Experience in ETL and related practices and strong experience in SQL and Python. * Good Experience in Apache Spark (Pyspark, spark streaming is a plus). * Experience with modern software engineering practices (CI/CD, Testing, Version Control).Personal Skills * Strong communication and organisational skills; works well in diverse teams. * Comfortable communicating across all levels of the business. * Proactive and able to drive projects forward with innovative thinking. * Detail-oriented with strong analytical skills. * Interested in new and emerging technologies and practices.Why Join Us?We're all about helping you grow, with plenty of support to develop in your current role whilst also creating opportunities to explore new ones and advance your career.We realise that we need to be a good fit for you above all else – so here’s what you can enjoy about AND-E: * Recognised as the Best Large Insurance Employer: We are proud to have been named the Best Large Insurance Employer for 2023 at the prestigious British Insurance Awards. * Unmatched Work-Life Balance. * Competitive Salaries and Benefits Package: We offer competitive salaries that recognise your skills and expertise.Our community’s unwritten rule is to be as flexible as we can be. We understand life happens, and on occasion, we all need a bit of give and take in our day. We don’t want you missing your child’s school play, or the new fridge being delivered. We believe our colleagues should have choice, flexibility, and balance in their home and work life, and we are committed to fostering a diverse, equitable, and inclusive environment where everyone feels valued and supported, including embracing neurodiversity and ensuring all individuals have the tools and opportunities they need to thrive. Our colleagues should have choice, flexibility and balance in their home and work life.We like to think our benefits package is one of the best, focusing on colleagues’ health, wealth, and lifestyle. We offer: * Up to 28 Days annual leave with the option to buy/sell up to 5 days holiday* * 10% Discretionary Annual Bonus* * Healix Private Medical Insurance Options* * 3 x Annual Salary Life Assurance* * Health and Well-being Support: Including money back on health expenses (optician, dental, physio), free flu jab voucher, 24/7 virtual GP service, employee assistance programme, and enhanced family-friendly policies (e.g. £200 baby bonus). * Financial and Lifestyle Benefits: Offers £250 towards driving lessons*, interest-free season ticket loan*, cycle scheme with discounts, Wagestream for financial flexibility*, and pension advisory services for retirement planning.* Subject to company performance and completion of probationAioi Nissay Dowa Europe is committed to promoting equal opportunities in employment. Employees and job applicants will receive equal treatment regardless of age, disability, gender reassignment, marital or civil partner status, pregnancy or maternity, race, colour, nationality, ethnic or national origin, religion or belief, sex or sexual orientation (Protected Characteristics)

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Best UK Universities for Data Science Degrees (2025 Guide)

Discover ten of the strongest UK universities for Data Science degrees in 2025. Compare entry requirements, course content, research strength and industry links to choose the right programme for you. Data is the currency of the modern economy, and professionals who can wrangle, model and interpret vast datasets are in demand across every sector—from biotechnology and finance to sport and public policy. UK universities have been at the forefront of statistics, artificial intelligence and large-scale computing for decades, making the country a prime destination for aspiring data scientists. Below, we profile ten institutions whose undergraduate or postgraduate pathways excel in data science. Although league tables vary each year, these universities have a proven record of excellence in teaching, research and industry collaboration.

Veterans in Data Science: A Military‑to‑Civilian Pathway into Analytical Careers

Introduction The UK Government’s National AI Strategy projects that data‑driven innovation could add £630 billion to the economy by 2035. Employers across healthcare, defence, and fintech are scrambling for professionals who can turn raw data into actionable insights. In 2024 alone, job‑tracker Adzuna recorded a 42 % year‑on‑year rise in data‑science vacancies, with average advertised salaries surpassing £65k. For veterans, that talent drought is a golden opportunity. Whether you plotted artillery trajectories, decrypted enemy comms, or managed aircraft engine logs, you have already practised the fundamentals of hypothesis‑driven analysis and statistical rigour. This guide explains how to translate your military experience into civilian data‑science language, leverage Ministry of Defence (MoD) transition programmes, and land a rewarding role building predictive models that solve real‑world problems. Quick Win: Take a peek at our live Junior Data Scientist roles to see who’s hiring this week.

Quantum-Enhanced AI in Data Science: Embracing the Next Frontier

Data science has undergone a staggering transformation in the past decade, evolving from a niche academic discipline into a linchpin of modern industry. Across every sector—finance, healthcare, retail, manufacturing—data scientists have become indispensable, leveraging statistical methods and machine learning to turn raw information into actionable insights. Yet as datasets grow ever larger and machine learning models become more computationally expensive, there are genuine questions about how far current methods can be pushed. Enter quantum computing, a nascent but promising technology grounded in the counterintuitive principles of quantum mechanics. Often dismissed just a few years ago as purely experimental, quantum computing is quickly gaining traction as prototypes evolve into cloud-accessible machines. When paired with artificial intelligence—particularly in the realm of data science—the results could be game-changing. From faster model training and complex optimisation to entirely new forms of data analysis, quantum-enhanced AI stands poised to disrupt established practices and create new opportunities. In this article, we will: Explore how data science has reached its current limits in certain areas, and why classical hardware might no longer suffice. Provide an accessible overview of quantum computing concepts and how they differ from classical systems. Examine the potential of quantum-enhanced AI to solve key data science challenges, from data wrangling to advanced machine learning. Highlight real-world applications, emerging job roles, and the skills you need to thrive in this new landscape. Offer actionable steps for data professionals eager to stay ahead of the curve in a rapidly evolving field. Whether you’re a practising data scientist, a student weighing up your future specialisations, or an executive curious about the next technological leap, read on. The quantum era may be closer than you think, and it promises to radically transform the very fabric of data science.