Senior Data Engineer

Pro5.ai
Sheffield
5 days ago
Create job alert

*Do take note that this is an on-site role based inKuala Lumpur, Malaysia.

*Candidates can be from anywhere in Europe ideally or any part of the world, as long as they are willing torelocateto KL, Malaysia.



Are you passionate about using data to drive innovative solutions in a fast-paced environment? We're looking for aSenior Data Engineerto join a cutting-edge technology company based in Kuala Lumpur!

As a Senior Data Engineer, your mission will be to support data scientists, analysts, and software engineers by providing maintainable infrastructure and tooling for end-to-end solutions. You’ll work with terabytes to petabyte-scale data, supporting multiple products and data stakeholders across global offices.


Key Responsibilities

  • Design, implement, operate and improve the analytics platform
  • Design data solutions using various big data technologies and low latency architectures
  • Collaborate with data scientists, business analysts, product managers, software engineers and other data engineers to develop, implement and validate deployed data solutions.
  • Maintain the data warehouse with timely and quality data
  • Build and maintain data pipelines from internal databases and SaaS applications
  • Understand and implement data engineering best practices
  • Improve, manage, and teach standards for code maintainability and performance in code submitted and reviewed
  • Mentor and provide guidance to junior engineers on the job


Qualifications

  • Expert at writing and optimising SQL queries
  • Proficiency in Python, Java or similar languages
  • Familiarity with data warehousing concepts
  • Experience in Airflow or other workflow orchestrators
  • Familiarity with basic principles of distributed computing
  • Experience with big data technologies like Spark, Delta Lake or others
  • Proven ability to innovate and leading delivery of a complex solution
  • Excellent verbal and written communication - proven ability to communicate with technical teams and summarise complex analyses in business terms
  • Ability to work with shifting deadlines in a fast-paced environment


Desirable Qualifications

  • Authoritative in ETL optimisation, designing, coding, and tuning big data processes using Spark
  • Knowledge of big data architecture concepts like Lambda or Kappa
  • Experience with streaming workflows to process datasets at low latencies
  • Experience in managing data - ensuring data quality, tracking lineages, improving data discovery and consumption
  • Sound knowledge of distributed systems - able to optimise partitioning, distribution and MPP of high-level data structures
  • Experience in working with large databases, efficiently moving billions of rows, and complex data modelling
  • Familiarity with AWS is a big plus
  • Experience in planning day to day tasks, knowing how and what to prioritise and overseeing their execution


Competitive salary and benefits

We'll cover visas, tickets, and1-2months of accommodationto help you settle in.


What’s Next:

  1. Interview with our Talent Acquisition team (virtual or face-to-face)
  2. Technical sample test (discussed in the technical round)
  3. Final interview with the Hiring Manager (virtual or face-to-face)

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Data Migration

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Essential Books to Read to Nail Your Data Science Career in the UK

Data science continues to be one of the most exciting and rapidly evolving fields in tech. With industries across the UK—ranging from finance and healthcare to e-commerce and government—embracing data-driven decision-making, the demand for skilled data scientists has soared. Whether you're a recent graduate looking for your first role or a professional aiming to advance your career, staying updated through books is crucial. In this article, we explore ten essential books every data science job seeker in the UK should read. Each book provides valuable insights into core concepts, practical applications, and industry-standard tools, helping you build skills employers are actively looking for.

Navigating Data Science Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Data science has taken centre stage in the modern workplace. Organisations rely on data-driven insights to shape everything from product innovation and customer experience to operational efficiency and strategic planning. As a result, there is a growing need for skilled data scientists who can analyse large volumes of data, build predictive models, communicate findings effectively, and collaborate cross-functionally. If you are looking to accelerate your data science career—or even land your first role—attending data science career fairs can be a game-changer. Unlike traditional online applications, face-to-face interactions let you showcase your personality, passion, and communication skills in addition to your technical expertise. However, to stand out in a busy environment, you need a clear strategy: from polishing your personal pitch and asking thoughtful questions to following up with a memorable message. In this article, we’ll guide you through every step of making a strong impression at data science career fairs in the UK and beyond.

Common Pitfalls Data Science Job Seekers Face and How to Avoid Them

Data science has become a linchpin for decision-making and innovation across countless industries, from finance and healthcare to tech and retail. The demand for data scientists in the UK continues to climb, with businesses seeking professionals who can interpret complex datasets, build predictive models, and communicate actionable insights. Despite this high demand, the job market can be extremely competitive—and many applicants unknowingly fall into avoidable traps. Whether you’re an aspiring data scientist fresh out of university, a professional transitioning from a quantitative role, or a seasoned analyst looking to expand your skill set, it’s crucial to navigate your job search effectively. In this article, we explore the most common pitfalls data science job seekers face and provide pragmatic advice to help you stand out. By refining your CV, portfolio, interview strategies, and communication skills, you can significantly increase your chances of landing a rewarding data science role. If you’re looking for your next data science job in the UK, don’t forget to explore the listings at Data Science Jobs. Read on to discover how to avoid critical mistakes and position yourself for success.