Senior Data Engineer, Data Platform - Macquarie Group

At Macquarie, our Data Services Team drives innovation by delivering a diverse suite of data products that empower data-driven decision-making and enhance operational efficiency. With a strong focus on engineering, data science, and analytics, the team delivers innovative solutions that empower business users primarily trading teams to tackle complex challenges and unlock new opportunities.

At Macquarie, our advantage is bringing together diverse people and empowering them to shape all kinds of possibilities. We are a global financial services group operating in 31 markets and with 56 years of unbroken profitability. You\'ll be part of a friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes.

What role will you play?

As a Data Platform Engineer, you will play a pivotal role in designing, building, and optimising a cutting-edge, petabyte-scale data platform powered by modern cloud technologies. In this role, you will manage and enhance a petabyte-scale Data Lake and will create secure, efficient, and scalable environments for our data platforms. You will leverage cloud technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, while preparing to adopt Apache Iceberg for even greater performance and flexibility. You\'ll tackle high-performance data workloads, ensuring seamless execution of massive queries, including 600+ billion-row queries in Redshift, by designing and maintaining robust, scalable infrastructure. Our flat structure means that you will directly contribute to our strategy while taking ownership of a diverse range of projects utilising the latest technologies.

What you offer

• 
  
• Design, build, and optimise a petabyte-scale data platform powered by modern cloud technologies.
  
• Manage and enhance a petabyte-scale Data Lake; create secure, efficient, and scalable environments for data platforms.
  
• Leverage cloud technologies and AWS tools (S3, EKS, Glue, Airflow, Trino, Parquet) and prepare to adopt Apache Iceberg for greater performance and flexibility.
  
• Address high-performance data workloads and ensure robust, scalable infrastructure to support massive queries.
  
• Contribute to strategy and own a diverse range of projects using the latest technologies.
  

• 
  
• A dynamic individual with a strong Data, DevOps, and Engineering background who loves to solve data problems and build automation and CI/CD pipelines in the data space and cloud infrastructure.
  
• Good understanding of modern Data Platforms, Databases, Data Lakes, Data Warehouses and Query Engines, SQL/DDLs.
  
• Experience with Python coding/testing or any Cloud-based technology (AWS preferred).
  
• Good understanding of Hosting Platform Linux/Unix (EKS and Container experience is a plus).
  

• 
  
• 1 wellbeing leave day per year and a minimum of 25 days of annual leave.
  
• 26 weeks\' paid parental leave for primary caregivers along with 12 days of paid transition leave upon return to work and 6 weeks\' paid leave for secondary caregivers.
  
• Paid fertility leave for those undergoing or supporting fertility treatment.
  
• 2 days of paid volunteer leave and donation matching.
  
• Access to a wide range of salary sacrificing options.
  
• Benefits and initiatives to support your physical, mental and financial wellbeing including comprehensive medical and life insurance cover.
  
• Access to our Employee Assistance Program, a robust behavioural health network with counselling and coaching services.
  
• Access to a wide range of learning and development opportunities, including reimbursement for professional membership or subscription.
  
• Access to company funded emergency and backup dependent care services.
  
• Recognition and service awards.
  
• Hybrid and flexible working arrangements, dependent on role.
  
• Reimbursement for work from home equipment.
  

Technology enables every aspect of Macquarie, for our people, our customers and our communities. We\'re a global team that is passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications and designing tomorrow\'s technology solutions.

We are committed to providing a working environment that embraces equity and inclusion. We encourage people from all backgrounds to apply regardless of their race, gender, sexual orientation, disability, neurodiversity, age, religion or belief, or socio-economic background. We welcome further discussions on how you can feel included and belong at Macquarie as you progress through our recruitment process. We aim to provide reasonable adjustments to individuals as required during the recruitment process and in the course of employment. If you require additional assistance, please let us know during the application process.