Senior Big Data Engineer - AI Forecasting

Get AI-powered advice on this job and more exclusive features.
Company Description We’re ASOS, the online retailer for fashion lovers all around the world.
We exist to give our customers the confidence to be whoever they want to be, and that goes for our people too. At ASOS, you’re free to be your true self without judgement, and channel your creativity into a platform used by millions.
We’re proud members of Inclusive Companies, are Disability Confident Committed, and have signed the Business in the Community Race at Work Charter. We ranked 8th in the Inclusive Top 50 Companies Employer list.
Let our Talent team know if you need any adjustments throughout the process in whatever way works best for you.
Job Description We are looking for a Senior Big Data Engineer to join our cross-functional AI Forecasting team. You will collaborate with machine learning engineers and scientists to solve problems and productionise innovative solutions leveraging cutting-edge technology.
ASOS Technology is transitioning towards a product operating model, supporting our global growth with strategic programmes to deliver advanced technology and business solutions.
The Digital Data Engineering team provides high-quality, scalable data solutions across the ASOS Digital Domain, advocating best practices, modern technologies, and education for development teams.
As a Data Engineer, you will deliver critical projects, optimize data pipelines, support production applications, develop proof of concepts, and ensure high standards and best practices. You will also stay abreast of emerging data technologies and industry trends, build strong relationships across teams, and implement data quality and observability checks.
What you'll be doing: Develop solutions using Microsoft Azure and Databricks, ensuring simplicity, testability, deployability, and operational monitoring.
Optimize data pipelines and frameworks for easier development.
Support production data applications and infrastructure.
Create proof of concepts, evaluate performance, data modeling, and costs.
Collaborate with team leads and product managers to maintain standards and practices.
Work within an agile, cross-functional team, taking responsibility for deliverables and quality.
Stay updated with emerging data technologies and trends.
Build relationships with business, science, analytics, and engineering teams.
Automate data quality and observability checks, proactively surfacing issues.
Qualifications We seek experienced Data Engineers passionate about data, eager to implement best practices in a dynamic environment.
Proficiency in Spark/PySpark, Azure data technologies, Python or Scala, SQL.
Experience with testing frameworks like pytest or ScalaTest.
Knowledge of open table formats such as Delta, Iceberg, or Apache Hudi.
Experience with CI/CD workflows using Azure DevOps, GitHub Actions, and version control systems like GIT.
Understanding of cloud infrastructure and Infrastructure as Code (Terraform or Bicep).
Excellent communication, analytical, and problem-solving skills.
Proven track record in delivering complex, high-volume, high-quality data solutions.
Experience with cloud-based solutions and agile methodologies like Scrum or Kanban.
Nice to have skills: Experience in retail or e-commerce.
Knowledge of Big Data and Distributed Computing.
Familiarity with streaming technologies like Spark Structured Streaming or Apache Flink.
Additional programming skills in PowerShell or Bash.
Understanding of Databricks Ecosystem components.
Experience with Data Observability or Data Quality frameworks.
Additional Information What's in it for you? Competitive salary, pension, private medical care.
Performance bonus, flexible benefits, 25 days holiday + birthday off.
Employee discount, tech development programs, opportunities to represent ASOS at industry events.
Drive diversity and inclusion initiatives in tech, work with cutting-edge technology, and make an impact from day one.
Check #InsideASOS on social media to see what life at ASOS is like, or listen to our Tech Podcast and read our Tech Blog for more insights.
Seniority level Mid-Senior level
Employment type Full-time
Job function Information Technology
Industries Retail

#J-18808-Ljbffr