Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

JOIN
Greater London
1 month ago
Create job alert

Backed by global technology visionaries like Sequoia Capital, Magentic brings together world-class AI engineering (from places like OpenAI, Meta, and AWS) with deep procurement expertise (formers from McKinsey & Company and ABInBev).


Our mission is to make global manufacturing supply chains robust to an ever-changing world - a $3tn market opportunity. We’re pushing the boundaries of AI with next-generation agentic systems that can manage entire workflows; deploying thoughtfully to maximising benefits while prioritising safety.


As out first Data Engineer you will work closely with ML engineers, product teams, and domain experts to transform raw supply chain data into structured, reliable, and actionable insights that drive decision-making across our platform, while ensuring that we build a platform capable of serving hundreds of Fortune 500 companies simultaneously.


This is an opportunity to work on deeply technical challenges with real-world impact at scale - we’re creating the data foundation for autonomous agents to reason, plan, and act in complex, high-stakes environments.


Tasks

In this role, you will:



  • Design and operate performant, scalable ingestion pipelines processing high-volume data from global supply chain and procurement systems.
  • Define, evolve, and manage data schemas and catalogues—from raw staging to high-quality analytics and feature stores—ensuring consistency and discoverability.
  • Build end-to-end monitoring and observability for your pipelines: owning data quality, latency, completeness, and lineage at every stage.
  • Champion secure, governed data practices: access controls, secrets management, encrypted data-in-transit/at-rest, and compliance with frameworks like GDPR.
  • Collaborate closely with AI, Platform, and Product teams, provisioning data sets, feature tables, and contracts for analytics and machine learning at scale.
  • Continuously improve efficiency and reliability via testing, CI/CD automation, cost/performance tuning, and incident/root-cause reviews.


Requirements

You may be a fit if you have:



  • Experience working at startups, scaleups or at companies with a big focus on data quality, DataOps and data management at scale.
  • Expertise in Cloud-Native Data Engineering: 5+ years building and running data warehouses and pipelines in AWS or Azure, including managed data services (e.g., Kinesis, EMR/Databricks, Redshift, Glue, Azure Data Lake).
  • Programming Mastery: Advanced skills in Python or another major language; writing clean, testable, production-grade ETL code at scale.
  • Modern Data Pipelines: Experience with batch and streaming frameworks (e.g., Apache Spark, Flink, Kafka Streams, Beam), including orchestration via Airflow, Prefect or Dagster.
  • Data Modeling & Schema Management: Demonstrated expertise in designing, evolving, and documenting schemas (OLAP/OLTP, dimensional, star/snowflake, CDC), data contracts, and data cataloguing.
  • API & Integration Fluency: Building data ingestion from REST/gRPC APIs, file drops, message queues (SQS, Kafka), and 3rd party SaaS integrations, with idempotency and error handling.
  • Storage & Query Engines: Strong with RDBMS (PostgreSQL, MySQL), NoSQL (DynamoDB, Cassandra), data lakes (Parquet, ORC), and warehouse paradigms.
  • Observability & Quality: Deep familiarity with metrics, logging, tracing, and data quality tools (e.g., Great Expectations, Monte Carlo, custom validation/test suites).
  • Security & Governance: Data encryption, secrets management, RBAC/ABAC, and compliance awareness (GDPR, CCPA).
  • CI/CD for Data Systems: Comfort with automation, infrastructure as code (Terraform), version control, and release workflows.
  • Collaborative Spirit: Experience working closely with platform, ML, and analytics teams in a fast-paced, mission-driven environment.


Benefits

Compensation and Benefits


At Magentic, we recognise and reward the talent that drives our success. We offer:



  • Competitive Equity: play a real part in Magentic’s upside.
  • A salary of £110,000-£120,000
  • Visa sponsorship available; (note we are only accepting candidates who are currently based in the UK.)
  • Hybrid London HQ (3-4 days in the office)
  • Annual team retreat—a fully-funded off-site to recharge, bond, and build.


About Magentic


At Magentic, we are committed to developing artificial intelligence that benefits humanity. We push the limits of AI's capabilities and are dedicated to its responsible and safe deployment. Recognising the profound impact of AI, we ensure that its development is centred around human needs and safety, incorporating a wide array of perspectives to fulfil our mission. We bring expertise from OpenAI, NASA, and McKinsey, and we’re backed by the best venture funds in the world.


We can’t wait to have you on board.


Equal Opportunities Statement


Magentic is committed to creating a diverse and inclusive workplace and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, gender, gender reassignment, marital or civil partnership status, age, disability, pregnancy or maternity, or any other basis as protected by the Equality Act 2010.


We actively encourage applications from candidates of all backgrounds and cultures and believe a diverse workforce enhances our ability to deliver innovative solutions. We also ensure that our employment decisions are based solely on individual qualifications, merit, and business needs.


Accommodations for Applicants with Disabilities


Magentic is dedicated to providing reasonable accommodations to job applicants with disabilities. If you require any adjustments during the recruitment process, please indicate this in your application or contact us directly



We’re building autonomous teammates for the supply chain and procurement teams that keep the world moving.


Supply‑chain and procurement teams run on grit and spreadsheets. Their days disappear inside labyrinthine ERP systems, while price shocks, regulatory twists, and sustainability targets pile on. We’ve felt that grind first‑hand, and we knew there had to be a better way.


Supply chains are the hidden engines of our world—complex, fragile, and too often overlooked until they break. We started Magentic when the world ran out of the medications that kept our families alive. That crisis drove us to build a technology that doesn’t just keep up—it stays miles ahead.

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Future of Data Science Jobs: Careers That Don’t Exist Yet

Data science has rapidly evolved into one of the most important disciplines of the 21st century. Once a niche field combining elements of statistics and computer science, it is now at the heart of decision-making across industries. Businesses, governments, and charities rely on data scientists to uncover insights, forecast trends, and build predictive models that shape strategy. In the UK, data science has become central to economic growth. From the NHS using data to improve patient outcomes to financial institutions modelling risk, the applications are endless. The UK’s thriving tech hubs in London, Cambridge, and Manchester are creating high demand for data talent, with salaries often outpacing other technology roles. Yet despite its current importance, data science is still in its infancy. Advances in artificial intelligence, quantum computing, automation, and ethics will transform what data scientists do. Many of the most vital data science jobs of the next two decades don’t exist yet. This article explores why new careers are emerging, the roles likely to appear, how current jobs will evolve, why the UK is well positioned, and how professionals can prepare now.

Seasonal Hiring Peaks for Data Science Jobs: The Best Months to Apply & Why

The UK's data science sector has matured into one of Europe's most intellectually rewarding and financially attractive technology markets, with roles spanning from junior data analysts to principal data scientists and heads of artificial intelligence. With data science positions commanding salaries from £30,000 for graduate data analysts to £140,000+ for senior principal scientists, understanding when organisations actively recruit can dramatically accelerate your career progression in this intellectually stimulating and rapidly evolving field. Unlike traditional analytical roles, data science hiring follows distinct patterns influenced by business intelligence cycles, research funding schedules, and machine learning project timelines. The sector's unique combination of mathematical rigour, business impact requirements, and cutting-edge technology adoption creates predictable hiring windows that strategic professionals can leverage to advance their careers in extracting insights from tomorrow's data. This comprehensive guide explores the optimal timing for data science job applications in the UK, examining how enterprise analytics strategies, academic research cycles, and artificial intelligence initiatives influence recruitment patterns, and why strategic timing can determine whether you join a pioneering AI research team or miss the opportunity to develop the next generation of intelligent systems.

Pre-Employment Checks for Data Science Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in data science reflects the discipline's unique position at the intersection of statistical analysis, machine learning innovation, and strategic business intelligence. Data scientists often have privileged access to comprehensive datasets, proprietary algorithms, and business-critical insights that form the foundation of organisational strategy and competitive positioning. The data science industry operates within complex regulatory frameworks spanning GDPR, sector-specific data protection requirements, and emerging AI governance regulations. Data scientists must demonstrate not only technical competence in statistical modelling and machine learning but also deep understanding of research ethics, data privacy principles, and the societal implications of algorithmic decision-making. Modern data science roles frequently involve analysing personally identifiable information, financial data, healthcare records, and sensitive business intelligence across multiple jurisdictions and regulatory frameworks simultaneously. The combination of analytical privilege, predictive capabilities, and strategic influence makes thorough candidate verification essential for maintaining compliance, security, and public trust in data-driven insights and automated systems.