Senior Data Scientist (Agent Evaluation & Optimisation)

Swap
London
5 days ago
Create job alert

London


About Swap

Swap is the infrastructure behind modern agentic commerce. The only AI-native platform connecting backend operations with a forward-thinking storefront experience.


Built for brands that want to sell anything—anywhere, Swap centralizes global operations, powers intelligent workflows, and unlocks margin‑protecting decisions with real‑time data and capability. Our products span cross‑border, tax, returns, demand planning, and our next‑generation agentic storefront, giving merchants full transparency and the ability to act with confidence.


At Swap, we’re building a culture that values clarity, creativity, and shared ownership as we redefine how global commerce works.


About the Role

As a Senior Data Scientist, you’ll help build the intelligence layer behind Swap’s agentic storefront, making our AI agents feel helpful, consistent, and trustworthy. This is a hands‑on role focused on agent components like memory, multimodal or VTO workflows, and our voice agent. You’ll work closely with product and engineering and have real ownership over what we build and Stair how it evolves.


Key responsibilities

  • Agent architecture & component design: Design and evolve the agent system and its components (memory, tool use, workflows), with clear interfaces and reliable behaviour. Partner with engineering to integrate retrieval and search capabilities into agent flows.
  • Evaluation‑first improvement: Build evaluation harnesses (offline and online) to measure quality, reliability, and task completion. Define rubrics, golden sets, regression tests, and lightweight dashboards. Run experiments (A/B tests where appropriate) and translate results into concrete product improvements.
  • Memory systems (Python): Implement and iterate on memory. Capture relevant user and context signals, improve retrieval and selection, and evaluate usefulness and failure modes. Establish feedback loops to learn from real interactions and systematically reduce errors.
  • Multimod tientallen or VTO (Python): Iterate on visual and multimodal workflows using APIs. Evaluate outputs, identify failure patterns, and improve prompts, tools, and data. Build pragmatic test sets for multimodal૩ quality and user‑perceived outcomes.
  • Voice agent experience (TypeScript and product sensibility): Help develop the voice agent. Evaluate the end‑to‑end experience, craft the persona, add tools, call APIs, and iterate. You don’t need to be a TypeScript expert, but you should be willing to work in it and learn fast. concursos;ol>
  • Prompting & tool reliability: Create and refine prompts, tool schemas, and structured outputs to reliably execute multi‑step workflows. Add practical guardrails such as fallbacks, error handling, logging and tracing hooks, and regression checks.

What we would like to see

Must‑haves



  • 3+ years experience driving data‑driven optimisation (GenAI products and/or data science problems), with a track record of shipping improvements.
  • Strong evaluation mindset. You have built measurement frameworks, test sets, or experimentation loops that make systems measurably better.
  • Solid system and architecture thinking for agent‑like products, including clear interfaces, iterative improvement, and pragmatic tradeoffs.
  • Strong Python engineering, and comfortable integrating with APIs. You can build quick, reliable prototypes and harden them over time.
  • Comfort working closely with product and engineering and owning outcomes end‑to‑end.
  • Experience with voice systems, multimodal workflows, or building agent tools.
  • Some TypeScript experience, or strong willingness to learn.
  • E‑commerce or marketplace familiarity.
  • Stock options in a high‑growth startup
  • Competitive PTO with public holidays additional
  • Private Health
  • Wellness benefits
  • Breakfast Mondays

Diversity & Equal Opportunities

We embrace diversity and equality in a serious way. We are committed to building a team with a variety of backgrounds, skills, and views. The more inclusive we are, the better our work will be. Creating a culture of equality isn’t just the right thing to do; it’s also the smart thing.


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Scientist

Senior Data Scientist

Senior Data Scientist

Senior Data Scientist

Senior Data Scientist

Senior Data Scientist

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data science in your 30s, 40s or 50s? You’re far from alone. Across the UK, businesses are investing in data science talent to turn data into insight, support better decisions and unlock competitive advantage. But with all the hype about machine learning, Python, AI and data unicorns, it can be hard to separate real opportunities from noise. This article gives you a practical, UK-focused reality check on data science careers for mid-life career switchers — what roles really exist, what skills employers really hire for, how long retraining typically takes, what UK recruiters actually look for and how to craft a compelling career pivot story. Whether you come from finance, marketing, operations, research, project management or another field entirely, there are meaningful pathways into data science — and age itself is not the barrier many people fear.

How to Write a Data Science Job Ad That Attracts the Right People

Data science plays a critical role in how organisations across the UK make decisions, build products and gain competitive advantage. From forecasting and personalisation to risk modelling and experimentation, data scientists help translate data into insight and action. Yet many employers struggle to attract the right data science candidates. Job adverts often generate high volumes of applications, but few applicants have the mix of analytical skill, business understanding and communication ability the role actually requires. At the same time, experienced data scientists skip over adverts that feel vague, inflated or misaligned with real data science work. In most cases, the issue is not a lack of talent — it is the quality and clarity of the job advert. Data scientists are analytical, sceptical of hype and highly selective. A poorly written job ad signals unclear expectations and immature data practices. A well-written one signals credibility, focus and serious intent. This guide explains how to write a data science job ad that attracts the right people, improves applicant quality and positions your organisation as a strong data employer.

Maths for Data Science Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for data science jobs in the UK, the maths can feel like a moving target. Job descriptions say “strong statistical knowledge” or “solid ML fundamentals” but they rarely tell you which topics you will actually use day to day. Here’s the truth: most UK data science roles do not require advanced pure maths. What they do require is confidence with a tight set of practical topics that come up repeatedly in modelling, experimentation, forecasting, evaluation, stakeholder comms & decision-making. This guide focuses on the only maths most data scientists keep using: Statistics for decision making (confidence intervals, hypothesis tests, power, uncertainty) Probability for real-world data (base rates, noise, sampling, Bayesian intuition) Linear algebra essentials (vectors, matrices, projections, PCA intuition) Calculus & gradients (enough to understand optimisation & backprop) Optimisation & model evaluation (loss functions, cross-validation, metrics, thresholds) You’ll also get a 6-week plan, portfolio projects & a resources section you can follow without getting pulled into unnecessary theory.