Artificial Intelligence Engineer - Distributed Inference (Hiring Immediately)

Placed
Birmingham
1 month ago
Applications closed

Related Jobs

View all jobs

Principal Data Scientist/Artificial Intelligence Engineer

Head of Artificial Intelligence

Head of Artificial Intelligence

Senior AI Engineer

AI Specialist

Senior Data Engineer

AI Engineer - Distributed Inference Specialist


Do you want to be a spectator or a player as the world races to develop AGI?

Are you ready to be a pioneer of AI?


Why join us?


AtDanucore, we are on the hunt forBRILLIANT MINDSto join a team of visionaries and innovators dedicated to building distributedsupercomputersandAI systemswhich are:


Faster️ –from building and deploying AI datacentres at speed to optimising the AI workloads that run on them we want to be the fastest


CheaperAI should be accessible to all. We lower the costs of AI deployment with careful hardware deployments and software systems to ensure efficient resource utilisation.


KinderOur systems are designed to benefit humanity. We do not allow our systems to participate in military, gambling or pornography applications


GreenerWe optimise energy consumption with an integrated hardware and software solution to leverage renewable energy, optimise heat recovery - all running under energy aware orchestration systems to optimise workloads


ClevererWe develop agentic AI systems and to make our systems intelligent and constantly improving


Help us build systems to ensure the power of frontier AI remainsaccessibleand give userssovereigntyover their AI systems


Join us in ensuring that the most transformative technology in human history remains in the hands of humanity itself. Let's make AI development transparent, accessible, and aligned with the interests of humanity, not just the profits of a few. ⚡


About the Role


This role is for those obsessed with pushing the boundaries of AI model performance.


We're looking for someone who gets excited about shaving milliseconds off inference time, every percentage point of GPU utilization gained and how many Watts were consumed to achieve it. ⚡️


You'll work directly with cutting-edge models — from LLMs to multimodal systems — and large GPU clusters, finding innovative ways to make them run faster, more efficiently, and more accessibly on diverse hardware setups. ️


What We're Looking For


In team members:


  • Passion for AI: A strong desire to influence the future of technology and its societal impact.
  • Willingness to Learn: we're looking for future experts with curious minds and a growth mindset.
  • Open-Mindedness: Ready to challenge the norm and think outside the box?


and for the role:


  • Evidence of deploying and optimising AI models in multi gpu and multi node systems ️ ️
  • Good working knowledge of leading AI runtimes: PyTorch, vLLM, TensorRT, ONNX Runtime, Llama.cpp ‍♂️‍➡️⏱️o
  • Experience with distributed inference engines: Ray Serve, Triton Inference Server, vLLM, SLURM
  • Knowledge of AI compilers: OpenXLA, torch.compile, OpenAI's triton, MLIR, Mojo, TVM, MLC-LLM ⚙️
  • Good working knowledge of inter-process communication: message queues, MPI, NCCL, gRPC
  • Good working knowledge of high performance networking: RDMA, RoCE, Infiniband, NVIDIA GPUDirect, NVLink, NVIDIA DOCA, MagnumIO, dpdk, spdk
  • Experience with model quantisation, pruning, and sparsity techniques for performance optimisation.


And bonus points if you have:

  • a homelab, blog, or a collection of git repos showcasing your talents and interests ‍ ‍
  • made contributions to open-source projects or publications in the field of AI/ML systems optimisation


Let us know which of the above you have worked with / are relevant in your cover letter! ✨


Key Responsibilities


  • Design and implement high-performance distributed inference systems for running large language models and multimodal AI models at scale
  • Optimise model serving infrastructure for maximum throughput, minimal latency, and optimal power efficiency ⚡
  • Develop and maintain deployment pipelines for efficient model serving, and monitoring in production
  • Research and implement cutting-edge techniques in model optimisation, including pruning, quantisation, and sparsity methods ‍
  • Design, build and configure experimental hardware setups for model serving and optimisation ️
  • Design and implement robust testing frameworks to ensure reliable model serving ✅
  • Collaborate with the team to build and improve our distributed inference platform, making it more accessible and efficient for users
  • Monitor, optimise and document system performance metrics, including latency, throughput, power consumption and benchmark scores



How Can We Tempt You?


Exceptional Financial Package: Enjoy a competitive compensation structure, including an enticing EMI scheme that rewards your brilliance.


Envious Compute Power: Gain access to a vast array of cutting-edge computing resources to bring your ideas to life!


Support for Your Vision: We believe that the brightest minds often have their own innovative projects. Let's collaborate! Share your ideas, and work with our team and support network to make them happen!


Make an Impact: Join a passionate team dedicated to creating positive change in the world. The future is ours to shape, and together we can ensure it's for the better.


Dynamic Start-Up Culture: Dive in from day one! Experience the thrill of a start-up environment where you can roll up your sleeves and make a real difference right away.



How to Apply

Email your cover letter and CV to with subject AI Engineer - Distributed Inference

In your cover letter, please include details of:

  • what parts or technologies mentioned in this job advert you have experience with and can add value with
  • links to any public work e.g. github profile, blogs or papers

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Navigating Data Science Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Data science has taken centre stage in the modern workplace. Organisations rely on data-driven insights to shape everything from product innovation and customer experience to operational efficiency and strategic planning. As a result, there is a growing need for skilled data scientists who can analyse large volumes of data, build predictive models, communicate findings effectively, and collaborate cross-functionally. If you are looking to accelerate your data science career—or even land your first role—attending data science career fairs can be a game-changer. Unlike traditional online applications, face-to-face interactions let you showcase your personality, passion, and communication skills in addition to your technical expertise. However, to stand out in a busy environment, you need a clear strategy: from polishing your personal pitch and asking thoughtful questions to following up with a memorable message. In this article, we’ll guide you through every step of making a strong impression at data science career fairs in the UK and beyond.

Common Pitfalls Data Science Job Seekers Face and How to Avoid Them

Data science has become a linchpin for decision-making and innovation across countless industries, from finance and healthcare to tech and retail. The demand for data scientists in the UK continues to climb, with businesses seeking professionals who can interpret complex datasets, build predictive models, and communicate actionable insights. Despite this high demand, the job market can be extremely competitive—and many applicants unknowingly fall into avoidable traps. Whether you’re an aspiring data scientist fresh out of university, a professional transitioning from a quantitative role, or a seasoned analyst looking to expand your skill set, it’s crucial to navigate your job search effectively. In this article, we explore the most common pitfalls data science job seekers face and provide pragmatic advice to help you stand out. By refining your CV, portfolio, interview strategies, and communication skills, you can significantly increase your chances of landing a rewarding data science role. If you’re looking for your next data science job in the UK, don’t forget to explore the listings at Data Science Jobs. Read on to discover how to avoid critical mistakes and position yourself for success.

Career Paths in Data Science: From Entry-Level Analysis to Leadership and Beyond

Data is the lifeblood of modern business, and Data Scientists are the experts who turn raw information into strategic insights. From building recommendation engines to predicting market trends, the impact of data science extends across virtually every industry—finance, healthcare, retail, manufacturing, and beyond. In the UK, data-driven decision-making is critical to remaining competitive in a global market, making data science one of the most sought-after career paths. But how does one launch a career in data science, and how can professionals progress from entry-level analysts to senior leadership roles? In this comprehensive guide, we’ll explore the typical career trajectory, from junior data scientist to chief data officer, discussing the key skills, qualifications, and strategic moves you need to succeed. Whether you’re a recent graduate, transitioning from another technical field, or an experienced data scientist aiming for management, you’ll find actionable insights on forging a successful career in the UK data science sector.