National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior Software Engineer - LLM Infrastructure & HPC Clusters

European Tech Recruit
London
9 months ago
Applications closed

Related Jobs

View all jobs

Senior Software Engineer

Senior Software Engineer C# - Near Edinburgh Hybrid

Senior Software Engineer – API & ML Infrastructure

Senior Software Engineer, Data Science

Senior C++ Software Engineer

Software Engineer - Data Science

Senior Software Engineer - LLM Infrastructure & HPC Clusters


Within this position you will be joining a Leading AI Innovation Team as a Senior Software & Infrastructure Engineer improving their generative AI products with automated testing and evaluation. We are working with a London-based start-up dedicated to engineering cutting-edge AI systems poised to revolutionize industries worldwide.


As a leading Engineer, you will play a crucial role in developing a robust framework for rapid training and experimentation of large language models. Your responsibilities will include architecting an internal platform to facilitate high-throughput inference of these models. You will develop the core inference engine to seamlessly deploy large machine learning models to customers at scale and across distributed systems, contributing significantly to the automated pipeline, optimizing for high throughput training runs and rapid experimentation while achieving top hardware efficiency.


Please note that this role requires in-person presence in London, but this role offers visa sponsorship and relocation support. Candidates should possess a minimum of 2-3 years of professional experience in a similar capacity.


Qualifications:

We are seeking candidates with exceptional engineering evidenced by:

  • Experience in creating and managing high-performance computing clusters across GPU/TPU, preferably in PyTorch.
  • Proficiency in efficient serving of large machine learning models at scale, including quantization and distributed computing, leveraging libraries such as deepspeed.
  • Strong software engineering acumen with expertise in software design/architecture, particularly in Python.
  • Understanding of the latest AI research and ability to efficiently implement these systems.
  • Prior experience at a leading machine learning company (OpenAI, DeepMind, Meta, Anthropic, HuggingFace, etc.).

Nice to Have:

  • Experience as an early engineer at a fast-growing startup.
  • Interest in and consideration of the impacts of AI technology.


Key Words:Machine Learning / PyTorch / High Performance Computing / HPC / GPU / TPU / Deepspeed / AI / OpenAI / Distributed Systems / Big Data / ETL Pipeline / CUDA


By applying to this role, you understand that we may collect your personal data and store and process it on our systems. For more information please see our Privacy Notice https://eu-recruit.com/wp-content/uploads/2020/12/Privacy-Notice.pdf

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs Skills Radar 2026: Emerging Frameworks, Languages & Tools to Learn Now

As the UK’s AI sector accelerates towards a £1 trillion tech economy, the job landscape is rapidly evolving. Whether you’re an aspiring AI engineer, a machine learning specialist, or a data-driven software developer, staying ahead of the curve means more than just brushing up on Python. You’ll need to master a new generation of frameworks, languages, and tools shaping the future of artificial intelligence. Welcome to the AI Jobs Skills Radar 2026—your definitive guide to the emerging AI tech stack that employers will be looking for in the next 12–24 months. Updated annually for accuracy and relevance, this guide breaks down the top tools, frameworks, platforms, and programming languages powering the UK’s most in-demand AI careers.

How to Find Hidden AI Jobs in the UK Using Professional Bodies like BCS, IET & the Turing Society

When it comes to job hunting in artificial intelligence (AI), most candidates head straight to traditional job boards, LinkedIn, or recruitment agencies. But what if there was a better way to find roles that aren’t advertised publicly? What if you could access hidden job leads, gain inside knowledge, or get referred by people already in the field? That’s where professional bodies and specialist AI communities come in. In this article, we’ll explore how UK-based organisations like BCS (The Chartered Institute for IT), IET (The Institution of Engineering and Technology), and the Turing Society can help you uncover AI job opportunities you won’t find elsewhere. We'll show you how to strategically use their directories, special-interest groups (SIGs), and CPD (Continuing Professional Development) events to elevate your career and expand your AI job search in ways most job seekers overlook.

How to Get a Better AI Job After a Lay-Off or Redundancy

Being made redundant or laid off can feel like the rug has been pulled from under you. Whether part of a wider company restructuring, budget cuts, or market shifts in tech, many skilled professionals in the AI industry have recently found themselves unexpectedly jobless. But while redundancy brings immediate financial and emotional stress, it can also be a powerful catalyst for career growth. In the fast-evolving field of artificial intelligence, where new roles and specialisms emerge constantly, bouncing back stronger is not only possible—it’s likely. In this guide, we’ll walk you through a step-by-step action plan for turning redundancy into your next big opportunity. From managing the shock to targeting better AI jobs, updating your CV, and approaching recruiters the smart way, we’ll help you move from setback to comeback.