Senior Software Engineer - LLM Infrastructure & HPC Clusters

European Tech Recruit
London
6 months ago
Applications closed

Related Jobs

View all jobs

Senior Software Engineer - AI & Machine Learning

Senior Software Engineer - AI & Machine Learning

Senior Software Engineer - AI & Machine Learning

Senior Software Engineer - AI & Machine Learning

Lead / Senior Software Engineer - ML/AI

Senior Data Scientist (Senior Software Engineer), BBC Verify

Senior Software Engineer - LLM Infrastructure & HPC Clusters


Within this position you will be joining a Leading AI Innovation Team as a Senior Software & Infrastructure Engineer improving their generative AI products with automated testing and evaluation. We are working with a London-based start-up dedicated to engineering cutting-edge AI systems poised to revolutionize industries worldwide.


As a leading Engineer, you will play a crucial role in developing a robust framework for rapid training and experimentation of large language models. Your responsibilities will include architecting an internal platform to facilitate high-throughput inference of these models. You will develop the core inference engine to seamlessly deploy large machine learning models to customers at scale and across distributed systems, contributing significantly to the automated pipeline, optimizing for high throughput training runs and rapid experimentation while achieving top hardware efficiency.


Please note that this role requires in-person presence in London, but this role offers visa sponsorship and relocation support. Candidates should possess a minimum of 2-3 years of professional experience in a similar capacity.


Qualifications:

We are seeking candidates with exceptional engineering evidenced by:

  • Experience in creating and managing high-performance computing clusters across GPU/TPU, preferably in PyTorch.
  • Proficiency in efficient serving of large machine learning models at scale, including quantization and distributed computing, leveraging libraries such as deepspeed.
  • Strong software engineering acumen with expertise in software design/architecture, particularly in Python.
  • Understanding of the latest AI research and ability to efficiently implement these systems.
  • Prior experience at a leading machine learning company (OpenAI, DeepMind, Meta, Anthropic, HuggingFace, etc.).

Nice to Have:

  • Experience as an early engineer at a fast-growing startup.
  • Interest in and consideration of the impacts of AI technology.


Key Words:Machine Learning / PyTorch / High Performance Computing / HPC / GPU / TPU / Deepspeed / AI / OpenAI / Distributed Systems / Big Data / ETL Pipeline / CUDA


By applying to this role, you understand that we may collect your personal data and store and process it on our systems. For more information please see our Privacy Notice https://eu-recruit.com/wp-content/uploads/2020/12/Privacy-Notice.pdf

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs in the Public Sector: MOD, NHS & Gov Digital Service Opportunities

Artificial intelligence (AI) has rapidly evolved from a niche field of computer science into a transformative force reshaping industries across the globe. From healthcare to finance and from education to defence, AI-driven tools and techniques are revolutionising how we approach problems, improve efficiency, and make data-driven decisions. Nowhere is this transformation more apparent than in the United Kingdom’s public sector. Key government entities, including the Ministry of Defence (MOD), the National Health Service (NHS), and the Government Digital Service (GDS), are increasingly incorporating AI into their operations. Consequently, AI jobs within these bodies are growing both in number and strategic importance. In this comprehensive blog post, we will explore the landscape of AI jobs across the UK public sector, with a close look at the MOD, the NHS, and the Government Digital Service. We will delve into the reasons these organisations are investing heavily in AI, the types of roles available, the essential skills and qualifications required, as well as the salary ranges one might expect. Whether you are a new graduate keen to make a meaningful impact through your technical skills or a seasoned professional looking for your next career move, the public sector offers a wealth of opportunities in AI. By the end of this article, you will have a clearer understanding of why AI is so crucial to the public sector’s success, which roles are in demand, and how you can tailor your application to stand out in a competitive and rewarding job market.

Contract vs Permanent AI Jobs: Which Pays Better in 2025?

n the ever-evolving world of technology, the competition for top talent in artificial intelligence (AI) is intense—and the rewards are significant. By 2025, AI roles in machine learning, natural language processing, data science, and robotics are expected to be among the highest-paid professions within the UK technology sector. As an AI professional, deciding between contracting (either as a day‑rate contractor or via fixed-term contracts) and permanent employment could drastically impact your take‑home pay, job security, and career trajectory. In this article, we will delve into the various types of AI roles in 2025—particularly focusing on day‑rate contracting, fixed-term contract (FTC) roles, and permanent positions. We will compare the earning potential across these three employment types, discuss the key pros and cons, and provide practical examples of how your annual take‑home pay might differ under each scenario. Whether you are already working in AI or looking to break into this booming field, understanding these employment options will help you make an informed decision on your next move.

AI Jobs for Non‑Technical Professionals: Where Do You Fit In?

Your Seat at the AI Table Artificial Intelligence (AI) has left the lab and entered boardrooms, high‑street banks, hospitals and marketing agencies across the United Kingdom. Yet a stubborn myth lingers: “AI careers are only for coders and PhDs.” If you can’t write TensorFlow, surely you have no place in the conversation—right? Wrong. According to PwC’s UK AI Jobs Barometer 2024, vacancies mentioning AI rose 61 % year‑on‑year, but only 35 % of those adverts required advanced programming skills (pwc.co.uk). The Department for Culture, Media & Sport (DCMS) likewise reports that Britain’s fastest‑growing AI employers are “actively recruiting non‑technical talent to scale responsibly” (gov.uk). Put simply, the nation needs communicators, strategists, ethicists, marketers and project leaders every bit as urgently as it needs machine‑learning engineers. This 2,500‑word guide shows where you fit in—and how to land an AI role without touching a line of Python.