National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Software Engineer - Model Evaluation and Productisation (Must be UK based)

PolyAI
London
7 months ago
Applications closed

Related Jobs

View all jobs

Software Engineer

Software Engineer

Software Engineer, Machine Learning and Electronic Design Automation

Software Engineer (Machine Learning)

Software Engineer (Leadership) - Machine Learning

Software Engineering Manager, Machine Learning

PolyAI is a leader in automating customer service through innovative voice technology. Our voice assistants empower businesses to deliver exceptional customer service at every interaction.

We are seeking a talented and hands-on Software Engineer with a strong data science background to join our team.

In this role, you will work on building software to enhance the visibility and configurability of large language models (LLMs). You will be responsible for rapidly developing tools and platforms to evaluate, iterate, and productionalize models, ensuring their reliability and accuracy.

We are looking for the right candidate, and therefore are flexible on the levelling for this position ranging from mid- level to senior!

Responsibilities:

  • Must have at least 2 years of Python experience
  • Must have at least 2+ years working experience
  • Develop software that provides visibility into LLM models and offers configurability for tuning and evaluation.
  • Build and maintain evaluation datasets and tools, enabling the measurement of model performance across key metrics.
  • Take a hands-on approach to quickly prototype, test, and iterate on solutions, moving from proof-of-concept to production.
  • Employ a data-driven methodology to drive model accuracy, leveraging evaluation results to inform decisions.
  • Collaborate with cross-functional teams to integrate developed tools and ensure they meet production standards.
  • Formulate hypotheses, design experiments, and collect data to validate model assumptions, consistently striving for improved reliability.
  • Communicate findings and ranking metrics clearly to both technical and non-technical stakeholders.

Why Join Us:

Join a dynamic and innovative team at the forefront of LLM development. You will have the opportunity to work on challenging projects, rapidly build impactful solutions, and drive data-informed improvements that push the boundaries of what LLMs can achieve.

Requirements

  • Degree in Computer Science, Data Science, or related field, or equivalent experience.
  • Strong proficiency in Python
  • Experience developing evaluation suites, datasets, and data-driven tools for model reliability testing.
  • Ability to rapidly prototype and iterate on solutions while maintaining a focus on production-level quality.
  • Strong problem-solving skills and a creative mindset, with the ability to hypothesize and validate results through experimentation.
  • Familiarity with cloud platforms such as AWS, GCP, or Azure is a plus.

Benefits

Participation in the company’s employee share options plan

25 days holiday, plus bank holidays

Flexible working from home policy plus a one-off WFH allowance when you join

Work from outside of the UK for up to 6 months each year

Enhanced parental leave

Yearly learning budget

Bike2Work scheme

Annual learning and development allowance

One-off WFH allowance when you join

‍ ‍Company-funded fertility and family-forming programmes

Menopause care programme with Maven

Private healthcare and dental cover, discounts on gym members and relaxation apps, and access to a range of mental health programs

Equal Opportunity Statement:

PolyAI is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

All employment decisions at PolyAI will be based on the business needs without attention to ethnicity, religion, sexual orientation, gender identity, family or parental status, national origin, neurodiversity status or disability status.

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs Salary Calculator 2025: Work Out Your Market Value in Seconds

Why your 2024 salary data is already outdated “Am I being paid what I’m worth?” It is the question that creeps in whenever you update your CV, see a former colleague announce a punchy pay rise on LinkedIn, or notice a recruiter slide into your inbox with a role that looks eerily similar to your current one—only advertised at £20k more. Artificial intelligence moves faster than any other hiring market. New frameworks are open‑sourced overnight, venture capital floods specific niches without warning, & entire job titles—Prompt Engineer, LLM Ops Specialist—appear in the time it takes most industries to schedule a meeting. In that environment, salary guides published only a year ago already look like historical curiosities. To give AI professionals an up‑to‑the‑minute benchmark, ArtificialIntelligenceJobs.co.uk has built a simple yet powerful salary‑calculation formula. By combining three variables—role, UK region, & seniority—you can estimate a realistic 2025 salary band in less than a minute. This article explains that formula, unpacks the latest trends driving pay, & offers concrete steps to boost your personal market value over the next 90 days.

How to Present AI Models to Non-Technical Audiences: A Public Speaking Guide for Job Seekers

In today’s competitive job market, AI professionals are expected to do more than just build brilliant algorithms—they must also explain them clearly to stakeholders who may have no technical background. Whether you're applying for a role as a machine learning engineer, data scientist, or AI consultant, your ability to articulate complex models in simple terms is fast becoming one of the most valued soft skills in interviews and on the job. This guide will help you master the art of public speaking for AI roles, offering tips on structuring presentations, designing effective slides, and using storytelling to make your work resonate with any audience.

AI Jobs UK 2025: 50 Companies Hiring Now

Bookmark this guide – we refresh it every quarter so you always know who’s really scaling their artificial‑intelligence teams. Artificial intelligence hiring has roared back in 2025. The UK’s boosted National AI Strategy funding, record‑breaking private investment (£18.1 billion so far) & a fresh wave of generative‑AI product launches mean employers are jockeying for data scientists, ML engineers, MLOps specialists, AI product managers, prompt engineers & applied researchers. Below are 50 organisations that have advertised UK‑based AI vacancies in the past eight weeks or formally announced growth plans. They’re grouped into five easy‑scan categories so you can jump straight to the kind of employer – & culture – that suits you. For each company you’ll find: Main UK hub Example live or recent vacancy Why it’s worth a look (tech stack, culture, mission) Use the internal links to browse current vacancies on ArtificialIntelligenceJobs.co.uk – or set up a free job alert so fresh roles land in your inbox.