Strategy and Delivery Adviser - AI Safety Institute

Department for Science, Innovation & Technology
London
1 year ago
Applications closed

Related Jobs

View all jobs

Head of DevOps and DataOps

Senior Data Scientist

Senior Manager, Data Science - eBay Live

Artificial Intelligence Specialist

Machine Learning Engineer (Manager)

Machine Learning Engineer (Manager)

Job summary

AI is bringing about huge changes to society, and it is our job as a team to work out how Government should respond. It is a once-in-a-generation moment, and an incredibly fast-paced and exciting environment.�

AI Safety Institute

Advances in artificial intelligence (AI) over the last decade have been impactful, rapid, and unpredictable. AdvancedAIsystems have the potential to drive economic growth and productivity, boost health and wellbeing, improve public services, and increase security.�

But advancedAIsystems also pose significant risks, as detailed in the government�s paper onpublished in be misused � this could include usingAIto generate disinformation, conduct sophisticated cyberattacks or help develop chemical cause societal harms � there have been examples ofAIchatbots encouraging harmful actions, promoting skewed or radical views, and providing biased advice.AIgenerated content that is highly realistic but false could reduce public trust in information. Some experts are concerned that humanity could lose control of advanced systems, with potentially catastrophic and permanent consequences. We will only unlock the benefits ofAIif we can manage these risks. At present, our ability to develop powerful systems outpaces our ability to make them safe. The first step is to better understand the capabilities and risks of these advancedAIsystems. This will then inform our regulatory framework forAI, so we ensureAIis developed and deployed safely and responsibly.�

The UK is taking a leading role in driving this conversation forward internationally. We hosted the world�s first major and have launched the AI Safety Institute. Responsible government action in an area as new and fast-paced as advancedAIrequires governments to develop their own sophisticated technical and sociotechnical AI Safety Institute is advancing the world�s knowledge ofAIsafety by carefully examining, evaluating, and testing new types ofAI, so that we understand what each new model is capable of. The Institute is conducting fundamental research on how to keep people safe in the face of fast and unpredictable progress inAI. The Institute will make its work available to the world, enabling an effective global response to the opportunities and risks of advancedAI.�

Job description

As a Strategy and Delivery Adviser, you will be working with a team of research scientists and engineers to drive forward cutting-edge AI safety research on the highest priority issues.�

You�ll provide crucial support for a team working on a specific set of AI safety issues: cyber risks, chem-bio risks, or safety cases (see below for further details).�

You might work on building a research strategy for your team, writing submissions and briefs for seniors and ministers, setting up and managing research partnerships, organising events and workshops, forging strong relationships with external stakeholders like major AI companies and other governments, coordinating model tests, or engaging the cross-Whitehall community to ensure our work has impact.�

These are multi-faceted roles which involve a mixture of strategy, policy and project management. They will be suitable for people who love getting things done, but who also enjoy big picture thinking and engaging with technical detail.�

Successful applicants will work within one of the three following workstreams. If you have a strong preference for any of these, please do state as much in your personal statement:�

Cyber Misuse

The aim of the Cyber Misuse team is to deeply understand, assess and mitigate the risks from AI uplifting threat actors in conducting cyber-attacks. This involves developing risk and capability thresholds for cyber that focus on the greatest expected harm, building evaluations that assess for the priority capabilities identified and running these evaluations as part of pre-deployment and lifecycle testing exercises.��

In this role you will support with setting out the strategy and delivery of projects that develop our risk modelling or build new evaluations. These projects could range from research and human uplift studies to creating complex automated cyber evaluations. You will contribute to the development of our risk and capability thresholds and communicate our work to key stakeholders by producing briefings and building relationships across government and externally.� While we don�t expect you to have a technical or a cybersecurity background, we strongly encourage participants with relevant experience to apply.��

Safety Cases

Safety cases are already used as standard in other industries and are structured arguments that a system is unlikely to cause significant harm if deployed in a particular setting. As the AI frontier develops, we expect safety cases could become an important tool for mitigating AI safety risks, whereby AI companies set out detailed arguments for how they have ensured their models are safe. We believe it is possible to significantly develop our understanding of what a good safety case would look like now, even though the field is far from knowing how to write a detailed safety case.�

In this role, you�ll support the safety cases policy / strategy lead to ensure that this research has an impact on the safety of AI systems. Strong candidates will have a pre-existing interest in AI safety, and be able to clearly and thoughtfully analyse a safety case for an AI system (although we don�t expect candidates to have a technical background or ML expertise). Alongside strategy and delivery responsibilities, you might attend cross-government meetings on AI policy, or write policy or academic papers on the use of AI safety cases.�

Key responsibilities (indicative, with some variation across workstreams):�

Overseeing the delivery of a suite of research projects by our in-house technical team and select external research partners� Working with our technical researchers to devise and deliver new research projects, in line with AISI�s strategic objectives, and turning their outputs into useful outputs for policy makers� Helping shape and define the longer-term strategy of the team and contributing to the wider research vision of the AISI Acting as a point person on the AISI�s research agenda, communicating the work of the team to senior officials and ministers within AISI and across Whitehall� Working with National Security partners in organisations across the UK Government� Building and leveraging a network of research partners and policy stakeholders within and outside of government� Coordinating the delivery of pre- and post-deployment model tests

Person specification

These are fast-paced and challenging roles, with the potential to have a massive impact on the work of the AI Safety Institute. We are looking for exceptional operators who can drive things forward and take responsibility for achieving the objectives of the team. You will be excellent at building strong, trusting relationships, problem-solving, and co-ordinating complex projects.�

Essential criteria

Start-up mindset / entrepreneurial approach; this will involve navigating in a lot of uncertainty, being quick to adapt, taking a 'trial and get feedback quickly' approach to a lot of pieces of work, and being willing to get stuck in and add value�Passionate about the mission of the AI Safety Institute, and ideally with a good working knowledge of issues at the intersection between AI and cyber or issues related to AI alignmentAble to work effectively at pace, make decisions in the face of competing priorities, and remain calm and resilient under pressure Able to manage a wide-range of diverse stakeholders to achieve goalsProactive and able to identify solutions to complex problems� breaking down large, intractable issues into tangible, and effective next stepsCan operate with autonomyand �self-drive� workExcellent written and oral communication skills, able to communicate effectively, with a range of expert and non-expert stakeholdersExperience managing complex projects with multiple stakeholders

Behaviours

We'll assess you against these behaviours during the selection process:

Delivering at Pace Communicating and Influencing

Benefits

Alongside your salary of �42,495, Department for Science, Innovation & Technology contributes �12,310 towards you being a member of the Civil Service Defined Benefit Pension scheme.

The Department for Science, Innovation and Technology offers a competitive mix of benefits including:

A culture of flexible working, such as job sharing, homeworking and compressed hours. Automatic enrolment into the , with an employer contribution of A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30. An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue. Access to a range of retail, travel and lifestyle employee discounts.

Office attendance

The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home based location for 40-60% of the time over the accounting period.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Changing career into artificial intelligence in your 30s, 40s or 50s is no longer unusual in the UK. It is happening quietly every day across fintech, healthcare, retail, manufacturing, government & professional services. But it is also surrounded by hype, fear & misinformation. This article is a realistic, UK-specific guide for career switchers who want the truth about AI jobs: what roles genuinely exist, what skills employers actually hire for, how long retraining really takes & whether age is a barrier (spoiler: not in the way people think). If you are considering a move into AI but want facts rather than Silicon Valley fantasy, this is for you.

How to Write an AI Job Ad That Attracts the Right People

Artificial intelligence is now embedded across almost every sector of the UK economy. From fintech and healthcare to retail, defence and climate tech, organisations are competing for AI talent at an unprecedented pace. Yet despite the volume of AI job adverts online, many employers struggle to attract the right candidates. Roles are flooded with unsuitable applications, while highly capable AI professionals scroll past adverts that feel vague, inflated or disconnected from reality. In most cases, the issue isn’t a shortage of AI talent — it’s the quality of the job advert. Writing an effective AI job ad requires more care than traditional tech hiring. AI professionals are analytical, sceptical of hype and highly selective about where they apply. A poorly written advert doesn’t just fail to convert — it actively damages your credibility. This guide explains how to write an AI job ad that attracts the right people, filters out mismatches and positions your organisation as a serious employer in the AI space.

Maths for AI Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are a software engineer, data scientist or analyst looking to move into AI or you are a UK undergraduate or postgraduate in computer science, maths, engineering or a related subject applying for AI roles, the maths can feel like the biggest barrier. Job descriptions say “strong maths” or “solid fundamentals” but rarely spell out what that means day to day. The good news is you do not need a full maths degree worth of theory to start applying. For most UK roles like Machine Learning Engineer, AI Engineer, Data Scientist, Applied Scientist, NLP Engineer or Computer Vision Engineer, the maths you actually use again & again is concentrated in a handful of topics: Linear algebra essentials Probability & statistics for uncertainty & evaluation Calculus essentials for gradients & backprop Optimisation basics for training & tuning A small amount of discrete maths for practical reasoning This guide turns vague requirements into a clear checklist, a 6-week learning plan & portfolio projects that prove you can translate maths into working code.