Data Science Subject Matter Expert - AI Evaluation (UK-Remote)

Braintrust
Edinburgh
2 months ago
Applications closed

Related Jobs

View all jobs

Data Science Lead

Data Science Practitioner

Data Science & Machine Learning - Senior Associate - Asset Management

Senior Data Scientist

Lead Data Scientist

Data Scientist

Data Science Subject Matter Expert - AI Evaluation (UK-Remote)

16 hours ago Be among the first 25 applicants


This range is provided by Braintrust. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.


Base pay range

$75.00/hr - $90.00/hr


Job Description:


Seeking multiple Data Science Subject Matter Experts to help design, run, and optimize data collection and evaluation workflows for GenAI research.


You’ll translate high-level research needs into scalable processes, produce and curate challenging domain problems, and ensure factual, bias-aware, high-quality datasets for LLM training.



  • To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands.
  • To Note: Hourly rate range (75 - 90) is in USD per hour

Responsibilities:



  • Partner with GenAI researchers/engineers to capture data needs and success criteria.
  • Expand high-level requirements into clear, executable workflows for larger teams.
  • Execute collection/evaluation workflows rapidly with minimal supervision.
  • Innovate on workflows to maximize throughput and quality.
  • Collaborate cross-functionally to maintain quality at scale.
  • Conduct in-depth LLM-assisted research; gather reliable, up-to-date info.
  • Craft original, high-quality content and hard problems for LLM eval/train.
  • Perform rigorous fact-checking (precision/recall) to prevent misinformation.

Requirements:



  • Education: Master’s with distinction or PhD in Data Science; top-tier institution preferred. Significant domain experience considered.
  • Detail orientation; precise data presentation; thorough proofreading.
  • Communication: articulate complex info; strong collaboration.
  • Understanding of AI/LLMs, their capabilities/limits.
  • Prompt engineering and familiarity with AI writing tools.
  • Ethical AI awareness and data literacy (collection, cleaning, transformation).
  • Thrives in fast-paced, minimally supervised environments.

Seniority level
  • Entry level

Employment type
  • Full-time

Job function
  • Engineering, Information Technology, and Science

Industries
  • Technology, Information and Internet, Data Infrastructure and Analytics, and IT System Data Services


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many AI Tools Do You Need to Know to Get an AI Job?

If you are job hunting in AI right now it can feel like you are drowning in tools. Every week there is a new framework, a new “must-learn” platform or a new productivity app that everyone on LinkedIn seems to be using. The result is predictable: job seekers panic-learn a long list of tools without actually getting better at delivering outcomes. Here is the truth most hiring managers will quietly agree with. They do not hire you because you know 27 tools. They hire you because you can solve a problem, communicate trade-offs, ship something reliable and improve it with feedback. Tools matter, but only in service of outcomes. So how many AI tools do you actually need to know? For most AI job seekers: fewer than you think. You need a tight core toolkit plus a role-specific layer. Everything else is optional. This guide breaks it down clearly, gives you a simple framework to choose what to learn and shows you how to present your toolset on your CV, portfolio and interviews.

What Hiring Managers Look for First in AI Job Applications (UK Guide)

Hiring managers do not start by reading your CV line-by-line. They scan for signals. In AI roles especially, they are looking for proof that you can ship, learn fast, communicate clearly & work safely with data and systems. The best applications make those signals obvious in the first 10–20 seconds. This guide breaks down what hiring managers typically look for first in AI applications in the UK market, how to present it on your CV, LinkedIn & portfolio, and the most common reasons strong candidates get overlooked. Use it as a checklist to tighten your application before you click apply.

The Skills Gap in AI Jobs: What Universities Aren’t Teaching

Artificial intelligence is no longer a future concept. It is already reshaping how businesses operate, how decisions are made, and how entire industries compete. From finance and healthcare to retail, manufacturing, defence, and climate science, AI is embedded in critical systems across the UK economy. Yet despite unprecedented demand for AI talent, employers continue to report severe recruitment challenges. Vacancies remain open for months. Salaries rise year on year. Candidates with impressive academic credentials often fail technical interviews. At the heart of this disconnect lies a growing and uncomfortable truth: Universities are not fully preparing graduates for real-world AI jobs. This article explores the AI skills gap in depth—what is missing from many university programmes, why the gap persists, what employers actually want, and how jobseekers can bridge the divide to build a successful career in artificial intelligence.