Global IT LLM Engineer Senior Manager

Boston Consulting Group
London
11 months ago
Applications closed

Related Jobs

View all jobs

Senior Machine Learning Engineer

Founding Lead Machine Learning Engineer

Founding Engineer - Chief of AI and Computer Vision

Machine Learning Engineer

Machine Learning Engineer

Artificial Intelligence Engineer - Fitness & Health

Who We Are
Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

What Youll Do
BCG Legal has been on a Generative AI journey to transform internal operations powered through cutting edge Generative AI technologies are core to this journey. Thus, we are looking for Generative AI engineers who are passionate about designing, developing, deploying and optimizing Gen AI products at scale.
 
This role will be hosted inLegal digital products teamto support building key prioritized Generative AI solutions for achieving Legal operations AI/Gen AI vision.
 
KEY RESPONSIBILITIES
 
You will work as a squad member with strong hands-on Gen AI expertise and will guide the product owners, digital leaders in conceptualizing new Gen AI products or embedding Gen AI as part of existing products in the most optimum manner. You will be an individual contributor (IC) to develop the Gen AI products along with broader squad members as well as guiding other Gen AI/LLM engineers or data scientists developing Gen AI applications.
 
Along with core Generative AI expertise, you will bring expertise in full backend development in technologies like python, typescript including REST, GraphQL etc. APIs development, core functional logic, performance, and stability of custom-built products.
 
Among your responsibilities, you will:

  • Conceptualize Generative AI custom products at BCG internally & operate as a technical thought partner for digital leaders and product owners.
  • Combine data science & engineering expertise in building Generative AI products
  • Develop Gen AI products as individual contributors (IC) to develop scalable high performance enterprise products along with broader squad
  • Share expertise and recommendations on alternate approaches & tools to improve product
  • Collaborate closely with data engineers, data scientists, software engineers, QA, product owners and analysts develop seamless end to end integrated products
  • Build strong relationships with business stakeholders, ensuring alignment on project goals and successful integration of products into business processes
  • Oversee & mentor other LLM/AI engineers, data scientists in the project on Gen AI expertise
  • Share Gen AI knowledge & expertise across with broader digital teams squads, chapters, CoEs
  • Regularly ramp up on latest LLMs, technologies, frameworks & platforms in the Gen AI space

What Youll Bring

  • Overall 9+ years of experience in engineering, machine learning & LLMs
  • 6+ years of hands-on experience in building & deploying AI/ML/Gen AI solutions in large business critical applications
  • 2+ years of experience in developing Gen AI products using variety of LLMs & frameworks
  • Advanced proficiency in Python for data science, engineering & LLMs
  • Highly curious technically to evaluate & test new technologies in Gen AI space
  • Proven ability to work with large structured & unstructured datasets and deploy AI/ML/Gen AI solutions through automated pipelines
  • Experience with leveraging, training and fine-tuning Foundation Models including multimodal inputs and outputs
  • Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex)
  • Proficiency in generating and working with embeddings across variety of data formats. Understanding of embedding spaces and their applications in semantic search and information retrieval.
  • Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.
  • Expertise with RAG concepts and fundamentals (vectorDBs, semanticsearch, re-rankers etc.), Expertise in implementing RAG systems that combine knowledge bases
  • Experience with multi-agent frameworks/systems and an understanding of multi-agent systems and their applications in complex problem-solving scenarios
  • Experience in working with variety of data bases (SQL, no SQL), APIs & microservices development
  • Experience with LLMOps tools (e.g. Langsmith) to implement guardrails, track accuracy, hallucinations, bias and other metrics in Gen AI products
  • Experience in constructing and querying knowledge graphs including graph-based reasoning.
  • Experience in front end development technologies (e.g. REACT) would be good to have
  • Excellent communication skills, with the ability to explain complex technical concepts to various audiences
  • Proven ability to operate with a transparent mindset, communicating openly with stakeholders at various levels of the organization

Who Youll Work With
As a pivotal member of the team, you will interact extensively with a diverse range of stakeholders from across the functions both geographically and functionally.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.

BCG is an E - Verify Employer. (Click here )(https://careers.bcg.com/global/en/e-verify) for more information on E-Verify.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Skills Gap in AI Jobs: What Universities Aren’t Teaching

Artificial intelligence is no longer a future concept. It is already reshaping how businesses operate, how decisions are made, and how entire industries compete. From finance and healthcare to retail, manufacturing, defence, and climate science, AI is embedded in critical systems across the UK economy. Yet despite unprecedented demand for AI talent, employers continue to report severe recruitment challenges. Vacancies remain open for months. Salaries rise year on year. Candidates with impressive academic credentials often fail technical interviews. At the heart of this disconnect lies a growing and uncomfortable truth: Universities are not fully preparing graduates for real-world AI jobs. This article explores the AI skills gap in depth—what is missing from many university programmes, why the gap persists, what employers actually want, and how jobseekers can bridge the divide to build a successful career in artificial intelligence.

AI Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Changing career into artificial intelligence in your 30s, 40s or 50s is no longer unusual in the UK. It is happening quietly every day across fintech, healthcare, retail, manufacturing, government & professional services. But it is also surrounded by hype, fear & misinformation. This article is a realistic, UK-specific guide for career switchers who want the truth about AI jobs: what roles genuinely exist, what skills employers actually hire for, how long retraining really takes & whether age is a barrier (spoiler: not in the way people think). If you are considering a move into AI but want facts rather than Silicon Valley fantasy, this is for you.

How to Write an AI Job Ad That Attracts the Right People

Artificial intelligence is now embedded across almost every sector of the UK economy. From fintech and healthcare to retail, defence and climate tech, organisations are competing for AI talent at an unprecedented pace. Yet despite the volume of AI job adverts online, many employers struggle to attract the right candidates. Roles are flooded with unsuitable applications, while highly capable AI professionals scroll past adverts that feel vague, inflated or disconnected from reality. In most cases, the issue isn’t a shortage of AI talent — it’s the quality of the job advert. Writing an effective AI job ad requires more care than traditional tech hiring. AI professionals are analytical, sceptical of hype and highly selective about where they apply. A poorly written advert doesn’t just fail to convert — it actively damages your credibility. This guide explains how to write an AI job ad that attracts the right people, filters out mismatches and positions your organisation as a serious employer in the AI space.