Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Global IT LLM Engineer Senior Manager

Boston Consulting Group
London
7 months ago
Applications closed

Related Jobs

View all jobs

Data Scientist

Data Scientist | Edtech | £60k to £70k | Global Business

Lead R Data Scientist - Sustainability

Lead R Engineer / Data Scientist - Integrated Pest Management (IPM)

Data Scientist - Contract

Contract Data Scientist - London - £700/pd

Who We Are
Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

What Youll Do
BCG Legal has been on a Generative AI journey to transform internal operations powered through cutting edge Generative AI technologies are core to this journey. Thus, we are looking for Generative AI engineers who are passionate about designing, developing, deploying and optimizing Gen AI products at scale.
 
This role will be hosted inLegal digital products teamto support building key prioritized Generative AI solutions for achieving Legal operations AI/Gen AI vision.
 
KEY RESPONSIBILITIES
 
You will work as a squad member with strong hands-on Gen AI expertise and will guide the product owners, digital leaders in conceptualizing new Gen AI products or embedding Gen AI as part of existing products in the most optimum manner. You will be an individual contributor (IC) to develop the Gen AI products along with broader squad members as well as guiding other Gen AI/LLM engineers or data scientists developing Gen AI applications.
 
Along with core Generative AI expertise, you will bring expertise in full backend development in technologies like python, typescript including REST, GraphQL etc. APIs development, core functional logic, performance, and stability of custom-built products.
 
Among your responsibilities, you will:

  • Conceptualize Generative AI custom products at BCG internally & operate as a technical thought partner for digital leaders and product owners.
  • Combine data science & engineering expertise in building Generative AI products
  • Develop Gen AI products as individual contributors (IC) to develop scalable high performance enterprise products along with broader squad
  • Share expertise and recommendations on alternate approaches & tools to improve product
  • Collaborate closely with data engineers, data scientists, software engineers, QA, product owners and analysts develop seamless end to end integrated products
  • Build strong relationships with business stakeholders, ensuring alignment on project goals and successful integration of products into business processes
  • Oversee & mentor other LLM/AI engineers, data scientists in the project on Gen AI expertise
  • Share Gen AI knowledge & expertise across with broader digital teams squads, chapters, CoEs
  • Regularly ramp up on latest LLMs, technologies, frameworks & platforms in the Gen AI space

What Youll Bring

  • Overall 9+ years of experience in engineering, machine learning & LLMs
  • 6+ years of hands-on experience in building & deploying AI/ML/Gen AI solutions in large business critical applications
  • 2+ years of experience in developing Gen AI products using variety of LLMs & frameworks
  • Advanced proficiency in Python for data science, engineering & LLMs
  • Highly curious technically to evaluate & test new technologies in Gen AI space
  • Proven ability to work with large structured & unstructured datasets and deploy AI/ML/Gen AI solutions through automated pipelines
  • Experience with leveraging, training and fine-tuning Foundation Models including multimodal inputs and outputs
  • Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex)
  • Proficiency in generating and working with embeddings across variety of data formats. Understanding of embedding spaces and their applications in semantic search and information retrieval.
  • Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.
  • Expertise with RAG concepts and fundamentals (vectorDBs, semanticsearch, re-rankers etc.), Expertise in implementing RAG systems that combine knowledge bases
  • Experience with multi-agent frameworks/systems and an understanding of multi-agent systems and their applications in complex problem-solving scenarios
  • Experience in working with variety of data bases (SQL, no SQL), APIs & microservices development
  • Experience with LLMOps tools (e.g. Langsmith) to implement guardrails, track accuracy, hallucinations, bias and other metrics in Gen AI products
  • Experience in constructing and querying knowledge graphs including graph-based reasoning.
  • Experience in front end development technologies (e.g. REACT) would be good to have
  • Excellent communication skills, with the ability to explain complex technical concepts to various audiences
  • Proven ability to operate with a transparent mindset, communicating openly with stakeholders at various levels of the organization

Who Youll Work With
As a pivotal member of the team, you will interact extensively with a diverse range of stakeholders from across the functions both geographically and functionally.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.

BCG is an E - Verify Employer. (Click here )(https://careers.bcg.com/global/en/e-verify) for more information on E-Verify.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why the UK Could Be the World’s Next AI Jobs Hub

Artificial Intelligence (AI) has rapidly moved from research labs into boardrooms, classrooms, hospitals, and homes. It is already reshaping economies and transforming industries at a scale comparable to the industrial revolution or the rise of the internet. Around the world, countries are competing fiercely to lead in AI innovation and reap its economic, social, and strategic benefits. The United Kingdom is uniquely positioned in this race. With a rich heritage in computing, world-class universities, forward-thinking government policy, and a growing ecosystem of startups and enterprises, the UK has many of the elements needed to become the world’s next AI hub. Yet competition is intense, particularly from the United States and China. Success will depend on how effectively the UK can scale its strengths, close its gaps, and seize opportunities in the years ahead. This article explores why the UK could be the world’s next global hub for artificial intelligence, what challenges it must overcome, and what this means for businesses, researchers, and job seekers.

The Best Free Tools & Platforms to Practise AI Skills in 2025/26

Artificial Intelligence (AI) is one of the fastest-growing career fields in the UK and worldwide. Whether you are a student exploring AI for the first time, a graduate looking to build your portfolio, or an experienced professional upskilling for career growth, having access to free tools and platforms to practise AI skills can make a huge difference. In this comprehensive guide, we’ll explore the best free resources available in 2025, covering AI coding platforms, datasets, cloud tools, no-code AI platforms, online communities, and learning hubs. These tools allow you to practise everything from machine learning models and natural language processing (NLP) to computer vision, reinforcement learning, and large language model (LLM) fine-tuning—without needing a huge budget. By the end of this article, you’ll have a clear roadmap of where to start practising your AI skills for free, how to build real-world projects, and which platforms can help you land your next AI job.

Top 10 Skills in Artificial Intelligence According to LinkedIn & Indeed Job Postings

Artificial intelligence is no longer a niche field reserved for research labs or tech giants—it has become a cornerstone of business strategy across the UK. From finance and healthcare to manufacturing and retail, employers are rapidly expanding their AI teams and competing for talent. But here’s the challenge: AI is evolving so quickly that the skills in demand today may look different from those of just a few years ago. Whether you’re a graduate looking to enter the industry, a mid-career professional pivoting into AI, or an experienced engineer wanting to stay ahead, it’s essential to know what employers are actually asking for in their job ads. That’s where platforms like LinkedIn and Indeed provide valuable insight. By analysing thousands of job postings across the UK, they reveal the most frequently requested skills and emerging trends. This article distils those findings into the Top 10 AI skills employers are prioritising in 2025—and shows you how to present them effectively on your CV, in interviews, and in your portfolio.