Lead Data Engineer (Kafka/Kinesis)

Harnham - Data and Analytics Recruitment
London, United Kingdom
Yesterday
£90,000 – £100,000 pa

Salary

£90,000 – £100,000 pa

Job Type
Permanent
Work Pattern
Full-time
Work Location
Hybrid
Seniority
Lead
Education
Degree
Visa Sponsorship
Available
Posted
8 Jul 2026 (Yesterday)

Benefits

Salary up to £100,000 Hybrid working (4 days onsite)

Lead Data Engineer

Up to £100,000

*Kafka or Kinesis required
London (4 days onsite)

This is a great opportunity to join a high-growth organisation where you can take ownership of building and architecting a greenfield data platform for an AI-driven product.

THE COMPANY:

This is an early-stage, venture-backed company building the operating system for modern property management through its AI platform.

THE ROLE:

You will take ownership of the entire data architecture, acting as the most senior individual contributor within Data Engineering. This is a hands-on leadership role focused on technical ownership rather than people management.

Key responsibilities include:

  • Designing and owning the company's data architecture from the ground up
  • Building scalable batch and real-time data pipelines
  • Developing data ingestion, storage, and transformation frameworks
  • Supporting AI and machine learning infrastructure, including vector search systems
  • Implementing data quality, monitoring, and observability practices
  • Collaborating closely with AI, backend engineering, and product teams
  • Optimising performance, scalability, and reliability of large datasets
  • Influencing long-term technical strategy and laying foundations for the data function
YOUR SKILLS AND EXPERIENCE:

You will bring strong capability in:

  • Python development and building scalable distributed data systems
  • Data architecture design and pipeline development
  • Batch and streaming data processing
  • Relational databases (PostgreSQL or similar)
  • NoSQL and modern vector databases (e.g., Qdrant, Milvus, pgvector)
THE BENEFITS:

You will receive a salary of up to £100,000 depending on experience.

HOW TO APPLY:

Please register your interest by sending your CV to Molly Bird via the apply link on this page.

Related Jobs

View all jobs
Spotlight

Senior ML Compiler Engineer

Fractile Bristol, United Kingdom
Spotlight

Senior Machine Learning Scientist

Chattermill London, United Kingdom
Remote

Lead Data Engineer

Matchtech London, United Kingdom
£80,000 – £110,000 pa On-site

Lead Data Engineer

Sphere Digital Recruitment London, United Kingdom
£75,000 pa Hybrid

Lead Data Engineer

The Hyde Se13Ny, SE1 3NY, United Kingdom
£68,000 – £80,400 pa On-site

Lead Data Engineer

Searchability NS&D Gloucester, United Kingdom
£65,000 – £85,000 pa Hybrid Clearance Required

Lead Data Engineer (Kafka/Kinesis)

Harnham - Data and Analytics Recruitment London, United Kingdom
£90,000 – £100,000 pa Hybrid

Lead Data Scientist

Yolk Recruitment Cardiff, Cymru / Wales, CF10 2AF, United Kingdom
£100,000 – £110,000 pa Hybrid

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Is an AI Forward Deployed Engineer? The Fastest-Growing Job in AI for 2026

If you have been watching AI job boards over the past year, one title keeps surfacing again and again: the forward deployed engineer, or FDE. It has gone from a niche term known mainly to Palantir alumni to arguably the hottest role in the entire AI hiring market. Job postings for forward deployed engineers have exploded, salaries have climbed past levels most software engineers will ever see, and the biggest names in AI — OpenAI, Anthropic, Google, Salesforce, Databricks and Palantir — are all competing for the same small pool of talent. So what exactly is an AI forward deployed engineer, why has demand surged so dramatically, and how do you position yourself to land one of these roles? This guide breaks it all down for AI engineers, software engineers and data scientists looking at their next move.