National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Principle Data Engineer ( AWS & Airflow )

London
2 weeks ago
Create job alert

Job Title: Principal Data Engineer

Location: London, UK - Hybrid (Liverpool Street office)

Department: Data & Engineering

Reports To: Head of Data Science

Employment Type: Permanent

A leading global payments and fintech platform, empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital assets.

As they continue to scale their data infrastructure, they're seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines.

The ideal candidate will bring both technical depth and strategic thinking, with the ability to communicate effectively across business and technical teams.

Key Responsibilities

Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics.
Define and drive the long-term architecture and data strategy in alignment with business goals.
Own orchestration of ETL/ELT workflows using Apache Airflow, including scheduling, monitoring, and alerting.
Collaborate with cross-functional teams (Product, Engineering, Data Science, Compliance) to define data requirements and build reliable data flows.
Champion best practices in data modelling, governance, and DevOps for data engineering (CI/CD, IaC).
Serve as a key communicator between technical teams and business stakeholders, translating complex data needs into actionable plans.
Mentor and lead data engineers, fostering continuous learning and technical excellence.
Ensure compliance with data security, privacy, and regulatory standards (e.g., PCI-DSS, GDPR).

Essential:

7+ years in Data Engineering, with 2+ years in a Principal or Lead role.
Proven experience designing and delivering enterprise data strategies.
Exceptional communication and stakeholder management skills.
Expertise in enterprise-grade data warehouses (Snowflake, BigQuery, Redshift).
Hands-on experience with Apache Airflow (or similar orchestration tools).
Strong proficiency in Python and SQL for pipeline development.
Deep understanding of data architecture, dimensional modelling, and metadata management.
Experience with cloud platforms (AWS, GCP, or Azure).
Familiarity with version control, CI/CD, and Infrastructure-as-Code (Terraform or similar).

Desirable:

Background in fintech or payments.
Knowledge of streaming frameworks (Kafka, Kinesis).
Experience with dbt and data quality frameworks (e.g., Great Expectations).

What's on Offer

Competitive base salary + bonus
Flexible hybrid working model (Liverpool Street office)
Private healthcare & wellness benefits
Learning and development support
The opportunity to shape the future of payments data infrastructure

Related Jobs

View all jobs

Engineering Lead I - Machine Learning Platform

Principal Machine Learning Engineer / Team Lead

Principal Machine Learning Engineer / Team Lead

Principal Machine Learning Engineer / Team Lead...

Senior Machine Learning Engineer

Principal Machine Learning Engineer / Team Lead

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs UK 2025: 50 Companies Hiring Now

Bookmark this guide – we refresh it every quarter so you always know who’s really scaling their artificial‑intelligence teams. Artificial intelligence hiring has roared back in 2025. The UK’s boosted National AI Strategy funding, record‑breaking private investment (£18.1 billion so far) & a fresh wave of generative‑AI product launches mean employers are jockeying for data scientists, ML engineers, MLOps specialists, AI product managers, prompt engineers & applied researchers. Below are 50 organisations that have advertised UK‑based AI vacancies in the past eight weeks or formally announced growth plans. They’re grouped into five easy‑scan categories so you can jump straight to the kind of employer – & culture – that suits you. For each company you’ll find: Main UK hub Example live or recent vacancy Why it’s worth a look (tech stack, culture, mission) Use the internal links to browse current vacancies on ArtificialIntelligenceJobs.co.uk – or set up a free job alert so fresh roles land in your inbox.

Return-to-Work Pathways: Relaunch Your AI Career with Returnships, Flexible & Hybrid Roles

Stepping back into the workplace after a career break can feel like embarking on a whole new journey—especially in a cutting-edge field such as artificial intelligence (AI). For parents and carers, the challenge isn’t just refreshing your technical know-how but also securing a role that respects your family commitments. Fortunately, the UK’s tech sector now boasts a wealth of return-to-work programmes—from formal returnships to flexible and hybrid opportunities. These pathways are designed to bridge the gap, equipping you with refreshed skills, confidence and a supportive network. In this comprehensive guide, you’ll discover how to: Understand the booming demand for AI talent in the UK Leverage transferable skills honed during your break Overcome common re-entry challenges Build your AI skillset with targeted training Tap into returnship and re-entry programmes Find flexible, hybrid and full-time AI roles that suit your lifestyle Balance professional growth with caring responsibilities Master applications, interviews and networking Whether you’re returning after maternity leave, eldercare duties or another life chapter, this article will equip you with practical steps, resources and insider tips.

LinkedIn Profile Checklist for AI Jobs: 10 Tweaks That Triple Recruiter Views

In today’s fiercely competitive AI job market, simply having a LinkedIn profile isn’t enough. Recruiters and hiring managers routinely scout for top talent in machine learning, data science, natural language processing, computer vision and beyond—sometimes before roles are even posted. With hundreds of applicants vying for each role, you need a profile that’s optimised for search, speaks directly to AI-specific skills, and showcases measurable impact. By following this step-by-step LinkedIn for AI jobs checklist, you’ll make ten strategic tweaks that can triple recruiter views and position you as a leading AI professional. Whether you’re a fresh graduate aiming for your first AI position or a seasoned expert targeting a senior role, these actionable changes will ensure your profile stands out in feeds, search results and recruiter queues. Let’s dive in.