National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Big Data Engineer

London
2 days ago
Create job alert

Big Data Engineer – Defence & National Security
📍 Full-time, On-Site | 💷 £77,400 – £116,000 | UK Citizenship & Highest Level Clearance Required | 🧳 Relocation Assistance Available

Work at the cutting edge of national security and big data innovation.

My client is seeking an experienced Big Data Engineer to help design, implement, and optimise scalable data systems that support critical AI, ML, and data science operations in a secure, mission-focused environment. This is a high-impact, high-trust role, supporting the UK’s most sensitive digital transformation programmes.

🔧 Key Responsibilities:



Automate and troubleshoot complex data workflows using tools like NiFi and Airflow

*

Design secure, scalable data systems with GDPR and privacy in mind

*

Integrate and maintain big data platforms like Hive, Impala, and Elasticsearch

*

Support hybrid cloud infrastructure (on-premise + AWS)

*

Enable AI/ML environments using tools such as Jupyter, Spacy, and Transformers

*

Use BI tools like Tableau, Kibana, and PowerBI for reporting and insight delivery

*

Collaborate across engineering and data science teams to deliver high-impact outcomes

✅ You’ll Need:

*

Strong scripting and Linux system administration skills

*

Deep understanding of TCP/IP, OSI models, and network troubleshooting

*

Experience with NoSQL databases and big data architectures

*

Track record supporting AI/ML pipelines in regulated or secure environments

*

Excellent problem-solving and integration testing skills

🌟 Desirable:

*

AWS/cloud certifications

*

Experience with Cloudera, Hadoop, CDSW, or CML

*

Background in defence, intelligence, or highly regulated industries

🎯 Why Apply?

*

Be part of a mission with real national impact

*

Competitive salary & benefits

*

Supportive team, with access to cutting-edge tools and training

*

Work on-site with some of the most advanced data systems in the UK

Define what’s possible. Apply now and help build the future of secure data in defence

Related Jobs

View all jobs

Big Data Engineer

Data Engineer, Data Engineer Data Analyst ETL Developer BI Developer Big Data Engineer Analytics Engineer Data Platform Engineer Cloud Data Engineer Azure Data Engineer Data Integration Specialist DataOps Engineer Data Pipeline Engineer

Data Scientist II, Data Scientist II - AOP Team

Machine Learning Performance Engineer

Data Scientist

Pricing Data Scientist

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Find Hidden AI Jobs in the UK Using Professional Bodies like BCS, IET & the Turing Society

When it comes to job hunting in artificial intelligence (AI), most candidates head straight to traditional job boards, LinkedIn, or recruitment agencies. But what if there was a better way to find roles that aren’t advertised publicly? What if you could access hidden job leads, gain inside knowledge, or get referred by people already in the field? That’s where professional bodies and specialist AI communities come in. In this article, we’ll explore how UK-based organisations like BCS (The Chartered Institute for IT), IET (The Institution of Engineering and Technology), and the Turing Society can help you uncover AI job opportunities you won’t find elsewhere. We'll show you how to strategically use their directories, special-interest groups (SIGs), and CPD (Continuing Professional Development) events to elevate your career and expand your AI job search in ways most job seekers overlook.

How to Get a Better AI Job After a Lay-Off or Redundancy

Being made redundant or laid off can feel like the rug has been pulled from under you. Whether part of a wider company restructuring, budget cuts, or market shifts in tech, many skilled professionals in the AI industry have recently found themselves unexpectedly jobless. But while redundancy brings immediate financial and emotional stress, it can also be a powerful catalyst for career growth. In the fast-evolving field of artificial intelligence, where new roles and specialisms emerge constantly, bouncing back stronger is not only possible—it’s likely. In this guide, we’ll walk you through a step-by-step action plan for turning redundancy into your next big opportunity. From managing the shock to targeting better AI jobs, updating your CV, and approaching recruiters the smart way, we’ll help you move from setback to comeback.

AI Jobs Salary Calculator 2025: Work Out Your Market Value in Seconds

Why your 2024 salary data is already outdated “Am I being paid what I’m worth?” It is the question that creeps in whenever you update your CV, see a former colleague announce a punchy pay rise on LinkedIn, or notice a recruiter slide into your inbox with a role that looks eerily similar to your current one—only advertised at £20k more. Artificial intelligence moves faster than any other hiring market. New frameworks are open‑sourced overnight, venture capital floods specific niches without warning, & entire job titles—Prompt Engineer, LLM Ops Specialist—appear in the time it takes most industries to schedule a meeting. In that environment, salary guides published only a year ago already look like historical curiosities. To give AI professionals an up‑to‑the‑minute benchmark, ArtificialIntelligenceJobs.co.uk has built a simple yet powerful salary‑calculation formula. By combining three variables—role, UK region, & seniority—you can estimate a realistic 2025 salary band in less than a minute. This article explains that formula, unpacks the latest trends driving pay, & offers concrete steps to boost your personal market value over the next 90 days.