National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Data Engineer

Daresbury
4 days ago
Create job alert

Data Engineer - Daresbury

Role Description

As a Data Engineer will be a core member of the wider technical team, responsible for designing, building, and optimising the pipelines that turn raw network, commercial, and operational data into trustworthy, analytics-ready assets. Working closely with Data Analysts, Network Engineering, and Digital teams, you will own our data platform, ensuring data is accurate, timely, and secure to drive reporting, automation, and develop towards AI-driven decision-making.

Key Responsibilities

• Design, develop and maintain scalable ELT/ETL pipelines that ingest data from network devices (IPDR, SNMP, OSS/BSS), CRM, finance, and IoT platforms into our BI warehousing environment.

• Model data using Kimball/star schemas and data-vault principles to support BI and self-service analytics.

• Implement data quality, lineage, and observability tooling (e.g., dbt tests, Great Expectations, Azure Purview).

• Optimise storage and compute costs through partitioning, incremental loads, and automation.

• Collaborate with DevOps to embed CI/CD and Infrastructure-as-Code (Terraform, Azure DevOps pipelines).

• Work with stakeholders to capture data requirements and translate them into technical solutions.

• Ensure data is handled in line with GDPR, ISO-27001, and company security policies. • Mentor junior data team members and champion a data-driven culture across ITS.

About You

• Proven experience as a Data Engineer (or similar), building cloud data platforms.

• Strong SQL and Python skills for data transformation and automation.

• Hands-on with modern ELT frameworks (e.g., dbt, Fivetran, ADF, Synapse Pipelines). • Experience with version control (Git) and CI/CD for data.

• Knowledge of data modelling techniques and performance optimisation.

• Familiarity with data governance, security, and privacy best practices.

Desirable

• Experience with network-centric datasets (fiber, GPON, ethernet, Wi-Fi telemetry).

• Exposure to streaming technologies (Kafka, Event Hubs) and real-time analytics.

• Knowledge of Machine Learning Ops (MLflow, Databricks)

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer (we have office locations in Cambridge, Leeds & London)

Data Engineer, Data Engineer Data Analyst ETL Developer BI Developer Big Data Engineer Analytics Engineer Data Platform Engineer Cloud Data Engineer Azure Data Engineer Data Integration Specialist DataOps Engineer Data Pipeline Engineer

Senior Data Engineer

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 AI Recruitment Agencies in the UK You Should Know (2025 Job‑Seeker Guide)

Generative‑AI hype has translated into real hiring: Lightcast recorded +57 % year‑on‑year growth in UK adverts mentioning “machine learning”, “LLM” or “gen‑AI” during Q1 2025. Yet supply still lags. Roughly 18,000 core AI professionals work in the UK, but monthly live vacancies hover around 1,400–1,600. That mismatch makes specialist recruiters invaluable—opening stealth vacancies, advising on salary bands and fast‑tracking interview loops. But many tech agencies sprinkle “AI” on their website without an active desk. To save you time, we vetted 50 + consultancies and kept only those with: A registered UK head office (verified via Companies House). A named AI/Machine‑Learning or Data practice.

AI Jobs Skills Radar 2026: Emerging Frameworks, Languages & Tools to Learn Now

As the UK’s AI sector accelerates towards a £1 trillion tech economy, the job landscape is rapidly evolving. Whether you’re an aspiring AI engineer, a machine learning specialist, or a data-driven software developer, staying ahead of the curve means more than just brushing up on Python. You’ll need to master a new generation of frameworks, languages, and tools shaping the future of artificial intelligence. Welcome to the AI Jobs Skills Radar 2026—your definitive guide to the emerging AI tech stack that employers will be looking for in the next 12–24 months. Updated annually for accuracy and relevance, this guide breaks down the top tools, frameworks, platforms, and programming languages powering the UK’s most in-demand AI careers.

How to Find Hidden AI Jobs in the UK Using Professional Bodies like BCS, IET & the Turing Society

Stop Scrolling Job Boards and Start Tapping the Real AI Market Every week a new headline announces millions of pounds flowing into artificial-intelligence research, defence initiatives, or health-tech pilots. Read the news and you could be forgiven for thinking that AI vacancies must be everywhere—just grab your laptop, open LinkedIn, and pick a role. Yet anyone who has hunted seriously for an AI job in the United Kingdom knows the truth is messier. A large percentage of worthwhile AI positions—especially specialist or senior posts—never appear on public boards. They emerge inside university–industry consortia, defence labs, NHS data-science teams, climate-tech start-ups, and venture studios. Most are filled through referral or conversation long before a recruiter drafts a formal advert. If you wait for a vacancy link, you are already at the back of the queue. The surest way to beat that dynamic is to embed yourself in the professional bodies and grassroots communities where the work is conceived. The UK has a dense network of such organisations: the Chartered Institute for IT (BCS); the Institution of Engineering and Technology (IET) with its Artificial Intelligence Technical Network; the Alan Turing Institute and its student-driven Turing Society; the Royal Statistical Society (RSS); the Institution of Mechanical Engineers (IMechE) and its Mechatronics, Informatics & Control Group; public-funding engines like UK Research and Innovation (UKRI); and an ecosystem of Slack channels and Meetup groups that trade genuine, timely intel. This article is a practical, step-by-step guide to using those networks. You will learn: Why professional bodies matter more than algorithmic job boards Exactly which special-interest groups (SIGs) and technical networks to join How to turn CPD events into informal interviews How to monitor grant databases so you hear about posts months before they exist Concrete scripts, portfolio tactics, and outreach rhythms that convert visibility into offers Follow the playbook and you move from passive applicant to insider—the colleague who hears about a role before it is written down.