National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Data Engineer

The National College
Sheffield
5 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer (we have office locations in Cambridge, Leeds & London)

Data Engineer II - Machine Learning

Data Engineer II - Machine Learning [17/07/2025]...

Job Purpose / Role Overview This role is responsible for the development and operation of the data warehouse stack and data quality, integrating additional data sources and providing processed data for consumption, BI and reporting. A key focus is enabling the business to make data-driven decisions that will support innovation and continuous sustainable growth.

Key Responsibilities • Responsible for the development and operation of the data warehouse stack and data quality, integrating additional data sources and providing processed data for consumption, BI and reporting. • Build and maintain scalable data pipelines written in Python and SQL and ran on AWS/Snowflake • Management and maintenance of the data architecture and configuration. Deployment of resources within the AWS estate to ensure optimal performance, scalability, and cost efficiency. • Taking ownership of data quality within projects • Managing and educating a range of stakeholders when gathering requirements and delivering data projects • Building effective and collaborative relationships with technical and non-technical colleagues • Reacting to change within the business in a positive and constructive way • Documenting processes and data pipelines • Working as part of an Agile (Scrum, kanban) team, and collaborating with other development, product, design and test teams to ensure the best implementation and highest quality product

Requirements

  • Experience working with complex data sets. • Data pipeline development experience in Python (especially using pandas, parsing API responses, posting data to API’s etc.) • Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines • Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred • An understanding of CICD concepts including having a working knowledge of GitHub
  • Skills and Competencies • A strong data mindset • Ability to thrive in a fast paced and dynamic environment • Exceptional SQL skills including an appreciation for performance tuning on a variety of database engines • Excellent communication, collaboration, and problem-solving skills. • An appreciation for the big picture while delivering short/mid-term solutions • Understanding of different data warehouse architectures is preferred (especially dimensional modelling and data vault 2.0 architectures) • Experience with agile methodologies such as Scrum or Kanban, and tools such as Jira and Git 5.
  • Qualifications • Desirable - Bachelor's degree in computer science, data science, software engineering, information systems or related discipline. • Desirable - Certifications in scripting/programming language, such as python or SQL. • Desirable – Certifications in cloud computing on platforms such as AWS

Benefits

  • Hybrid working, with regular collaboration days in our Sheffield HQ
  • Opportunity to work at an established but rapidly growing EdTech scaleup
  • NEST Pensions scheme
  • Buy & Sell Holiday scheme offering an opportunity to boost holiday allowance to up to 38 days annually
  • Access to company Life Assurance scheme
  • SmartHealth - access to 24/7 virtual GP, mental health support, financial advice and more

Who are The National College

The National College are a fast growing and innovative EdTech business headquartered in Sheffield. We are a market-leading and multi-award-winning provider of professional development and software tools that support over 45,000 schools worldwide to ensure compliance and drive up standards. Our cutting-edge platform has revolutionised online training and now boasts the world's largest professional development library for educators! 

The National College is part of the National Education Group.

CancelAdd Benefits

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs Skills Radar 2026: Emerging Frameworks, Languages & Tools to Learn Now

As the UK’s AI sector accelerates towards a £1 trillion tech economy, the job landscape is rapidly evolving. Whether you’re an aspiring AI engineer, a machine learning specialist, or a data-driven software developer, staying ahead of the curve means more than just brushing up on Python. You’ll need to master a new generation of frameworks, languages, and tools shaping the future of artificial intelligence. Welcome to the AI Jobs Skills Radar 2026—your definitive guide to the emerging AI tech stack that employers will be looking for in the next 12–24 months. Updated annually for accuracy and relevance, this guide breaks down the top tools, frameworks, platforms, and programming languages powering the UK’s most in-demand AI careers.

How to Find Hidden AI Jobs in the UK Using Professional Bodies like BCS, IET & the Turing Society

When it comes to job hunting in artificial intelligence (AI), most candidates head straight to traditional job boards, LinkedIn, or recruitment agencies. But what if there was a better way to find roles that aren’t advertised publicly? What if you could access hidden job leads, gain inside knowledge, or get referred by people already in the field? That’s where professional bodies and specialist AI communities come in. In this article, we’ll explore how UK-based organisations like BCS (The Chartered Institute for IT), IET (The Institution of Engineering and Technology), and the Turing Society can help you uncover AI job opportunities you won’t find elsewhere. We'll show you how to strategically use their directories, special-interest groups (SIGs), and CPD (Continuing Professional Development) events to elevate your career and expand your AI job search in ways most job seekers overlook.

How to Get a Better AI Job After a Lay-Off or Redundancy

Being made redundant or laid off can feel like the rug has been pulled from under you. Whether part of a wider company restructuring, budget cuts, or market shifts in tech, many skilled professionals in the AI industry have recently found themselves unexpectedly jobless. But while redundancy brings immediate financial and emotional stress, it can also be a powerful catalyst for career growth. In the fast-evolving field of artificial intelligence, where new roles and specialisms emerge constantly, bouncing back stronger is not only possible—it’s likely. In this guide, we’ll walk you through a step-by-step action plan for turning redundancy into your next big opportunity. From managing the shock to targeting better AI jobs, updating your CV, and approaching recruiters the smart way, we’ll help you move from setback to comeback.