Data Engineer

Sheffield
5 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer - Azure or Snowflake

Data Engineer - Machine Learning - Hybrid

Data Engineer - Python & Azure

Data Engineer

Pay up to £58,347, plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance.

As a Data Engineer you'll be working within a high-performing team of engineers, developing data-centric solutions that positively impact millions of DWP users, helping them to find and use essential DWP services.

DWP. Digital with Purpose.

We are looking for a Data Engineer to join our community of tech experts in DWP Digital.

We're using fresh ideas and leading-edge tech to build and maintain digital solutions that will be used by nearly every person in the UK, every day and at key moments in their lives.

DWP is the UK's largest government department. We help people into work, and make payments worth over £195bn a year to support and empower millions of people.

The scale of what we do is extraordinary, and our purpose is unique. We'd love you to join us.

What skills, knowledge and experience will you need?

Experience of developing, testing, maintaining, deploying and supporting efficient, scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage
Strong coding skills using Hive SQL, Spark SQL, Python, PySpark and Bash
Experience of working with a wide variety of structured and unstructured data.

You and your role

As a Data Engineer at DWP, you'll be executing code across a full tech stack, including Azure, Databricks, PySpark and Pandas, helping the department to move towards a cloud computing environment, working with huge data sets as part of our DataWorks platform - a system that provides Universal Credit data to our Data Science team, helping improve our data security, integrity and cloud based technology.

Details. Wages. Perks.

Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds, Manchester, Newcastle-upon-Tyne and Sheffield, whichever is most convenient for you.

Hybrid Working: We work a hybrid model - you'll spend some time working at home and some time collaborating face to face in a hub.

Pay: We offer competitive pay of up to £58,347.

Pension: You'll get a brilliant civil service pension with employer contributions worth 28.97%, worth up to £16,862 per year.

Holidays: A generous leave package starting at 26 days and rising to 27 days after one year.

You can also take up to 3 extra days off a month on flexi-time. You'll also get all the usual public holidays.

We have a broad benefits package built around your work-life balance which includes:

An award-winning environment and culture: Employer of the Year 2023 (Women In IT Awards), Founders Award for Outstanding Digital Leadership 2023 (Digital 100)
Flexible working including flexible hours and flex-friendly policies
Time off volunteering and charitable giving
Bring your authentic self to work with 'I Can Be Me in DWP'
Discounts and savings on shopping, fun days out and more
Interest-free loans to buy a bike or a season ticket, so it's even easier for you to get to work and start making a difference
Sports and social activities
Professional development, coaching, mentoring and career progression opportunities.

Process:

We know your time is valuable so our application and selection process is just two stages:

Apply: complete your application on Civil Service Jobs. There'll be full instructions when you click through.
Interview: a single stage interview online.

CLICK APPLY for more information and to start your application

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Ways AI Pros Stay Inspired: Boost Creativity with Side Projects, Hackathons & More

In the rapidly evolving world of Artificial Intelligence (AI), creativity and innovation are critical. AI professionals—whether data scientists, machine learning engineers, or research scientists—must constantly rejuvenate their thinking to solve complex challenges. But how exactly do these experts stay energised and creative in their work? The answer often lies in a combination of strategic habits, side projects, hackathons, Kaggle competitions, reading the latest research, and consciously stepping out of comfort zones. This article will explore why these activities are so valuable, as well as provide actionable tips for anyone looking to spark new ideas and enrich their AI career. Below, we’ll delve into tried-and-tested strategies that AI pros employ to drive innovation, foster creativity, and maintain an inspired outlook in an industry that can be both exhilarating and daunting. Whether you’re just starting your AI journey or you’re an experienced professional aiming to sharpen your skills, these insights will help you break out of ruts, discover fresh perspectives, and bring your boldest ideas to life.

Top 10 AI Career Myths Debunked: Key Facts for Aspiring Professionals

Artificial Intelligence (AI) is one of the most dynamic and rapidly growing sectors in technology today. The lure of AI-related roles continues to draw a diverse range of job seekers—from seasoned software engineers to recent graduates in fields such as mathematics, physics, or data science. Yet, despite AI’s growing prominence and accessibility, there remains a dizzying array of myths surrounding careers in this field. From ideas about requiring near-superhuman technical prowess to assumptions that machines themselves will replace these jobs, the stories we hear sometimes do more harm than good. In reality, the AI job market offers far more opportunities than the alarmist headlines and misconceptions might suggest. Here at ArtificialIntelligenceJobs.co.uk, we witness firsthand the myriad roles, backgrounds, and success stories that drive the industry forward. In this blog post, we aim to separate fact from fiction—taking the most pervasive myths about AI careers and debunking them with clear, evidence-based insights. Whether you are an established professional considering a career pivot into data science, or a student uncertain about whether AI is the right path, this article will help you gain a realistic perspective on what AI careers entail. Let’s uncover the truth behind the most common myths and discover the actual opportunities and realities you can expect in this vibrant sector.

Global vs. Local: Comparing the UK AI Job Market to International Landscapes

How to navigate salaries, opportunities, and work culture in AI across the UK, the US, Europe, and Asia Artificial Intelligence (AI) has evolved from a niche field of research to an integral component of modern industries—powering everything from chatbots and driverless cars to sophisticated data analytics in finance and healthcare. The job market for AI professionals is consequently booming, with thousands of new positions posted each month worldwide. In this blog post, we will explore how the UK’s AI job market compares to that of the United States, Europe, and Asia, delving into differences in job demand, salaries, and workplace culture. Additionally, we will provide insights for candidates considering remote or international opportunities. Whether you are a freshly qualified graduate in data science, an experienced machine learning engineer, or a professional from a parallel domain looking to transition into AI, understanding the global vs. local landscape can help you make an informed decision about your career trajectory. As the demand for artificial intelligence skills grows—and borders become more porous with hybrid and remote work—the possibilities for ambitious job-seekers are expanding exponentially. This article will offer a comprehensive look at the various regional markets, exploring how the UK fares in comparison to other major AI hubs. We’ll also suggest factors to consider when choosing where in the world to work, whether physically or remotely. By the end, you’ll have a clearer picture of the AI employment landscape, and you’ll be better prepared to carve out your own path.