Senior Data Engineer (1 role available), Data Directorate, Ministry of Justice (Ref:90178)

Ministry of Justice
6 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Fabric - £70,000 - London

Senior Data Engineer - Snowflake & AWS

Senior Manager Marketing Data & Insights Strategy

Senior Data Scientist (GenAI)

Job summary

This position is based nationally

Job description

Senior Data Engineer (SEO), Data Directorate, Ministry of Justice

Hello!

Welcome to the Data & Analysis directorate at the Ministry of Justice and thank you for taking an interest in this role. We�re looking for 1 Senior Data Engineer to join our growing team. The successful candidate will join the Data Modelling and Engineering Team (DMET), although we also work closely with the Data Platform team. A summary of the type of work the teams are involved in can be found in our�. We're also hosting a webinar on Monday 2nd September 2024 from 18:00 to 19:00 for anyone interested in learning more about the team and the roles we�re currently recruiting. You can�.

This is a great opportunity to work with leading cloud technology and help change the way data is used in the public sector. Data engineers at MoJ play a critical role in our mission to put data at the heart of decision-making.�We're looking for people with the drive to develop a deep understanding of data needs and data availability across specific areas of the Ministry of Justice. You will work in a team of Data Engineers, alongside Analytics Engineers, to bridge the gap between data producers and data users, developing analytical pipelines and self-service tools to acquire and transform data, making it available on our�.

As a Senior Data Engineer your work might involve:

designing and building robust and scalable automated data flows to connect operational systems, data for analytics and business intelligence (BI) systems

recognising opportunities to reuse and re-engineer data flows to enable scaling and repeatable use

designing and writing ETL (extract, transform, load) scripts and code to ensure the ETL process performs optimally

working with data users to understand and translate their needs into technical requirements

using a range of AWS services to deploy your solutions in a reproducible, sustainable manner

using infrastructure-as-code to deploy AWS cloud infrastructure

developing and optimising code, tools and services that enable people to use data effectively

You may also be expected to carry out the following day to day activities:

designing and maintaining technical documentation

creating and promoting best practices within the team and wider

responding to incident reports, ensuring relevant prioritisation and detail to allow for effective investigation

developing novel solutions to fit the needs of a range of stakeholders

supporting the Ministry of Justice's Analytical Platform users to use our data and tools

initiating team-building and development initiatives

line managing a more junior colleague

About you

We welcome applications from anyone with the skills we consider to make a good data engineer. You may not currently be in a data engineering role and that's ok. Many of our team members have a background in analysis, software engineering, data science, and more.�

Essential Skills

You�ll have a demonstrable passion for Data Engineering, with the following skills or some experience in:

Python

automated testing, for example with pytest

version control tools, such as git

working with a range of data sources

working with data, such as data wrangling, analysis or manipulation

SQL

communicating with stakeholders, and translating user needs into technical requirements

Desirable skills

It's a bonus if you also have experience of:

Kubernetes and container-based workflows

continuous integration and deployment tools, such as GitHub Actions

cloud infrastructure, especially AWS, and infrastructure as code tools, such as Terraform

orchestration systems, such as Airflow

big data tools, such as Spark

data transformation tools, such as dbt

Data Lake table formats, such as Iceberg

We make our workplace as inclusive as we can. Find out more about�.�

Location

We welcome applications from candidates based across the UK. Candidates will have the option of being based in the Leeds or London HQ offices (with flexible working arrangements available) or your nearest Justice Collaboration Centre or Justice Satellite Office:�.

Recruitment process

You'll need to apply online by submitting:

an anonymised CV, including career history, responsibilities, and achievements

a cover letter, explaining why you're the right person for the job and how you meet the criteria above � this should be no longer than 750 words

There will be an initial sift of applicants, comparing submitted evidence against the �About you� criteria. We�ll assess your application and get back to you in around two weeks to let you know if we�d like to invite you to an interview.

The interview

There will be one interview, covered in two sections, which will include a technical exercise and assessment of civil service behaviours. The interview will take place via Microsoft Teams.

The purpose of the technical exercise is to test your technical skills. The exercise will last one hour and will involve completing some scenario-based tasks using Python. More information on the exercise will be provided to candidates invited to interview.

In the second section of the interview, candidates will be assessed against the following civil service behaviours:

Changing and Improving

Managing a Quality Service

You can find out more about behaviours via the�.

We recommend that you use the STAR approach � situation, task, action, and result � when structuring your answers. Further information can be found on the�.

Interviews are likely to take place in October 2024. The highest scoring candidates who pass the interview will be offered a role. If you do well at the interview but we don't offer you a role right now, we'll keep your details for a year and let you know if other opportunities come up. The whole process can take up to a month.

Further information

If you require any additional information about the role, please contact:

You can also ask questions at the webinar on Monday 2nd September -�.

Person specification

Please refer to Job Description

Behaviours

We'll assess you against these behaviours during the selection process:

Changing and Improving Managing a Quality Service

Benefits

Alongside your salary of �39,868, Ministry of Justice contributes �11,549 towards you being a member of the Civil Service Defined Benefit Pension scheme. Access to learning and developmentA working environment that supports a range of flexible working options to enhance your work life balanceA working culture which encourages inclusion and diversityA with an average employer contribution of 27%Annual LeavePublic HolidaysSeason Ticket Advance



For more information about the recruitment process, benefits and allowances and answers to general queries, please click the below link which will direct you to our Candidate Information Page.

Link:

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Ways AI Pros Stay Inspired: Boost Creativity with Side Projects, Hackathons & More

In the rapidly evolving world of Artificial Intelligence (AI), creativity and innovation are critical. AI professionals—whether data scientists, machine learning engineers, or research scientists—must constantly rejuvenate their thinking to solve complex challenges. But how exactly do these experts stay energised and creative in their work? The answer often lies in a combination of strategic habits, side projects, hackathons, Kaggle competitions, reading the latest research, and consciously stepping out of comfort zones. This article will explore why these activities are so valuable, as well as provide actionable tips for anyone looking to spark new ideas and enrich their AI career. Below, we’ll delve into tried-and-tested strategies that AI pros employ to drive innovation, foster creativity, and maintain an inspired outlook in an industry that can be both exhilarating and daunting. Whether you’re just starting your AI journey or you’re an experienced professional aiming to sharpen your skills, these insights will help you break out of ruts, discover fresh perspectives, and bring your boldest ideas to life.

Top 10 AI Career Myths Debunked: Key Facts for Aspiring Professionals

Artificial Intelligence (AI) is one of the most dynamic and rapidly growing sectors in technology today. The lure of AI-related roles continues to draw a diverse range of job seekers—from seasoned software engineers to recent graduates in fields such as mathematics, physics, or data science. Yet, despite AI’s growing prominence and accessibility, there remains a dizzying array of myths surrounding careers in this field. From ideas about requiring near-superhuman technical prowess to assumptions that machines themselves will replace these jobs, the stories we hear sometimes do more harm than good. In reality, the AI job market offers far more opportunities than the alarmist headlines and misconceptions might suggest. Here at ArtificialIntelligenceJobs.co.uk, we witness firsthand the myriad roles, backgrounds, and success stories that drive the industry forward. In this blog post, we aim to separate fact from fiction—taking the most pervasive myths about AI careers and debunking them with clear, evidence-based insights. Whether you are an established professional considering a career pivot into data science, or a student uncertain about whether AI is the right path, this article will help you gain a realistic perspective on what AI careers entail. Let’s uncover the truth behind the most common myths and discover the actual opportunities and realities you can expect in this vibrant sector.

Global vs. Local: Comparing the UK AI Job Market to International Landscapes

How to navigate salaries, opportunities, and work culture in AI across the UK, the US, Europe, and Asia Artificial Intelligence (AI) has evolved from a niche field of research to an integral component of modern industries—powering everything from chatbots and driverless cars to sophisticated data analytics in finance and healthcare. The job market for AI professionals is consequently booming, with thousands of new positions posted each month worldwide. In this blog post, we will explore how the UK’s AI job market compares to that of the United States, Europe, and Asia, delving into differences in job demand, salaries, and workplace culture. Additionally, we will provide insights for candidates considering remote or international opportunities. Whether you are a freshly qualified graduate in data science, an experienced machine learning engineer, or a professional from a parallel domain looking to transition into AI, understanding the global vs. local landscape can help you make an informed decision about your career trajectory. As the demand for artificial intelligence skills grows—and borders become more porous with hybrid and remote work—the possibilities for ambitious job-seekers are expanding exponentially. This article will offer a comprehensive look at the various regional markets, exploring how the UK fares in comparison to other major AI hubs. We’ll also suggest factors to consider when choosing where in the world to work, whether physically or remotely. By the end, you’ll have a clearer picture of the AI employment landscape, and you’ll be better prepared to carve out your own path.