Jobs

Apply in 3 Minutes! Senior Data Engineer


Job details
  • SR2 | Socially Responsible Recruitment | Certified BCorporation™
  • 2 days ago

The following role is a Fixed Term Contract, with theideal candidate starting in October and working up until Christmas2025. The company: Are an organisation dedicated to building asociety where everyone has a secure place to live, supportivepeople around them, and a meaningful purpose. They achieve thisthrough two key approaches: delivering high-quality public servicesto improve lives on the frontline, and using their knowledge todrive systemic change, addressing the complex web that can trap anddisempower those it was created to help. With the heart of acharity and the mindset of a business, we are uniquely positionedto address this challenging agenda. Where You Fit In It’s anexciting time for the charity as they embark on their firstlarge-scale data transformation project. We are seeking aforward-thinking, dynamic problem solver to be our go-to expert indata engineering. The Data Architecture Project will centralisetheir siloed data assets into one ecosystem, allowing them to divedeeper into insights from their projects and databases, and tomeasure impact more effectively. In the future, this valuableinformation will be used to predict needs on the frontline ofservice delivery. In this project, you will work within theEvidence and Insight Team and collaborate across the organisation,including the wider Corporate Services Team and key stakeholdersfrom various Delivery Teams. They are a rapidly growing, agile teamthat ensures we stay up-to-date with the latest standards by usingkey tools such as Azure Data Factory, Databricks, Terraform,DevOps, and Jinja. They believe trust and transparency are keydrivers of best practice, and they offer an environment built onshared ownership, unity, and emotional intelligence. Main Duties& Accountabilities As the Senior Data Engineer, you will play apivotal role in designing and building our data ecosystem. Keyareas of responsibility will include: Architecture Design: Lead thedevelopment and implementation of a dynamic, elastic, and resilientdata architecture that supports current and future contracts. Thisrole requires cross-departmental and external collaboration toidentify needs and create data solutions, along with the ability tocommunicate and translate complex technical concepts effectively.You must understand the full data lifecycle and business needs todevelop suitable solutions. ETL Process: Collaborate with externaland internal teams to build and implement Extract, Transform, Load(ETL) processes and comprehensive pipelines using tools like AzureData Factory, Azure Logic/Functions Apps, and Databricks. You willextract data from diverse, complex sources across the organisation,transform it into a usable format, and load it into data storagesystems. Reviewing systems and suggesting optimisation solutionsfor organisational efficiency and security will be required. DataPipeline Management: Build and manage data pipelines that arefault-tolerant, reliable, and dynamic. Automate data workflows,including data ingestion, aggregation, and ETL processing. Ensuredata accuracy, integrity, security, and compliance in collaborationwith the wider team and Information Security team. Data Modelling:Ensure business readiness from the data we ingest, with a strongknowledge of data modelling, creating queryable, efficientanalytics-ready models. Work alongside analysts to speed upanalysis and make our organisation AI/ML-ready. Cloud-BasedSolutions: Serve as the expert on all things Azure, including themanagement of the data infrastructure, best practices, costoptimisation, and performance tuning. Skill Development: As anexpert in data engineering, you will play a fundamental role in thedata maturity journey, upskilling and supporting data professionalsacross the organisation to sharpen and grow their skills whileenhancing an environment of skill development. About You You willhave at least 5 years of experience in data engineering roles andbe an Azure expert. You thrive in small, collaborative teams thatwork quickly and maintain a high level of quality. You should haveenough business acumen to understand how our work ties into thebigger picture, along with a sharp eye for details and an abilityto spot inconsistencies. Your skill set should include: DataAnalysis and Synthesis: Ability to bring multiple data sourcestogether in a conformed model for analysis. Cloud Management:Expertise in managing and optimising cloud data management systems.Data Modelling: Understanding of the concepts and principles ofdata modelling and the ability to produce relevant data models.Programming and Building: Proficiency in leading on design, coding,testing, and corrections, with input from others on specifications.Technical Understanding: Strong knowledge and understanding oftechnical concepts within the role and the wider landscape. SkillDevelopment: Capability to lead and coach others to improve teamskills. Collaboration: Ability to work across multiple teams andwith external resources to achieve the best outcomes. Strategy:Understanding of how work fits within the broader organisationallandscape and potential future developments. Key Success Outcomesfor This Role: Data is captured within one ecosystem, and systemsare maintainable. The organisation is well-positioned for futuredata insights, building predictive models, and data scienceopportunities by Summer 2025. Clear and well-documented datapipelines are established and maintained. A data maturity frameworkis co-created with the Data Transformation Programme Manager andother collaborative stakeholders. Strong foundations of dataquality, governance, and security are provided to future-proof datapractices.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Scientist

The Value of Active Minds About JupiterJupiter is one of the UK’s leading investment management companies with just over 500 employees and £51.4 billion worth of assets under management (as at 30th June 2023). Jupiter provides investment services to individual and institutional investors through mutual funds (UK unit trusts, Luxembourg...

Jupiter London

Data Scientist

Hi, we’re Bloom & Wild. We don’t just send flowers. We help our customers to care wildly. Caring wildly is celebrating the little things we all do for each other every day. Not just the big occasions. It’s being there for the highs. Stepping up for the lows.We care wildly...

Bloom & Wild London

Technical Product Manager

Hi, we’re Bloom & Wild. We don’t just send flowers. We help our customers to care wildly. Caring wildly is celebrating the little things we all do for each other every day. Not just the big occasions. It’s being there for the highs. Stepping up for the lows.We care wildly...

Bloom & Wild London

Assurance Analysis (3 roles available), Analysis Directorate, Ministry of Justice (Ref: 90632)

Job summaryThis position is based NationallyJob descriptionDo you have the passion, values, and ability to help us solve the biggest problems of the justice system?SEO Assurance Analyst, Analysis Directorate Ministry of Justice�1. � �OverviewWe have up to 3 roles in the Analysis Assurance team, within the Analysis Directorate.Roles are open...

Ministry of Justice

Data Analyst (Entry Level)

Are you looking to kickstart your career in data? Join iO-Sphere's Data Analyst Experience Accelerator to land a job as a data analyst at a leading organisation Apply now to join our upcoming cohorts starting October 7th or November 18th:https://data-analytics.io-sphere.io/Why choose iO-Sphere? We run a unique training programme - the...

IO Sphere London

Senior Credit Strategy Analyst

We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds.If there’s anything we can do to accommodate your specific situation, please let us know.About CleoMost people come to Cleo to do work that matters. Every day,...

Cleo AI London