Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer

BI, Big Data & Analytics
Penrith
1 year ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer – Data Science & Engineering | Global Lifestyle Brand

Senior Data Engineer – Data Science & Engineering | Global Lifestyle Brand

Senior Data Engineer (AI & MLOps, AWS, Python)

Senior Data Infrastructure & MLOps Engineer

Senior Data Scientist (Product Analytics)

Senior Data Scientists/Analysts - MOD, National Security, Defence, or Government

Senior Data Engineer opportunity to join a well-known financial services company working on a Remote first basis (once a month in the office on average).

Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits

Purpose of Job

Advise on and ensure the maximum return of value from the company's data assets; through use of best practice data engineering techniques that aid the delivery of the company's data management strategy and roadmap and align to regulatory requirements.

Contribute towards the support, maintenance, and improvement of the company's platform inc data pipelines, and ensure data quality and governance.

Responsibilities

Advise on the Design, implementation, and maintenance of complex data engineering solutions. Ensure the implementation, and maintenance of complex data engineering solutions to acquire and prepare data and that it adheres to Best Practice. (Extract, Transform, Load) Contributes towards and ensures the delivery of the creation and maintenance of data pipelines to connect data within and between data stores, applications, and organisations. Contributes towards and ensures the delivery of complex data quality checking and remediation. Identifying data sources, data processing concepts and methods Evaluating, designing and implementing on-premise, cloud-based and hybrid data engineering solutions Structuring and storing data for uses including - but not limited to - analytics, machine learning, data mining, sharing with applications and organisations. Harvesting structured and unstructured data Integrating, consolidating, and cleansing data Migrating and converting data Applying ethical principles and regulatory requirements in handling data Ensuring appropriate storage of data in line with relevant legislation, and the company requirements. Guiding and contributing towards the development of junior & trainee Data Engineers. Providing Technical guidance to Data Engineers

Knowledge, Experience and qualifications

Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation, optimisation and maintenance of Relational SQL and NoSQL databases. Experienced working with CI/CD tooling such as Azure DevOps/GitHub including repos, source-control, pipelines, actions. Awareness of Informatica or similar data governance tools (Desirable) Experience of working in agile (SCRUM) and waterfall delivery-type teams. Experienced with Confluence & Jira. Experience in a financial services or other highly regulated environment. Any experience or interest in AI is desirable

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why AI Careers in the UK Are Becoming More Multidisciplinary

Artificial intelligence is no longer a single-discipline pursuit. In the UK, employers increasingly want talent that can code and communicate, model and manage risk, experiment and empathise. That shift is reshaping job descriptions, training pathways & career progression. AI is touching regulated sectors, sensitive user journeys & public services — so the work now sits at the crossroads of computer science, law, ethics, psychology, linguistics & design. This isn’t a buzzword-driven change. It’s happening because real systems are deployed in the wild where people have rights, needs, habits & constraints. As models move from lab demos to products that diagnose, advise, detect fraud, personalise education or generate media, teams must align performance with accountability, safety & usability. The UK’s maturing AI ecosystem — from startups to FTSE 100s, consultancies, the public sector & universities — is responding by hiring multidisciplinary teams who can anticipate social impact as confidently as they ship features. Below, we unpack the forces behind this change, spotlight five disciplines now fused with AI roles, show what it means for UK job-seekers & employers, and map practical steps to future-proof your CV.

AI Team Structures Explained: Who Does What in a Modern AI Department

Artificial Intelligence (AI) and Machine Learning (ML) are no longer confined to research labs and tech giants. In the UK, organisations from healthcare and finance to retail and logistics are adopting AI to solve problems, automate processes, and create new products. With this growth comes the need for well-structured teams. But what does an AI department actually look like? Who does what? And how do all the moving parts come together to deliver business value? In this guide, we’ll explain modern AI team structures, break down the responsibilities of each role, explore how teams differ in startups versus enterprises, and highlight what UK employers are looking for. Whether you’re an applicant or an employer, this article will help you understand the anatomy of a successful AI department.

Why the UK Could Be the World’s Next AI Jobs Hub

Artificial Intelligence (AI) has rapidly moved from research labs into boardrooms, classrooms, hospitals, and homes. It is already reshaping economies and transforming industries at a scale comparable to the industrial revolution or the rise of the internet. Around the world, countries are competing fiercely to lead in AI innovation and reap its economic, social, and strategic benefits. The United Kingdom is uniquely positioned in this race. With a rich heritage in computing, world-class universities, forward-thinking government policy, and a growing ecosystem of startups and enterprises, the UK has many of the elements needed to become the world’s next AI hub. Yet competition is intense, particularly from the United States and China. Success will depend on how effectively the UK can scale its strengths, close its gaps, and seize opportunities in the years ahead. This article explores why the UK could be the world’s next global hub for artificial intelligence, what challenges it must overcome, and what this means for businesses, researchers, and job seekers.