Data Engineer - London

City of London
11 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer (Data Science)

Data Engineer: Data Pipelines & DataOps (Edinburgh, 6m)

Data Engineer — DataOps, Cloud Data Pipelines

Data Engineer — Hybrid: Pipelines & DataOps Expert

Data Engineer - DataOps & Cloud Data Pipelines

Data Engineer for Data Science — Marketing Analytics

Data Engineer - London - Hybrid - £100 - £115k

This is a great opportunity for a data engineer and snowflake expert to join a leading global company in the energy commodities industry. This position will play an integral role as the team implements new data management platforms, creates new data ingestion pipelines, and sources new data sets. The role will assist with all aspects of data - from data architecture design to on-going data management.

Salary & Benefits

Highly competitive salary of up to £115k
Competitive comprehensive medical, dental, retirement and life insurance benefits
Employee assistance & wellness programs
Parental and family leave policies
Tuition assistance & reimbursement
Quarterly Innovation & Collaboration Awards
Employee discount program, including access to fitness facilities
Competitive paid time off
Continued learning opportunitiesRole & Responsibilities

Execute data architecture and data management projects for both new and existing data sources.
Transition existing data sets, databases, and code from Oracle to Snowflake.
Lead analysis of data sets using a variety of techniques such as machine learning.
Manage end to end data ingestion process and publishing to investing teams.
Own the process of mapping, standardising, and normalising data.
Ad hoc research on project topics such as vendor trends, usage best practices, big data trends, artificial intelligence, vendors, etc.
Help transition existing data sets, databases, and code to Snowflake.
Assess data loads for tactical errors and build out appropriate workflows, as well as create data quality analysis that identifies larger issues in data.
Actively manage vendors and capture changes in data input proactively.
Properly prioritise and resolve data issues based on business usage.
Assist with managing strategic initiatives around big data projects for the commercial (trading) business.
Partner with commercial teams to gain understanding of current data flow, data architecture, investment process as well as gather functional requirements.
Assess gaps in current datasets and remediate.
What do I need to apply for the role

Expert use of Snowflake
Depth of experience with Python
Strong SQL/Oracle
Experience in energy commodities or financial services required.
Experience in mapping, standardizing, and normalizing data.
Experience with data integration platforms is preferred, and SnapLogic experience is highly preferred.
Extensive work experience with ETL/ELT frameworks to write pipelines to load millions of records.
Strong analytics skills with demonstrated attention to details.
Familiarity with Business intelligence tools Power BI and Tableau.
Interest or experience in machine learning/Artificial Intelligence is a plus.

My client have very limited interview slots and they are looking to fill this vacancy within the next 2 weeks. I have limited slots for 1st stage interviews next week so if you're interest, get in touch ASAP with a copy of your most recent and up to date CV and email me at or you can call me on (phone number removed).

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, the London Power BI User Group, Newcastle Power BI User Group and Newcastle Data Platform and Cloud User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Hiring Managers Look for First in AI Job Applications (UK Guide)

Hiring managers do not start by reading your CV line-by-line. They scan for signals. In AI roles especially, they are looking for proof that you can ship, learn fast, communicate clearly & work safely with data and systems. The best applications make those signals obvious in the first 10–20 seconds. This guide breaks down what hiring managers typically look for first in AI applications in the UK market, how to present it on your CV, LinkedIn & portfolio, and the most common reasons strong candidates get overlooked. Use it as a checklist to tighten your application before you click apply.

The Skills Gap in AI Jobs: What Universities Aren’t Teaching

Artificial intelligence is no longer a future concept. It is already reshaping how businesses operate, how decisions are made, and how entire industries compete. From finance and healthcare to retail, manufacturing, defence, and climate science, AI is embedded in critical systems across the UK economy. Yet despite unprecedented demand for AI talent, employers continue to report severe recruitment challenges. Vacancies remain open for months. Salaries rise year on year. Candidates with impressive academic credentials often fail technical interviews. At the heart of this disconnect lies a growing and uncomfortable truth: Universities are not fully preparing graduates for real-world AI jobs. This article explores the AI skills gap in depth—what is missing from many university programmes, why the gap persists, what employers actually want, and how jobseekers can bridge the divide to build a successful career in artificial intelligence.

AI Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Changing career into artificial intelligence in your 30s, 40s or 50s is no longer unusual in the UK. It is happening quietly every day across fintech, healthcare, retail, manufacturing, government & professional services. But it is also surrounded by hype, fear & misinformation. This article is a realistic, UK-specific guide for career switchers who want the truth about AI jobs: what roles genuinely exist, what skills employers actually hire for, how long retraining really takes & whether age is a barrier (spoiler: not in the way people think). If you are considering a move into AI but want facts rather than Silicon Valley fantasy, this is for you.