[11/11/2024] Data Engineering Lead - AWS &Snowflake

Datatech Analytics
London
1 year ago
Applications closed

Related Jobs

View all jobs

Machine Learning Engineer Python LLM AWS

Global Banking & Markets - Data Scientist / Machine Learning Scientist, Marquee Sales Strats - Associate

Senior Machine Learning Scientist

Machine Learning Engineer

Data Scientist

Computer Vision and Artificial Intelligence Engineer

Data Engineering Lead – AWS & Snowflake Hybridworking: 3 days in TW6, Middlesex offices & 2 days homer/remoteSalary: Negotiable to £70,000 DOE plus 40 % bonus potential JobReference: J12869 Full UK working rights required/no sponsorshipavailable THE ROLE Looking for a challenge in one of the world’slargest airfreight logistics organisation and a FTSE 100 company?Within the Digital and Information function, the Data EngineeringLead will play a pivotal role in delivering and operating dataproducts. Reporting to the Head of Data, Insights & OperationalResearch, this position holds significant responsibility within thedata leadership team, ensuring our data solutions and businessprocesses are fully aligned and contribute to the vision andstrategic direction of the organisation. The successful candidatewill join the team at an exciting time. They are in the earlystages of a major programme of work to modernise their datainfrastructure, tooling and processes to migrate from an on-premiseto a cloud native environment and the Data Engineering Lead will beessential to the success of the transformation. Using your strongcommunication skills combined with a determined attitude you willbe responsible for managing and developing a team of data engineersto develop effective and innovative solutions aligning to ourarchitectural principles and the business need. You will ensure theteam adheres to best practices in data engineering and contributesto the continuous improvement of our data systems. DUTIES Keyresponsibilities for this role include: 1. Lead the design,development, and deployment of scalable and efficient datapipelines and architectures. 2. Manage and mentor a team of dataengineers, ensuring a culture of collaboration and excellence. 3.Manage demand for data engineering resources, prioritising tasksand projects based on business needs and strategic goals. 4.Monitor and report on the progress of data engineering projects,addressing any issues or risks that may arise. 5. Collaborateclosely with Analytics Leads, Data Architects, and the widerDigital and Information team to ensure seamless integration andoperation of data solutions. 6. Develop and implement a robust dataoperations capability to ensure the smooth running and reliabilityof our data estate. 7. Drive the adoption of cloud technologies andmodern data engineering practices within the team. 8. Ensure datagovernance and compliance with relevant regulations and standards.9. Work with the team to define and implement best practices fordata engineering, including coding standards, documentation,version control. PERSON SPECIFICATION Skills 1. Expert in SQL anddatabase concepts including performance tuning and optimisation 2.Solid understanding of data warehousing principles and datamodelling practice 3. Strong engineering skills, preferably in thefollowing toolsets 4. AWS services (S3, EC2, Lambda, Glue) 5. ETLTools (e.g. Apache Airflow) 6. Streaming processing tools (e.g.Kinesis) 7. Snowflake 8. Python 9. Excellent knowledge of creationand maintenance of data pipelines 10. Strong problem-solving andanalytical skills, with the ability to troubleshoot and resolvecomplex data-related issues 11. Proficient in data integrationtechniques including APIs and real-time ingestion 12. Excellentcommunication and collaboration skills to work effectively withcross-functional teams 13. Capable of building, leading, anddeveloping a team of data engineers 14. Strong project managementskills and an ability to manage multiple projects and prioritiesExperience 1. Experienced and confident leadership of dataengineering activities (essential) 2. Expert in data engineeringpractise on cloud data platforms (essential) 3. Background in dataanalysis and preparation, including experience with large data setsand unstructured data (desirable) 4. Knowledge of AI/Data Scienceprinciples (desirable) If you would like to hear more, please doget in touch.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many AI Tools Do You Need to Know to Get an AI Job?

If you are job hunting in AI right now it can feel like you are drowning in tools. Every week there is a new framework, a new “must-learn” platform or a new productivity app that everyone on LinkedIn seems to be using. The result is predictable: job seekers panic-learn a long list of tools without actually getting better at delivering outcomes. Here is the truth most hiring managers will quietly agree with. They do not hire you because you know 27 tools. They hire you because you can solve a problem, communicate trade-offs, ship something reliable and improve it with feedback. Tools matter, but only in service of outcomes. So how many AI tools do you actually need to know? For most AI job seekers: fewer than you think. You need a tight core toolkit plus a role-specific layer. Everything else is optional. This guide breaks it down clearly, gives you a simple framework to choose what to learn and shows you how to present your toolset on your CV, portfolio and interviews.

What Hiring Managers Look for First in AI Job Applications (UK Guide)

Hiring managers do not start by reading your CV line-by-line. They scan for signals. In AI roles especially, they are looking for proof that you can ship, learn fast, communicate clearly & work safely with data and systems. The best applications make those signals obvious in the first 10–20 seconds. This guide breaks down what hiring managers typically look for first in AI applications in the UK market, how to present it on your CV, LinkedIn & portfolio, and the most common reasons strong candidates get overlooked. Use it as a checklist to tighten your application before you click apply.

The Skills Gap in AI Jobs: What Universities Aren’t Teaching

Artificial intelligence is no longer a future concept. It is already reshaping how businesses operate, how decisions are made, and how entire industries compete. From finance and healthcare to retail, manufacturing, defence, and climate science, AI is embedded in critical systems across the UK economy. Yet despite unprecedented demand for AI talent, employers continue to report severe recruitment challenges. Vacancies remain open for months. Salaries rise year on year. Candidates with impressive academic credentials often fail technical interviews. At the heart of this disconnect lies a growing and uncomfortable truth: Universities are not fully preparing graduates for real-world AI jobs. This article explores the AI skills gap in depth—what is missing from many university programmes, why the gap persists, what employers actually want, and how jobseekers can bridge the divide to build a successful career in artificial intelligence.