[11/11/2024] Data Engineering Lead - AWS &Snowflake

Datatech Analytics
London
1 year ago
Applications closed

Related Jobs

View all jobs

Senior Machine Learning Engineer

Data Science Engineer

Machine Learning Engineer

Lead Machine Learning Engineer

Applied Machine Learning Engineer

Senior Machine Learning Engineer

Data Engineering Lead – AWS & Snowflake Hybridworking: 3 days in TW6, Middlesex offices & 2 days homer/remoteSalary: Negotiable to £70,000 DOE plus 40 % bonus potential JobReference: J12869 Full UK working rights required/no sponsorshipavailable THE ROLE Looking for a challenge in one of the world’slargest airfreight logistics organisation and a FTSE 100 company?Within the Digital and Information function, the Data EngineeringLead will play a pivotal role in delivering and operating dataproducts. Reporting to the Head of Data, Insights & OperationalResearch, this position holds significant responsibility within thedata leadership team, ensuring our data solutions and businessprocesses are fully aligned and contribute to the vision andstrategic direction of the organisation. The successful candidatewill join the team at an exciting time. They are in the earlystages of a major programme of work to modernise their datainfrastructure, tooling and processes to migrate from an on-premiseto a cloud native environment and the Data Engineering Lead will beessential to the success of the transformation. Using your strongcommunication skills combined with a determined attitude you willbe responsible for managing and developing a team of data engineersto develop effective and innovative solutions aligning to ourarchitectural principles and the business need. You will ensure theteam adheres to best practices in data engineering and contributesto the continuous improvement of our data systems. DUTIES Keyresponsibilities for this role include: 1. Lead the design,development, and deployment of scalable and efficient datapipelines and architectures. 2. Manage and mentor a team of dataengineers, ensuring a culture of collaboration and excellence. 3.Manage demand for data engineering resources, prioritising tasksand projects based on business needs and strategic goals. 4.Monitor and report on the progress of data engineering projects,addressing any issues or risks that may arise. 5. Collaborateclosely with Analytics Leads, Data Architects, and the widerDigital and Information team to ensure seamless integration andoperation of data solutions. 6. Develop and implement a robust dataoperations capability to ensure the smooth running and reliabilityof our data estate. 7. Drive the adoption of cloud technologies andmodern data engineering practices within the team. 8. Ensure datagovernance and compliance with relevant regulations and standards.9. Work with the team to define and implement best practices fordata engineering, including coding standards, documentation,version control. PERSON SPECIFICATION Skills 1. Expert in SQL anddatabase concepts including performance tuning and optimisation 2.Solid understanding of data warehousing principles and datamodelling practice 3. Strong engineering skills, preferably in thefollowing toolsets 4. AWS services (S3, EC2, Lambda, Glue) 5. ETLTools (e.g. Apache Airflow) 6. Streaming processing tools (e.g.Kinesis) 7. Snowflake 8. Python 9. Excellent knowledge of creationand maintenance of data pipelines 10. Strong problem-solving andanalytical skills, with the ability to troubleshoot and resolvecomplex data-related issues 11. Proficient in data integrationtechniques including APIs and real-time ingestion 12. Excellentcommunication and collaboration skills to work effectively withcross-functional teams 13. Capable of building, leading, anddeveloping a team of data engineers 14. Strong project managementskills and an ability to manage multiple projects and prioritiesExperience 1. Experienced and confident leadership of dataengineering activities (essential) 2. Expert in data engineeringpractise on cloud data platforms (essential) 3. Background in dataanalysis and preparation, including experience with large data setsand unstructured data (desirable) 4. Knowledge of AI/Data Scienceprinciples (desirable) If you would like to hear more, please doget in touch.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Changing career into artificial intelligence in your 30s, 40s or 50s is no longer unusual in the UK. It is happening quietly every day across fintech, healthcare, retail, manufacturing, government & professional services. But it is also surrounded by hype, fear & misinformation. This article is a realistic, UK-specific guide for career switchers who want the truth about AI jobs: what roles genuinely exist, what skills employers actually hire for, how long retraining really takes & whether age is a barrier (spoiler: not in the way people think). If you are considering a move into AI but want facts rather than Silicon Valley fantasy, this is for you.

How to Write an AI Job Ad That Attracts the Right People

Artificial intelligence is now embedded across almost every sector of the UK economy. From fintech and healthcare to retail, defence and climate tech, organisations are competing for AI talent at an unprecedented pace. Yet despite the volume of AI job adverts online, many employers struggle to attract the right candidates. Roles are flooded with unsuitable applications, while highly capable AI professionals scroll past adverts that feel vague, inflated or disconnected from reality. In most cases, the issue isn’t a shortage of AI talent — it’s the quality of the job advert. Writing an effective AI job ad requires more care than traditional tech hiring. AI professionals are analytical, sceptical of hype and highly selective about where they apply. A poorly written advert doesn’t just fail to convert — it actively damages your credibility. This guide explains how to write an AI job ad that attracts the right people, filters out mismatches and positions your organisation as a serious employer in the AI space.

Maths for AI Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are a software engineer, data scientist or analyst looking to move into AI or you are a UK undergraduate or postgraduate in computer science, maths, engineering or a related subject applying for AI roles, the maths can feel like the biggest barrier. Job descriptions say “strong maths” or “solid fundamentals” but rarely spell out what that means day to day. The good news is you do not need a full maths degree worth of theory to start applying. For most UK roles like Machine Learning Engineer, AI Engineer, Data Scientist, Applied Scientist, NLP Engineer or Computer Vision Engineer, the maths you actually use again & again is concentrated in a handful of topics: Linear algebra essentials Probability & statistics for uncertainty & evaluation Calculus essentials for gradients & backprop Optimisation basics for training & tuning A small amount of discrete maths for practical reasoning This guide turns vague requirements into a clear checklist, a 6-week learning plan & portfolio projects that prove you can translate maths into working code.