One of the world's largest retailers is looking for aStaff Data Platform Engineer

Salary: up to ~£120k (+ 20% bonus)

Location: Central London (3 office days/week)

Role Overview

You will play a key role in designing, developing, and deploying a scalable data platform and infrastructure that empowers users to create advanced analytics, machine learning, and GenAI solutions to enhance the company's security efforts. You will lead architectural decisions, guide technical direction, and mentor the engineering team to deliver high quality data services.

✅Must have requirements:

• Experience designing, building and deploying scalable and reliable data platforms on cloud services - ideally withDatabricksonAzure(although experience with AWS and GCP services is also acceptable and transferrable)
• Experience building and maintaining data pipelines that ingest, process, and transform large volumes of data from various sources
• Proficiency inPythonandSQL, with a solid grasp of architectural patterns, coding standards, code reviews, version control, andCI/CDpractices.
• Expertise inETLandELTframeworks for large scale realtime and batch data processing, with hands-on experience inKafka,Flink,Airflowanddbt
• Containerisation and orchestration experience withDockerandKubernetes
• Great communication skills

Bonus points for:

• Data warehousing and data lake experience - ideally with Databricks on Azure
• Knowledge of cybersecurity principles and practices
• Experience working with security engineers/analysts and senior security stakeholders
• Infrastructure automation experience with Terraform
• Source code control experience with Git
• Having worked in global tech companies, global retailers and/or high growth scale-ups with progressive tech stack