Jobs

[11/11/2024] Data Engineering Lead - AWS &Snowflake


Job details
  • Datatech Analytics
  • London
  • 3 days ago

Data Engineering Lead – AWS & Snowflake Hybridworking: 3 days in TW6, Middlesex offices & 2 days homer/remoteSalary: Negotiable to £70,000 DOE plus 40 % bonus potential JobReference: J12869 Full UK working rights required/no sponsorshipavailable THE ROLE Looking for a challenge in one of the world’slargest airfreight logistics organisation and a FTSE 100 company?Within the Digital and Information function, the Data EngineeringLead will play a pivotal role in delivering and operating dataproducts. Reporting to the Head of Data, Insights & OperationalResearch, this position holds significant responsibility within thedata leadership team, ensuring our data solutions and businessprocesses are fully aligned and contribute to the vision andstrategic direction of the organisation. The successful candidatewill join the team at an exciting time. They are in the earlystages of a major programme of work to modernise their datainfrastructure, tooling and processes to migrate from an on-premiseto a cloud native environment and the Data Engineering Lead will beessential to the success of the transformation. Using your strongcommunication skills combined with a determined attitude you willbe responsible for managing and developing a team of data engineersto develop effective and innovative solutions aligning to ourarchitectural principles and the business need. You will ensure theteam adheres to best practices in data engineering and contributesto the continuous improvement of our data systems. DUTIES Keyresponsibilities for this role include: 1. Lead the design,development, and deployment of scalable and efficient datapipelines and architectures. 2. Manage and mentor a team of dataengineers, ensuring a culture of collaboration and excellence. 3.Manage demand for data engineering resources, prioritising tasksand projects based on business needs and strategic goals. 4.Monitor and report on the progress of data engineering projects,addressing any issues or risks that may arise. 5. Collaborateclosely with Analytics Leads, Data Architects, and the widerDigital and Information team to ensure seamless integration andoperation of data solutions. 6. Develop and implement a robust dataoperations capability to ensure the smooth running and reliabilityof our data estate. 7. Drive the adoption of cloud technologies andmodern data engineering practices within the team. 8. Ensure datagovernance and compliance with relevant regulations and standards.9. Work with the team to define and implement best practices fordata engineering, including coding standards, documentation,version control. PERSON SPECIFICATION Skills 1. Expert in SQL anddatabase concepts including performance tuning and optimisation 2.Solid understanding of data warehousing principles and datamodelling practice 3. Strong engineering skills, preferably in thefollowing toolsets 4. AWS services (S3, EC2, Lambda, Glue) 5. ETLTools (e.g. Apache Airflow) 6. Streaming processing tools (e.g.Kinesis) 7. Snowflake 8. Python 9. Excellent knowledge of creationand maintenance of data pipelines 10. Strong problem-solving andanalytical skills, with the ability to troubleshoot and resolvecomplex data-related issues 11. Proficient in data integrationtechniques including APIs and real-time ingestion 12. Excellentcommunication and collaboration skills to work effectively withcross-functional teams 13. Capable of building, leading, anddeveloping a team of data engineers 14. Strong project managementskills and an ability to manage multiple projects and prioritiesExperience 1. Experienced and confident leadership of dataengineering activities (essential) 2. Expert in data engineeringpractise on cloud data platforms (essential) 3. Background in dataanalysis and preparation, including experience with large data setsand unstructured data (desirable) 4. Knowledge of AI/Data Scienceprinciples (desirable) If you would like to hear more, please doget in touch.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

▷ (11/11/2024) Lead Electronics Engineer

Sportable is a leading sports technology company on amission to solve the hardest problems in elite sports using cuttingedge technology. From bare metal to cloud Sportable is amultidisciplinary mecca for sports and technology enthusiasts. Ifyou're a data scientist, computer scientist, physicist, sportsscientist, engineer, business graduate, graphic designer,mechanical designer, creative or...

Sportable London

Data Science Degree Apprenticeship - Level 6 - London - News & Current Affairs

Salary: £21,840 (+ £5,318 London Living Allowance)Contract type: Fixed Term Contract Location: London An apprenticeship at the BBC gives you the opportunity to kick-start your career in a job you'll love. We’re the industry leaders in early careers and are committed to your skills and talent development. As one of...

BBC London