Lead Data Engineer - West London (Hybrid) - £90,000-£100,000

Our client is seeking an experienced Lead Data Engineer to join their Engineering team within the Digital & Product Department in West London. In this hands-on role, you will lead a team of data engineers to design and build scalable data pipelines. These pipelines will transform and integrate data from various sources in a repeatable way, automating processes to ensure smooth data ingestion, cleansing, and transformation.

Duties & Responsibilities

• Lead the design, development, and maintenance of ETL and data integration solutions across a wide range of technologies and data sources.
• Manage and update the overall Data Engineering Architecture to ensure scalability and performance.
• Analyse and organize raw data from different sources, ensuring data quality and reliability.
• Identify, design, and implement internal process improvements, including automating manual processes and optimizing data delivery pipelines.
• Work with cloud-based infrastructure (Azure) to host data solutions and applications.

Skills Required

• Extensive experience as a data engineer, with a proven track record in leading data engineering teams.
• Proficient in developing and maintaining ETL/ELT processes within a medallion architecture.
• Strong background in data modelling within a cloud-based data platform.
• In-depth experience with SQL Server and relational databases.
• Expertise in the Azure data engineering stack, including Azure Synapse, Azure Data Lake, and Azure ML Studio.
• Strong programming experience with Python, PySpark, and T-SQL.

Join our client in West London and lead the development of cutting-edge data solutions. Apply now to become their next Lead Data Engineer!