Lead Data Engineer – Join Us in Shaping the Future of Energy!

Are you a seasoned Data Engineering Lead with expertise in Microsoft technology stacks? This is your opportunity to lead and innovate as part of the Civil Works Alliance (CWA), contributing to the transformation of the UK’s energy landscape.

As part of our commitment to the Sizewell C project – a 3.2-gigawatt nuclear power station generating clean, low-carbon electricity for millions of homes – you will drive the development and integration of cutting-edge data solutions. In this pivotal role, you will manage complex data contracts, ensure top-tier data quality, and lead the team responsible for deploying scalable and efficient data services across both cloud-based and on-premises platforms.

Key Responsibilities:

Lead and mentor a team of data engineers, developers, testers, and data modellers while fostering a collaborative and inclusive environment.

Design and implement scalable data solutions using Microsoft Azure Data Platform and Azure Databricks.

Oversee the architecture and maintenance of secure data systems and ensure their alignment with business needs.

Implement systems to monitor and ensure high data quality, governance, compliance, and lifecycle management.

Research and integrate innovative tools, including AI and machine learning, to enhance data practices.

Work closely with IT teams and stakeholders to align data strategies with broader business goals.

Manage budgets and resources effectively for data initiatives while promoting Equality, Diversity, and Inclusion (EDI) in all aspects of your work.

Skills and Expertise Required:

Extensive experience in data lake and lakehouse architectures, as well as ETL/ELT processes.

Advanced knowledge of Azure Data Factory V2, Azure Databricks, Azure Data Lake Gen2, and Azure Event Hubs.

Proficiency in SQL, PySpark, and Python for data transformation and scripting.

Hands-on experience with DevOps practices and managing CI/CD pipelines.

Expertise in big data technologies such as Hadoop, Spark, and Kafka.

Strong leadership skills, with experience in managing and developing high-performing teams.

Familiarity with MuleSoft and systems thinking is a plus.

Qualifications and Experience:

Proven track record in a Lead Data Engineering role.

Accreditation from a recognised governing body is desirable.

Experience in setting up and growing a data engineering team is advantageous.

As we continue to build for the future of the UK's energy infrastructure, this is an exciting opportunity to make a meaningful impact. If you're ready to take on a leadership role in driving innovation and excellence in data engineering, we’d love to hear from you. Click the link to apply today