Jobs

Principal Data Engineer (Core Engineering)


Job details
  • Royal London Group
  • Edinburgh
  • 2 months ago
Applications closed

Job Title: Principal Data Engineer

Contract Type: Permanent

Location: Alderley or Edinburgh or Glasgow

Working style: Hybrid 50% home/office based

Closing date: 29th October 2024

 

Royal London is seeking a Principal Data Engineer to lead a Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to the Group’s data strategy and consists of a core structured data warehouse area plus an attached data science\ML platform.

 

This role presents a fantastic opportunity for an experienced data engineer – helping setup the core engineering team (who consist of data engineers, testers, and data modellers), defining reusable frameworks, patterns, and standards, guiding the data modellers in the definition and extension of the silver layer data model, and managing Agile Engineering boards/backlogs.

 

About the Role

 

  • Design and implement Extract, Transform, and Load (ETL) processes across a Data Lakehouse to ensure efficient data movement with appropriate transformations. Define and publish data engineering and ETL standards for the data platform.
  • Analyse and communicate complex data engineering problems to senior audiences. Work with both structured and unstructured data to support downstream business outcomes. Oversee data movement across platforms, including designing controls and technical checks for monitoring data pipelines.
  • Work with Databricks, Lakehouse, ETL, and data pipelines.
  • Provide technical leadership, responsible for mid and lower-level designs, patterns, and standards. Produce artifacts for architecture and design authorities to make informed decisions.

 

About You

 

  • Extensive technical design and development experience in specialism for the platform. Expected to be a code contributor in specialism.
  • Experience with Azure Databricks, Azure Data Factory.
  • Proficiency in SQL, Python, and PySpark.
  • Knowledge of Azure data lake, ADLS Gen 2 storage, and Azure services.
  • Extensive experience with Data Warehousing, ETL concepts, and data structure designs, including data pipelines and data marts (Inmon & Kimball approaches).
  • A broad understanding of BI and analytics tools, such as PowerBI, and optimizing consumption against engineered data layers.
  • Broad knowledge within wider and adjacent data domains, for example, ML/AI, Master Data Management (MDM), data analysis, and data modeling.

 

About Royal London

 

We’re the UK’s largest mutual life, pensions, and investment company, offering protection, long-term savings and asset management products and services.   

 

OurPeople Promiseto our colleagues is that we will all work somewhere inclusive, responsible, enjoyable and fulfilling. This is underpinned by our Spirit of Royal London values; Empowered, Trustworthy, Collaborate, Achieve. 

 

We've always been proud to reward employees by offering great workplace benefits such as 28 days annual leave in addition to bank holidays, an up to 14% employer matching pension scheme and private medical insurance. You can see all our benefits here -Our Benefits

 

Inclusion, diversity and belonging. 

 

We’re anInclusiveemployer. We celebrate and value different backgrounds and cultures across Royal London. Our diverse people and perspectives give us a range of skills which are recognised and respected – whatever their background. 

 

 

 

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data engineer

Role: Senior Data EngineerLocation: UK Remote Rate £400.00 As a Senior Data Engineer, you’ll play a key role in crafting the data platforms, models and pipelines that inform strategic decision-making for our customers and prepare data for a plethora of use cases from simple analytics to Generative AI and Data...

London

Data Engineer

Want to bring your experience to an industry leader and contribute to our digital transformation?This Data Engineer role will be multi-faceted, working on data pipelines as well as our new strategic data platform and supporting our analytical/data science workstreams.Reporting to the Head of Data, Insights & Analytics, you will be...

Davyhulme

Principal Data Scientist

Principal Data ScientistLocation: Nottinghamshire (Hybrid 3days/week)Salary: £80,(Apply online only) – £90,(Apply online only)Are you ready to take the lead in shaping the future of data science? We are recruiting on behalf of an exciting organisation for a Principal Data Scientist role based in Nottinghamshire. This is a hybrid position that...

Basford

Principal Data Product Manager – Insight & Analytics

Job DescriptionMost of our Talent team are currently on leave for the holiday period, so your application is likely to be reviewed in January. Enjoy the break, we’ll get back to you in the new year!  Principal Data Product Manager London (Hybrid, 40% in office)  £Salary + Bonus + Shares...

Trainline London

Data & Infrastructure Engineer (CA)

About Element HumanOur vision is to bring empathy to digital interactions. Emotions make us human. Technology doesn’t account for human emotions. We’re going to change that. Element Human believes in a world where people are first, always.  We are a multi-disciplinary team using AI to build the emotion layer for...

Element Human London

EV Data Science and Modelling Expert

Head over to our main website to hear more about our storyABOUT ZENOBEOur goal is to make clean power accessible, to accelerate the shift to zero carbon power and transport.We’re building and operating the world’s most sophisticated battery systems to enable the uptake of more renewable power and accelerating fleet...

Zenobē London