Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Principal Data Engineer

SitePoint Pty
London
1 year ago
Applications closed

Related Jobs

View all jobs

Senior Machine Learning Engineer

Senior Machine Learning Engineer

Principal Data Scientist

Principal Data Scientist

Principal Data Scientist

Principal Data Scientist - Healthcare

Site Name: UK - London - New Oxford Street, UK - Hertfordshire - Stevenage

Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button.Posted Date: Nov 15 2024

GSK is a global leader in pharmaceuticals and healthcare, with a relentless commitment to advancing healthcare for the betterment of humanity. Our mission is to help people around the world do more, feel better, and live longer. We achieve this by researching, developing, and providing innovative medicines and vaccines. Our dedication to scientific excellence and ethical practices guides everything we do.

Job DescriptionThis role is based in a team that is working on projects involving AI/ML, generative AI, information retrieval, and data science. The team's future projects will be in diverse areas, such as regulatory, clinical, legal, and HR. Versatility is key, with an ability to quickly understand domain data and requirements and translate them into solutions.

You will interact with architects, software and data engineers, modelers, data scientists, AI/ML engineers, product owners as well as other team members in Clinical Solutions and R&D. You will actively participate in creating technical solutions, designs, implementations, and participate in the relentless improvement of R&D Tech systems in alignment with agile and DevOps principles.

Data Engineering is responsible for the design, delivery, support, and maintenance of industrialised automated end-to-end data services and pipelines. They apply standardised data models and mapping to ensure data is accessible for end users in tools through the use of APIs. They define and embed best practices and ensure compliance with Quality Management practices and alignment to automated data governance. They also acquire and process internal and external, structured and unstructured data in line with Product requirements.

As a Senior Principal Data Engineer, you will be able to develop a well-defined specification for a function, pipeline, service, or other sort of component, and a technical approach to building it, and deliver it at a high level. In that respect, you will be a technical contributor but will also provide leadership and guidance to junior data engineers. You will be aware of, and adhere to, best practices for software development in general (and data engineering in particular), including code quality, documentation, DevOps practices, and testing. You will ensure the robustness of our services and serve as an escalation point in the operation of existing services, pipelines, and workflows.

You should have awareness of the most common tools (languages, libraries, etc.) in the data space, such as Spark, Databricks, Kafka, ADF/AirFlow, Snowflake, Denodo, etc. and have experience working on Azure.

Responsibilities

Build modular code/libraries/services using modern data engineering tools (Python/Spark, Databricks, Kafka) and orchestration tools (e.g., ADF, Airflow Composer).

Produce well-engineered software, including appropriate automated test suites and technical documentation.

Ensure consistent application of platform abstractions to ensure quality and consistency with respect to logging and lineage.

Adhere to QMS framework and CI/CD best practices.

Provide leadership and guidance to junior data engineers.

Qualifications & SkillsWe are looking for professionals with these required skills to achieve our goals:

Bachelor's degree in data engineering, Computer Science, Software Engineering, or related discipline.

Experience in industry as a Data Engineer.

Solid experience with working on Azure.

Experience with choosing appropriate data structures for scale and access patterns.

Knowledge and use of at least one common programming language (preferably Python), including toolchains for documentation and testing.

Exposure to modern software development tools/ways of working (e.g., git/GitHub, DevOps tools).

Software engineering experience.

Hands-on experience with logging and monitoring tools.

Exposure to common tools for data engineering (e.g., Spark, ADF/AirFlow, Databricks, Snowflake, Kafka, Denodo).

Demonstrable experience overcoming high volume, high compute challenges.

Familiarity with databases and SQL.

Familiarity with Data Mesh/Fabric concepts, with exposure to MS Fabric a bonus.

Exposure to automated testing techniques.

Preferred Qualifications & SkillsIf you have the following characteristics, it would be a plus:

Masters or PhD in Data Engineering, Computer Science, Software Engineering, or related discipline.

Azure certifications for data engineering.

Closing Date for Applications: Friday 6th December 2024 (COB)

Please take a copy of the Job Description, as this will not be available post closure of the advert.

As an Equal Opportunity Employer, we are open to all talent. In the US, we also adhere to Affirmative Action principles. This ensures that all qualified applicants will receive equal consideration for employment without regard to neurodiversity, race/ethnicity, colour, national origin, religion, gender, pregnancy, marital status, sexual orientation, gender identity/expression, age, disability, genetic information, military service, covered/protected veteran status, or any other federal, state or local protected class (US only).

We believe in an agile working culture for all our roles. If flexibility is important to you, we encourage you to explore with our hiring team what the opportunities are.

#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we head into 2026, the AI hiring market in the UK is going through one of its biggest shake-ups yet. Economic conditions are still tight, some employers are cutting headcount, & AI itself is automating whole chunks of work. At the same time, demand for strong AI talent is still rising, salaries for in-demand skills remain high, & new roles are emerging around AI safety, governance & automation. Whether you are an AI job seeker planning your next move or a recruiter trying to build teams in a volatile market, understanding the key AI hiring trends for 2026 will help you stay ahead. This guide breaks down the most important trends to watch, what they mean in practice, & how to adapt – with practical actions for both candidates & hiring teams.

How to Write an AI CV that Beats ATS (UK examples)

Writing an AI CV for the UK market is about clarity, credibility, and alignment. Recruiters spend seconds scanning the top third of your CV, while Applicant Tracking Systems (ATS) check for relevant skills & recent impact. Your goal is to make both happy without gimmicks: plain structure, sharp evidence, and links that prove you can ship to production. This guide shows you exactly how to do that. You’ll get a clean CV anatomy, a phrase bank for measurable bullets, GitHub & portfolio tips, and three copy-ready UK examples (junior, mid, research). Paste the structure, replace the details, and tailor to each job ad.

AI Recruitment Trends 2025 (UK): What Job Seekers Must Know About Today’s Hiring Process

Summary: UK AI hiring has shifted from titles & puzzle rounds to skills, portfolios, evals, safety, governance & measurable business impact. This guide explains what’s changed, what to expect in interviews, and how to prepare—especially for LLM application, MLOps/platform, data science, AI product & safety roles. Who this is for: AI/ML engineers, LLM engineers, data scientists, MLOps/platform engineers, AI product managers, applied researchers & safety/governance specialists targeting roles in the UK.