National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior Principal Data Engineer

SitePoint Pty
London
8 months ago
Applications closed

Related Jobs

View all jobs

Principal Scientist

Principal Software Engineer

AIOps Principal Engineer

Senior Data Science Director

Senior Data Engineer

Senior MLops (Full Stack) Engineer | London | Foundation Models

Site Name: UK - London - New Oxford Street, UK - Hertfordshire - Stevenage

Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button.Posted Date: Nov 15 2024

GSK is a global leader in pharmaceuticals and healthcare, with a relentless commitment to advancing healthcare for the betterment of humanity. Our mission is to help people around the world do more, feel better, and live longer. We achieve this by researching, developing, and providing innovative medicines and vaccines. Our dedication to scientific excellence and ethical practices guides everything we do.

Job DescriptionThis role is based in a team that is working on projects involving AI/ML, generative AI, information retrieval, and data science. The team's future projects will be in diverse areas, such as regulatory, clinical, legal, and HR. Versatility is key, with an ability to quickly understand domain data and requirements and translate them into solutions.

You will interact with architects, software and data engineers, modelers, data scientists, AI/ML engineers, product owners as well as other team members in Clinical Solutions and R&D. You will actively participate in creating technical solutions, designs, implementations, and participate in the relentless improvement of R&D Tech systems in alignment with agile and DevOps principles.

Data Engineering is responsible for the design, delivery, support, and maintenance of industrialised automated end-to-end data services and pipelines. They apply standardised data models and mapping to ensure data is accessible for end users in tools through the use of APIs. They define and embed best practices and ensure compliance with Quality Management practices and alignment to automated data governance. They also acquire and process internal and external, structured and unstructured data in line with Product requirements.

As a Senior Principal Data Engineer, you will be able to develop a well-defined specification for a function, pipeline, service, or other sort of component, and a technical approach to building it, and deliver it at a high level. In that respect, you will be a technical contributor but will also provide leadership and guidance to junior data engineers. You will be aware of, and adhere to, best practices for software development in general (and data engineering in particular), including code quality, documentation, DevOps practices, and testing. You will ensure the robustness of our services and serve as an escalation point in the operation of existing services, pipelines, and workflows.

You should have awareness of the most common tools (languages, libraries, etc.) in the data space, such as Spark, Databricks, Kafka, ADF/AirFlow, Snowflake, Denodo, etc. and have experience working on Azure.

Responsibilities

Build modular code/libraries/services using modern data engineering tools (Python/Spark, Databricks, Kafka) and orchestration tools (e.g., ADF, Airflow Composer).

Produce well-engineered software, including appropriate automated test suites and technical documentation.

Ensure consistent application of platform abstractions to ensure quality and consistency with respect to logging and lineage.

Adhere to QMS framework and CI/CD best practices.

Provide leadership and guidance to junior data engineers.

Qualifications & SkillsWe are looking for professionals with these required skills to achieve our goals:

Bachelor's degree in data engineering, Computer Science, Software Engineering, or related discipline.

Experience in industry as a Data Engineer.

Solid experience with working on Azure.

Experience with choosing appropriate data structures for scale and access patterns.

Knowledge and use of at least one common programming language (preferably Python), including toolchains for documentation and testing.

Exposure to modern software development tools/ways of working (e.g., git/GitHub, DevOps tools).

Software engineering experience.

Hands-on experience with logging and monitoring tools.

Exposure to common tools for data engineering (e.g., Spark, ADF/AirFlow, Databricks, Snowflake, Kafka, Denodo).

Demonstrable experience overcoming high volume, high compute challenges.

Familiarity with databases and SQL.

Familiarity with Data Mesh/Fabric concepts, with exposure to MS Fabric a bonus.

Exposure to automated testing techniques.

Preferred Qualifications & SkillsIf you have the following characteristics, it would be a plus:

Masters or PhD in Data Engineering, Computer Science, Software Engineering, or related discipline.

Azure certifications for data engineering.

Closing Date for Applications: Friday 6th December 2024 (COB)

Please take a copy of the Job Description, as this will not be available post closure of the advert.

As an Equal Opportunity Employer, we are open to all talent. In the US, we also adhere to Affirmative Action principles. This ensures that all qualified applicants will receive equal consideration for employment without regard to neurodiversity, race/ethnicity, colour, national origin, religion, gender, pregnancy, marital status, sexual orientation, gender identity/expression, age, disability, genetic information, military service, covered/protected veteran status, or any other federal, state or local protected class (US only).

We believe in an agile working culture for all our roles. If flexibility is important to you, we encourage you to explore with our hiring team what the opportunities are.

#J-18808-Ljbffr

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 AI Recruitment Agencies in the UK You Should Know (2025 Job‑Seeker Guide)

Generative‑AI hype has translated into real hiring: Lightcast recorded +57 % year‑on‑year growth in UK adverts mentioning “machine learning”, “LLM” or “gen‑AI” during Q1 2025. Yet supply still lags. Roughly 18,000 core AI professionals work in the UK, but monthly live vacancies hover around 1,400–1,600. That mismatch makes specialist recruiters invaluable—opening stealth vacancies, advising on salary bands and fast‑tracking interview loops. But many tech agencies sprinkle “AI” on their website without an active desk. To save you time, we vetted 50 + consultancies and kept only those with: A registered UK head office (verified via Companies House). A named AI/Machine‑Learning or Data practice.

AI Jobs Skills Radar 2026: Emerging Frameworks, Languages & Tools to Learn Now

As the UK’s AI sector accelerates towards a £1 trillion tech economy, the job landscape is rapidly evolving. Whether you’re an aspiring AI engineer, a machine learning specialist, or a data-driven software developer, staying ahead of the curve means more than just brushing up on Python. You’ll need to master a new generation of frameworks, languages, and tools shaping the future of artificial intelligence. Welcome to the AI Jobs Skills Radar 2026—your definitive guide to the emerging AI tech stack that employers will be looking for in the next 12–24 months. Updated annually for accuracy and relevance, this guide breaks down the top tools, frameworks, platforms, and programming languages powering the UK’s most in-demand AI careers.

How to Find Hidden AI Jobs in the UK Using Professional Bodies like BCS, IET & the Turing Society

Stop Scrolling Job Boards and Start Tapping the Real AI Market Every week a new headline announces millions of pounds flowing into artificial-intelligence research, defence initiatives, or health-tech pilots. Read the news and you could be forgiven for thinking that AI vacancies must be everywhere—just grab your laptop, open LinkedIn, and pick a role. Yet anyone who has hunted seriously for an AI job in the United Kingdom knows the truth is messier. A large percentage of worthwhile AI positions—especially specialist or senior posts—never appear on public boards. They emerge inside university–industry consortia, defence labs, NHS data-science teams, climate-tech start-ups, and venture studios. Most are filled through referral or conversation long before a recruiter drafts a formal advert. If you wait for a vacancy link, you are already at the back of the queue. The surest way to beat that dynamic is to embed yourself in the professional bodies and grassroots communities where the work is conceived. The UK has a dense network of such organisations: the Chartered Institute for IT (BCS); the Institution of Engineering and Technology (IET) with its Artificial Intelligence Technical Network; the Alan Turing Institute and its student-driven Turing Society; the Royal Statistical Society (RSS); the Institution of Mechanical Engineers (IMechE) and its Mechatronics, Informatics & Control Group; public-funding engines like UK Research and Innovation (UKRI); and an ecosystem of Slack channels and Meetup groups that trade genuine, timely intel. This article is a practical, step-by-step guide to using those networks. You will learn: Why professional bodies matter more than algorithmic job boards Exactly which special-interest groups (SIGs) and technical networks to join How to turn CPD events into informal interviews How to monitor grant databases so you hear about posts months before they exist Concrete scripts, portfolio tactics, and outreach rhythms that convert visibility into offers Follow the playbook and you move from passive applicant to insider—the colleague who hears about a role before it is written down.