Senior Principal Data Engineer

SitePoint Pty
London
1 year ago
Applications closed

Related Jobs

View all jobs

Senior Simulation Engineer (Data Science)

Principal Data Scientist - Healthcare

Principal Data Scientist

Data Science Principal

Senior Machine Learning Engineer

Senior Recruitment Consultant - AI & Data Science - Manchester

Site Name: UK - London - New Oxford Street, UK - Hertfordshire - Stevenage

Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button.Posted Date: Nov 15 2024

GSK is a global leader in pharmaceuticals and healthcare, with a relentless commitment to advancing healthcare for the betterment of humanity. Our mission is to help people around the world do more, feel better, and live longer. We achieve this by researching, developing, and providing innovative medicines and vaccines. Our dedication to scientific excellence and ethical practices guides everything we do.

Job DescriptionThis role is based in a team that is working on projects involving AI/ML, generative AI, information retrieval, and data science. The team's future projects will be in diverse areas, such as regulatory, clinical, legal, and HR. Versatility is key, with an ability to quickly understand domain data and requirements and translate them into solutions.

You will interact with architects, software and data engineers, modelers, data scientists, AI/ML engineers, product owners as well as other team members in Clinical Solutions and R&D. You will actively participate in creating technical solutions, designs, implementations, and participate in the relentless improvement of R&D Tech systems in alignment with agile and DevOps principles.

Data Engineering is responsible for the design, delivery, support, and maintenance of industrialised automated end-to-end data services and pipelines. They apply standardised data models and mapping to ensure data is accessible for end users in tools through the use of APIs. They define and embed best practices and ensure compliance with Quality Management practices and alignment to automated data governance. They also acquire and process internal and external, structured and unstructured data in line with Product requirements.

As a Senior Principal Data Engineer, you will be able to develop a well-defined specification for a function, pipeline, service, or other sort of component, and a technical approach to building it, and deliver it at a high level. In that respect, you will be a technical contributor but will also provide leadership and guidance to junior data engineers. You will be aware of, and adhere to, best practices for software development in general (and data engineering in particular), including code quality, documentation, DevOps practices, and testing. You will ensure the robustness of our services and serve as an escalation point in the operation of existing services, pipelines, and workflows.

You should have awareness of the most common tools (languages, libraries, etc.) in the data space, such as Spark, Databricks, Kafka, ADF/AirFlow, Snowflake, Denodo, etc. and have experience working on Azure.

Responsibilities

Build modular code/libraries/services using modern data engineering tools (Python/Spark, Databricks, Kafka) and orchestration tools (e.g., ADF, Airflow Composer).

Produce well-engineered software, including appropriate automated test suites and technical documentation.

Ensure consistent application of platform abstractions to ensure quality and consistency with respect to logging and lineage.

Adhere to QMS framework and CI/CD best practices.

Provide leadership and guidance to junior data engineers.

Qualifications & SkillsWe are looking for professionals with these required skills to achieve our goals:

Bachelor's degree in data engineering, Computer Science, Software Engineering, or related discipline.

Experience in industry as a Data Engineer.

Solid experience with working on Azure.

Experience with choosing appropriate data structures for scale and access patterns.

Knowledge and use of at least one common programming language (preferably Python), including toolchains for documentation and testing.

Exposure to modern software development tools/ways of working (e.g., git/GitHub, DevOps tools).

Software engineering experience.

Hands-on experience with logging and monitoring tools.

Exposure to common tools for data engineering (e.g., Spark, ADF/AirFlow, Databricks, Snowflake, Kafka, Denodo).

Demonstrable experience overcoming high volume, high compute challenges.

Familiarity with databases and SQL.

Familiarity with Data Mesh/Fabric concepts, with exposure to MS Fabric a bonus.

Exposure to automated testing techniques.

Preferred Qualifications & SkillsIf you have the following characteristics, it would be a plus:

Masters or PhD in Data Engineering, Computer Science, Software Engineering, or related discipline.

Azure certifications for data engineering.

Closing Date for Applications: Friday 6th December 2024 (COB)

Please take a copy of the Job Description, as this will not be available post closure of the advert.

As an Equal Opportunity Employer, we are open to all talent. In the US, we also adhere to Affirmative Action principles. This ensures that all qualified applicants will receive equal consideration for employment without regard to neurodiversity, race/ethnicity, colour, national origin, religion, gender, pregnancy, marital status, sexual orientation, gender identity/expression, age, disability, genetic information, military service, covered/protected veteran status, or any other federal, state or local protected class (US only).

We believe in an agile working culture for all our roles. If flexibility is important to you, we encourage you to explore with our hiring team what the opportunities are.

#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many AI Tools Do You Need to Know to Get an AI Job?

If you are job hunting in AI right now it can feel like you are drowning in tools. Every week there is a new framework, a new “must-learn” platform or a new productivity app that everyone on LinkedIn seems to be using. The result is predictable: job seekers panic-learn a long list of tools without actually getting better at delivering outcomes. Here is the truth most hiring managers will quietly agree with. They do not hire you because you know 27 tools. They hire you because you can solve a problem, communicate trade-offs, ship something reliable and improve it with feedback. Tools matter, but only in service of outcomes. So how many AI tools do you actually need to know? For most AI job seekers: fewer than you think. You need a tight core toolkit plus a role-specific layer. Everything else is optional. This guide breaks it down clearly, gives you a simple framework to choose what to learn and shows you how to present your toolset on your CV, portfolio and interviews.

What Hiring Managers Look for First in AI Job Applications (UK Guide)

Hiring managers do not start by reading your CV line-by-line. They scan for signals. In AI roles especially, they are looking for proof that you can ship, learn fast, communicate clearly & work safely with data and systems. The best applications make those signals obvious in the first 10–20 seconds. This guide breaks down what hiring managers typically look for first in AI applications in the UK market, how to present it on your CV, LinkedIn & portfolio, and the most common reasons strong candidates get overlooked. Use it as a checklist to tighten your application before you click apply.

The Skills Gap in AI Jobs: What Universities Aren’t Teaching

Artificial intelligence is no longer a future concept. It is already reshaping how businesses operate, how decisions are made, and how entire industries compete. From finance and healthcare to retail, manufacturing, defence, and climate science, AI is embedded in critical systems across the UK economy. Yet despite unprecedented demand for AI talent, employers continue to report severe recruitment challenges. Vacancies remain open for months. Salaries rise year on year. Candidates with impressive academic credentials often fail technical interviews. At the heart of this disconnect lies a growing and uncomfortable truth: Universities are not fully preparing graduates for real-world AI jobs. This article explores the AI skills gap in depth—what is missing from many university programmes, why the gap persists, what employers actually want, and how jobseekers can bridge the divide to build a successful career in artificial intelligence.