Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Principal Data Engineer

SitePoint Pty
London
10 months ago
Applications closed

Related Jobs

View all jobs

Principal Data Scientist

Principal Data Scientist

Principal Data Scientist

Senior Scientist/Principal Scientist, Machine Learning

Principal, AI Data Scientist (Remote)

Senior Data Scientist

Site Name: UK - London - New Oxford Street, UK - Hertfordshire - Stevenage

Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button.Posted Date: Nov 15 2024

GSK is a global leader in pharmaceuticals and healthcare, with a relentless commitment to advancing healthcare for the betterment of humanity. Our mission is to help people around the world do more, feel better, and live longer. We achieve this by researching, developing, and providing innovative medicines and vaccines. Our dedication to scientific excellence and ethical practices guides everything we do.

Job DescriptionThis role is based in a team that is working on projects involving AI/ML, generative AI, information retrieval, and data science. The team's future projects will be in diverse areas, such as regulatory, clinical, legal, and HR. Versatility is key, with an ability to quickly understand domain data and requirements and translate them into solutions.

You will interact with architects, software and data engineers, modelers, data scientists, AI/ML engineers, product owners as well as other team members in Clinical Solutions and R&D. You will actively participate in creating technical solutions, designs, implementations, and participate in the relentless improvement of R&D Tech systems in alignment with agile and DevOps principles.

Data Engineering is responsible for the design, delivery, support, and maintenance of industrialised automated end-to-end data services and pipelines. They apply standardised data models and mapping to ensure data is accessible for end users in tools through the use of APIs. They define and embed best practices and ensure compliance with Quality Management practices and alignment to automated data governance. They also acquire and process internal and external, structured and unstructured data in line with Product requirements.

As a Senior Principal Data Engineer, you will be able to develop a well-defined specification for a function, pipeline, service, or other sort of component, and a technical approach to building it, and deliver it at a high level. In that respect, you will be a technical contributor but will also provide leadership and guidance to junior data engineers. You will be aware of, and adhere to, best practices for software development in general (and data engineering in particular), including code quality, documentation, DevOps practices, and testing. You will ensure the robustness of our services and serve as an escalation point in the operation of existing services, pipelines, and workflows.

You should have awareness of the most common tools (languages, libraries, etc.) in the data space, such as Spark, Databricks, Kafka, ADF/AirFlow, Snowflake, Denodo, etc. and have experience working on Azure.

Responsibilities

Build modular code/libraries/services using modern data engineering tools (Python/Spark, Databricks, Kafka) and orchestration tools (e.g., ADF, Airflow Composer).

Produce well-engineered software, including appropriate automated test suites and technical documentation.

Ensure consistent application of platform abstractions to ensure quality and consistency with respect to logging and lineage.

Adhere to QMS framework and CI/CD best practices.

Provide leadership and guidance to junior data engineers.

Qualifications & SkillsWe are looking for professionals with these required skills to achieve our goals:

Bachelor's degree in data engineering, Computer Science, Software Engineering, or related discipline.

Experience in industry as a Data Engineer.

Solid experience with working on Azure.

Experience with choosing appropriate data structures for scale and access patterns.

Knowledge and use of at least one common programming language (preferably Python), including toolchains for documentation and testing.

Exposure to modern software development tools/ways of working (e.g., git/GitHub, DevOps tools).

Software engineering experience.

Hands-on experience with logging and monitoring tools.

Exposure to common tools for data engineering (e.g., Spark, ADF/AirFlow, Databricks, Snowflake, Kafka, Denodo).

Demonstrable experience overcoming high volume, high compute challenges.

Familiarity with databases and SQL.

Familiarity with Data Mesh/Fabric concepts, with exposure to MS Fabric a bonus.

Exposure to automated testing techniques.

Preferred Qualifications & SkillsIf you have the following characteristics, it would be a plus:

Masters or PhD in Data Engineering, Computer Science, Software Engineering, or related discipline.

Azure certifications for data engineering.

Closing Date for Applications: Friday 6th December 2024 (COB)

Please take a copy of the Job Description, as this will not be available post closure of the advert.

As an Equal Opportunity Employer, we are open to all talent. In the US, we also adhere to Affirmative Action principles. This ensures that all qualified applicants will receive equal consideration for employment without regard to neurodiversity, race/ethnicity, colour, national origin, religion, gender, pregnancy, marital status, sexual orientation, gender identity/expression, age, disability, genetic information, military service, covered/protected veteran status, or any other federal, state or local protected class (US only).

We believe in an agile working culture for all our roles. If flexibility is important to you, we encourage you to explore with our hiring team what the opportunities are.

#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why AI Careers in the UK Are Becoming More Multidisciplinary

Artificial intelligence is no longer a single-discipline pursuit. In the UK, employers increasingly want talent that can code and communicate, model and manage risk, experiment and empathise. That shift is reshaping job descriptions, training pathways & career progression. AI is touching regulated sectors, sensitive user journeys & public services — so the work now sits at the crossroads of computer science, law, ethics, psychology, linguistics & design. This isn’t a buzzword-driven change. It’s happening because real systems are deployed in the wild where people have rights, needs, habits & constraints. As models move from lab demos to products that diagnose, advise, detect fraud, personalise education or generate media, teams must align performance with accountability, safety & usability. The UK’s maturing AI ecosystem — from startups to FTSE 100s, consultancies, the public sector & universities — is responding by hiring multidisciplinary teams who can anticipate social impact as confidently as they ship features. Below, we unpack the forces behind this change, spotlight five disciplines now fused with AI roles, show what it means for UK job-seekers & employers, and map practical steps to future-proof your CV.

AI Team Structures Explained: Who Does What in a Modern AI Department

Artificial Intelligence (AI) and Machine Learning (ML) are no longer confined to research labs and tech giants. In the UK, organisations from healthcare and finance to retail and logistics are adopting AI to solve problems, automate processes, and create new products. With this growth comes the need for well-structured teams. But what does an AI department actually look like? Who does what? And how do all the moving parts come together to deliver business value? In this guide, we’ll explain modern AI team structures, break down the responsibilities of each role, explore how teams differ in startups versus enterprises, and highlight what UK employers are looking for. Whether you’re an applicant or an employer, this article will help you understand the anatomy of a successful AI department.

Why the UK Could Be the World’s Next AI Jobs Hub

Artificial Intelligence (AI) has rapidly moved from research labs into boardrooms, classrooms, hospitals, and homes. It is already reshaping economies and transforming industries at a scale comparable to the industrial revolution or the rise of the internet. Around the world, countries are competing fiercely to lead in AI innovation and reap its economic, social, and strategic benefits. The United Kingdom is uniquely positioned in this race. With a rich heritage in computing, world-class universities, forward-thinking government policy, and a growing ecosystem of startups and enterprises, the UK has many of the elements needed to become the world’s next AI hub. Yet competition is intense, particularly from the United States and China. Success will depend on how effectively the UK can scale its strengths, close its gaps, and seize opportunities in the years ahead. This article explores why the UK could be the world’s next global hub for artificial intelligence, what challenges it must overcome, and what this means for businesses, researchers, and job seekers.