Jobs

Senior Principal Data Engineer


Job details
  • SitePoint Pty
  • London
  • 1 month ago
Applications closed

Site Name: UK - London - New Oxford Street, UK - Hertfordshire - Stevenage

Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button.Posted Date: Nov 15 2024

GSK is a global leader in pharmaceuticals and healthcare, with a relentless commitment to advancing healthcare for the betterment of humanity. Our mission is to help people around the world do more, feel better, and live longer. We achieve this by researching, developing, and providing innovative medicines and vaccines. Our dedication to scientific excellence and ethical practices guides everything we do.

Job DescriptionThis role is based in a team that is working on projects involving AI/ML, generative AI, information retrieval, and data science. The team's future projects will be in diverse areas, such as regulatory, clinical, legal, and HR. Versatility is key, with an ability to quickly understand domain data and requirements and translate them into solutions.

You will interact with architects, software and data engineers, modelers, data scientists, AI/ML engineers, product owners as well as other team members in Clinical Solutions and R&D. You will actively participate in creating technical solutions, designs, implementations, and participate in the relentless improvement of R&D Tech systems in alignment with agile and DevOps principles.

Data Engineering is responsible for the design, delivery, support, and maintenance of industrialised automated end-to-end data services and pipelines. They apply standardised data models and mapping to ensure data is accessible for end users in tools through the use of APIs. They define and embed best practices and ensure compliance with Quality Management practices and alignment to automated data governance. They also acquire and process internal and external, structured and unstructured data in line with Product requirements.

As a Senior Principal Data Engineer, you will be able to develop a well-defined specification for a function, pipeline, service, or other sort of component, and a technical approach to building it, and deliver it at a high level. In that respect, you will be a technical contributor but will also provide leadership and guidance to junior data engineers. You will be aware of, and adhere to, best practices for software development in general (and data engineering in particular), including code quality, documentation, DevOps practices, and testing. You will ensure the robustness of our services and serve as an escalation point in the operation of existing services, pipelines, and workflows.

You should have awareness of the most common tools (languages, libraries, etc.) in the data space, such as Spark, Databricks, Kafka, ADF/AirFlow, Snowflake, Denodo, etc. and have experience working on Azure.

Responsibilities

Build modular code/libraries/services using modern data engineering tools (Python/Spark, Databricks, Kafka) and orchestration tools (e.g., ADF, Airflow Composer).

Produce well-engineered software, including appropriate automated test suites and technical documentation.

Ensure consistent application of platform abstractions to ensure quality and consistency with respect to logging and lineage.

Adhere to QMS framework and CI/CD best practices.

Provide leadership and guidance to junior data engineers.

Qualifications & SkillsWe are looking for professionals with these required skills to achieve our goals:

Bachelor's degree in data engineering, Computer Science, Software Engineering, or related discipline.

Experience in industry as a Data Engineer.

Solid experience with working on Azure.

Experience with choosing appropriate data structures for scale and access patterns.

Knowledge and use of at least one common programming language (preferably Python), including toolchains for documentation and testing.

Exposure to modern software development tools/ways of working (e.g., git/GitHub, DevOps tools).

Software engineering experience.

Hands-on experience with logging and monitoring tools.

Exposure to common tools for data engineering (e.g., Spark, ADF/AirFlow, Databricks, Snowflake, Kafka, Denodo).

Demonstrable experience overcoming high volume, high compute challenges.

Familiarity with databases and SQL.

Familiarity with Data Mesh/Fabric concepts, with exposure to MS Fabric a bonus.

Exposure to automated testing techniques.

Preferred Qualifications & SkillsIf you have the following characteristics, it would be a plus:

Masters or PhD in Data Engineering, Computer Science, Software Engineering, or related discipline.

Azure certifications for data engineering.

Closing Date for Applications: Friday 6th December 2024 (COB)

Please take a copy of the Job Description, as this will not be available post closure of the advert.

As an Equal Opportunity Employer, we are open to all talent. In the US, we also adhere to Affirmative Action principles. This ensures that all qualified applicants will receive equal consideration for employment without regard to neurodiversity, race/ethnicity, colour, national origin, religion, gender, pregnancy, marital status, sexual orientation, gender identity/expression, age, disability, genetic information, military service, covered/protected veteran status, or any other federal, state or local protected class (US only).

We believe in an agile working culture for all our roles. If flexibility is important to you, we encourage you to explore with our hiring team what the opportunities are.

#J-18808-Ljbffr

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data engineer

Role: Senior Data EngineerLocation: UK Remote Rate £400.00 As a Senior Data Engineer, you’ll play a key role in crafting the data platforms, models and pipelines that inform strategic decision-making for our customers and prepare data for a plethora of use cases from simple analytics to Generative AI and Data...

London

Senior/Principal Software-Firmware Engineer

Senior / Principal Software-Firmware Engineer | Cambridge | Onsite | up to £80k DOEAre you an experienced Software/Firmware Engineer with Low Level & Bare Metal experience? Do you have experience in the Automotive and/or Medical Devices sector? Do you want to join a scaling company working on the cutting edge...

Impington

NPIC Data Engineer (XN07)

Job summaryExpected Shortlisting Date:17/01/2025Planned Interview Date:27/01/2025Due to recent and continued expansion an exciting opportunity has arisen at NPIC (National Pathology Imaging Cooperative) based at LTHT for a Data Engineer. The candidate will work closely with the NPIC Senior Data Engineer to ensure that data architecture is effectively implemented, maintained and...

Leeds Teaching Hospitals Leeds

Senior / Principal Biological Software Engineer in Bio AI

InstaDeep is the AI specialist for our parent company BioNTech, combining our state-of-the-art research expertise in deep learning and biology. We specialise in not only developing new fundamental research but also in every stage of production that research to deliver benefit. As a senior/principal software engineer, you will lead initiatives...

Passcreator London

Principal/Senior Principal Architect : DevOps - Cloud Engineering (R&D)

Job DescriptionThe Principal/Senior Principal Architect (“SPA”) within Cloud Engineering will own the overall architecture accountability for one or more specialist areas within the overa portfolio of the team. The role of the SPA is to design and communicate complex pipelines and assocuated capabilities to deliver a whole range of IFS...

IFS Staines-upon-Thames

Senior Recruitment Consultant - AI & Data Science - Manchester

Senior Recruitment Consultant - AI & Data ScienceLocation: Manchester City CentreSalary: £25,000 - £40,000 + high OTE (uncapped commission)Are you passionate about the transformative power of AI and data science? Our client is Manchester's leading specialist recruitment agency in artificial intelligence and data sectors who are now expanding their presence...

Ruth Moran Manchester