Senior Data Engineer

Senior Data Engineer - Python, ETL, AWS - health tech - tech for good, make a positive impact on the world. Highly successful and fast growing organisation.

JOB PURPOSE

This is a new role and part of the Technology team. The Senior Data Engineer will design, build, maintain, and troubleshoot the systems and infrastructure that enables the organisation to collect, store, process, and analyse large amounts of data. The Senior Data Engineer is responsible for developing and maintaining the data pipelines that move data from various sources into a centralised data warehouse or data lake, where it can be used by data analysts, data scientists, and other stakeholders within the organisation.

MAIN ACCOUNTABILITIES

• Guiding their internal customers towards a successful technical solution to their data challenges.
  
  
• Communicating with technical and non-technical stakeholders.
  
  
• Developing, testing, and monitoring distributed data processing pipelines.
  
  
• Producing high quality, reproducible data models in a scalable and maintainable way.
  
  
• Collaborating with other data roles such as Software Engineers and Data Scientists.
  
  
• Ensuring solutions meet the requirements of data producers and consumers.
  
  
• Delivering solutions iteratively to produce value from data early and frequently.
  
  
• Keeping technically sharp, being open to learning new concepts and technologies.
  
  KNOWLEDGE & SKILLS FOR THIS JOB
  
  They encourage their data engineers to be open to learn new technology on a project-by-project basis. They are looking for data engineers who have some of the following skills and experience, such as:
  
  
• Advanced programming skills using Python.
  
  
• Building data pipelines, complex ETL, large data migration projects.
  
  
• AWS (Redshift, Lambda, DynamoDB, S3 etc.).
  
  
• Strong communication skills, working with everyone from senior stakeholders / C suite to graduates.
  
  
• Understanding of common approaches to data analysis, machine learning and data visualisation.
  
  
• Understanding different approaches to data architectures (e.g., Data Lake, Data Mesh, Data Warehouse, streaming, batch processing).
  
  
• Hands-on experience with relational and NoSQL databases.
  
  
• Familiarity with big data concepts for storing and processing large data volumes.
  
  
• Practical knowledge of handling varied types of data (text, tabular, graph, time-series, geospatial, image, etc.).
  
  
• Practical knowledge of containerisation and public and private Cloud environments.
  
  
• Knowledge of information security and data governance.
  
  
• Experience delivering projects to deadlines, with an emphasis on quality, ideally in client facing contexts.
  
  
• Leadership (this is a senior role where your leadership and mentorship skills are important to the success of the wider team).
  
  A great opportunity to make a huge contribution to the healthcare sector working on complex and career defining projects.
  
  Basic salary £80,000 + benefits
  
  Hybrid role - between 4 - 8 days per month in the London office, the rest remote