Azure Data Engineer

Azure Data Engineer - Derby based (3 days on site per week)

£45K - £55K DOE (Up to 10% bonus)

Exciting opportunity to be part of a new and growing team for a Derby based organisation.

As an Azure Data Engineer, you will support the delivery and development of the organisations Digital Portfolio. Taking advantage of the data platform and working with the team you would have overall responsibility for managing and maintaining existing data pipelines, monitoring of workloads, root cause analysis, data quality monitoring and escalation of technical issues to Product Owner.

Expedience needed:

• Microsoft Azure Experience
• Knowledge of Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc
• Strong Python and SQL skills for manipulating data
• Apache Spark and/or Databricks experience
• Experience in managing end-to-end analytics pipelines (batch and streaming) suitable for data science workload consumption
• Experience in root-cause analysis and post-incident reporting in a production environment

Responsibilities

As a Data Engineer you will be responsible for:

• Monitoring and recovery of Azure Data Factory and Databricks jobs
• ​Proactive monitoring of data quality
• Understanding data sources, ingestion methods and data quality levels
• Developing data governance policies and internal processes
• Develop and maintain digital services data quality KPIs
• Maintaining and monitoring of user facing dashboards and other internal Digital products
• Documenting root cause analysis outputs

Please apply asap for more information.

This role will not offer sponsorship

Azure Data Engineer