Jobs

Azure Data Engineer


Job details
  • London
  • 2 weeks ago
Applications closed

£55,000 (+ bonus opportunity, up to 10%)
Full Time - Permanent
Hybrid Working - Location (Derby - London

The Client
The client has been at the heart of the UK rail network for three decades and owns around a quarter of the national passenger rail fleet.
They mobilise private finance to drive rail growth through tailored leasing solutions, industry leading innovations and essential network projects that deliver a safe, efficient and sustainable railway.
Their mission is to provide high-quality, digitally enabled rolling stock solutions that help deliver a safe, efficient and sustainable railway. We take an industry-leading approach, driven by innovative thinking and future planning.
About the team
The successful candidate will be joining the Fleet function, a small multi-disciplinary team that supports corporate and project governance, risk management and audits of Train Operating Companies, suppliers and internal processes. The team is part of the Operations Directorate reporting to the Chief Operating Officer
Responsibilities
This role will support the delivery and development of the client's Digital Portfolio. Taking advantage of the client's unified data platform and working with the team you would have overall responsibility for managing and maintaining existing data pipelines, monitoring of workloads, root cause analysis, data quality monitoring and escalation of technical issues to Product Owner

  • Monitoring and recovery of Azure Data Factory and Databricks jobs
  • Proactive monitoring of data quality
  • Becoming a subject matter expert on understanding client's data sources, ingestion methods and data quality levels
  • Assisting in developing and adhering to associated data governance policies and internal processes
  • Working closely with the wider team to understand the business needs and improve data quality
  • Develop and maintain digital services data quality KPIs
  • Maintaining and monitoring of user facing dashboards and other internal Digital products
  • Updating and patching of existing Digital software products
  • Documenting root cause analysis outputs
  • Skills, Knowledge and Expertise
    Role Requirements
  • Microsoft Azure Experience (essential)
  • Knowledge of Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc
  • Strong Python and SQL skills for manipulating data
  • Apache Spark and/or Databricks experience
  • Experience using BI visualisation tools, such as Power BI
  • Experience in managing end-to-end analytics pipelines (batch and streaming) suitable for data science workload consumption
  • Experience in root-cause analysis and post-incident reporting in a production environment
    Knowledge and Qualifications
  • A relevant degree in Computer Science, Engineering, and/or relevant certificates including, Azure Data Engineer Associate are desirable
  • Knowledge of railway industry rolling stock, organisation and players
  • Data ingestion methods for real-time and batch ingestion
  • PySpark
  • Debugging Apache Spark workloads
  • Experience using BI visualisation tools, such as Power BI
    Key Skills
  • Interpersonal skills
  • Report writing, presentation and record keeping skills
  • Excellent communication and stakeholder management
  • A great place to work
  • We are seeking the very best talent to join the team, and offer an excellent salary, along with bonus and benefits
    This is a fantastic opportunity to join a great organisation with excellent people and a road map for the future to grow and develop the business. Some of our benefits are listed below:
  • Excellent pension scheme
  • Financial wellbeing support
  • Flexible working
  • Enhanced family friendly policies
  • Adoption & Shared Parental Leave benefits
  • Enhanced Armed Forces policies
  • Ongoing support with professional and personal development
  • Long service awards
  • Life assurance
  • Healthcare cash plan
  • 25 days' annual leave + Bank Holidays + option to buy and sell up to 5 days' additional leave
  • Additional days annual leave for long service
  • Season ticket loan
  • Cycle to work scheme

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Azure Data Engineer

This is an exciting opportunity for an Azure Data Engineer to contribute to the evolution of data services with our forward-thinking and exceptional client.Our well-respected client provides a wide range of high-quality services and as their newly appointed Azure Data Engineer, you will join a dynamic and supportive Data &...

Chippenham

Azure Data Engineer

Job Title:Azure Databricks Data EngineerLocation:UK-Wide Offices - Hybrid (Primarily Remote)Salary:£70,000 to £100,000 (plus Pension, Benefits, and Bonus)We're looking for a skilled Azure Data Engineers to join our clients team and help us build robust, scalable, and secure data platforms. In this role, you'll work with Databricks, Apache Spark, and Azure...

83zero Limited Glasgow

Azure Data Engineer

Job Title:Azure Databricks Data EngineerLocation:UK-Wide Offices - Hybrid (Primarily Remote)Salary:£70,000 to £100,000 (plus Pension, Benefits, and Bonus)We're looking for a skilled Azure Data Engineers to join our clients team and help us build robust, scalable, and secure data platforms. In this role, you'll work with Databricks, Apache Spark, and Azure...

83zero Limited London

Data Architect

Our client is looking for an experienced Data Architect with strong data science and data modelling skills.This is a long term contract role based in Brussels, Belgium. Please note that all candidates need to hold current valid security clearance.To be successful in this job you must have:Excellent written and verbal...

LA International

Senior Data Engineer

Senior Data EngineerAre you a seasoned data professional with a passion for designing and implementing scalable data solutions? We are looking for a Senior Data Engineer to join our innovative team. This role offers the chance to work on exciting projects, leverage cutting-edge technologies, and play a key role in...

Bristol

Senior Data Engineer (Synapse/Databricks),12m FTC Fully Remote

Leading UK Logistics Company require a Senior Data Engineer to play a pivotal role in leading the design, development and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment. Your expertise will ensure the availability, reliability and scalability of their data platform, empowering the organisation with timely...

Birmingham