Senior Data Ops Data EngineerLeeds 2/3 days per week£55,000-£67,000+ Excellent Benefits18 Months FTC with long term potentialYour NewpanyOur large public sector organisation are seeking a senior Data Platform DataOps Engineer to serve as our clients first DataOps specialist in a growing team of Data Engineers and DevOps professionals.In this pivotal role, you will focus on operationalising and automating their data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust dataernance, and optimise operational costs within our Microsoft Azure environment.Your work will be centred on proactive system monitoring, error resolution, and continuous improvements, while mentoring and guiding colleagues.
What you will be doing
Oversee and automate the operational processes that support data workflows developed by the Data Engineering team while ensuring seamless coordination with the DevOps group. Spearhead the development, integration, and maintenance of CI/CD data pipelines for automated deployments. Integrate best practices for monitoring and observability to proactively detect, analyse, and resolve issues. Enforce robust dataernance and security protocols through tools like Azure Key Vault, ensuringpliance with standards such as GDPR, and other regulatory frameworks. Collaborate closely with Data Engineering, Data Science, Analytics, and DevOps teams to align operational strategies with technical and business requirements. Optimize operational performance and cost management for services including Azure Data Factory, Azure Databricks, Delta Lake, and Azure Data Lake Storage. Serve as the domain expert in DataOps by providing strategic guidance, mentoring colleagues, and driving continuous process improvements.
What you will need Demonstrable experience in DataOps, Data Engineering, DevOps, or related roles focused on managing data operations inplex, data-centric environments.Proven experience working with agile teams and driving automation of data workflows within the Microsoft Azure ecosystem.Hands-on expertise with Azure Data Platform withponents such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Delta Lake, Azure SQL, Purview and APIM.Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation.Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption.Implemented data and pipeline observability dashboards, ensuring high data quality, and improving the efficiency of data workflows.Experience ensuringpliance with regulatory frameworks and implementing robust dataernance measures.Demonstrated ability to implement Infrastructure as Code using Terraform, to provision and manage data pipelines and associated resources.What you will get in returnIn return, you’ll receive apetitive salary of £55,280 – £62,190, plus the opportunity to take an 8% cash benefit uplift. This is an 18-month fixed-term contract with strong potential to be permanent. You’ll also benefit from an excellent package that includes private medical insurance and a generous pension scheme, making this a highly attractive opportunity.
