At Peregrine, we are constantly seeking Specialist Talent that offers the ideal mix of skills, experience, and attitude to place with our diverse clients. From Project Change Professionals in large government organizations to Software Developers in the private sector, we are always in search of the best talent to place now.
How Specialist Talent Works
At Peregrine, we find the best talent for our clients. Unlike traditional contractors, where you are hired by the client, you remain a permanent employee of Peregrine, with access to all our standard benefits:
A Permanent Position
Life Assurance
5% annual bonus
Pension Scheme – Employer matched to 5%
Voluntary Benefits – Health Cash Plan, Dental, Will Writing, etc.
Annual Leave – 23 days rising to 27 with length of service
Sick Pay – Increasing with length of service
The Role: DataOps Engineer
Job Description
We are seeking a senior DataOps Engineer to serve as our first DataOps specialist in a growing team of Data Engineers and DevOps professionals. In this pivotal role, you will focus on operationalising and automating our data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft Azure environment. Your work will include proactive system monitoring, error resolution, continuous improvements, and mentoring colleagues.
Role Requirements:
Oversee and automate operational processes supporting data workflows developed by the Data Engineering team, ensuring seamless coordination with DevOps.
Spearhead the development, integration, and maintenance of CI/CD data pipelines for automated deployments.
Integrate best practices for monitoring and observability to proactively detect, analyze, and resolve issues.
Enforce data governance and security protocols through tools like Azure Key Vault, ensuring compliance with GDPR and other standards.
Collaborate with Data Engineering, Data Science, Analytics, and DevOps teams to align operational strategies with technical and business needs.
Optimize operational performance and cost management for services like Azure Data Factory, Azure Databricks, Delta Lake, and Azure Data Lake Storage.
Serve as the domain expert in DataOps, providing strategic guidance, mentoring, and driving process improvements.
Evaluate and adopt emerging technologies to enhance operational efficiency and automation.
Minimum Criteria:
Experience in DataOps, Data Engineering, DevOps, or related fields managing data operations in complex environments.
Experience working with agile teams and automating data workflows within Azure.
Hands-on expertise with Azure Data Platform components: Data Factory, Databricks, Data Lake Storage, Delta Lake, SQL, Purview, APIM.
Proficiency in Python, SQL, Bash, PySpark for automation.
Knowledge of data security practices like RBAC and encryption.
Experience with observability dashboards and ensuring high data quality.
Understanding of regulatory compliance and data governance.
Ability to implement Infrastructure as Code using Terraform.
Essential Criteria:
Enjoy sharing knowledge and training others.
Excellent communication and collaboration skills.
Motivated to learn and improve technical and soft skills.
Desirable Criteria:
It would be beneficial to have:
Experience in scaling high-volume data operations in Azure.
Familiarity with Azure services for data efficiency and analytics.
Exposure to Spark processing and advanced analytics.
Experience mentoring teams and implementing strategic improvements.
Certifications such as Azure Data Engineer, Azure DevOps, Databricks Data Engineer.
Ability to build and manage DataOps processes in a growing team.
About Us
At Peregrine, we look beyond the immediate and focus on the horizon. We build lasting partnerships and deliver flexible solutions for resource needs, now and in the future. We help our clients engage, develop, and harness skills to grow their workforce.
Our Culture
We embrace new ideas, love learning quickly, and rely on openness and honesty. Our work aims to benefit society through digital talent development and social mobility.
Diversity and Inclusion
We are committed to diversity and inclusion, with initiatives to promote social mobility and reduce environmental impact. Our teams are diverse in culture, language, and ethnicity, with over 20 nationalities and varied backgrounds. We continuously improve our practices to reflect this commitment.
#J-18808-Ljbffr
