Responsibilities
Azure Platform Engineering: Lead the design, provisioning, and optimization of the Azure cloud platform for data analytics and AI/ML workflows, with a focus on scalability, resilience, and high availability.
Infrastructure as Code (IaC): Implement and manage Infrastructure as Code using Terraform to automate the deployment and configuration of Azure resources for efficiency and repeatability.
Azure DevOps Integration: Manage and optimize CI/CD pipelines using Azure DevOps to deploy platform updates and infrastructure changes across environments seamlessly.
Cloud Resource Management: Optimize the performance, cost, and availability of cloud resources including virtual machines, storage solutions, networking, and identity management.
Collaboration with Data Teams: Work closely with data engineers, AI/ML specialists, and analysts to ensure the Azure platform supports their requirements without direct involvement in coding or data pipeline development.
Security and Compliance: Implement best practices for security, governance, and compliance across Azure services, ensuring adherence to GDPR and other relevant regulations.
Monitoring and Performance Tuning: Establish robust monitoring, logging, and alerting systems using Azure Monitor, Log Analytics, and other tools to ensure platform health and performance.
Collaboration with Project Managers: Assist project managers by providing technical insights and support in the planning and execution of infrastructure-related components of data analytics initiatives.
Qualifications
Expertise in Azure Platform Engineering: Extensive experience in designing and managing Azure-based platforms for large-scale data analytics, AI, and machine learning applications.
Infrastructure Automation (Terraform): Hands-on experience using Terraform to automate the provisioning, scaling, and management of Azure resources.
Azure DevOps: Experience managing CI/CD pipelines for infrastructure updates, automation, and operational workflows using Azure DevOps.
Cloud Resource Optimization: Proven ability to optimize Azure resources for cost, performance, and availability, including managing compute, storage, and networking resources.
Security and Compliance: Strong understanding of Azure security best practices, identity and access management, encryption, and compliance frameworks such as GDPR.
Platform Monitoring: Proficiency in setting up and managing monitoring solutions like Azure Monitor, Log Analytics, and Application Insights to ensure platform stability and performance.
