Automation Test Analyst

Job DescriptionLocation: Hybrid Working - Mostly remote working with visits a few times per month to the London officeSector: InsuranceJob Type: ConsultantASSIGNMENT OVERVIEWAlchemy London Market is seeking experienced Test Automation Engineer, who will play a crucial role in automating the testing of AI-driven applications, ensuring high accuracy, reliability, and performance. This project will involve developing automated test scripts using Natural Language Programming, performing thorough regression, User Acceptance Testing, and integration testing, and analysing the root causes of defects. You will work closely with development teams to resolve issues and continually refine test processes for optimal efficiency.ASSIGNMENT OBJECTIVES:Develop and maintain automated test scripts using Virtuoso (Natural Language Programmer) to support AI and machine learning applications.Ensure that test scripts cover all critical functionalities and provide thorough test coverage for regression, UAT, and integration testing.Analyze the performance, accuracy, and reliability of AI models.Identify potential issues and provide recommendations for improvement in model design or performance.Raise and track defects using tools such as JIRA.Collaborate closely with the development team to resolve defects and improve product quality efficiently.Set up, maintain, and update test environments, ensuring that data sets support the testing activities required for AI applications.Manage the necessary configurations to align test environments with development needs.Continuously evaluate test coverage and identify areas for improvement.Ensure that all essential features and functions are tested thoroughly to minimise risk in AI applications.Perform root cause analysis on defects and model failures.Provide actionable feedback to the development and data science teams to address underlying issues and prevent recurrence.EXPERIENCE AND SKILL-SET:Proven hands-on experience in manual software testing, with the ability to perform root cause analysis and provide accurate, detailed feedback.Experience with building, executing, and maintaining automated tests for regression, UAT, and integration testing.Knowledge of the latest AI testing tools and frameworks, and the ability to adopt and implement new technologies to improve testing processes.Proficiency in using JIRA, and JavaScript frameworks like React, Angular.Strong analytical skills with attention to detail.Excellent communication skills for effective collaboration with cross-functional teams.Ability to manage multiple tasks and priorities in a fast-paced environment.Ability to adapt to changing project requirements and priorities.Experience working within the Insurance/London Market.