Jobs

Machine Learning QA Manager, Strategic Analytics Services


Job details
  • Arch Capital Group
  • Bristol
  • 5 months ago
Applications closed

With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility℠.

Strategic Analytics is a dynamic, growing team at Arch. The team develops innovative predictive models and analytical tools to improve profitability and growth. This position is responsible for leading the design and execution of automated diagnostic test plans in the new MLOps framework to ensure that our services meet the highest quality standards and business requirements. This role requires excellent technical skills, a high degree of problem-solving skills, and a passion for exploring and implementing new technology and processes to improve the QA framework. The team member will be expected to regularly contribute towards the team and organizational goal of continuous process improvement. This role requires thorough communication skills and the ability to work well with others, including internal and external stakeholders.

Job Responsibilities

Test Framework and Communication

Maintains and enhances the MLOps testing framework Suggests improvements of the processes to increase quality of the product and performance of the team Keeps stakeholders updated with testing status and reports Manage product requirements, technical execution plan, and testing objectives

Test Planning and Execution

Leads test planning activities Leads creation and modification of test cases, test data, and automated test scripts Analyze new feature performance against established baselines Manages and coordinates testing process Manages documentation efforts of defects and resolution Collaborate with QA engineers and project leads

Required Skills/Experience

7-9 years of software testing experience. Experience with leading a small team Experience with MLOps frameworks and concepts Thorough understanding of quality assurance with APIs Experience testing APIs and using test automation resources. Experience with Azure Portal, Function Apps, and Databricks Experience shaping automation scripts using automation framework. Strong understanding of SQL and Python, and the ability to use SQL resources to query a database to retrieve data. Meaningful experience with Windows, Web Applications and/or Web Service environments. Thorough experience using JIRA or similar agile resources. Thorough experience with multiple testing resources including HP ALM, HP LoadRunner, Selenium, ReadyAPI and SOAP UI are preferred.

Desired Skills/Experience

Strong experience with SQL databases like Azure SQL and Python Good experience with different testing frameworks HP Unified Functional Testing (UFT), Cypress, and REST Assured frameworks. Strong experience with Python and Databricks

Education

Bachelor’s degree in computer science or equivalent work experience. IT software testing certification. (a plus but not required) IT Agile certification (a plus but not required)

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.