About the Role
Lead the implementation of a holistic test strategy for data and model evaluation as well as the fundamental ML pipeline testing and monitoring
Implement best practices into the AI/ML development cycle so that it is highly stable, discovers issues and requires low maintenance.
Supporting ML Engineers in Model Evaluation (e.g. Error Analysis), Data Quality Validation, Data Annotation and Model Monitoring to ensure a high quality of AI driven products.
Working closely with ML Engineers, MLOPs Engineers and other QA engineers to ensure a common understanding and implementation of best practices.
Contribute to the growth and continuous improvement of quality and testing processes within the organization.
About You
Basic Qualifications :
Strong Experience in Quality Assurance and Test Automation with strong focus on AI/ML
Understanding of QA methodologies, tools, and processes
Strong experience at least in statistical analysis or machine learning algorithms, natural language processing, LLMs
Experience in AI/ML System Design and Life cycle of ML Models
Other Qualifications:
Hands on experience with test automation and tools such as Pytest, Giskard, Garak
Proficiency in SQL and Python
Experience in Red Teaming of LLM and ML Models
Experience in AI/ML Model performance validation, data quality/validation testing, model monitoring and data pipeline
The latest news, articles, and resources, sent to your inbox weekly.
Senior QA Automation EngineerEdinburgh (hybrid)We have a truly exciting opportunity for a Senior QA Automation Engineer to be part of an innovative software engineering team developing Brady's cloud-native trading solution for the power and energy markets. With the energy revolution under way and decarbonisation driving reliance on intermittent renewable energy...
Brady Edinburgh
It's fun to work in a company where people truly BELIEVE in what they're doing!We're committed to bringing passion and customer focus to the business.Corporate OverviewProofpoint is a leading cybersecurity company protecting organizations’ greatest assets and biggest risks: vulnerabilities in people. With an integrated suite of cloud-based solutions, Proofpoint helps...
Proofpoint Belfast
DescriptionTheBack-end Engineer (Kotlin)is a key member of our core Engineering teams, building our powerful, flexible financial crime detection engine that is used by top Financial Institutions globally to quickly and easily apply predefined scenarios or Machine Learning algorithms to customer, and transaction data.In this role, you (Back-end Engineer) will be...
Napier AI Belfast
Why this role is important for CPI’s workCPI is delighted to be recruiting for a placement opportunity who will join the established and growing Automation and Digital team within the National Formulation Centre based at NETPark, in Sedgefield.Why join?Our ideal candidate can be from any science/engineering discipline with an interest...
CPI Sedgefield
This role is hybrid, with one day per week at our HQ in Oxford. We aren't able to offer visa sponsorship for this role at this time.Who are we?Oxais enabling the transition to self-driving vehicles through an initial focus on the most commercially advanced sector; the autonomous shuttling of goods...
Oxa Oxford
ABOUT USWe’re building Tomorrow’s Connections Today, bringing people together through the power of our technology.Liberty Global is a world leader in converged broadband, video and mobile communications and an active investor in cutting-edge infrastructure, content and technology ventures.With our investments in fibre-based and 5G networks we play a vital role...
Liberty Global Technology Services BV Reading