Senior Machine Learning Quality Assurance and Test Automation Engineer

Social network you want to login/join with:

Senior Machine Learning Quality Assurance and Test Automation Engineer, LondonClient:Location:

London, United Kingdom

Job Category:

Other

EU work permit required:

Yes

Job Reference:

aabdc15d4f38

Job Views:

91

Posted:

11.03.2025

Expiry Date:

25.04.2025

Job Description:

About the Role

Lead the implementation of a holistic test strategy for data and model evaluation as well as the fundamental ML pipeline testing and monitoring.

Implement best practices into the AI/ML development cycle so that it is highly stable, discovers issues, and requires low maintenance.

Support ML Engineers in Model Evaluation (e.g. Error Analysis), Data Quality Validation, Data Annotation, and Model Monitoring to ensure a high quality of AI-driven products.

Work closely with ML Engineers, MLOps Engineers, and other QA engineers to ensure a common understanding and implementation of best practices.

Contribute to the growth and continuous improvement of quality and testing processes within the organization.

About You

Basic Qualifications:

1. Strong experience in Quality Assurance and Test Automation with a strong focus on AI/ML.
2. Understanding of QA methodologies, tools, and processes.
3. Strong experience in statistical analysis or machine learning algorithms, natural language processing, and LLMs.
4. Experience in AI/ML System Design and the life cycle of ML Models.

Other Qualifications:

1. Hands-on experience with test automation and tools such as Pytest, Giskard, and Garak.
2. Proficiency in SQL and Python.
3. Experience in Red Teaming of LLM and ML Models.
4. Experience in AI/ML Model performance validation, data quality/validation testing, model monitoring, and data pipeline.

#J-18808-Ljbffr