Scenario-based Automatic Testing of a Machine Learning Solution with the Human in the Loop - Archive ouverte HAL
Conference Papers Year : 2024

Scenario-based Automatic Testing of a Machine Learning Solution with the Human in the Loop

Abstract

More and more applications rely on machine learning, particularly interactive online learning, to make decisions tailored to human needs and situation. Like any program, the behavior of learning programs must be verified and validated. Testing is one way to achieve this.

In this paper, we analyze the challenges of testing machine learning solutions, focusing on programs that learn online and in interaction with human users. Given the issues arising from the presence of the human in the loop, the non-determinism and the dynamics of online learning, we propose a scenario-based approach. We apply it to the test of OCE, a learning program that builds applications in ambient environments with the user in the loop. In addition, two prototype tools are presented to implement test scenarios and automate their execution for the assessment of OCE.

Embargoed file
Embargoed file
0 5 6
Year Month Jours
Avant la publication
Wednesday, April 9, 2025
Embargoed file
Wednesday, April 9, 2025
Please log in to request access to the document

Dates and versions

hal-04726773 , version 1 (09-10-2024)

Licence

Identifiers

  • HAL Id : hal-04726773 , version 1

Cite

Maxence Demougeot, Sylvie Trouilhet, Jean-Paul Arcangeli, Françoise Adreit. Scenario-based Automatic Testing of a Machine Learning Solution with the Human in the Loop. Second Workshop on Hybrid Human-Machine Learning and Decision Making (co-located with the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in DataBases, Sep 2024, Vilnius, Lithuania. ⟨hal-04726773⟩
0 View
0 Download

Share

More