ML-ModelExplorer: An Explorative Model-Agnostic Approach to Evaluate and Compare Multi-class Classifiers
Fiche du document
25 août 2020
- handle: 10670/1.4j3fz7
- hal: hal-03414731
- doi: 10.1007/978-3-030-57321-8_16
Ce document est lié à :
info:eu-repo/semantics/altIdentifier/doi/10.1007/978-3-030-57321-8_16
http://creativecommons.org/licenses/by/ , info:eu-repo/semantics/OpenAccess
Mots-clés
Multi-class classification Model selection Feature selection Human-centered machine learning Visual analyticsCiter ce document
Andreas Theissler et al., « ML-ModelExplorer: An Explorative Model-Agnostic Approach to Evaluate and Compare Multi-class Classifiers », HAL-SHS : sciences de l'information, de la communication et des bibliothèques, ID : 10.1007/978-3-030-57321-8_16
Métriques
Partage / Export
Résumé
A major challenge during the development of Machine Learning systems is the large number of models resulting from testing different model types, parameters, or feature subsets. The common approach of selecting the best model using one overall metric does not necessarily find the most suitable model for a given application, since it ignores the different effects of class confusions. Expert knowledge is key to evaluate, understand and compare model candidates and hence to control the training process. This paper addresses the research question of how we can support experts in the evaluation and selection of Machine Learning models, alongside the reasoning about them. ML-ModelExplorer is proposed – an explorative, interactive, and model-agnostic approach utilising confusion matrices. It enables Machine Learning and domain experts to conduct a thorough and efficient evaluation of multiple models by taking overall metrics, per-class errors, and individual class confusions into account. The approach is evaluated in a user-study and a real-world case study from football (soccer) data analytics is presented.ML-ModelExplorer and a tutorial video are available online for use with own data sets: www.ml-and-vis.org/mex