About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment
Fiche du document
1 janvier 2005
- handle: 10670/1.2wsl01
Ce document est lié à :
10.4067/S0718-09342005000300004
info:eu-repo/semantics/openAccess
Sujets proches
Assessment Assessment, Tax Assessment Property tax--Assessment Real property tax--Assessment Assessed valuationCiter ce document
Diana Pérez et al., « About the effects of combining Latent Semantic Analysis with natural language processing techniques for free-text assessment », Revista Signos - Estudios de lingüística, ID : 10670/1.2wsl01
Métriques
Partage / Export
Résumé
This article presents the combination of Latent Semantic Analysis (LSA) with other natural language processing techniques (stemming, removal of closed-class words and word sense disambiguation) to improve the automatic assessment of students' free-text answers. The combinational schema has been tested in the experimental framework provided by the free-text Computer Assisted Assessment (CAA) system called Atenea (Alfonseca & Pérez, 2004). This system is able to ask randomly or according to the students' profile an open-ended question to the student and then, assign a score to it. The results prove that for all datasets, when the NLP techniques are combined with LSA, the Pearson correlation between the scores given by Atenea and the scores given by the teachers for the same dataset of questions improves. We believe that this is due to the complementarity between LSA, which works more at a shallow semantic level, and the rest of the NLP techniques used in Atenea, which are more focused on the lexical and syntactical levels.