Fiche du document
20 octobre 2022
- doi: 10.4000/books.aaccademia.11009
- eisbn: 9791280136947
https://creativecommons.org/licenses/by-nc-nd/4.0/ , info:eu-repo/semantics/openAccess
Mots-clés
linguistica computazionale linguistica linguistique computationelle linguistique Computational Linguistics Language Linguistics LAN009000 Linguistics CFSujets proches
Competitive examinations TestsCiter ce document
Daniele Puccinelli et al., « Tackling Italian University Assessment Tests with Transformer-Based Language Models », Accademia University Press, ID : 10.4000/books.aaccademia.11009
Métriques
Partage / Export
Résumé
Cloze tests are a great tool to asses reading proficiency as well as analytical thinking, and are therefore employed in admission and assessment tests at various levels of the education system in multiple countries. In Italy, cloze tests are administered to incoming university students to ascertain their starting level. The goal of a cloze test is to determine several tokens that have been pre-deleted from a text; this is largely equivalent to the well-known NLP task of missing token prediction. In this paper, we show that cloze tests can be solved reasonably well with various Transformer-based pre-trained language models, whose performance often compares favorably to the one of incoming Italian university students.