Fiche du document
3 septembre 2021
- doi: 10.4000/books.aaccademia.8438
- eisbn: 9791280136336
https://www.openedition.org/12554 , info:eu-repo/semantics/openAccess
Mots-clés
Computational Linguistics Fine-grained sentiment analysis Distributional Semantics Quantitative Linguistic Investigations Gender Bias Depression from Social Media Online Hate Speech Automatic Sarcasm Detection TrAVaSI AriEmozione AEREST COVID-19 Linguistic Ostracism in Social Networks Multilingual NLU E3C Project DistilBERT Twitter during Pandemic LAN000000 Linguistics CBXSujets proches
Language (New words, slang, etc.)Citer ce document
De Mattei Lorenzo et al., « GePpeTto Carves Italian into a Language Model », Accademia University Press, ID : 10.4000/books.aaccademia.8438
Métriques
Partage / Export
Résumé
In the last few years, pre-trained neural architectures have provided impressive improvements across several NLP tasks. Still, generative language models are available mainly for English. We develop GePpeTto, the first generative language model for Italian, built using the GPT-2 architecture. We provide a thorough analysis of GePpeTto’s quality by means of both an automatic and a human-based evaluation. The automatic assessment consists in (i) calculating perplexity across different genres and (ii) a profiling analysis over GePpeTto’s writing characteristics. We find that GePpeTto’s production is a sort of bonsai version of human production, with shorter but yet complex sentences. Human evaluation is performed over a sentence completion task, where GePpeTto’s output is judged as natural more often than not, and much closer to the original human texts than to a simpler language model which we take as baseline.