Modern French Poetry Generation with RoBERTa and GPT-2

Fiche du document

Date

27 juin 2022

Type de document
Périmètre
Langue
Identifiants
Collection

Archives ouvertes

Licence

info:eu-repo/semantics/OpenAccess



Sujets proches En

Pattern Model

Citer ce document

Mika Hämäläinen et al., « Modern French Poetry Generation with RoBERTa and GPT-2 », HAL-SHS : linguistique, ID : 10670/1.2g9gdh


Métriques


Partage / Export

Résumé En

We present a novel neural model for modern poetry generation in French. The model consists of two pretrained neural models that are fine-tuned for the poem generation task. The encoder of the model is a RoBERTa based one while the decoder is based on GPT-2. This way the model can benefit from the superior natural language understanding performance of RoBERTa and the good natural language generation performance of GPT-2. Our evaluation shows that the model can create French poetry successfully. On a 5 point scale, the lowest score of 3.57 was given by human judges to typicality and emotionality of the output poetry while the best score of 3.79 was given to understandability.

document thumbnail

Par les mêmes auteurs

Sur les mêmes sujets

Sur les mêmes disciplines

Exporter en