HunSum-1: an Abstractive Summarization Dataset for Hungarian
Barta, Botond, Lakatos, Dorina, Nagy, Attila, Nyist, Milán Konor, Ács, Judit
–arXiv.org Artificial Intelligence
We introduce HunSum-1: a dataset for Hungarian abstractive summarization, consisting of 1.14M news articles. The dataset is built by collecting, cleaning and deduplicating data from 9 major Hungarian news sites through CommonCrawl. Using this dataset, we build abstractive summarizer models based on huBERT and mT5. We demonstrate the value of the created dataset by performing a quantitative and qualitative analysis on the models' results. The HunSum-1 dataset, all models used in our experiments and our code are available open source.
arXiv.org Artificial Intelligence
Feb-1-2023
- Country:
- Oceania > Australia
- North America
- Europe
- Sweden > Uppsala County
- Uppsala (0.04)
- Spain > Catalonia
- Barcelona Province > Barcelona (0.04)
- Portugal > Lisbon
- Lisbon (0.04)
- Hungary
- Csongrád-Csanád County > Szeged (0.04)
- Budapest > Budapest (0.04)
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Sweden > Uppsala County
- Asia > China
- Hong Kong (0.04)
- Genre:
- Research Report (0.84)
- Technology: