RankSum An unsupervised extractive text summarization based on rank fusion
Joshi, A., Fidalgo, E., Alegre, E., Alaiz-Rodriguez, R.
–arXiv.org Artificial Intelligence
In this paper, we propose Ranksum, an approach for extractive text summarization of single documents based on the rank fusion of four multi-dimensional sentence features extracted for each sentence: topic information, semantic content, significant keywords, and position. The Ranksum obtains the sentence saliency rankings corresponding to each feature in an unsupervised way followed by the weighted fusion of the four scores to rank the sentences according to their significance. The scores are generated in completely unsupervised way, and a labeled document set is required to learn the fusion weights. Since we found that the fusion weights can generalize to other datasets, we consider the Ranksum as an unsupervised approach. To determine topic rank, we employ probabilistic topic models whereas semantic information is captured using sentence embeddings. To derive rankings using sentence embeddings, we utilize Siamese networks to produce abstractive sentence representation and then we formulate a novel strategy to arrange them in their order of importance. A graph-based strategy is applied to find the significant keywords and related sentence rankings in the document. We also formulate a sentence novelty measure based on bigrams, trigrams, and sentence embeddings to eliminate redundant sentences from the summary. The ranks of all the sentences computed for each feature are finally fused to get the final score for each sentence in the document. We evaluate our approach on publicly available summarization datasets CNN/DailyMail and DUC 2002. Experimental results show that our approach outperforms other existing state-of-the-art summarization methods.
arXiv.org Artificial Intelligence
Feb-7-2024
- Country:
- Oceania > Australia
- North America > United States
- New York > New York County
- New York City (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- Massachusetts > Middlesex County
- Cambridge (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- California
- San Francisco County > San Francisco (0.14)
- San Diego County > San Diego (0.04)
- New York > New York County
- Europe
- Germany > Berlin (0.04)
- Spain
- Valencian Community > Valencia Province
- Valencia (0.04)
- Catalonia > Barcelona Province
- Barcelona (0.04)
- Castile and León > León Province
- León (0.04)
- Valencian Community > Valencia Province
- Portugal > Lisbon
- Lisbon (0.04)
- Italy > Tuscany
- Florence (0.04)
- Denmark > Capital Region
- Copenhagen (0.04)
- Bulgaria > Varna Province
- Varna (0.04)
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Asia
- Vietnam (0.04)
- Middle East > Jordan (0.04)
- India > Maharashtra
- Mumbai (0.04)
- China
- Sichuan Province (0.04)
- Tianjin Province > Tianjin (0.04)
- Hong Kong (0.04)
- Beijing > Beijing (0.04)
- Genre:
- Research Report > New Finding (0.34)
- Technology: