Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Two-Phase Multidocument Summarization Through Content-Attention-Based Subtopic Detection

Bibliographic Data

ID22108749
AuthorsLuobing Dong (0000-0003-3185-4781, Xidian University), Meghana N Satpute (0000-0001-7111-1814, The University of Texas at Dallas), Weili Wu (0000-0001-8747-6340, The University of Texas at Dallas), Ding-Zhu Du (Department of Computer Science, University of Texas at Dallas, Richardson, TX, USA), Ding‐Zhu Du (0000-0002-7345-2185, The University of Texas at Dallas)
Year2021
Volume8
Issue6
Pages1379-1392
Publication date2021-12-01
Open AccessYes
TypeARTICLE
VenueIEEE Transactions on Computational Social Systems (JOURNAL)
Journal identifiersISSN: 2329-924X • E-ISSN: 2373-7476
PublisherInstitute of Electrical and Electronics Engineers (IEEE) (PUBLISHER)
DOI10.1109/tcss.2021.3079206
OpenAlexW4236900068
LanguageEN
Citations received1
References cited29

Multidocument summarization problem deals with extracting main information and ideas from a set of related documents. Solution to this problem is to find an extraction strategy that aims at finding a small subset of sentences that is able to cover the most important information about the whole document set. Although a large number of machine-learning-based methods have shown great promise, the lack of high-quality training data poses an inherent obstacle to them. Furthermore, because of the proliferation of low-quality documents on the Internet, the existing summarization strategies, which are merely based on statistical features, get poor performance. In this article, we propose a new two-phase multidocument summarization strategy using content attention-based subtopic detection. First, inspired by distance dynamics-based community detection mechanism, we extract subtopics from the set of documents by having insight into their own content attention and also underlying semantic relations. Instead of complicated neural attention mechanisms, we propose a simple iteration-based content attention method to complete the subtopic detection task. Second, we formulate summarization from different subtopics as a combinatorial optimization problem of minimizing sentence distance and maximizing topic diversity. We prove the submodularity of the above optimization problem, which allows us to propose a new multidocument summarization algorithm based on the greedy mechanism. Finally, we experimentally validate our new algorithms on BBC news summary and wikiHow data. The results show our new algorithms outperform the state-of-the-art methods

Automatic summarization · Data mining · Information retrieval · Machine learning · Multi-document summarization · Sentence · Topic model · Advanced Text Analysis Techniques · Computer Science · Natural Language Processing Techniques · Topic Modeling · Artificial Intelligence

  • Ebpga

    Open Access•Hemamalini Siranjeevi, Swaminathan Venkatraman et al.•IEEE Transactions on Computational…•2025

  • Probabilistic topic models

    Open Access•David M Blei•Communications of the ACM•2012

  • Measuring common knowledge

    Open Access•A Burcu Bayram, Vivian P Ta et al.•International Relations•2020

Citations per year1
Citation span2025 - 2025 (1)
Highly citedNo

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae