Xiaoyan Cai is now at College of Information Engineering, Northwest A&F University.
Enhancing sentence-level clustering with integrated and interactive frameworks for theme-based summarization
Article first published online: 20 JUL 2011
© 2011 ASIS&T
Journal of the American Society for Information Science and Technology
Volume 62, Issue 10, pages 2067–2082, October 2011
How to Cite
Cai, X. and Li, W. (2011), Enhancing sentence-level clustering with integrated and interactive frameworks for theme-based summarization. J. Am. Soc. Inf. Sci., 62: 2067–2082. doi: 10.1002/asi.21593
- Issue published online: 9 SEP 2011
- Article first published online: 20 JUL 2011
- Manuscript Accepted: 17 MAY 2011
- Manuscript Revised: 16 MAY 2011
- Manuscript Received: 9 SEP 2010
Sentence clustering plays a pivotal role in theme-based summarization, which discovers topic themes defined as the clusters of highly related sentences to avoid redundancy and cover more diverse information. As the length of sentences is short and the content it contains is limited, the bag-of-words cosine similarity traditionally used for document clustering is no longer suitable. Special treatment for measuring sentence similarity is necessary. In this article, we study the sentence-level clustering problem. After exploiting concept- and context-enriched sentence vector representations, we develop two co-clustering frameworks to enhance sentence-level clustering for theme-based summarization—integrated clustering and interactive clustering—both allowing word and document to play an explicit role in sentence clustering as independent text objects rather than using word or concept as features of a sentence in a document set. In each framework, we experiment with two-level co-clustering (i.e., sentence-word co-clustering or sentence-document co-clustering) and three-level co-clustering (i.e., document-sentence-word co-clustering). Compared against concept- and context-oriented sentence-representation reformation, co-clustering shows a clear advantage in both intrinsic clustering quality evaluation and extrinsic summarization evaluation conducted on the Document Understanding Conferences (DUC) datasets.