Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

BP-Seg: A graphical model approach to unsupervised and non-contiguous text segmentation using belief propagation

Created by
  • Haebom

Author

Fengyi Li, Kayhan Behdin, Natesh Pillai, Xiaofeng Wang, Zhipeng Wang, Ercan Yildiz

BP-Seg: A Graph-Model-Based Unsupervised Learning Approach for Efficient Text Segmentation

Outline

This paper proposes BP-Seg, an efficient graph model-based unsupervised learning approach for text segmentation based on the semantic meaning of sentences. BP-Seg not only considers local consistency, which captures the intuition that adjacent sentences are highly related, but also effectively groups distant but semantically similar sentences in the text. This is achieved through belief propagation on a carefully constructed graph model.

Takeaways, Limitations

BP-Seg performs text segmentation by considering both local consistency and long-range semantic similarity.
We achieve efficient text segmentation using a graph model-based approach.
The proposed method outperforms competitive methods in experiments on example and long document datasets.
(Limitations is not clearly stated in the abstract)
👍