Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Segment Anything in Pathology Images with Natural Language

Created by
  • Haebom

Author

Zhixuan Chen, Junlin Hou, Liqi Lin, Yihui Wang, Yequan Bie, Xi Wang, Yanning Zhou, Ronald Cheong Kin Chan, Hao Chen

Outline

PathSegmentor is the first text-prompt-based baseline model for pathology image segmentation. To overcome the challenges of limited annotation data and category definition, we present PathSeg, a large-scale pathology segmentation dataset containing 275,000 image-mask-label triples collected from 21 publicly available sources. PathSegmentor allows users to perform semantic segmentation using natural language prompts, eliminating the need for spatial inputs such as points or boxes. Experimental results show that PathSegmentor is more accurate and has a wider range of applicability than existing spatial and text-prompt models, achieving an overall Dice score of 0.145 and 0.429, respectively. Furthermore, it enhances the interpretability of diagnostic models through feature importance estimation and imaging biomarker discovery, supporting pathologists' clinical decision-making.

Takeaways, Limitations

Takeaways:
We present the first text-prompt-based baseline model for pathological image segmentation.
Building a large-scale pathology segmentation dataset, PathSeg.
Achieves higher accuracy and wider application range than existing models.
Improve usability by using natural language prompts.
Improving diagnostic model interpretability through feature importance estimation and imaging biomarker discovery.
Contributing to the advancement of explainable AI in precision oncology.
Limitations:
Lack of detailed analysis of the composition and bias of the dataset PathSeg.
Further validation of the model's generalization performance is needed.
Further research is needed to determine its practical applicability and utility in clinical settings.
👍