| Title: | Multi-granularity learning of explicit geometric constraint and contrast for label-efficient medical image segmentation and differentiable clinical function assessment |
| Journal: | Medical Image Analysis |
| Published: | 20 Apr 2024 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/38692098/ |
| DOI: | https://doi.org/10.1016/j.media.2024.103183 |
| Citations: | 1 (1 in last 2 years) as of 8 Aug 2024 |
Publication 12179
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
Automated segmentation is a challenging task in medical image analysis that usually requires a large amount of manually labeled data. However, most current supervised learning based algorithms suffer from insufficient manual annotations, posing a significant difficulty for accurate and robust segmentation. In addition, most current semi-supervised methods lack explicit representations of geometric structure and semantic information, restricting segmentation accuracy. In this work, we propose a hybrid framework to learn polygon vertices, region masks, and their boundaries in a weakly/semi-supervised manner that significantly advances geometric and semantic representations. Firstly, we propose multi-granularity learning of explicit geometric structure constraints via polygon vertices (PolyV) and pixel-wise region (PixelR) segmentation masks in a semi-supervised manner. Secondly, we propose eliminating boundary ambiguity by using an explicit contrastive objective to learn a discriminative feature space of boundary contours at the pixel level with limited annotations. Thirdly, we exploit the task-specific clinical domain knowledge to differentiate the clinical function assessment end-to-end. The ground truth of clinical function assessment, on the other hand, can serve as auxiliary weak supervision for PolyV and PixelR learning. We evaluate the proposed framework on two tasks, including optic disc (OD) and cup (OC) segmentation along with vertical cup-to-disc ratio (vCDR) estimation in fundus images; left ventricle (LV) segmentation at end-diastolic and end-systolic frames along with ejection fraction (LVEF) estimation in two-dimensional echocardiography images. Experiments on nine large-scale datasets of the two tasks under different label settings demonstrate our model's superior performance on segmentation and clinical function assessment.</p>
9 Authors
- Yanda Meng
- Yuchen Zhang
- Jianyang Xie
- Jinming Duan
- Martha Joddrell
- Savita Madhusudhan
- Tunde Peto
- Yitian Zhao
- Yalin Zheng
1 Application
| Application ID | Title |
|---|---|
| 54078 | AI Enabled Structure and Function Analysis for Establishing the Eye as the Window to the Heart and Brain |
Enabling scientific discoveries that improve human health