| Title: | Joint shape/texture representation learning for cardiovascular disease diagnosis from magnetic resonance imaging |
| Journal: | European Heart Journal - Imaging Methods and Practice |
| Published: | 16 Jan 2024 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/39045211/ |
| DOI: | https://doi.org/10.1093/ehjimp/qyae042 |
| URL: | https://academic.oup.com/ehjimp/advance-article-pdf/doi/10.1093/ehjimp/qyae042/57653635/qyae042.pdf |
Publication 12190
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
Aims: Cardiovascular diseases (CVDs) are the leading cause of mortality worldwide. Cardiac image and mesh are two primary modalities to present the shape and structure of the heart and have been demonstrated to be efficient in CVD prediction and diagnosis. However, previous research has been generally focussed on a single modality (image or mesh), and few of them have tried to jointly consider the image and mesh representations of heart. To obtain efficient and explainable biomarkers for CVD prediction and diagnosis, it is needed to jointly consider both representations.</p>
Methods and results: We design a novel multi-channel variational auto-encoder, mesh-image variational auto-encoder, to learn joint representation of paired mesh and image. After training, the shape-aware image representation (SAIR) can be learned directly from the raw images and applied for further CVD prediction and diagnosis. We demonstrate our method on data from UK Biobank study and two other datasets via extensive experiments. In acute myocardial infarction prediction, SAIR achieves 81.43% accuracy, significantly higher than traditional biomarkers like metadata and clinical indices (left ventricle and right ventricle clinical indices of cardiac function like chamber volume, mass, and ejection fraction).</p>
Conclusion: Our mesh-image variational auto-encoder provides a novel approach for 3D cardiac mesh reconstruction from images. The extraction of SAIR is fast and without need of segmentation masks, and its focussing can be visualized in the corresponding cardiac meshes. SAIR archives better performance than traditional biomarkers and can be applied as an efficient supplement to them, which is of significant potential in CVD analysis.</p>
5 Authors
- Xiang Chen
- Yan Xia
- Erica Dall'Armellina
- Nishant Ravikumar
- Alejandro F Frangi
1 Application
| Application ID | Title |
|---|---|
| 11350 | CARDIOMARKER- Computational imaging phenomics in population cardiac MRI with automatic image quality assessment: benchmarking, scalability and inference with state-of-the-art algorithms. |
Enabling scientific discoveries that improve human health