| Title: | Automated quality control in image segmentation: application to the UK Biobank cardiovascular magnetic resonance imaging study |
| Journal: | Journal of Cardiovascular Magnetic Resonance |
| Published: | 14 Mar 2019 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/30866968/ |
| DOI: | https://doi.org/10.1186/s12968-019-0523-x |
| URL: | https://jcmr-online.biomedcentral.com/track/pdf/10.1186/s12968-019-0523-x |
Publication 4330
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
BackgroundThe trend towards large-scale studies including population imaging poses new challenges in terms of quality control (QC). This is a particular issue when automatic processing tools such as image segmentation methods are employed to derive quantitative measures or biomarkers for further analyses. Manual inspection and visual QC of each segmentation result is not feasible at large scale. However, it is important to be able to automatically detect when a segmentation method fails in order to avoid inclusion of wrong measurements into subsequent analyses which could otherwise lead to incorrect conclusions.MethodsTo overcome this challenge, we explore an approach for predicting segmentation quality based on Reverse Classification Accuracy, which enables us to discriminate between successful and failed segmentations on a per-cases basis. We validate this approach on a new, large-scale manually-annotated set of 4800 cardiovascular magnetic resonance (CMR) scans. We then apply our method to a large cohort of 7250 CMR on which we have performed manual QC.ResultsWe report results used for predicting segmentation quality metrics including Dice Similarity Coefficient (DSC) and surface-distance measures. As initial validation, we present data for 400 scans demonstrating 99% accuracy for classifying low and high quality segmentations using the predicted DSC scores. As further validation we show high correlation between real and predicted scores and 95% classification accuracy on 4800 scans for which manual segmentations were available. We mimic real-world application of the method on 7250 CMR where we show good agreement between predicted quality metrics and manual visual QC scores.ConclusionsWe show that Reverse classification accuracy has the potential for accurate and fully automatic segmentation QC on a per-case basis in the context of large-scale population imaging as in the UK Biobank Imaging Study.22 Authors
- Robert Robinson
- Vanya V. Valindria
- Wenjia Bai
- Ozan Oktay
- Bernhard Kainz
- Hideaki Suzuki
- Mihir M. Sanghvi
- Nay Aung
- José Miguel Paiva
- Filip Zemrak
- Kenneth Fung
- Elena Lukaschuk
- Aaron M. Lee
- Valentina Carapella
- Young Jin Kim
- Stefan K. Piechnik
- Stefan Neubauer
- Steffen E. Petersen
- Chris Page
- Paul M. Matthews
- Daniel Rueckert
- Ben Glocker
Enabling scientific discoveries that improve human health