| Title: | Detect and correct bias in multi-site neuroimaging datasets |
| Journal: | Medical Image Analysis |
| Published: | 21 Oct 2020 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/33152602/ |
| DOI: | https://doi.org/10.1016/j.media.2020.101879 |
| URL: | https://www.sciencedirect.com/science/article/am/pii/S1361841520302437 |
| Citations: | 81 (36 in last 2 years) as of 8 Aug 2024 |
Publication 9268
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
The desire to train complex machine learning algorithms and to increase the statistical power in association studies drives neuroimaging research to use ever-larger datasets. The most obvious way to increase sample size is by pooling scans from independent studies. However, simple pooling is often ill-advised as selection, measurement, and confounding biases may creep in and yield spurious correlations. In this work, we combine 35,320 magnetic resonance images of the brain from 17 studies to examine bias in neuroimaging. In the first experiment, Name That Dataset, we provide empirical evidence for the presence of bias by showing that scans can be correctly assigned to their respective dataset with 71.5% accuracy. Given such evidence, we take a closer look at confounding bias, which is often viewed as the main shortcoming in observational studies. In practice, we neither know all potential confounders nor do we have data on them. Hence, we model confounders as unknown, latent variables. Kolmogorov complexity is then used to decide whether the confounded or the causal model provides the simplest factorization of the graphical model. Finally, we present methods for dataset harmonization and study their ability to remove bias in imaging features. In particular, we propose an extension of the recently introduced ComBat algorithm to control for global variation across image features, inspired by adjusting for unknown population stratification in genetics. Our results demonstrate that harmonization can reduce dataset-specific information in image features. Further, confounding bias can be reduced and even turned into a causal relationship. However, harmonization also requires caution as it can easily remove relevant subject-specific information. Code is available at https://github.com/ai-med/Dataset-Bias.</p>
6 Keywords
- Algorithms
- Bias
- Humans
- Machine Learning
- Magnetic Resonance Imaging
- Neuroimaging
4 Authors
- Christian Wachinger
- Anna Rieckmann
- Sebastian Pölsterl
- for the Alzheimer's Disease Neuroimaging Initiative and the Australian Imaging Biomarkers and Lifestyle flagship study of ageing
1 Application
| Application ID | Title |
|---|---|
| 34479 | Joint analysis of abdominal and cerebral morphology in diabetes |
Enabling scientific discoveries that improve human health