| Title: | How to remove or control confounds in predictive models, with applications to brain biomarkers |
| Journal: | GigaScience |
| Published: | 12 Mar 2022 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/35277962/ |
| DOI: | https://doi.org/10.1093/gigascience/giac014 |
| URL: | https://academic.oup.com/gigascience/article-pdf/doi/10.1093/gigascience/giac014/42869927/giac014.pdf |
Publication 13887
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
BACKGROUND: With increasing data sizes and more easily available computational methods, neurosciences rely more and more on predictive modeling with machine learning, e.g., to extract disease biomarkers. Yet, a successful prediction may capture a confounding effect correlated with the outcome instead of brain features specific to the outcome of interest. For instance, because patients tend to move more in the scanner than controls, imaging biomarkers of a disease condition may mostly reflect head motion, leading to inefficient use of resources and wrong interpretation of the biomarkers.</p>
RESULTS: Here we study how to adapt statistical methods that control for confounds to predictive modeling settings. We review how to train predictors that are not driven by such spurious effects. We also show how to measure the unbiased predictive accuracy of these biomarkers, based on a confounded dataset. For this purpose, cross-validation must be modified to account for the nuisance effect. To guide understanding and practical recommendations, we apply various strategies to assess predictive models in the presence of confounds on simulated data and population brain imaging settings. Theoretical and empirical studies show that deconfounding should not be applied to the train and test data jointly: modeling the effect of confounds, on the training data only, should instead be decoupled from removing confounds.</p>
CONCLUSIONS: Cross-validation that isolates nuisance effects gives an additional piece of information: confound-free prediction accuracy.</p>
4 Keywords
- Biomarkers
- Brain
- Humans
- Machine Learning
4 Authors
- Darya Chyzhyk
- Gaël Varoquaux
- Michael Milham
- Bertrand Thirion
1 Application
| Application ID | Title |
|---|---|
| 25163 | Structural genetic contributions brain function and behavior |
Enabling scientific discoveries that improve human health