| Title: | Different scaling of linear models and deep learning in UKBiobank brain images versus machine-learning datasets |
| Journal: | Nature Communications |
| Published: | 25 Aug 2020 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/32843633/ |
| DOI: | https://doi.org/10.1038/s41467-020-18037-z |
| URL: | https://www.nature.com/articles/s41467-020-18037-z.pdf |
Publication 7495
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
Recently, deep learning has unlocked unprecedented success in various domains, especially using images, text, and speech. However, deep learning is only beneficial if the data have nonlinear relationships and if they are exploitable at available sample sizes. We systematically profiled the performance of deep, kernel, and linear models as a function of sample size on UKBiobank brain images against established machine learning references. On MNIST and Zalando Fashion, prediction accuracy consistently improves when escalating from linear models to shallow-nonlinear models, and further improves with deep-nonlinear models. In contrast, using structural or functional brain scans, simple linear models perform on par with more complex, highly parameterized models in age/sex prediction across increasing sample sizes. In sum, linear models keep improving as the sample size approaches ~10,000 subjects. Yet, nonlinearities for predicting common phenotypes from typical brain scans remain largely inaccessible to the examined kernel and deep learning methods.8 Authors
- Marc-Andre Schulz
- B. T. Thomas Yeo
- Joshua T. Vogelstein
- Janaina Mourao-Miranada
- Jakob N. Kather
- Konrad Kording
- Blake Richards
- Danilo Bzdok
Enabling scientific discoveries that improve human health