| Title: | Neural network training with highly incomplete medical datasets |
| Journal: | Machine Learning: Science and Technology |
| Published: | 6 Jul 2022 |
| DOI: | https://doi.org/10.1088/2632-2153/ac7b69 |
| Citations: | 4 (3 in last 2 years) as of 8 Aug 2024 |
Publication 10351
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
Neural network training and validation rely on the availability of large high-quality datasets. However, in many cases only incomplete datasets are available, particularly in health care applications, where each patient typically undergoes different clinical procedures or can drop out of a study. Since the data to train the neural networks need to be complete, most studies discard the incomplete datapoints, which reduces the size of the training data, or impute the missing features, which can lead to artifacts. Alas, both approaches are inadequate when a large portion of the data is missing. Here, we introduce GapNet, an alternative deep-learning training approach that can use highly incomplete datasets without overfitting or introducing artefacts. First, the dataset is split into subsets of samples containing all values for a certain cluster of features. Then, these subsets are used to train individual neural networks. Finally, this ensemble of neural networks is combined into a single neural network whose training is fine-tuned using all complete datapoints. Using two highly incomplete real-world medical datasets, we show that GapNet improves the identification of patients with underlying Alzheimer's disease pathology and of patients at risk of hospitalization due to Covid-19. Compared to commonly used imputation methods, this improvement suggests that GapNet can become a general tool to handle incomplete medical datasets.</p>
6 Authors
- Yu-Wei Chang
- Laura Natali
- Oveis Jamialahmadi
- Stefano Romeo
- Joana B Pereira
- Giovanni Volpe
1 Application
| Application ID | Title |
|---|---|
| 37142 | UNDERSTANDING THE GENETIC ARCHITECTURE OF CHRONIC LIVER DISEASE |
Enabling scientific discoveries that improve human health