| Title: | Hierarchical Mixture-of-Experts Framework for Whole-Brain Imaging and Whole-Genome Analysis of Multiple Cognitive Functions |
| Journal: | IEEE Journal of Biomedical and Health Informatics |
| Published: | 13 Jul 2026 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/42441438/ |
| DOI: | https://doi.org/10.1109/jbhi.2026.3712671 |
Publication 20367
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
Understanding the biological mechanisms of different cognitive functions is essential for assessing brain health and developing proper interventions. Neuroimaging and genetic data provide complementary information for studying these mechanisms. However, it remains challenging to extract task-specific features from each modality and effectively integrate them for prediction because of the high-dimensional and heterogeneous multimodal data. To address this challenge, we propose IGMoE, a hierarchical mixture-of-experts framework, which jointly performs task-guided feature selection and multi modal fusion for whole-brain imaging and whole-genome analysis. First, we design two modality-specific sparse mixture-of-experts networks (SMoE) to extract, group, and select task-relevant features from imaging and genetic data separately. Contrastive pretraining is then employed to align multimodal representations. In addition, a multimodal fusion mixture-of-experts network (FMoE) is proposed to dynamically integrate the selected features to predict multiple cognitive scores. We evaluate IGMoE using MRI and genetic data from the UK Biobank (UKB) dataset on three cognitive tasks: paired associate learning, matrix pattern completion, and trail making, as well as from the ADNI and PPMI datasets on the trail making task. Experimental results show that IGMoE outperforms existing methods in both unimodal and multimodal data, demonstrating its effectiveness for multi-task whole-brain and whole-genome analysis.</p>
5 Authors
- Hongrui Liu
- Yuanyuan Gui
- Hui Lu
- Yiman Liu
- Manhua Liu
1 Application
| Application ID | Title |
|---|---|
| 57947 | Genotype and phenotype analysis in human brain of mental disorders |
Enabling scientific discoveries that improve human health