Assessing Versatile Machine Learning Models for Glioma Radiogenomic Studies across Hospitals

Kawaguchi, Risa K., Takahashi, Masamichi, Miyake, Mototaka, Kinoshita, Manabu, Takahashi, Satoshi, Ichimura, Koichi, Hamamoto, Ryuji, Narita, Yoshitaka, Sese, Jun (July 2021) Assessing Versatile Machine Learning Models for Glioma Radiogenomic Studies across Hospitals. Cancers, 13 (14). p. 3611. ISSN 2072-6694

[thumbnail of 2021.Kawaguchi.machine_learning_glioma.pdf] PDF
Available under License Creative Commons Attribution.

Download (1MB)
DOI: 10.3390/cancers13143611


Radiogenomics use non-invasively obtained imaging data, such as magnetic resonance imaging (MRI), to predict critical biomarkers of patients. Developing an accurate machine learning (ML) technique for MRI requires data from hundreds of patients, which cannot be gathered from any single local hospital. Hence, a model universally applicable to multiple cohorts/hospitals is required. We applied various ML and image pre-processing procedures on a glioma dataset from The Cancer Image Archive (TCIA, n = 159). The models that showed a high level of accuracy in predicting glioblastoma or WHO Grade II and III glioma using the TCIA dataset, were then tested for the data from the National Cancer Center Hospital, Japan (NCC, n = 166) whether they could maintain similar levels of high accuracy. Results: we confirmed that our ML procedure achieved a level of accuracy (AUROC = 0.904) comparable to that shown previously by the deep-learning methods using TCIA. However, when we directly applied the model to the NCC dataset, its AUROC dropped to 0.383. Introduction of standardization and dimension reduction procedures before classification without re-training improved the prediction accuracy obtained using NCC (0.804) without a loss in prediction accuracy for the TCIA dataset. Furthermore, we confirmed the same tendency in a model for IDH1/2 mutation prediction with standardization and application of dimension reduction that was also applicable to multiple hospitals. Our results demonstrated that overfitting may occur when an ML method providing the highest accuracy in a small training dataset is used for different heterogeneous data sets, and suggested a promising process for developing an ML method applicable to multiple cohorts

Item Type: Paper
Subjects: diseases & disorders > cancer
bioinformatics > computational biology > algorithms > machine learning
diseases & disorders > cancer > drugs and therapies > patient outcomes
CSHL Authors:
Communities: CSHL labs > Gillis Lab
Depositing User: Sasha Luks-Morgan
Date: 19 July 2021
Date Deposited: 28 Jul 2021 13:48
Last Modified: 28 Jul 2021 13:48
PMCID: PMC8306149

Actions (login required)

Administrator's edit/view item Administrator's edit/view item
CSHL HomeAbout CSHLResearchEducationNews & FeaturesCampus & Public EventsCareersGiving