Assessing Versatile Machine Learning Models for Glioma Radiogenomic Studies across Hospitals

Kawaguchi, Risa K., Takahashi, Masamichi, Miyake, Mototaka, Kinoshita, Manabu, Takahashi, Satoshi, Ichimura, Koichi, Hamamoto, Ryuji, Narita, Yoshitaka, Sese, Jun (July 2021) Assessing Versatile Machine Learning Models for Glioma Radiogenomic Studies across Hospitals. Cancers, 13 (14). p. 3611. ISSN 2072-6694

PDF 2021.Kawaguchi.machine_learning_glioma.pdf Available under License Creative Commons Attribution. Download (1MB)

Abstract

Radiogenomics use non-invasively obtained imaging data, such as magnetic resonance imaging (MRI), to predict critical biomarkers of patients. Developing an accurate machine learning (ML) technique for MRI requires data from hundreds of patients, which cannot be gathered from any single local hospital. Hence, a model universally applicable to multiple cohorts/hospitals is required. We applied various ML and image pre-processing procedures on a glioma dataset from The Cancer Image Archive (TCIA, n = 159). The models that showed a high level of accuracy in predicting glioblastoma or WHO Grade II and III glioma using the TCIA dataset, were then tested for the data from the National Cancer Center Hospital, Japan (NCC, n = 166) whether they could maintain similar levels of high accuracy. Results: we confirmed that our ML procedure achieved a level of accuracy (AUROC = 0.904) comparable to that shown previously by the deep-learning methods using TCIA. However, when we directly applied the model to the NCC dataset, its AUROC dropped to 0.383. Introduction of standardization and dimension reduction procedures before classification without re-training improved the prediction accuracy obtained using NCC (0.804) without a loss in prediction accuracy for the TCIA dataset. Furthermore, we confirmed the same tendency in a model for IDH1/2 mutation prediction with standardization and application of dimension reduction that was also applicable to multiple hospitals. Our results demonstrated that overfitting may occur when an ML method providing the highest accuracy in a small training dataset is used for different heterogeneous data sets, and suggested a promising process for developing an ML method applicable to multiple cohorts

Item Type:	Paper
Subjects:	bioinformatics diseases & disorders > cancer bioinformatics > computational biology > algorithms bioinformatics > computational biology diseases & disorders > cancer > drugs and therapies bioinformatics > computational biology > algorithms > machine learning diseases & disorders > cancer > drugs and therapies > patient outcomes
CSHL Authors:	Karakida Kawaguchi, Risa
Communities:	CSHL labs > Gillis Lab
Depositing User:	Sasha Luks-Morgan
Date:	19 July 2021
Date Deposited:	28 Jul 2021 13:48
Last Modified:	25 Jan 2024 14:21
PMCID:	PMC8306149
Related URLs:	PubMed
URI:	https://repository.cshl.edu/id/eprint/40300

Actions (login required)

Administrator's edit/view item