Abstract
Objectives
Currently, the BRAF status of pediatric low-grade glioma (pLGG) patients is determined through a biopsy. We established a nomogram to predict BRAF status non-invasively using clinical and radiomic factors. Additionally, we assessed an advanced thresholding method to provide only high-confidence predictions for the molecular subtype. Finally, we tested whether radiomic features provide additional predictive information for this classification task, beyond that which is embedded in the location of the tumor.
Methods
Random forest (RF) models were trained on radiomic and clinical features both separately and together, to evaluate the utility of each feature set. Instead of using the traditional single threshold technique to convert the model outputs to class predictions, we implemented a double threshold mechanism that accounted for uncertainty. Additionally, a linear model was trained and depicted graphically as a nomogram.
Results
The combined RF (AUC: 0.925) outperformed the RFs trained on radiomic (AUC: 0.863) or clinical (AUC: 0.889) features alone. The linear model had a comparable AUC (0.916), despite its lower complexity. Traditional thresholding produced an accuracy of 84.5%, while the double threshold approach yielded 92.2% accuracy on the 80.7% of patients with the highest confidence predictions.
Conclusion
Models that included radiomic features outperformed, underscoring their importance for the prediction of BRAF status. A linear model performed similarly to RF but with the added benefit that it can be visualized as a nomogram, improving the explainability of the model. The double threshold technique was able to identify uncertain predictions, enhancing the clinical utility of the model.
Clinical relevance statement
Radiomic features and tumor location are both predictive of BRAF status in pLGG patients. We show that they contain complementary information and depict the optimal model as a nomogram, which can be used as a non-invasive alternative to biopsy.
Key Points
• Radiomic features provide additional predictive information for the determination of the molecular subtype of pediatric low-grade gliomas patients, beyond what is embedded in the location of the tumor, which has an established relationship with genetic status.
• An advanced thresholding method can help to distinguish cases where machine learning models have a high chance of being (in)correct, improving the utility of these models.
• A simple linear model performs similarly to a more powerful random forest model at classifying the molecular subtype of pediatric low-grade gliomas but has the added benefit that it can be converted into a nomogram, which may facilitate clinical implementation by improving the explainability of the model.






Similar content being viewed by others
Abbreviations
- AUC:
-
Area under the ROC curve
- BRAF mutation:
-
BRAF V600E point mutation
- CI:
-
Confidence interval
- ML:
-
Machine learning
- pLGG:
-
Pediatric low-grade gliomas
- RF:
-
Random forest
- ROI:
-
Region of interest
- FLAIR:
-
T2-weighted fluid-attenuated inversion recovery
References
Ostrom QT, Patil N, Cioffi G et al (2020) CBTRUS Statistical Report: primary brain and other central nervous system tumors diagnosed in the United States in 2013–2017. Neuro Oncol 22 (Supplement_1):iv1–iv96
Sievert AJ, Fisher MJ (2009) Pediatric low-grade gliomas. J Child Neurol 24:1397–1408
Sturm D, Pfister SM, Jones DTW (2017) Pediatric gliomas: current concepts on diagnosis, biology, and clinical management. J Clin Oncol 35:2370–2377
Ryall S, Tabori U, Hawkins C (2020) Pediatric low-grade glioma in the era of molecular diagnostics. Acta Neuropathol Commun 8:30
Wagner MW, Hainc N, Khalvati F et al (2021) Radiomics of pediatric low-grade gliomas: toward a pretherapeutic differentiation of BRAF-mutated and BRAF-fused tumors. AJNR Am J Neuroradiol 42:759–765
Lassaletta A, Zapotocky M, Mistry M et al (2017) Therapeutic and prognostic implications of BRAF V600E in pediatric low-grade gliomas. J Clin Oncol 35:2934–2941
Ryall S, Zapotocky M, Fukuoka K et al (2020) Integrated molecular and clinical analysis of 1,000 pediatric low-grade gliomas. Cancer Cell 37:569-583.e5
Khalvati, F, Zhang Y, Wong A et al (2019) Radiomics. Encyclopedia of Biomedical Engineering:597–603
van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Cancer Res 77:e104–e107
Breiman L (2001) Random Forests. Mach Learn 45:5–32
Wagner MW, Namdar K, Alqabbani A et al (2022) Dataset size sensitivity analysis of machine learning classifiers to differentiate molecular markers of paediatric low-grade gliomas based on MRI. Oncology and Radiotherapy 16:01–06
Pedregosa F, Varoquaux G, Gramfort A et al (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830
Iasonos A, Schrag D, Raj GV, Panageas KS (2008) How to build and interpret a nomogram for cancer prognosis. J Clin Oncol 26:1364–1370
Hart WE, Laird CD, Watson J-P et al (2017) Pyomo — optimization modeling in Python. Springer, Cham
Acknowledgements
This research has been made possible with the financial support of the Canadian Institutes of Health Research (CIHR) (Funding Reference Number: 184015).
Funding
This research has been made possible with the financial support of the Canadian Institutes of Health Research (CIHR) (Funding Reference Number: 184015).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Guarantor
The scientific guarantor of this publication is Dr. Farzad Khalvati.
Conflict of interest
The authors of this manuscript declare no relationships with any companies, whose products or services may be related to the subject matter of the article.
Statistics and biometry
No complex statistical methods were necessary for this paper.
Informed consent
Written informed consent was waived by the Institutional Review Board.
Ethical approval
Institutional Review Board approval was obtained (The Hospital for Sick Children (Toronto, Ontario, Canada) and the Lucile Packard Children’s Hospital (Stanford University, Palo Alto, California).
Study subjects or cohorts overlap
Some study subjects or cohorts have been previously reported in two previous papers. The first, “Radiomics of Pediatric Low-Grade Gliomas: Toward a Pretherapeutic Differentiation of BRAF-Mutated and BRAF-Fused Tumors,” https://doi.org/10.3174/ajnr.A6998, was an exploratory study that relied on 115 of our 253 patients. The second, “Dataset size sensitivity analysis of machine learning classifiers to differentiate molecular markers of pediatric low-grade gliomas based on MRI,” Oncology and Radiotherapy 16 (S1) 2022: 01–06, relied on 251 of our 253 patients. These previous studies aimed to establish a relationship between radiomics features and BRAF status, and to determine the best machine learning model on this classification task.
Methodology
• Retrospective
• Diagnostic or prognostic study
• Multicenter study
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Birgit B. Ertl-Wagner and Farzad Khalvati are co-senior authors.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kudus, K., Wagner, M.W., Namdar, K. et al. Increased confidence of radiomics facilitating pretherapeutic differentiation of BRAF-altered pediatric low-grade glioma. Eur Radiol 34, 2772–2781 (2024). https://doi.org/10.1007/s00330-023-10267-1
Received:
Revised:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1007/s00330-023-10267-1


