Nguyen, Dan
Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients
Huet-Dastarac, Margerie, Nguyen, Dan, Jiang, Steve, Lee, John, Montero, Ana Barragan
Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources.
OpenKBP-Opt: An international and reproducible evaluation of 76 knowledge-based planning pipelines
Babier, Aaron, Mahmood, Rafid, Zhang, Binghao, Alves, Victor G. L., Barragán-Montero, Ana Maria, Beaudry, Joel, Cardenas, Carlos E., Chang, Yankui, Chen, Zijie, Chun, Jaehee, Diaz, Kelly, Eraso, Harold David, Faustmann, Erik, Gaj, Sibaji, Gay, Skylar, Gronberg, Mary, Guo, Bingqi, He, Junjun, Heilemann, Gerd, Hira, Sanchit, Huang, Yuliang, Ji, Fuxin, Jiang, Dashan, Giraldo, Jean Carlo Jimenez, Lee, Hoyeon, Lian, Jun, Liu, Shuolin, Liu, Keng-Chi, Marrugo, José, Miki, Kentaro, Nakamura, Kunio, Netherton, Tucker, Nguyen, Dan, Nourzadeh, Hamidreza, Osman, Alexander F. I., Peng, Zhao, Muñoz, José Darío Quinto, Ramsl, Christian, Rhee, Dong Joo, Rodriguez, Juan David, Shan, Hongming, Siebers, Jeffrey V., Soomro, Mumtaz H., Sun, Kay, Hoyos, Andrés Usuga, Valderrama, Carlos, Verbeek, Rob, Wang, Enpei, Willems, Siri, Wu, Qi, Xu, Xuanang, Yang, Sen, Yuan, Lulin, Zhu, Simeng, Zimmermann, Lukas, Moore, Kevin L., Purdie, Thomas G., McNiven, Andrea L., Chan, Timothy C. Y.
We establish an open framework for developing plan optimization models for knowledge-based planning (KBP) in radiotherapy. Our framework includes reference plans for 100 patients with head-and-neck cancer and high-quality dose predictions from 19 KBP models that were developed by different research groups during the OpenKBP Grand Challenge. The dose predictions were input to four optimization models to form 76 unique KBP pipelines that generated 7600 plans. The predictions and plans were compared to the reference plans via: dose score, which is the average mean absolute voxel-by-voxel difference in dose a model achieved; the deviation in dose-volume histogram (DVH) criterion; and the frequency of clinical planning criteria satisfaction. We also performed a theoretical investigation to justify our dose mimicking models. The range in rank order correlation of the dose score between predictions and their KBP pipelines was 0.50 to 0.62, which indicates that the quality of the predictions is generally positively correlated with the quality of the plans. Additionally, compared to the input predictions, the KBP-generated plans performed significantly better (P<0.05; one-sided Wilcoxon test) on 18 of 23 DVH criteria. Similarly, each optimization model generated plans that satisfied a higher percentage of criteria than the reference plans. Lastly, our theoretical investigation demonstrated that the dose mimicking models generated plans that are also optimal for a conventional planning model. This was the largest international effort to date for evaluating the combination of KBP prediction and optimization models. In the interest of reproducibility, our data and code is freely available at https://github.com/ababier/open-kbp-opt.
Site-Agnostic 3D Dose Distribution Prediction with Deep Learning Neural Networks
Mashayekhi, Maryam, Tapia, Itzel Ramirez, Balagopal, Anjali, Zhong, Xinran, Barkousaraie, Azar Sadeghnejad, McBeth, Rafe, Lin, Mu-Han, Jiang, Steve, Nguyen, Dan
Typically, the current dose prediction models are limited to small amounts of data and require re-training for a specific site, often leading to suboptimal performance. We propose a site-agnostic, 3D dose distribution prediction model using deep learning that can leverage data from any treatment site, thus increasing the total data available to train the model. Applying our proposed model to a new target treatment site requires only a brief fine-tuning of the model to the new data and involves no modifications to the model input channels or its parameters. Thus, it can be efficiently adapted to a different treatment site, even with a small training dataset.
Dosimetric impact of physician style variations in contouring CTV for post-operative prostate cancer: A deep learning based simulation study
Balagopal, Anjali, Nguyen, Dan, Mashayekhi, Maryam, Morgan, Howard, Garant, Aurelie, Desai, Neil, Hannan, Raquibul, Lin, Mu-Han, Jiang, Steve
In tumor segmentation, inter-observer variation is acknowledged to be a significant problem. This is even more significant in clinical target volume (CTV) segmentation, specifically, in post-operative settings, where a gross tumor does not exist. In this scenario, CTV is not an anatomically established structure but rather one determined by the physician based on the clinical guideline used, the preferred trade off between tumor control and toxicity, their experience, training background etc... This results in high inter-observer variability between physicians. Inter-observer variability has been considered an issue, however its dosimetric consequence is still unclear, due to the absence of multiple physician CTV contours for each patient and the significant amount of time required for dose planning. In this study, we analyze the impact that these physician stylistic variations have on organs-at-risk (OAR) dose by simulating the clinical workflow using deep learning. For a given patient previously treated by one physician, we use DL-based tools to simulate how other physicians would contour the CTV and how the corresponding dose distributions should look like for this patient. To simulate multiple physician styles, we use a previously developed in-house CTV segmentation model that can produce physician style-aware segmentations. The corresponding dose distribution is predicted using another in-house deep learning tool, which, averaging across all structures, is capable of predicting dose within 3% of the prescription dose on the test data. For every test patient, four different physician-style CTVs are considered and four different dose distributions are analyzed. OAR dose metrics are compared, showing that even though physician style variations results in organs getting different doses, all the important dose metrics except Maximum Dose point are within the clinically acceptable limit.
Three-Dimensional Dose Prediction for Lung IMRT Patients with Deep Neural Networks: Robust Learning from Heterogeneous Beam Configurations
Barragan-Montero, Ana M., Nguyen, Dan, Lu, Weiguo, Lin, Mu-Han, Geets, Xavier, Sterpin, Edmond, Jiang, Steve
The use of neural networks to directly predict three-dimensional dose distributions for automatic planning is becoming popular. However, the existing methods only use patient anatomy as input and assume consistent beam configuration for all patients in the training database. The purpose of this work is to develop a more general model that, in addition to patient anatomy, also considers variable beam configurations, to achieve a more comprehensive automatic planning with a potentially easier clinical implementation, without the need of training specific models for different beam settings.
Dose Prediction with U-net: A Feasibility Study for Predicting Dose Distributions from Contours using Deep Learning on Prostate IMRT Patients
Nguyen, Dan, Long, Troy, Jia, Xun, Lu, Weiguo, Gu, Xuejun, Iqbal, Zohaib, Jiang, Steve
With the advancement of treatment modalities in radiation therapy for cancer patients, outcomes have improved, but at the cost of increased treatment plan complexity and planning time. The accurate prediction of dose distributions would alleviate this issue by guiding clinical plan optimization to save time and maintain high quality plans. We have modified a convolutional deep network model, U-net (originally designed for segmentation purposes), for predicting dose from patient image contours. We show that, as an example, we are able to accurately predict the dose of intensity-modulated radiation therapy (IMRT) for prostate cancer patients, where the average dice similarity coefficient is 0.91 when comparing the predicted vs. true isodose volumes between 0% and 100% of the prescription dose. The average value of the absolute differences in [max, mean] dose is found to be under 5% of the prescription dose, specifically for each structure is [1.80%, 1.03%](PTV), [1.94%, 4.22%](Bladder), [1.80%, 0.48%](Body), [3.87%, 1.79%](L Femoral Head), [5.07%, 2.55%](R Femoral Head), and [1.26%, 1.62%](Rectum) of the prescription dose. We thus managed to map a desired radiation dose distribution from a patient's PTV and OAR contours. As an additional advantage, relatively little data was used in the techniques and models described in this paper.