Evaluation of a Clinical Acceptability of Deep Learning-Based Autocontouring: An Example of The Use of Artificial Intelligence in Prostate Radiotherapy

Authors

  • Serap ÇATLI DİNÇ
  • Müge AKMANSU
  • Hüseyin BORA
  • Aybala ÜÇGÜL
  • Bekir Eren ÇETİN
  • Petek ERPOLAT
  • Eray KARAHACIOĞLU
  • Ertuğrul ŞENTÜRK

DOI:

https://doi.org/10.22399/ijcesen.386

Keywords:

Artificial intelligence, Deep learning, Radiotheraphy, prostate, Inter-Observer Variability of Organ Contouring

Abstract

This study aimed to evaluate the usability and benefit of a new generation of auto segmentation, that automatically identifies organs and auto-contours them directly at CT simulator before creating prostate radiotherapy plans. The prostates of 10 patients were automatically contoured using the DirectORGANS auto-segmentation algorithm at the CT simulator. The CT scans were imported into the Eclipse treatment planning system for contouring.  On the same CT image sets, the prostate was manually contoured by a group of five experienced physicians.  MR-guided prostate contours were delineated using MRI images and used as a reference structure. The volumes of the prostate were measured, and the Overlap index (OI), Dice similarity index (DSC), and Volume difference (Dv) were calculated based on contours. The Kruskal-Wallis H test was performed with SPSS (P<0.05). MR-based contouring was used as a reference, and the OI, DSC, Dv, and contouring time results of users and artificial intelligence were analyzed accordingly. There was a significant difference in OI, DSC, and Dv between the results of users and artificial intelligence. The most significant difference between users, artificial intelligence, and MR-based contouring was contouring time (p <0.001). MR- based contouring was time-consuming. Artificial Intelligence’s automatic contouring of the prostate required minimal modification.

References

Siegel RL, Miller KD and Jema A. (2019). Cancer Statistics. CA: A Cancer Journal for Clinicians. 69: 7-34. https://doi.org/10.3322/caac.21551

Hamdy FC, Donovan JL, Lane J, Mason M, Metcalfe C, Holding P, Davis M, Peters TJ, Turner EL and Martin RM. (2016). 10-Year Outcomes after Monitoring, Surgery, or Radiotherapy for Localized Prostate Cancer. The New England Journal of Medicine. 375;1415-1424. https://doi.org/10.1056/NEJMoa1606220

Wong J, Fong A, McVicar N, Smith S, Giambattista J, Wells D, et al. (2020). Comparing deep learning-based auto-segmentation of organs at risk and clinical target volumes to expert inter-observer variability in radiotherapy planning. Radiother Oncol. 144;152–8. https://doi.org/10.1016/j.ijrobp.2019.06.523

Fiorino C, Reni M, Bolognesi A, Cattaneo GM, Calandrino R. (1998). Intra- and interobserver variability in contouring prostate and seminal vesicles: implications for conformal treatment planning. Radiother Oncol. 47;285–92. https://doi.org/10.1016/s0167-8140(98)00021-8

Chao KSC. et al. (2007). Reduce in variation and improve efficiency of target volume delineation by a computer-assisted system using a deformable image registration approach. Int. J. Radiat. Oncol. Biol. Phys. 68(5);15121521. https://doi.org/10.1016/j.ijrobp.2007.04.037

Kiljunen T, Akram S, Niemelä J, Löyttyniemi E, Seppälä J, Heikkilä J, et al. (2020). A deep learning-based automated CT segmentation of prostate cancer anatomy for radiation therapy planning-A retrospective multicenter study. Diagnostics. 10;959. https://doi.org/10.3390/diagnostics10110959.

Elguindi S, Zelefsky MJ, Jiang J, Veeraraghavan H, Deasy JO, Hunt MA, et al. (2019). Deep learning-based auto-segmentation of targets and organs-at-risk for magnetic resonance imaging only planning of prostate radiotherapy. Phys Imaging Radiat Oncol. 12;80–6. https://doi.org/10.1016/j.phro.2019.11.006

Vaassen F, Hazelaar C, Vaniqui A, Gooding M, van der Heyden B, Canters R, et al. (2020). Evaluation of measures for assessing time-saving of automatic organ-at-risk segmentation in radiotherapy. Phys Imag Radiat Oncol. 13;1–6. https://doi. org/10.1016/j.phro.2019.12.001.).

Feng X, Bernard ME, Hunter T, Chen Q. (2020). Improving accuracy and robustness of deep convolutional neural network based thoracic OAR segmentation. Phys Med Biol. 65(7);07NT01. https://doi. org/10.1088/1361-6560/ab7877

Feng X, Qing K, Tustison NJ, Meyer CH, Chen Q. (2019). Deep convolutiona neural network for segmentation of thoracic organs at-risk using cropped 3D images. Med Phys. 46(5):2169- 2180. https://doi. org/10.1002/mp.13466

Yang J, Veeraraghavan H, Armato III SG,et al. (2018). Autosegmentation for thoracic radiation treatment planning: a grand challenge at AAPM 2017. Med Phys. 45(10);4568-4581. https://doi. org/10.1002/mp.13141

Cardenas CE, Mohamed AS, Yang J, et al. (2020). Head and neck cancer patient images for determining auto-segmentation accuracy in T2-weighted magnetic resonance imaging through expert manual segmentations. Med Phys. 47(5);2317-2322. https://doi. org/10.1002/mp.13942

Zhu W, Huang Y, Zeng L, et al. (2019). AnatomyNet: deep learning for fast and fully automated whole-volume segmentation of head and neck anatomy. Med Phys. 46(2):576-589. https://doi. org/10.1002/mp.13300

Wong J, Fong A, McVicar N,et al. (2020) Comparing deep learning-based auto-segmentation of organs at risk and clinical target volumes to expert inter-observer variability in radiotherapy planning. Radiother Oncol. 144;152-158. https://doi. org/10.1016/j.radonc.2019.10.019

Rigaud B, Anderson BM, Zhiqian HY, et al. (2021). Automatic segmentation using deep learning to enable online dose optimization during adaptive radiation therapy of cervical cancer. Int J Radiat Oncol Biol Phys. 109(4);1096-1110. https://doi. org/10.1016/j.ijrobp.2020.10.038

Lee WR, Roach M, Michalski J, Moran B. and Beyer D. (2002). Interobserver Variability Leads to Significant Differences in Quantifiers of Prostate Implant Adequacy. International Journal of Radiation Oncology Biology Physics. 54;457- 461. https://doi.org/10.1016/S0360-3016(02)02950-4 (9)

Vinod SK, Min M, Jameson MG and Holloway LC. (2016). A Review of Interventions to Reduce Inter-Observer Variability in Volume Delineation in Radiation Oncology. Journal of Medical Imaging and Radiation Oncology. 60;393-406(10). https://doi.org/10.1111/1754-9485.12462

Hanna G, Hounsell A and O’Sullivan J. (2010). Geometrical Analysis of Radiotherapy Target Volume Delineation: A Systematic Review of Reported Comparison Methods. Clinical Oncology. 22;515-525. https://doi.org/10.1016/j.clon.2010.05.006

Jameson M, Holloway LC, Vial PJ, Vinod SK, Metcalfe PE, Liu et al. (2010). Clinical Engineering and Radiation Oncology Review of Methods of Analysis in Contouring Studies for Radiation Oncology. Journal of Medical Imaging and Radiation Oncology. 54;401-410. https://doi.org/10.1111/j.1754-9485.2010.02192.x

DirectOrgans (Siemens Healthineers GmbH). White paper. Online · 7871 0620

Nelms BE et al. (2012). Variations in the contouring of organs at risk: Test case from a patient with oropharyngeal cancer. Int. J. Radiat. Oncol. Biol. Phys. 82(1);368–378. https://doi.org/10.1016/j.ijrobp.2010.10.019

Liu C, Gardner SJ, Wen N, et al. (2019). Automatic segmentation of the prostate on CT images using deep neural networks (DNN). Int J Radiat Oncol Biol Phys. 104(4);924-932. https://doi.org/10.1016/j.ijrobp.2019.03.017

Ghavami N, Hu Y, Gibson E, et al. (2019). Automatic segmentation of prostate MRI using convolutional neural networks: investigating the impact of network architecture on the accuracy of volume measurement and MRI-ultrasound registration. Med Image Anal. 58;101558. https://doi.org/10.1016/j.media.2019.101558

Wang B, Lei Y, Tian S, et al. (2019). Deeply supervised 3D fully convolutional networks with group dilated convolution for automatic MRI prostate segmentation. Med Phys. 46(4);1707-1718. https://doi.org/10.1002/mp.13416

Rasch C, Barillot I, Remeijer P, Touw A, Van Herk M, Lebesque JV. (1999). Definition of the prostate in CT and MRI: a multi-observer study. Int J Radiat Oncol Biol Phys. 43(1);57-66. https://doi.org/10.1016/s0360-3016(98)00351-4

Pathmanathan AU, McNair HA, Schmidt MA, et al. (2019). Comparison of prostate delineation on multimodality imaging for MR-guided radiotherapy. Br J Radiol. 92(1096);20180948. https://doi.org/10.1259/bjr.20180948

Gao Z, Wilkins D, Eapen L, Morash C, Wassef Y, Gerig L. (2007). A study of prostate delineation referenced against a gold standard created from the visible human data. Radiother Oncol. 85(2);239-246. https://doi.org/10.1016/j.radonc.2007.08.001

McLaughlin PW, Evans C, Feng M, Narayana V. (2010). Radiographic and anatomic basis for prostate contouring errors and methods to improve prostate contouring accuracy. Int J Radiat Oncol Biol Phys. 76(2);369-378. https://doi.org/ 10.1016/j.ijrobp.2009.02.019

sengul, aycan, Toksoy, T., Kandemir, R., & Karaali, K. (2024). Feasibility of board tilt angle on critical organs during hippocampus-sparing whole-brain radiotherapy. International Journal of Computational and Experimental Science and Engineering, 10(1);49-55. https://doi.org/10.22399/ijcesen.292

Çağlan, A., & Dirican, B. (2024). Evaluation of Dosimetric and Radiobiological Parameters for Different TPS Dose Calculation Algorithms and Plans for Lung Cancer Radiotherapy . International Journal of Computational and Experimental Science and Engineering, 10(2);247-256. https://doi.org/10.22399/ijcesen.335

gul, osman vefa, Demir, hikmettin, Kanyilmaz, G., & Cakır, T. (2024). Dosimetric comparison of 3D-Conformal and IMRT techniques used in radiotherapy of gastric cancer: A retrospective study . International Journal of Computational and Experimental Science and Engineering, 10(1);42-48. https://doi.org/10.22399/ijcesen.296

Downloads

Published

2024-11-27

How to Cite

Serap ÇATLI DİNÇ, AKMANSU, M., BORA, H., ÜÇGÜL, A., ÇETİN, B. E., ERPOLAT, P., … ŞENTÜRK, E. (2024). Evaluation of a Clinical Acceptability of Deep Learning-Based Autocontouring: An Example of The Use of Artificial Intelligence in Prostate Radiotherapy. International Journal of Computational and Experimental Science and Engineering, 10(4). https://doi.org/10.22399/ijcesen.386

Issue

Section

Research Article