Browsing by Author "Yang, Deshan"
- Results Per Page
- Sort Options
Item Embargo 5D-MRI Cardiac Motion Analysis and 2D-Cine MRI Cardiac Motion Tracking(2024) Ng, Kah KeePurpose: This project aimed to establish a method for computing 3D cardiac motion given continuous 2D-Cine MRI frames as the inputs. This approach would be useful for continuously monitoring cardiac and respiratory motion during MR-guided cardiac radiation therapy, and thus supporting radiation delivery guidance and gating.Methods: 5D-MRI datasets of seven patients, with each consisting of 3D spatial volumes of the cardiac cycle and respiratory cycle, were used for quantitative evaluation of the heart motion due to respiratory and cardiac movements. This was achieved through deformable image registration (DIR). Subsequently, principal component analysis (PCA) was performed on the computed deformation vector fields (DVF) to extract scores that effectively represent the characteristics of the DVFs. A deep learning model was then trained to predict the cardiac motion PCA scores given the inputs of 2D-Cine MRI. The predicted PCA scores were then transformed into 3D DVFs, which were then used to track 3D target motion. Results: The model’s performance was quantitatively evaluated on ground truth data that were withheld from model training. Across all 7 subjects, the average 3D DVF prediction errors for the heart region consistently remained around 0.3 ± 0.1mm. The predicted target motion, computed from the predicted DVFs, was visually evaluated, and found to be satisfactory. Conclusion: The developed method demonstrated promising potential in accurately computing and tracking real-time 3D cardiac motion given 2D-Cine MRI inputs. This approach presents a viable solution for continuously monitoring the 3D cardiac and respiratory motion of the heart during MR-guided cardiac radiation therapy.
Item Open Access A comprehensive lung CT landmark pair dataset for evaluating deformable image registration algorithms.(Medical physics, 2024-05) Criscuolo, Edward R; Fu, Yabo; Hao, Yao; Zhang, Zhendong; Yang, DeshanPurpose
Deformable image registration (DIR) is a key enabling technology in many diagnostic and therapeutic tasks, but often does not meet the required robustness and accuracy for supporting clinical tasks. This is in large part due to a lack of high-quality benchmark datasets by which new DIR algorithms can be evaluated. Our team was supported by the National Institute of Biomedical Imaging and Bioengineering to develop DIR benchmark dataset libraries for multiple anatomical sites, comprising of large numbers of highly accurate landmark pairs on matching blood vessel bifurcations. Here we introduce our lung CT DIR benchmark dataset library, which was developed to improve upon the number and distribution of landmark pairs in current public lung CT benchmark datasets.Acquisition and validation methods
Thirty CT image pairs were acquired from several publicly available repositories as well as authors' institution with IRB approval. The data processing workflow included multiple steps: (1) The images were denoised. (2) Lungs, airways, and blood vessels were automatically segmented. (3) Bifurcations were directly detected on the skeleton of the segmented vessel tree. (4) Falsely identified bifurcations were filtered out using manually defined rules. (5) A DIR was used to project landmarks detected on the first image onto the second image of the image pair to form landmark pairs. (6) Landmark pairs were manually verified. This workflow resulted in an average of 1262 landmark pairs per image pair. Estimates of the landmark pair target registration error (TRE) using digital phantoms were 0.4 mm ± 0.3 mm.Data format and usage notes
The data is published in Zenodo at https://doi.org/10.5281/zenodo.8200423. Instructions for use can be found at https://github.com/deshanyang/Lung-DIR-QA.Potential applications
The dataset library generated in this work is the largest of its kind to date and will provide researchers with a new and improved set of ground truth benchmarks for quantitatively validating DIR algorithms within the lung.Item Open Access Build 5DCT by Connecting Cardiac ECG 4DCT with Respiratory 4DCT for Heart Motion Management in Stereotactic Tachycardia Radiosurgery(2023) Liu, ShiyiPurpose: To develop a generic procedure to make 5DCT from ECG 4DCTs and respiratory 4DCTs of cardiac RT patients. The 5DCT, whose dimension consists of 3D volume, cardiac cycle and respiratory cycle, will be used for quantitatively evaluating respiratory and cardiac motion of the heart, and supporting cardiac RT motion management, 5D dose calculation and dosimetry motion assessment. Methods: Images of ECG 4DCTs and respiratory 4DCTs for cardiac RT patients were obtained from the clinical system with IRB approval. For each patient, ten ECG 4DCT phases were registered using the groupwise deformable image registration algorithm GroupRegNet. The results were the template ECG CT representing the accurate average heart anatomy rather than an intensity-averaged CT, and the cardiac 4D DVF (deformation vector field). The ECG CT template and ten respiratory 4DCT phases were registered together using the 2nd groupwise registration to compute the 2nd respiratory 4D DVF. The computed DVFs from two groupwise registrations connected ECG 4DCTs to respiratory 4DCTs. A 10x10 cardiorespiratory 5DCT volume was generated by warping the ECG phases using composed DVFs. The final 5DCT phases were manually evaluated by visually the checking the respiratory and cardiac motion of the heart chambers. Results: The 5DCT generation procedure was implemented using Python and MATLAB, and was successfully applied to 4DCT images from five cardiac RT patients. The registration results were satisfactory based on visual evaluation. The quantitative evaluation and 5D dose calculation are planned for future work. Conclusion: A practical and effective procedure was developed to assess 5D motion of the heart and generate 5DCT phases from the clinical ECG 4DCTs and respiratory 4DCTs. The generated 5DCT could be used in dose calculation to assess the effect of 5D motion of the heart chambers on dosimetry for cardiac RT treatments.
Item Open Access Contour interpolation by deep learning approach.(Journal of medical imaging (Bellingham, Wash.), 2022-11) Zhao, Chenxi; Duan, Ye; Yang, DeshanPurpose
Contour interpolation is an important tool for expediting manual segmentation of anatomical structures. The process allows users to manually contour on discontinuous slices and then automatically fill in the gaps, therefore saving time and efforts. The most used conventional shape-based interpolation (SBI) algorithm, which operates on shape information, often performs suboptimally near the superior and inferior borders of organs and for the gastrointestinal structures. In this study, we present a generic deep learning solution to improve the robustness and accuracy for contour interpolation, especially for these historically difficult cases.Approach
A generic deep contour interpolation model was developed and trained using 16,796 publicly available cases from 5 different data libraries, covering 15 organs. The network inputs were a 128×128×5 image patch and the two-dimensional contour masks for the top and bottom slices of the patch. The outputs were the organ masks for the three middle slices. The performance was evaluated on both dice scores and distance-to-agreement (DTA) values.Results
The deep contour interpolation model achieved a dice score of 0.95±0.05 and a mean DTA value of 1.09±2.30 mm , averaged on 3167 testing cases of all 15 organs. In a comparison, the results by the conventional SBI method were 0.94±0.08 and 1.50±3.63 mm , respectively. For the difficult cases, the dice score and DTA value were 0.91±0.09 and 1.68±2.28 mm by the deep interpolator, compared with 0.86±0.13 and 3.43±5.89 mm by SBI. The t-test results confirmed that the performance improvements were statistically significant ( p<0.05 ) for all cases in dice scores and for small organs and difficult cases in DTA values. Ablation studies were also performed.Conclusions
A deep learning method was developed to enhance the process of contour interpolation. It could be useful for expediting the tasks of manual segmentation of organs and structures in the medical images.Item Open Access Deep learning-based motion compensation for four-dimensional cone-beam computed tomography (4D-CBCT) reconstruction.(Medical physics, 2023-02) Zhang, Zhehao; Liu, Jiaming; Yang, Deshan; Kamilov, Ulugbek S; Hugo, Geoffrey DBackground
Motion-compensated (MoCo) reconstruction shows great promise in improving four-dimensional cone-beam computed tomography (4D-CBCT) image quality. MoCo reconstruction for a 4D-CBCT could be more accurate using motion information at the CBCT imaging time than that obtained from previous 4D-CT scans. However, such data-driven approaches are hampered by the quality of initial 4D-CBCT images used for motion modeling.Purpose
This study aims to develop a deep-learning method to generate high-quality motion models for MoCo reconstruction to improve the quality of final 4D-CBCT images.Methods
A 3D artifact-reduction convolutional neural network (CNN) was proposed to improve conventional phase-correlated Feldkamp-Davis-Kress (PCF) reconstructions by reducing undersampling-induced streaking artifacts while maintaining motion information. The CNN-generated artifact-mitigated 4D-CBCT images (CNN enhanced) were then used to build a motion model which was used by MoCo reconstruction (CNN+MoCo). The proposed procedure was evaluated using in-vivo patient datasets, an extended cardiac-torso (XCAT) phantom, and the public SPARE challenge datasets. The quality of reconstructed images for XCAT phantom and SPARE datasets was quantitatively assessed using root-mean-square-error (RMSE) and normalized cross-correlation (NCC).Results
The trained CNN effectively reduced the streaking artifacts of PCF CBCT images for all datasets. More detailed structures can be recovered using the proposed CNN+MoCo reconstruction procedure. XCAT phantom experiments showed that the accuracy of estimated motion model using CNN enhanced images was greatly improved over PCF. CNN+MoCo showed lower RMSE and higher NCC compared to PCF, CNN enhanced and conventional MoCo. For the SPARE datasets, the average (± standard deviation) RMSE in mm-1 for body region of PCF, CNN enhanced, conventional MoCo and CNN+MoCo were 0.0040 ± 0.0009, 0.0029 ± 0.0002, 0.0024 ± 0.0003 and 0.0021 ± 0.0003. Corresponding NCC were 0.84 ± 0.05, 0.91 ± 0.05, 0.91 ± 0.05 and 0.93 ± 0.04.Conclusions
CNN-based artifact reduction can substantially reduce the artifacts in the initial 4D-CBCT images. The improved images could be used to enhance the motion modeling and ultimately improve the quality of the final 4D-CBCT images reconstructed using MoCo.Item Open Access Exploring a Patient-Specific Respiratory Motion Prediction Model for Tumor Localization in Abdominal and Lung SBRT Patients(2024) Garcia Alcoser, Michael EnriqueManaging respiratory motion in radiotherapy for abdominal and lung stereotactic body radiation therapy (SBRT) patients is crucial to achieving dose conformity and sparing healthy tissue. While previous studies have utilized principal component analysis (PCA) combined with deep learning to localize lung tumors in real-time, these models lack testing or validation with patient data from later treatment fractions. This study aims to achieve highly accurate 3D tumor localization for abdominal and lung cancer patients using a PCA-based convolutional neural network (CNN) motion model. Another goal is to enhance this prediction model by addressing interfractional motion in lung patients through deep learning and multiple treatment-acquired CT datasets.
The patient's 4D computed tomography (4DCT) image was registered, and resulting deformation vector fields (DVFs) were approximated using PCA. PCA coefficients, linked to diaphragm displacement, controlled breath variability in synthetic CT images. Digitally reconstructed radiographs (DRRs) from synthetic CTs served as network input. The networks were evaluated using a CT image designated for abdominal and lung cancer patient testing. A DRR of the testing CT was input into the model, and the predicted CT image was validated against the test CT to locate the tumor.
This study validated a PCA-based CNN motion model for abdominal and lung cancer patients. Intrafractional motion modeling accurately predicted abdominal tumors with a maximum error of 1.41 mm, whereas lung tumor localization resulted in a maximum error of 2.83 mm. Interfractional motion significantly influenced the accuracy of lung tumor prediction.
Item Embargo Liver Vessel Segmentation and Accurate Landmark Pairs Detection for Quantitative Liver Deformable Image Registration Verification(2023) Zhang, ZhendongBackground: Target Registration Error (TRE) calculated based on selected anatomical landmarks is commonly known as the only trustable way to evaluate DIR accuracy. However, manual landmark pair selection is labor intensive and subjected to observer variability. Currently, no DIR benchmark datasets are available for Liver CTs. Manually selected landmark pairs have limited DIR evaluation power due to inadequate landmarks quantity (i.e., ~5 landmark pairs per dataset1 for liver CTs) and positional accuracy. For the purpose of liver DIR verification, there is a great need to establish a large quantity of landmark pairs with good positional accuracy.Purpose: An image processing procedure was developed in this study to automatically and precisely detect landmark pairs on corresponding vessel bifurcations between pairs of intra-patient CT images. With high positional accuracy, the generated landmark pairs can be used to evaluate deformable image registration (DIR) methods quantitatively for liver CTs. Methods: Landmark pairs were detected within the liver between pairs of contrast-enhanced CT scans for 32 patients. For each case, the liver vessel tree was automatically segmented in one image. Landmarks were automatically detected on vessel bifurcations. The corresponding landmarks in the second image were placed using a parametric DIR method (pTVreg). Manual validation was applied to reject outliers and adjust the landmarks’ positions to account for vessel segmentation uncertainty caused by the inconsistent image quality. Landmark pairs' positional accuracy of the procedure was evaluated using digital phantoms on target registration errors (TREs). Results: On average, ~71 landmark pairs per case were detected after manual outlier rejection. The proposed procedure increased the quantity of liver landmark pairs by ~10 times compared to the reported in the literature. A fully manual spot check showed that the reported procedure performed better than or as good as human at landmark pairs positional accuracy. Measured in the digital phantoms, the mean and standard deviation of TREs were 0.67 ± 0.48 mm with 99% of landmark pairs having TREs smaller than 2mm. Conclusion: A large number of liver landmark pairs with high positional accuracy were detected in contrasted enhanced CT image pairs using the reported method. The detected landmark pairs can be used for the quantitative evaluation of DIR methods.
Item Open Access Real-time B0 compensation during gantry rotation in a 0.35-T MRI-Linac.(Medical physics, 2022-10) Curcuru, Austen N; Kim, Taeho; Yang, Deshan; Gach, H MichaelBackground
Rotation of the ferromagnetic gantry of a low magnetic field MRI-Linac was previously demonstrated to cause large center frequency offsets of ±400 Hz. The B0 off-resonances cause image artifacts and imaging isocenter shifts that would preclude MRI-guided arc therapy.Purpose
The purpose of this study was to measure and compensate for center frequency offsets in real time during gantry rotation on a 0.35-T MRI-Linac using a free induction decay (FID) navigator.Methods
A nonselective FID navigator was added before each 2D balanced steady-state free precession cine image acquisition on a 0.35-T MRI-Linac. Images were acquired at 7.3 frames per second. Phase data from the initial FID navigator (while the gantry was stationary) was used as a reference. The phase data from each subsequent FID navigator was used to calculate the real-time B0 off-resonance. The transmitter/receiver phase and the phase accrual over the adjacent image acquisition were adjusted to correct for the center frequency offset. Measurements were performed using an MRI-Linac dynamic phantom prior to and while the gantry rotated clockwise and counterclockwise. Image quality and signal-to-noise ratio (SNR) were compared between uncorrected and B0 -corrected MRIs using a reference image acquired while the gantry was stationary. Four targets in the phantom were manually contoured on the first image frame, and an active contouring algorithm was used retrospectively on each subsequent frame to assess image variations and calculate Dice coefficients. Additionally, three healthy volunteers were imaged using the same pulse sequences with and without real-time B0 compensation during gantry rotation. Normalized root mean square errors (nRMSEs) were calculated for the phantom and in vivo to assess the efficacy of the B0 compensation on image quality. The measured center frequency offsets from the volunteer and MRI dynamic phantom navigator data were also compared. The sinusoidal behavior of the center frequency offsets was modeled based on the gantry layout and long-time constant eddy currents resulting from gantry rotation.Results
The duration of the FID navigator and processing was 4.5 ms. The FID navigator resulted in a ≤11% drop in SNR in the phantom and in vivo (liver). Dice coefficients from the MRI-guided radiation therapy (MR-IGRT) phantom contour measurements remained above 0.8 with B0 compensation. Without B0 compensation, the Dice coefficients dropped below 0.8 for up to 21% of the time depending on the contour. Real-time B0 compensation resulted in mean reductions in nRMSE of 51% and 16% for the MR-IGRT phantom and in vivo, respectively. Peak-to-peak center frequency offsets ranged from 757 to 773 Hz in the phantom and 760 to 871 Hz in vivo.Conclusion
Dynamic real-time B0 compensation significantly improved image quality and reduced artifacts during gantry rotation in the phantom and in vivo. However, the FID navigator resulted in a small drop in the imaging duty cycle and SNR.