Validation of Algorithmic CT Image Quality Metrics with Preferences of Radiologists.


PURPOSE:Automated assessment of perceptual image quality on clinical Computed Tomography (CT) data by computer algorithms has the potential to greatly facilitate data-driven monitoring and optimization of CT image acquisition protocols. The application of these techniques in clinical operation requires the knowledge of how the output of the computer algorithms corresponds to clinical expectations. This study addressed the need to validate algorithmic image quality measurements on clinical CT images with preferences of radiologists and determine the clinically acceptable range of algorithmic measurements for abdominal CT examinations. MATERIALS AND METHODS:Algorithmic measurements of image quality metrics (organ HU, noise magnitude, and clarity) were performed on a clinical CT image dataset with supplemental measures of noise power spectrum from phantom images using techniques developed previously. The algorithmic measurements were compared to clinical expectations of image quality in an observer study with seven radiologists. Sets of CT liver images were selected from the dataset where images in the same set varied in terms of one metric at a time. These sets of images were shown via a web interface to one observer at a time. First, the observer rank ordered the CT images in a set according to his/her preference for the varying metric. The observer then selected his/her preferred acceptable range of the metric within the ranked images. The agreement between algorithmic and observer rankings of image quality were investigated and the clinically acceptable image quality in terms of algorithmic measurements were determined. RESULTS:The overall rank order agreements between algorithmic and observer assessments were 0.90, 0.98, and 1.00 for noise magnitude, liver parenchyma HU, and clarity, respectively. The results indicate a strong agreement between the algorithmic and observer assessments of image quality. Clinically acceptable thresholds (median) of algorithmic metric values were (17.8, 32.6) HU for noise magnitude, (92.1, 131.9) for liver parenchyma HU, and (0.47, 0.52) for clarity. CONCLUSIONS:The observer study results indicated that these algorithms can robustly assess the perceptual quality of clinical CT images in an automated fashion. Clinically acceptable ranges of algorithmic measurements were determined. The correspondence of these image quality assessment algorithms to clinical expectations paves the way towards establishing diagnostic reference levels in terms of clinically acceptable perceptual image quality and data-driven optimization of CT image acquisition protocols.






Published Version (Please cite this version)


Publication Info

Cheng, Yuan, Ehsan Abadi, Taylor Brunton Smith, Francesco Ria, Mathias Meyer, Daniele Marin and Ehsan Samei (2019). Validation of Algorithmic CT Image Quality Metrics with Preferences of Radiologists. Medical physics. 10.1002/mp.13795 Retrieved from

This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.



Ehsan Abadi

Assistant Professor in Radiology

Ehsan Abadi, PhD is an imaging scientist at Duke University. He serves as an Assistant Professor in the departments of Radiology and Electrical & Computer Engineering, a faculty member in the Medical Physics Graduate Program and Carl E. Ravin Advanced Imaging Laboratories, and a co-Lead in the Center for Virtual Imaging Trials. Ehsan’s research focuses on quantitative imaging and optimization, CT imaging, lung diseases, computational human modeling, and medical imaging simulation. He is actively involved in developing computational anthropomorphic models with various diseases such as COPD, and scanner-specific simulation platforms (e.g., DukeSim) for imaging systems. Currently, his work is centered on identifying and optimizing imaging systems to ensure accurate and precise quantifications of lung diseases.


Daniele Marin

Associate Professor of Radiology

Liver Imaging
Dual Energy CT
CT Protocol Optimization
Dose Reduction Strategies for Abdominal CT Applications

Unless otherwise indicated, scholarly articles published by Duke faculty members are made available here with a CC-BY-NC (Creative Commons Attribution Non-Commercial) license, as enabled by the Duke Open Access Policy. If you wish to use the materials in ways not already permitted under CC-BY-NC, please consult the copyright owner. Other materials are made available here through the author’s grant of a non-exclusive license to make their work openly accessible.