A performance comparison of convolutional neural network-based image denoising methods: The effect of loss functions on low-dose CT images

Byeongjoon Kim, Minah Han, Hyunjung Shim, Jongduk Baek

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)


Purpose: Convolutional neural network (CNN)-based image denoising techniques have shown promising results in low-dose CT denoising. However, CNN often introduces blurring in denoised images when trained with a widely used pixel-level loss function. Perceptual loss and adversarial loss have been proposed recently to further improve the image denoising performance. In this paper, we investigate the effect of different loss functions on image denoising performance using task-based image quality assessment methods for various signals and dose levels. Methods: We used a modified version of U-net that was effective at reducing the correlated noise in CT images. The loss functions used for comparison were two pixel-level losses (i.e., the mean-squared error and the mean absolute error), Visual Geometry Group network-based perceptual loss (VGG loss), adversarial loss used to train the Wasserstein generative adversarial network with gradient penalty (WGAN-GP), and their weighted summation. Each image denoising method was applied to reconstructed images and sinogram images independently and validated using the extended cardiac-torso (XCAT) simulation and Mayo Clinic datasets. In the XCAT simulation, we generated fan-beam CT datasets with four different dose levels (25%, 50%, 75%, and 100% of a normal-dose level) using 10 XCAT phantoms and inserted signals in a test set. The signals had two different shapes (spherical and spiculated), sizes (4 and 12 mm), and contrast levels (60 and 160 HU). To evaluate signal detectability, we used a detection task SNR (tSNR) calculated from a non-prewhitening model observer with an eye filter. We also measured the noise power spectrum (NPS) and modulation transfer function (MTF) to compare the noise and signal transfer properties. Results: Compared to CNNs without VGG loss, VGG-loss-based CNNs achieved a more similar tSNR to that of the normal-dose CT for all signals at different dose levels except for a small signal at the 25% dose level. For a low-contrast signal at 25% or 50% dose, adding other losses to the VGG loss showed more improved performance than only using VGG loss. The NPS shapes from VGG-loss-based CNN closely matched that of normal-dose CT images while CNN without VGG loss overly reduced the mid-high-frequency noise power at all dose levels. MTF also showed VGG-loss-based CNN with better-preserved high resolution for all dose and contrast levels. It is also observed that additional WGAN-GP loss helps improve the noise and signal transfer properties of VGG-loss-based CNN. Conclusions: The evaluation results using tSNR, NPS, and MTF indicate that VGG-loss-based CNNs are more effective than those without VGG loss for natural denoising of low-dose images and WGAN-GP loss improves the denoising performance of VGG-loss-based CNNs, which corresponds with the qualitative evaluation.

Original languageEnglish
Pages (from-to)3906-3923
Number of pages18
JournalMedical physics
Issue number9
Publication statusPublished - 2019 Sep 1

Bibliographical note

Funding Information:
The authors thank Dr. C. McCollough, the Mayo Clinic, the American Association of Physicists in Medicine, and the National Institute of Biomedical Imaging and Bioengineering, for providing the clinical dataset, under grants EB017095 and EB017185. This research was supported by the Ministry of Science and ICT (MSIT), Korea, under the ICT Consilience Creative Program (IITP‐2019‐2017‐0‐01015) supervised by the Institute of Information & communications Technology Planning & evaluation (IITP), and by the National Research Foundation of Korea (NRF) grant funded by the Ministry of Science and ICT (NRF‐2018R1A1A1A05077894, 2018M3A9H6081483, 2017M2A2A4A01070302, 2017M2A2A6A01019663, and 2017M2A2A6A02087175).

All Science Journal Classification (ASJC) codes

  • Biophysics
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'A performance comparison of convolutional neural network-based image denoising methods: The effect of loss functions on low-dose CT images'. Together they form a unique fingerprint.

Cite this