Single image shadow removal via detection-free spatially adaptive denormalization

Hyunjeong Ryu, Taehyeon Kim, Yoonsik Choe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Removing shadows in a single image has been a challenging problem because shadows can appear in various forms due to complex physical situations, influenced by many factors such as light sources and the material's transparency. In order to remove shadows precisely, most previous works utilized shadow mask information, which indicates the shadow region in a given image using binary representation. However, shadow mask utilization inevitably induces multiple problems, including shadow removal performance dependency and additional shadow detection process requirements. To solve these problems, the proposed algorithm is based on an image-to-image translation algorithm, which does not require additional shadow mask information. In this deep neural network, the convergence of fast learning is induced by utilizing various normalization layers. However, in a case that is very sensitive to various spatial features of an input image, such as shadow removal, the normalization process causes a problem of losing a large amount of information existing in the input image data. So, we utilize spatially adaptive denormalization(SPADE) to prevent loss of spatial features of input image data. Therefore, not only does it fundamentally solve the problem that various feature information constituting the input image is lost in the normalization process, but also enables precise shadow region removal by combining the feature map of multi-resolutions with the feature map of the decoder. In evaluation, the proposed algorithm shows that it exceeds the existing approach by about 20∼30% in both PSNR and RMSE based on the ISTD large data set.

Original languageEnglish
Title of host publicationInternational Workshop on Advanced Imaging Technology, IWAIT 2021
EditorsMasayuki Nakajima, Jae-Gon Kim, Wen-Nung Lie, Qian Kemao
PublisherSPIE
ISBN (Electronic)9781510643642
DOIs
Publication statusPublished - 2021
Event2021 International Workshop on Advanced Imaging Technology, IWAIT 2021 - Kagoshima, Virtual, Japan
Duration: 2021 Jan 52021 Jan 6

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11766
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference2021 International Workshop on Advanced Imaging Technology, IWAIT 2021
CountryJapan
CityKagoshima, Virtual
Period21/1/521/1/6

Bibliographical note

Funding Information:
This research is supported by Ministry of Culture, Sports and Tourism and Korea Creative Content Agency(Project Number: R2020040238)

Publisher Copyright:
© COPYRIGHT SPIE. Downloading of the abstract is permitted for personal use only.

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Single image shadow removal via detection-free spatially adaptive denormalization'. Together they form a unique fingerprint.

Cite this