Probabilistic moving least squares with spatial constraints for nonlinear color transfer between images

Youngbae Hwang, Joon Young Lee, In So Kweon, Seon Joo Kim

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)

Abstract

The color of a scene may vary from image to image because the photographs are taken at different times, with different cameras, and under different camera settings. To align the color of a scene between images, we introduce a novel color transfer framework based on a scattered point interpolation scheme. Compared to the conventional color transformation methods that use a parametric mapping or color distribution matching, we solve for a full nonlinear and nonparametric color mapping in the 3D RGB color space by employing the moving least squares framework. We further strengthen the transfer with a probabilistic modeling of the color transfer in the 3D color space as well as spatial constraints to deal with mis-alignments, noise, and spatially varying illumination. Experiments show the effectiveness of our method over previous color transfer methods both quantitatively and qualitatively. In addition, our framework can be applied for various instances of color transfer such as transferring color between different camera models, camera settings, and illumination conditions, as well as for video color transfers.

Original languageEnglish
Pages (from-to)1-12
Number of pages12
JournalComputer Vision and Image Understanding
Volume180
DOIs
Publication statusPublished - 2019 Mar

Bibliographical note

Funding Information:
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) ( NRF-2016R1A2B4014610 ), by Ministry of Culture, Sports and Tourism(MCST) and Korea Content Agency(KOCCA) in the Culture Technology(CT) Research & Development Program 2015, and the Cross-Ministry Giga KOREA Project (MSIT) No. GK18P0200 .

Publisher Copyright:
© 2019 Elsevier Inc.

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Probabilistic moving least squares with spatial constraints for nonlinear color transfer between images'. Together they form a unique fingerprint.

Cite this