Viewing-distance aware super-resolution for high-definition display

Chih Tsung Shen, Hung Hsun Liu, Ming Hsuan Yang, Yi Ping Hung, Soo Chang Pei

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

In this paper, we propose a novel algorithm for high-definition displays to enlarge low-resolution images while maintaining perceptual constancy (i.e., the same field-of-view, perceptual blur radius, and the retinal image size in viewer's eyes). We model the relationship between a viewer and a display by considering two main aspects of visual perception, i.e., scaling factor and perceptual blur radius. As long as we enlarge an image while adjust its image blur levels on the display, we can maintain viewer's perceptual constancy. We show that the scaling factor should be set in proportion to the viewing distance and the blur levels on the display should be adjusted according to the focal length of a viewer. Toward this, we first refer to edge directions to interpolate a low-resolution image with the increasing of viewing distance and the scaling factor. After images are interpolated, we utilize a local contrast to estimate the spatially varying image blur levels of the interpolated image. We then further adjust the image blur levels using a parametric deblurring method, which combines L1 as well as L2 reconstruction errors, and Tikhonov with total variation regularization terms. By taking these factors into account, high-resolution images adaptive to viewing distance on a display can be generated. Experimental results on both natural image metric and user subjective studies across image scales demonstrate that the proposed super-resolution algorithm for high-definition displays performs favorably against the state-of-the-art methods.

Original languageEnglish
Article number6966784
Pages (from-to)403-418
Number of pages16
JournalIEEE Transactions on Image Processing
Volume24
Issue number1
DOIs
Publication statusPublished - 2015 Jan 1

Fingerprint

Display devices
Image resolution

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this

Shen, Chih Tsung ; Liu, Hung Hsun ; Yang, Ming Hsuan ; Hung, Yi Ping ; Pei, Soo Chang. / Viewing-distance aware super-resolution for high-definition display. In: IEEE Transactions on Image Processing. 2015 ; Vol. 24, No. 1. pp. 403-418.
@article{1fa2125ad6ca4835a339f599141789cc,
title = "Viewing-distance aware super-resolution for high-definition display",
abstract = "In this paper, we propose a novel algorithm for high-definition displays to enlarge low-resolution images while maintaining perceptual constancy (i.e., the same field-of-view, perceptual blur radius, and the retinal image size in viewer's eyes). We model the relationship between a viewer and a display by considering two main aspects of visual perception, i.e., scaling factor and perceptual blur radius. As long as we enlarge an image while adjust its image blur levels on the display, we can maintain viewer's perceptual constancy. We show that the scaling factor should be set in proportion to the viewing distance and the blur levels on the display should be adjusted according to the focal length of a viewer. Toward this, we first refer to edge directions to interpolate a low-resolution image with the increasing of viewing distance and the scaling factor. After images are interpolated, we utilize a local contrast to estimate the spatially varying image blur levels of the interpolated image. We then further adjust the image blur levels using a parametric deblurring method, which combines L1 as well as L2 reconstruction errors, and Tikhonov with total variation regularization terms. By taking these factors into account, high-resolution images adaptive to viewing distance on a display can be generated. Experimental results on both natural image metric and user subjective studies across image scales demonstrate that the proposed super-resolution algorithm for high-definition displays performs favorably against the state-of-the-art methods.",
author = "Shen, {Chih Tsung} and Liu, {Hung Hsun} and Yang, {Ming Hsuan} and Hung, {Yi Ping} and Pei, {Soo Chang}",
year = "2015",
month = "1",
day = "1",
doi = "10.1109/TIP.2014.2375639",
language = "English",
volume = "24",
pages = "403--418",
journal = "IEEE Transactions on Image Processing",
issn = "1057-7149",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

Viewing-distance aware super-resolution for high-definition display. / Shen, Chih Tsung; Liu, Hung Hsun; Yang, Ming Hsuan; Hung, Yi Ping; Pei, Soo Chang.

In: IEEE Transactions on Image Processing, Vol. 24, No. 1, 6966784, 01.01.2015, p. 403-418.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Viewing-distance aware super-resolution for high-definition display

AU - Shen, Chih Tsung

AU - Liu, Hung Hsun

AU - Yang, Ming Hsuan

AU - Hung, Yi Ping

AU - Pei, Soo Chang

PY - 2015/1/1

Y1 - 2015/1/1

N2 - In this paper, we propose a novel algorithm for high-definition displays to enlarge low-resolution images while maintaining perceptual constancy (i.e., the same field-of-view, perceptual blur radius, and the retinal image size in viewer's eyes). We model the relationship between a viewer and a display by considering two main aspects of visual perception, i.e., scaling factor and perceptual blur radius. As long as we enlarge an image while adjust its image blur levels on the display, we can maintain viewer's perceptual constancy. We show that the scaling factor should be set in proportion to the viewing distance and the blur levels on the display should be adjusted according to the focal length of a viewer. Toward this, we first refer to edge directions to interpolate a low-resolution image with the increasing of viewing distance and the scaling factor. After images are interpolated, we utilize a local contrast to estimate the spatially varying image blur levels of the interpolated image. We then further adjust the image blur levels using a parametric deblurring method, which combines L1 as well as L2 reconstruction errors, and Tikhonov with total variation regularization terms. By taking these factors into account, high-resolution images adaptive to viewing distance on a display can be generated. Experimental results on both natural image metric and user subjective studies across image scales demonstrate that the proposed super-resolution algorithm for high-definition displays performs favorably against the state-of-the-art methods.

AB - In this paper, we propose a novel algorithm for high-definition displays to enlarge low-resolution images while maintaining perceptual constancy (i.e., the same field-of-view, perceptual blur radius, and the retinal image size in viewer's eyes). We model the relationship between a viewer and a display by considering two main aspects of visual perception, i.e., scaling factor and perceptual blur radius. As long as we enlarge an image while adjust its image blur levels on the display, we can maintain viewer's perceptual constancy. We show that the scaling factor should be set in proportion to the viewing distance and the blur levels on the display should be adjusted according to the focal length of a viewer. Toward this, we first refer to edge directions to interpolate a low-resolution image with the increasing of viewing distance and the scaling factor. After images are interpolated, we utilize a local contrast to estimate the spatially varying image blur levels of the interpolated image. We then further adjust the image blur levels using a parametric deblurring method, which combines L1 as well as L2 reconstruction errors, and Tikhonov with total variation regularization terms. By taking these factors into account, high-resolution images adaptive to viewing distance on a display can be generated. Experimental results on both natural image metric and user subjective studies across image scales demonstrate that the proposed super-resolution algorithm for high-definition displays performs favorably against the state-of-the-art methods.

UR - http://www.scopus.com/inward/record.url?scp=84919904357&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84919904357&partnerID=8YFLogxK

U2 - 10.1109/TIP.2014.2375639

DO - 10.1109/TIP.2014.2375639

M3 - Article

C2 - 25438313

AN - SCOPUS:84919904357

VL - 24

SP - 403

EP - 418

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

SN - 1057-7149

IS - 1

M1 - 6966784

ER -