Transition of visual attention assessment in stereoscopic images with evaluation of subjective visual quality and discomfort

Haksub Kim, Sanghoon Lee

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

Through statistical analysis of the behaviors of human visual attention, we discovered that fixation behaviors are highly correlated with the degree to which the viewer experiences visual quality/discomfort with stereoscopic images. To quantify the correlation between visual attention and quality/discomfort with respect to various distortions and disparities, we explore a novel methodology called transition of visual attention (ToVA) that accounts for diverse low-level luminance, chrominance, and depth attributes of 3D images in eye-tracker experiments. Moreover, saliency entropy is defined in order to quantify the distribution of fixations for 3D images. Using saliency entropy, we interpret perceptual factors in accordance with the non-uniform resolution of the human eye and the stereoscopic limits caused by foveation and Panum's fusional area. We then measure ToVA in terms of relative saliency entropy using Kullback-Leibler divergence. To evaluate the effectiveness of ToVA, a successful example application is also provided for which ToVA is applied to obtain subjective measurements of the quality and discomfort experienced when viewing 3D displays, rather than relying on conventional subjective tests using a scoring system.

Original languageEnglish
Article number7303954
Pages (from-to)2198-2209
Number of pages12
JournalIEEE Transactions on Multimedia
Volume17
Issue number12
DOIs
Publication statusPublished - 2015 Dec 1

Fingerprint

Entropy
Luminance
Statistical methods
Display devices
Experiments

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

@article{9362e36ae56f410b8ae8ebd3017d4642,
title = "Transition of visual attention assessment in stereoscopic images with evaluation of subjective visual quality and discomfort",
abstract = "Through statistical analysis of the behaviors of human visual attention, we discovered that fixation behaviors are highly correlated with the degree to which the viewer experiences visual quality/discomfort with stereoscopic images. To quantify the correlation between visual attention and quality/discomfort with respect to various distortions and disparities, we explore a novel methodology called transition of visual attention (ToVA) that accounts for diverse low-level luminance, chrominance, and depth attributes of 3D images in eye-tracker experiments. Moreover, saliency entropy is defined in order to quantify the distribution of fixations for 3D images. Using saliency entropy, we interpret perceptual factors in accordance with the non-uniform resolution of the human eye and the stereoscopic limits caused by foveation and Panum's fusional area. We then measure ToVA in terms of relative saliency entropy using Kullback-Leibler divergence. To evaluate the effectiveness of ToVA, a successful example application is also provided for which ToVA is applied to obtain subjective measurements of the quality and discomfort experienced when viewing 3D displays, rather than relying on conventional subjective tests using a scoring system.",
author = "Haksub Kim and Sanghoon Lee",
year = "2015",
month = "12",
day = "1",
doi = "10.1109/TMM.2015.2493367",
language = "English",
volume = "17",
pages = "2198--2209",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "12",

}

Transition of visual attention assessment in stereoscopic images with evaluation of subjective visual quality and discomfort. / Kim, Haksub; Lee, Sanghoon.

In: IEEE Transactions on Multimedia, Vol. 17, No. 12, 7303954, 01.12.2015, p. 2198-2209.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Transition of visual attention assessment in stereoscopic images with evaluation of subjective visual quality and discomfort

AU - Kim, Haksub

AU - Lee, Sanghoon

PY - 2015/12/1

Y1 - 2015/12/1

N2 - Through statistical analysis of the behaviors of human visual attention, we discovered that fixation behaviors are highly correlated with the degree to which the viewer experiences visual quality/discomfort with stereoscopic images. To quantify the correlation between visual attention and quality/discomfort with respect to various distortions and disparities, we explore a novel methodology called transition of visual attention (ToVA) that accounts for diverse low-level luminance, chrominance, and depth attributes of 3D images in eye-tracker experiments. Moreover, saliency entropy is defined in order to quantify the distribution of fixations for 3D images. Using saliency entropy, we interpret perceptual factors in accordance with the non-uniform resolution of the human eye and the stereoscopic limits caused by foveation and Panum's fusional area. We then measure ToVA in terms of relative saliency entropy using Kullback-Leibler divergence. To evaluate the effectiveness of ToVA, a successful example application is also provided for which ToVA is applied to obtain subjective measurements of the quality and discomfort experienced when viewing 3D displays, rather than relying on conventional subjective tests using a scoring system.

AB - Through statistical analysis of the behaviors of human visual attention, we discovered that fixation behaviors are highly correlated with the degree to which the viewer experiences visual quality/discomfort with stereoscopic images. To quantify the correlation between visual attention and quality/discomfort with respect to various distortions and disparities, we explore a novel methodology called transition of visual attention (ToVA) that accounts for diverse low-level luminance, chrominance, and depth attributes of 3D images in eye-tracker experiments. Moreover, saliency entropy is defined in order to quantify the distribution of fixations for 3D images. Using saliency entropy, we interpret perceptual factors in accordance with the non-uniform resolution of the human eye and the stereoscopic limits caused by foveation and Panum's fusional area. We then measure ToVA in terms of relative saliency entropy using Kullback-Leibler divergence. To evaluate the effectiveness of ToVA, a successful example application is also provided for which ToVA is applied to obtain subjective measurements of the quality and discomfort experienced when viewing 3D displays, rather than relying on conventional subjective tests using a scoring system.

UR - http://www.scopus.com/inward/record.url?scp=84960849583&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84960849583&partnerID=8YFLogxK

U2 - 10.1109/TMM.2015.2493367

DO - 10.1109/TMM.2015.2493367

M3 - Article

VL - 17

SP - 2198

EP - 2209

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 12

M1 - 7303954

ER -