Enhancement of Visual Comfort and Sense of Presence on Stereoscopic 3D Images

Heeseok Oh, Jongyoo Kim, Jinwoo Kim, Taewan Kim, Sanghoon Lee, Alan Conrad Bovik

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

Conventional stereoscopic 3D (S3D) displays do not provide accommodation depth cues of the 3D image or video contents being viewed. The sense of content depths is thus limited to cues supplied by motion parallax (for 3D video), stereoscopic vergence cues created by presenting left and right views to the respective eyes, and other contextual and perspective depth cues. The absence of accommodation cues can induce two kinds of accommodation vergence mismatches (AVM) at the fixation and peripheral points, which can result in severe visual discomfort. With the aim of alleviating discomfort arising from AVM, we propose a new visual comfort enhancement approach for processing S3D visual signals to deliver a more comfortable 3D viewing experience at the display. This is accomplished via an optimization process whereby a predictive indicator of visual discomfort is minimized, while still aiming to maintain the viewer's sense of 3D presence by performing a suitable parallax shift, and by directed blurring of the signal. Our processing framework is defined on 3D visual coordinates that reflect the nonuniform resolution of retinal sensors and that uses a measure of 3D saliency strength. An appropriate level of blur that corresponds to the degree of parallax shift is found, making it possible to produce synthetic accommodation cues implemented using a perceptively relevant filter. By this method, AVM, the primary contributor to the discomfort felt when viewing S3D images, is reduced. We show via a series of subjective experiments that the proposed approach improves visual comfort while preserving the sense of 3D presence.

Original languageEnglish
Article number7922601
Pages (from-to)3789-3801
Number of pages13
JournalIEEE Transactions on Image Processing
Volume26
Issue number8
DOIs
Publication statusPublished - 2017 Aug

Fingerprint

Display devices
Processing
Sensors
Experiments

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this

Oh, Heeseok ; Kim, Jongyoo ; Kim, Jinwoo ; Kim, Taewan ; Lee, Sanghoon ; Bovik, Alan Conrad. / Enhancement of Visual Comfort and Sense of Presence on Stereoscopic 3D Images. In: IEEE Transactions on Image Processing. 2017 ; Vol. 26, No. 8. pp. 3789-3801.
@article{53978ac94abf4a808993e68dc0b39fd4,
title = "Enhancement of Visual Comfort and Sense of Presence on Stereoscopic 3D Images",
abstract = "Conventional stereoscopic 3D (S3D) displays do not provide accommodation depth cues of the 3D image or video contents being viewed. The sense of content depths is thus limited to cues supplied by motion parallax (for 3D video), stereoscopic vergence cues created by presenting left and right views to the respective eyes, and other contextual and perspective depth cues. The absence of accommodation cues can induce two kinds of accommodation vergence mismatches (AVM) at the fixation and peripheral points, which can result in severe visual discomfort. With the aim of alleviating discomfort arising from AVM, we propose a new visual comfort enhancement approach for processing S3D visual signals to deliver a more comfortable 3D viewing experience at the display. This is accomplished via an optimization process whereby a predictive indicator of visual discomfort is minimized, while still aiming to maintain the viewer's sense of 3D presence by performing a suitable parallax shift, and by directed blurring of the signal. Our processing framework is defined on 3D visual coordinates that reflect the nonuniform resolution of retinal sensors and that uses a measure of 3D saliency strength. An appropriate level of blur that corresponds to the degree of parallax shift is found, making it possible to produce synthetic accommodation cues implemented using a perceptively relevant filter. By this method, AVM, the primary contributor to the discomfort felt when viewing S3D images, is reduced. We show via a series of subjective experiments that the proposed approach improves visual comfort while preserving the sense of 3D presence.",
author = "Heeseok Oh and Jongyoo Kim and Jinwoo Kim and Taewan Kim and Sanghoon Lee and Bovik, {Alan Conrad}",
year = "2017",
month = "8",
doi = "10.1109/TIP.2017.2702383",
language = "English",
volume = "26",
pages = "3789--3801",
journal = "IEEE Transactions on Image Processing",
issn = "1057-7149",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "8",

}

Enhancement of Visual Comfort and Sense of Presence on Stereoscopic 3D Images. / Oh, Heeseok; Kim, Jongyoo; Kim, Jinwoo; Kim, Taewan; Lee, Sanghoon; Bovik, Alan Conrad.

In: IEEE Transactions on Image Processing, Vol. 26, No. 8, 7922601, 08.2017, p. 3789-3801.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Enhancement of Visual Comfort and Sense of Presence on Stereoscopic 3D Images

AU - Oh, Heeseok

AU - Kim, Jongyoo

AU - Kim, Jinwoo

AU - Kim, Taewan

AU - Lee, Sanghoon

AU - Bovik, Alan Conrad

PY - 2017/8

Y1 - 2017/8

N2 - Conventional stereoscopic 3D (S3D) displays do not provide accommodation depth cues of the 3D image or video contents being viewed. The sense of content depths is thus limited to cues supplied by motion parallax (for 3D video), stereoscopic vergence cues created by presenting left and right views to the respective eyes, and other contextual and perspective depth cues. The absence of accommodation cues can induce two kinds of accommodation vergence mismatches (AVM) at the fixation and peripheral points, which can result in severe visual discomfort. With the aim of alleviating discomfort arising from AVM, we propose a new visual comfort enhancement approach for processing S3D visual signals to deliver a more comfortable 3D viewing experience at the display. This is accomplished via an optimization process whereby a predictive indicator of visual discomfort is minimized, while still aiming to maintain the viewer's sense of 3D presence by performing a suitable parallax shift, and by directed blurring of the signal. Our processing framework is defined on 3D visual coordinates that reflect the nonuniform resolution of retinal sensors and that uses a measure of 3D saliency strength. An appropriate level of blur that corresponds to the degree of parallax shift is found, making it possible to produce synthetic accommodation cues implemented using a perceptively relevant filter. By this method, AVM, the primary contributor to the discomfort felt when viewing S3D images, is reduced. We show via a series of subjective experiments that the proposed approach improves visual comfort while preserving the sense of 3D presence.

AB - Conventional stereoscopic 3D (S3D) displays do not provide accommodation depth cues of the 3D image or video contents being viewed. The sense of content depths is thus limited to cues supplied by motion parallax (for 3D video), stereoscopic vergence cues created by presenting left and right views to the respective eyes, and other contextual and perspective depth cues. The absence of accommodation cues can induce two kinds of accommodation vergence mismatches (AVM) at the fixation and peripheral points, which can result in severe visual discomfort. With the aim of alleviating discomfort arising from AVM, we propose a new visual comfort enhancement approach for processing S3D visual signals to deliver a more comfortable 3D viewing experience at the display. This is accomplished via an optimization process whereby a predictive indicator of visual discomfort is minimized, while still aiming to maintain the viewer's sense of 3D presence by performing a suitable parallax shift, and by directed blurring of the signal. Our processing framework is defined on 3D visual coordinates that reflect the nonuniform resolution of retinal sensors and that uses a measure of 3D saliency strength. An appropriate level of blur that corresponds to the degree of parallax shift is found, making it possible to produce synthetic accommodation cues implemented using a perceptively relevant filter. By this method, AVM, the primary contributor to the discomfort felt when viewing S3D images, is reduced. We show via a series of subjective experiments that the proposed approach improves visual comfort while preserving the sense of 3D presence.

UR - http://www.scopus.com/inward/record.url?scp=85020692745&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85020692745&partnerID=8YFLogxK

U2 - 10.1109/TIP.2017.2702383

DO - 10.1109/TIP.2017.2702383

M3 - Article

AN - SCOPUS:85020692745

VL - 26

SP - 3789

EP - 3801

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

SN - 1057-7149

IS - 8

M1 - 7922601

ER -