Stereoscopic video coding and disparity estimation for low bitrate applications based on MPEG-4 multiple auxiliary components

Jiyoung Kim, Yongtae Kim, Kwanghoon Sohn

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Using an MPEG-4 MAC (multiple auxiliary component) system is a good way to encode stereoscopic video with existing standard CODECs, especially when it comes to low bitrate applications. In this paper, we discuss the properties and problems of MAC systems when encoding stereoscopic video, and propose an MAC-based stereoscopic video coder and disparity estimation scheme to solve those problems. We used a reconstructed disparity map during the disparity compensation process and took that disparity map into account while estimating the base-view sequence motion vectors. Moreover, we proposed a search range finding and illumination imbalance decision system. We also proposed a block-based disparity map regularization process as well as block splitting in the object boundary and occlusion regions (to reduce the number of bits to encode in both the disparity map and the residual image). Last, we compensated for the imbalance between two cameras with a novel system that used MAC characteristics. Experimental results indicate that the proposed MAC system outperformed conventional stereo coding systems by a maximum of 3.5 dB in terms of the PSNR and 10-18% in terms of bitsaving, especially in low bitrate applications.

Original languageEnglish
Pages (from-to)405-416
Number of pages12
JournalSignal Processing: Image Communication
Volume23
Issue number6
DOIs
Publication statusPublished - 2008 Jul 1

Fingerprint

Image coding
Lighting
Cameras

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Cite this

@article{6901953fa87b4376a0844c5576a0fe6f,
title = "Stereoscopic video coding and disparity estimation for low bitrate applications based on MPEG-4 multiple auxiliary components",
abstract = "Using an MPEG-4 MAC (multiple auxiliary component) system is a good way to encode stereoscopic video with existing standard CODECs, especially when it comes to low bitrate applications. In this paper, we discuss the properties and problems of MAC systems when encoding stereoscopic video, and propose an MAC-based stereoscopic video coder and disparity estimation scheme to solve those problems. We used a reconstructed disparity map during the disparity compensation process and took that disparity map into account while estimating the base-view sequence motion vectors. Moreover, we proposed a search range finding and illumination imbalance decision system. We also proposed a block-based disparity map regularization process as well as block splitting in the object boundary and occlusion regions (to reduce the number of bits to encode in both the disparity map and the residual image). Last, we compensated for the imbalance between two cameras with a novel system that used MAC characteristics. Experimental results indicate that the proposed MAC system outperformed conventional stereo coding systems by a maximum of 3.5 dB in terms of the PSNR and 10-18{\%} in terms of bitsaving, especially in low bitrate applications.",
author = "Jiyoung Kim and Yongtae Kim and Kwanghoon Sohn",
year = "2008",
month = "7",
day = "1",
doi = "10.1016/j.image.2008.03.006",
language = "English",
volume = "23",
pages = "405--416",
journal = "Signal Processing: Image Communication",
issn = "0923-5965",
publisher = "Elsevier",
number = "6",

}

Stereoscopic video coding and disparity estimation for low bitrate applications based on MPEG-4 multiple auxiliary components. / Kim, Jiyoung; Kim, Yongtae; Sohn, Kwanghoon.

In: Signal Processing: Image Communication, Vol. 23, No. 6, 01.07.2008, p. 405-416.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Stereoscopic video coding and disparity estimation for low bitrate applications based on MPEG-4 multiple auxiliary components

AU - Kim, Jiyoung

AU - Kim, Yongtae

AU - Sohn, Kwanghoon

PY - 2008/7/1

Y1 - 2008/7/1

N2 - Using an MPEG-4 MAC (multiple auxiliary component) system is a good way to encode stereoscopic video with existing standard CODECs, especially when it comes to low bitrate applications. In this paper, we discuss the properties and problems of MAC systems when encoding stereoscopic video, and propose an MAC-based stereoscopic video coder and disparity estimation scheme to solve those problems. We used a reconstructed disparity map during the disparity compensation process and took that disparity map into account while estimating the base-view sequence motion vectors. Moreover, we proposed a search range finding and illumination imbalance decision system. We also proposed a block-based disparity map regularization process as well as block splitting in the object boundary and occlusion regions (to reduce the number of bits to encode in both the disparity map and the residual image). Last, we compensated for the imbalance between two cameras with a novel system that used MAC characteristics. Experimental results indicate that the proposed MAC system outperformed conventional stereo coding systems by a maximum of 3.5 dB in terms of the PSNR and 10-18% in terms of bitsaving, especially in low bitrate applications.

AB - Using an MPEG-4 MAC (multiple auxiliary component) system is a good way to encode stereoscopic video with existing standard CODECs, especially when it comes to low bitrate applications. In this paper, we discuss the properties and problems of MAC systems when encoding stereoscopic video, and propose an MAC-based stereoscopic video coder and disparity estimation scheme to solve those problems. We used a reconstructed disparity map during the disparity compensation process and took that disparity map into account while estimating the base-view sequence motion vectors. Moreover, we proposed a search range finding and illumination imbalance decision system. We also proposed a block-based disparity map regularization process as well as block splitting in the object boundary and occlusion regions (to reduce the number of bits to encode in both the disparity map and the residual image). Last, we compensated for the imbalance between two cameras with a novel system that used MAC characteristics. Experimental results indicate that the proposed MAC system outperformed conventional stereo coding systems by a maximum of 3.5 dB in terms of the PSNR and 10-18% in terms of bitsaving, especially in low bitrate applications.

UR - http://www.scopus.com/inward/record.url?scp=45049083647&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=45049083647&partnerID=8YFLogxK

U2 - 10.1016/j.image.2008.03.006

DO - 10.1016/j.image.2008.03.006

M3 - Article

AN - SCOPUS:45049083647

VL - 23

SP - 405

EP - 416

JO - Signal Processing: Image Communication

JF - Signal Processing: Image Communication

SN - 0923-5965

IS - 6

ER -