The fast stereo sequence compression using edge-directional joint disparity-motion estimation

Yongtae Kim, Changseob Park, Jaeho Lee, Kwanghoon Sohn

Research output: Contribution to journalConference article

1 Citation (Scopus)

Abstract

This paper presents an efficient joint disparity-motion estimation algorithm and fast estimation scheme for stereo sequence CODEC. In stereo sequences, frames from one camera view (usually the left) are defined as the base layer, and frames from the other one as the enhancement layer. The enhancement-from-base-layer prediction then turns out as a disparity-compensated prediction instead of a motion-compensated prediction. Although the disparity-compensated prediction fails, it is still possible to achieve compression by motion-compensated prediction with the same channel. At the same time, the base layer represents a monoscopic sequence. Joint disparity-motion estimation can increase coding efficiency and reduce complexity of stereo CODEC using relationship between disparity and motion fields. The disparity vectors are estimated by using the left and right motion vectors and the previous disparity vectors in each time frame. In order to obtain more accurate disparity vectors, we include spatial prediction process after joint estimation. From joint estimation and spatial prediction, we can obtain accurate disparity vectors and then increase coding efficiency. Moreover, we proposed fast motion estimation technique which utilizes correlation for motion vectors of neighboring blocks. We confirmed PSNR of the proposed method increases by 0.5-1.5dB compared to the conventional methods from simulation results. At the same time, the processing time is reduced by almost 1/10.

Original languageEnglish
Article number94
Pages (from-to)833-842
Number of pages10
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume5685
Issue numberPART 2
DOIs
Publication statusPublished - 2005 Jul 21

Fingerprint

Motion Estimation
Motion estimation
Compression
Prediction
Spatial Prediction
Motion Vector
predictions
Motion
Enhancement
Coding
Estimation Algorithms
coding
Camera
augmentation
Cameras
cameras
Simulation
Processing

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

@article{2ae1720594594f0ca178f8ce28ce3952,
title = "The fast stereo sequence compression using edge-directional joint disparity-motion estimation",
abstract = "This paper presents an efficient joint disparity-motion estimation algorithm and fast estimation scheme for stereo sequence CODEC. In stereo sequences, frames from one camera view (usually the left) are defined as the base layer, and frames from the other one as the enhancement layer. The enhancement-from-base-layer prediction then turns out as a disparity-compensated prediction instead of a motion-compensated prediction. Although the disparity-compensated prediction fails, it is still possible to achieve compression by motion-compensated prediction with the same channel. At the same time, the base layer represents a monoscopic sequence. Joint disparity-motion estimation can increase coding efficiency and reduce complexity of stereo CODEC using relationship between disparity and motion fields. The disparity vectors are estimated by using the left and right motion vectors and the previous disparity vectors in each time frame. In order to obtain more accurate disparity vectors, we include spatial prediction process after joint estimation. From joint estimation and spatial prediction, we can obtain accurate disparity vectors and then increase coding efficiency. Moreover, we proposed fast motion estimation technique which utilizes correlation for motion vectors of neighboring blocks. We confirmed PSNR of the proposed method increases by 0.5-1.5dB compared to the conventional methods from simulation results. At the same time, the processing time is reduced by almost 1/10.",
author = "Yongtae Kim and Changseob Park and Jaeho Lee and Kwanghoon Sohn",
year = "2005",
month = "7",
day = "21",
doi = "10.1117/12.586699",
language = "English",
volume = "5685",
pages = "833--842",
journal = "Proceedings of SPIE - The International Society for Optical Engineering",
issn = "0277-786X",
publisher = "SPIE",
number = "PART 2",

}

The fast stereo sequence compression using edge-directional joint disparity-motion estimation. / Kim, Yongtae; Park, Changseob; Lee, Jaeho; Sohn, Kwanghoon.

In: Proceedings of SPIE - The International Society for Optical Engineering, Vol. 5685, No. PART 2, 94, 21.07.2005, p. 833-842.

Research output: Contribution to journalConference article

TY - JOUR

T1 - The fast stereo sequence compression using edge-directional joint disparity-motion estimation

AU - Kim, Yongtae

AU - Park, Changseob

AU - Lee, Jaeho

AU - Sohn, Kwanghoon

PY - 2005/7/21

Y1 - 2005/7/21

N2 - This paper presents an efficient joint disparity-motion estimation algorithm and fast estimation scheme for stereo sequence CODEC. In stereo sequences, frames from one camera view (usually the left) are defined as the base layer, and frames from the other one as the enhancement layer. The enhancement-from-base-layer prediction then turns out as a disparity-compensated prediction instead of a motion-compensated prediction. Although the disparity-compensated prediction fails, it is still possible to achieve compression by motion-compensated prediction with the same channel. At the same time, the base layer represents a monoscopic sequence. Joint disparity-motion estimation can increase coding efficiency and reduce complexity of stereo CODEC using relationship between disparity and motion fields. The disparity vectors are estimated by using the left and right motion vectors and the previous disparity vectors in each time frame. In order to obtain more accurate disparity vectors, we include spatial prediction process after joint estimation. From joint estimation and spatial prediction, we can obtain accurate disparity vectors and then increase coding efficiency. Moreover, we proposed fast motion estimation technique which utilizes correlation for motion vectors of neighboring blocks. We confirmed PSNR of the proposed method increases by 0.5-1.5dB compared to the conventional methods from simulation results. At the same time, the processing time is reduced by almost 1/10.

AB - This paper presents an efficient joint disparity-motion estimation algorithm and fast estimation scheme for stereo sequence CODEC. In stereo sequences, frames from one camera view (usually the left) are defined as the base layer, and frames from the other one as the enhancement layer. The enhancement-from-base-layer prediction then turns out as a disparity-compensated prediction instead of a motion-compensated prediction. Although the disparity-compensated prediction fails, it is still possible to achieve compression by motion-compensated prediction with the same channel. At the same time, the base layer represents a monoscopic sequence. Joint disparity-motion estimation can increase coding efficiency and reduce complexity of stereo CODEC using relationship between disparity and motion fields. The disparity vectors are estimated by using the left and right motion vectors and the previous disparity vectors in each time frame. In order to obtain more accurate disparity vectors, we include spatial prediction process after joint estimation. From joint estimation and spatial prediction, we can obtain accurate disparity vectors and then increase coding efficiency. Moreover, we proposed fast motion estimation technique which utilizes correlation for motion vectors of neighboring blocks. We confirmed PSNR of the proposed method increases by 0.5-1.5dB compared to the conventional methods from simulation results. At the same time, the processing time is reduced by almost 1/10.

UR - http://www.scopus.com/inward/record.url?scp=21844460565&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=21844460565&partnerID=8YFLogxK

U2 - 10.1117/12.586699

DO - 10.1117/12.586699

M3 - Conference article

VL - 5685

SP - 833

EP - 842

JO - Proceedings of SPIE - The International Society for Optical Engineering

JF - Proceedings of SPIE - The International Society for Optical Engineering

SN - 0277-786X

IS - PART 2

M1 - 94

ER -