Fast disparity and motion estimation for multi-view video coding

Yongtae Kim, Jiyoung Kim, Kwanghoon Sohn

Research output: Contribution to journalArticle

63 Citations (Scopus)

Abstract

In this paper, we propose a fast disparity and motion estimation for multi-view video coding (MVC). When implementing MVC, one of the most critical problems is heavy computational complexity caused by the large amount of information in multi-view sequences. Hence, a fast algorithm is essential. To reduce this computational complexity, we adaptively controlled a search range considering the reliability of each macroblock. In order to estimate this reliability, we calculated the difference between the predicted vectors that were obtained from different methods. When working with conventional encoders, vectors can be predicted using median filtering from causal blocks. Moreover, we calculated another predicted vector using multi-view camera geometry or the relationship between the disparity and motion vectors. We assumed that this difference indicated the reliability of the current macroblock. By using these properties, we were able to determine new search range and reduce the number of searching points within the limited window. The proposed MVC system was tested with several multiview sequences to evaluate performance. Experimental results showed that the proposed algorithm was able to reduce processing time by maximumly 70-80% in estimation process.

Original languageEnglish
Pages (from-to)712-719
Number of pages8
JournalIEEE Transactions on Consumer Electronics
Volume53
Issue number2
DOIs
Publication statusPublished - 2007 May 1

Fingerprint

Motion estimation
Image coding
Computational complexity
Cameras
Geometry
Processing

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Electrical and Electronic Engineering

Cite this

@article{5b22cebf9e9543ffadc2f8429fe8f471,
title = "Fast disparity and motion estimation for multi-view video coding",
abstract = "In this paper, we propose a fast disparity and motion estimation for multi-view video coding (MVC). When implementing MVC, one of the most critical problems is heavy computational complexity caused by the large amount of information in multi-view sequences. Hence, a fast algorithm is essential. To reduce this computational complexity, we adaptively controlled a search range considering the reliability of each macroblock. In order to estimate this reliability, we calculated the difference between the predicted vectors that were obtained from different methods. When working with conventional encoders, vectors can be predicted using median filtering from causal blocks. Moreover, we calculated another predicted vector using multi-view camera geometry or the relationship between the disparity and motion vectors. We assumed that this difference indicated the reliability of the current macroblock. By using these properties, we were able to determine new search range and reduce the number of searching points within the limited window. The proposed MVC system was tested with several multiview sequences to evaluate performance. Experimental results showed that the proposed algorithm was able to reduce processing time by maximumly 70-80{\%} in estimation process.",
author = "Yongtae Kim and Jiyoung Kim and Kwanghoon Sohn",
year = "2007",
month = "5",
day = "1",
doi = "10.1109/TCE.2007.381750",
language = "English",
volume = "53",
pages = "712--719",
journal = "IEEE Transactions on Consumer Electronics",
issn = "0098-3063",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

Fast disparity and motion estimation for multi-view video coding. / Kim, Yongtae; Kim, Jiyoung; Sohn, Kwanghoon.

In: IEEE Transactions on Consumer Electronics, Vol. 53, No. 2, 01.05.2007, p. 712-719.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Fast disparity and motion estimation for multi-view video coding

AU - Kim, Yongtae

AU - Kim, Jiyoung

AU - Sohn, Kwanghoon

PY - 2007/5/1

Y1 - 2007/5/1

N2 - In this paper, we propose a fast disparity and motion estimation for multi-view video coding (MVC). When implementing MVC, one of the most critical problems is heavy computational complexity caused by the large amount of information in multi-view sequences. Hence, a fast algorithm is essential. To reduce this computational complexity, we adaptively controlled a search range considering the reliability of each macroblock. In order to estimate this reliability, we calculated the difference between the predicted vectors that were obtained from different methods. When working with conventional encoders, vectors can be predicted using median filtering from causal blocks. Moreover, we calculated another predicted vector using multi-view camera geometry or the relationship between the disparity and motion vectors. We assumed that this difference indicated the reliability of the current macroblock. By using these properties, we were able to determine new search range and reduce the number of searching points within the limited window. The proposed MVC system was tested with several multiview sequences to evaluate performance. Experimental results showed that the proposed algorithm was able to reduce processing time by maximumly 70-80% in estimation process.

AB - In this paper, we propose a fast disparity and motion estimation for multi-view video coding (MVC). When implementing MVC, one of the most critical problems is heavy computational complexity caused by the large amount of information in multi-view sequences. Hence, a fast algorithm is essential. To reduce this computational complexity, we adaptively controlled a search range considering the reliability of each macroblock. In order to estimate this reliability, we calculated the difference between the predicted vectors that were obtained from different methods. When working with conventional encoders, vectors can be predicted using median filtering from causal blocks. Moreover, we calculated another predicted vector using multi-view camera geometry or the relationship between the disparity and motion vectors. We assumed that this difference indicated the reliability of the current macroblock. By using these properties, we were able to determine new search range and reduce the number of searching points within the limited window. The proposed MVC system was tested with several multiview sequences to evaluate performance. Experimental results showed that the proposed algorithm was able to reduce processing time by maximumly 70-80% in estimation process.

UR - http://www.scopus.com/inward/record.url?scp=34547651346&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34547651346&partnerID=8YFLogxK

U2 - 10.1109/TCE.2007.381750

DO - 10.1109/TCE.2007.381750

M3 - Article

AN - SCOPUS:34547651346

VL - 53

SP - 712

EP - 719

JO - IEEE Transactions on Consumer Electronics

JF - IEEE Transactions on Consumer Electronics

SN - 0098-3063

IS - 2

ER -