Geometry compensation using depth and camera parameters for three-dimensional video coding

Dong Hyun Kim, Jungdong Seo, Seungchul Ryu, Jin Young Lee, Ho Cheon Wey, Kwanghoon Sohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

One of the important issues for a next generation broadcasting system is how to compress a massive amount of threedimensional (3D) video efficiently. In this paper, we propose a geometry compensation method for 3D video coding exploiting color videos, depth videos and camera parameters. In the proposed method, we first generate a compensated view, which is located at the geometrically same position with the current view, using depth and camera parameters of neighboring views. Then, the compensated view is used as a reference picture to reduce the inter-view redundancies such as disparity and motion vectors. Furthermore, considering the direction of hole-regions, we propose a hole-filling method for picture of P-view to fill up the holes based on the neighboring background pixels. The experimental results show that the proposed algorithm increases BD-PSNRs up to 0.22dB and 0.63dB for P- and B-views, respectively. Meanwhile, we achieved up to 6.28% and 18.32% BD bit-rates gain for P- and B- views, respectively.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII
DOIs
Publication statusPublished - 2012 Apr 30
EventStereoscopic Displays and Applications XXIII - Burlingame, CA, United States
Duration: 2012 Jan 232012 Jan 25

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume8288
ISSN (Print)0277-786X

Other

OtherStereoscopic Displays and Applications XXIII
CountryUnited States
CityBurlingame, CA
Period12/1/2312/1/25

Fingerprint

Video Coding
Image coding
3D Video
coding
Camera
Cameras
cameras
Three-dimensional
Geometry
geometry
Broadcasting
color coding
Redundancy
broadcasting
Motion Vector
Pixels
redundancy
Color
Pixel
pixels

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Kim, D. H., Seo, J., Ryu, S., Lee, J. Y., Wey, H. C., & Sohn, K. (2012). Geometry compensation using depth and camera parameters for three-dimensional video coding. In Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII [828827] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8288). https://doi.org/10.1117/12.906133
Kim, Dong Hyun ; Seo, Jungdong ; Ryu, Seungchul ; Lee, Jin Young ; Wey, Ho Cheon ; Sohn, Kwanghoon. / Geometry compensation using depth and camera parameters for three-dimensional video coding. Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII. 2012. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{021cd7debf3f46039d689d7386f27370,
title = "Geometry compensation using depth and camera parameters for three-dimensional video coding",
abstract = "One of the important issues for a next generation broadcasting system is how to compress a massive amount of threedimensional (3D) video efficiently. In this paper, we propose a geometry compensation method for 3D video coding exploiting color videos, depth videos and camera parameters. In the proposed method, we first generate a compensated view, which is located at the geometrically same position with the current view, using depth and camera parameters of neighboring views. Then, the compensated view is used as a reference picture to reduce the inter-view redundancies such as disparity and motion vectors. Furthermore, considering the direction of hole-regions, we propose a hole-filling method for picture of P-view to fill up the holes based on the neighboring background pixels. The experimental results show that the proposed algorithm increases BD-PSNRs up to 0.22dB and 0.63dB for P- and B-views, respectively. Meanwhile, we achieved up to 6.28{\%} and 18.32{\%} BD bit-rates gain for P- and B- views, respectively.",
author = "Kim, {Dong Hyun} and Jungdong Seo and Seungchul Ryu and Lee, {Jin Young} and Wey, {Ho Cheon} and Kwanghoon Sohn",
year = "2012",
month = "4",
day = "30",
doi = "10.1117/12.906133",
language = "English",
isbn = "9780819489357",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
booktitle = "Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII",

}

Kim, DH, Seo, J, Ryu, S, Lee, JY, Wey, HC & Sohn, K 2012, Geometry compensation using depth and camera parameters for three-dimensional video coding. in Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII., 828827, Proceedings of SPIE - The International Society for Optical Engineering, vol. 8288, Stereoscopic Displays and Applications XXIII, Burlingame, CA, United States, 12/1/23. https://doi.org/10.1117/12.906133

Geometry compensation using depth and camera parameters for three-dimensional video coding. / Kim, Dong Hyun; Seo, Jungdong; Ryu, Seungchul; Lee, Jin Young; Wey, Ho Cheon; Sohn, Kwanghoon.

Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII. 2012. 828827 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8288).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Geometry compensation using depth and camera parameters for three-dimensional video coding

AU - Kim, Dong Hyun

AU - Seo, Jungdong

AU - Ryu, Seungchul

AU - Lee, Jin Young

AU - Wey, Ho Cheon

AU - Sohn, Kwanghoon

PY - 2012/4/30

Y1 - 2012/4/30

N2 - One of the important issues for a next generation broadcasting system is how to compress a massive amount of threedimensional (3D) video efficiently. In this paper, we propose a geometry compensation method for 3D video coding exploiting color videos, depth videos and camera parameters. In the proposed method, we first generate a compensated view, which is located at the geometrically same position with the current view, using depth and camera parameters of neighboring views. Then, the compensated view is used as a reference picture to reduce the inter-view redundancies such as disparity and motion vectors. Furthermore, considering the direction of hole-regions, we propose a hole-filling method for picture of P-view to fill up the holes based on the neighboring background pixels. The experimental results show that the proposed algorithm increases BD-PSNRs up to 0.22dB and 0.63dB for P- and B-views, respectively. Meanwhile, we achieved up to 6.28% and 18.32% BD bit-rates gain for P- and B- views, respectively.

AB - One of the important issues for a next generation broadcasting system is how to compress a massive amount of threedimensional (3D) video efficiently. In this paper, we propose a geometry compensation method for 3D video coding exploiting color videos, depth videos and camera parameters. In the proposed method, we first generate a compensated view, which is located at the geometrically same position with the current view, using depth and camera parameters of neighboring views. Then, the compensated view is used as a reference picture to reduce the inter-view redundancies such as disparity and motion vectors. Furthermore, considering the direction of hole-regions, we propose a hole-filling method for picture of P-view to fill up the holes based on the neighboring background pixels. The experimental results show that the proposed algorithm increases BD-PSNRs up to 0.22dB and 0.63dB for P- and B-views, respectively. Meanwhile, we achieved up to 6.28% and 18.32% BD bit-rates gain for P- and B- views, respectively.

UR - http://www.scopus.com/inward/record.url?scp=84860163409&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860163409&partnerID=8YFLogxK

U2 - 10.1117/12.906133

DO - 10.1117/12.906133

M3 - Conference contribution

AN - SCOPUS:84860163409

SN - 9780819489357

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII

ER -

Kim DH, Seo J, Ryu S, Lee JY, Wey HC, Sohn K. Geometry compensation using depth and camera parameters for three-dimensional video coding. In Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII. 2012. 828827. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.906133