Using an MPEG-4 MAC (multiple auxiliary component) system is a good way to encode stereoscopic video with existing standard CODECs, especially when it comes to low bitrate applications. In this paper, we discuss the properties and problems of MAC systems when encoding stereoscopic video, and propose an MAC-based stereoscopic video coder and disparity estimation scheme to solve those problems. We used a reconstructed disparity map during the disparity compensation process and took that disparity map into account while estimating the base-view sequence motion vectors. Moreover, we proposed a search range finding and illumination imbalance decision system. We also proposed a block-based disparity map regularization process as well as block splitting in the object boundary and occlusion regions (to reduce the number of bits to encode in both the disparity map and the residual image). Last, we compensated for the imbalance between two cameras with a novel system that used MAC characteristics. Experimental results indicate that the proposed MAC system outperformed conventional stereo coding systems by a maximum of 3.5 dB in terms of the PSNR and 10-18% in terms of bitsaving, especially in low bitrate applications.
Bibliographical noteFunding Information:
This work is financially partly supported by the Ministry of Education, Science Technology (MEST), the Ministry of Knowledge Economy (MKE) and the Ministry of Labor (MOLAB) through the fostering project of the Lab of Excellency and partly supported by the IT R&D program of MKE/IITA [2007-F036-02 Objective quality assessment system based on human visual system].
All Science Journal Classification (ASJC) codes
- Signal Processing
- Computer Vision and Pattern Recognition
- Electrical and Electronic Engineering