Fast mode decision for intra prediction in H.264/AVC encoder

Byeongdu La, Minyoung Eom, Yoonsik Choe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

22 Citations (Scopus)

Abstract

The H.264/AVC video coding standard uses the rate distortion optimization (RDO) method to improve the compression performance in the intra prediction. Whereas the computational complexity is increased comparing with previous standards due to this method, even though this standard selects the best coding mode for the current macroblock. In this paper, a fast intra mode decision algorithm for H.264/AVC encoder based on dominant edge direction (DED) is proposed. The algorithm uses the approximation of discrete cosine transform (DCT) coefficient formula. By detecting the DED before intra prediction, 3 modes instead of 9 modes are chosen for RDO calculation to decide the best mode in the 4×4 luma block. For the 16×16 luma and the 8×8 chroma, instead of 4 modes, only 2 modes are chosen. Experimental results show that the computation time of the proposed algorithm is decreased to about 71% of the full search method in the reference code with negligible quality loss.

Original languageEnglish
Title of host publication2007 IEEE International Conference on Image Processing, ICIP 2007 Proceedings
PublisherIEEE Computer Society
ISBN (Print)1424414377, 9781424414376
DOIs
Publication statusPublished - 2007 Jan 1
Event14th IEEE International Conference on Image Processing, ICIP 2007 - San Antonio, TX, United States
Duration: 2007 Sep 162007 Sep 19

Publication series

NameProceedings - International Conference on Image Processing, ICIP
Volume5
ISSN (Print)1522-4880

Other

Other14th IEEE International Conference on Image Processing, ICIP 2007
CountryUnited States
CitySan Antonio, TX
Period07/9/1607/9/19

Fingerprint

Discrete cosine transforms
Image coding
Computational complexity

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

La, B., Eom, M., & Choe, Y. (2007). Fast mode decision for intra prediction in H.264/AVC encoder. In 2007 IEEE International Conference on Image Processing, ICIP 2007 Proceedings [4379830] (Proceedings - International Conference on Image Processing, ICIP; Vol. 5). IEEE Computer Society. https://doi.org/10.1109/ICIP.2007.4379830
La, Byeongdu ; Eom, Minyoung ; Choe, Yoonsik. / Fast mode decision for intra prediction in H.264/AVC encoder. 2007 IEEE International Conference on Image Processing, ICIP 2007 Proceedings. IEEE Computer Society, 2007. (Proceedings - International Conference on Image Processing, ICIP).
@inproceedings{bb01680643794604a0492d8f9b969e9c,
title = "Fast mode decision for intra prediction in H.264/AVC encoder",
abstract = "The H.264/AVC video coding standard uses the rate distortion optimization (RDO) method to improve the compression performance in the intra prediction. Whereas the computational complexity is increased comparing with previous standards due to this method, even though this standard selects the best coding mode for the current macroblock. In this paper, a fast intra mode decision algorithm for H.264/AVC encoder based on dominant edge direction (DED) is proposed. The algorithm uses the approximation of discrete cosine transform (DCT) coefficient formula. By detecting the DED before intra prediction, 3 modes instead of 9 modes are chosen for RDO calculation to decide the best mode in the 4×4 luma block. For the 16×16 luma and the 8×8 chroma, instead of 4 modes, only 2 modes are chosen. Experimental results show that the computation time of the proposed algorithm is decreased to about 71{\%} of the full search method in the reference code with negligible quality loss.",
author = "Byeongdu La and Minyoung Eom and Yoonsik Choe",
year = "2007",
month = "1",
day = "1",
doi = "10.1109/ICIP.2007.4379830",
language = "English",
isbn = "1424414377",
series = "Proceedings - International Conference on Image Processing, ICIP",
publisher = "IEEE Computer Society",
booktitle = "2007 IEEE International Conference on Image Processing, ICIP 2007 Proceedings",
address = "United States",

}

La, B, Eom, M & Choe, Y 2007, Fast mode decision for intra prediction in H.264/AVC encoder. in 2007 IEEE International Conference on Image Processing, ICIP 2007 Proceedings., 4379830, Proceedings - International Conference on Image Processing, ICIP, vol. 5, IEEE Computer Society, 14th IEEE International Conference on Image Processing, ICIP 2007, San Antonio, TX, United States, 07/9/16. https://doi.org/10.1109/ICIP.2007.4379830

Fast mode decision for intra prediction in H.264/AVC encoder. / La, Byeongdu; Eom, Minyoung; Choe, Yoonsik.

2007 IEEE International Conference on Image Processing, ICIP 2007 Proceedings. IEEE Computer Society, 2007. 4379830 (Proceedings - International Conference on Image Processing, ICIP; Vol. 5).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Fast mode decision for intra prediction in H.264/AVC encoder

AU - La, Byeongdu

AU - Eom, Minyoung

AU - Choe, Yoonsik

PY - 2007/1/1

Y1 - 2007/1/1

N2 - The H.264/AVC video coding standard uses the rate distortion optimization (RDO) method to improve the compression performance in the intra prediction. Whereas the computational complexity is increased comparing with previous standards due to this method, even though this standard selects the best coding mode for the current macroblock. In this paper, a fast intra mode decision algorithm for H.264/AVC encoder based on dominant edge direction (DED) is proposed. The algorithm uses the approximation of discrete cosine transform (DCT) coefficient formula. By detecting the DED before intra prediction, 3 modes instead of 9 modes are chosen for RDO calculation to decide the best mode in the 4×4 luma block. For the 16×16 luma and the 8×8 chroma, instead of 4 modes, only 2 modes are chosen. Experimental results show that the computation time of the proposed algorithm is decreased to about 71% of the full search method in the reference code with negligible quality loss.

AB - The H.264/AVC video coding standard uses the rate distortion optimization (RDO) method to improve the compression performance in the intra prediction. Whereas the computational complexity is increased comparing with previous standards due to this method, even though this standard selects the best coding mode for the current macroblock. In this paper, a fast intra mode decision algorithm for H.264/AVC encoder based on dominant edge direction (DED) is proposed. The algorithm uses the approximation of discrete cosine transform (DCT) coefficient formula. By detecting the DED before intra prediction, 3 modes instead of 9 modes are chosen for RDO calculation to decide the best mode in the 4×4 luma block. For the 16×16 luma and the 8×8 chroma, instead of 4 modes, only 2 modes are chosen. Experimental results show that the computation time of the proposed algorithm is decreased to about 71% of the full search method in the reference code with negligible quality loss.

UR - http://www.scopus.com/inward/record.url?scp=48149100426&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=48149100426&partnerID=8YFLogxK

U2 - 10.1109/ICIP.2007.4379830

DO - 10.1109/ICIP.2007.4379830

M3 - Conference contribution

SN - 1424414377

SN - 9781424414376

T3 - Proceedings - International Conference on Image Processing, ICIP

BT - 2007 IEEE International Conference on Image Processing, ICIP 2007 Proceedings

PB - IEEE Computer Society

ER -

La B, Eom M, Choe Y. Fast mode decision for intra prediction in H.264/AVC encoder. In 2007 IEEE International Conference on Image Processing, ICIP 2007 Proceedings. IEEE Computer Society. 2007. 4379830. (Proceedings - International Conference on Image Processing, ICIP). https://doi.org/10.1109/ICIP.2007.4379830