Block artifact reduction in BMA-based super-resolution video processing

Young Wook Sohn, Moon Gi Kang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Super-resolution (SR) video processing method with reduced block artifacts using conventional block-matching algorithm (BMA) is proposed. To get high-quality SR results, accurate motion vectors are necessary in registration process. For real-time applications, block-based motion estimators are widely used, which show block-based motion errors if their motion vectors are employed for the registration. Incorrectly registered pixels due to the block-based motion errors limit the image quality improvement of the SR processing and even degrade the results by causing block artifacts. To reduce the artifacts from the inaccurately registered pixels, a weighting function using three-dimensional confidence measure is proposed in this paper. The measure uses spatial and inter-channel analysis to suppress the weight on incorrectly registered pixels during the SR process. Motion-compensated pixel differences and motion vector variances between previous and current frames are utilized for spatial analysis, and motion vector variance with constant acceleration model and pixel difference variances through LR frames are used for inter-channel analysis. Experimental results show significantly improved results in error regions keeping enhanced quality with accurately registered pixels, when motion vectors are found by conventional BMAs.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging -Image Processing
Subtitle of host publicationAlgorithms and Systems VI
DOIs
Publication statusPublished - 2008 May 15
EventImage Processing: Algorithms and Systems VI - San Jose, CA, United States
Duration: 2008 Jan 282008 Jan 29

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume6812
ISSN (Print)0277-786X

Other

OtherImage Processing: Algorithms and Systems VI
CountryUnited States
CitySan Jose, CA
Period08/1/2808/1/29

Fingerprint

artifacts
Pixels
Processing
pixels
Image quality
weighting functions
estimators
confidence

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Sohn, Y. W., & Kang, M. G. (2008). Block artifact reduction in BMA-based super-resolution video processing. In Proceedings of SPIE-IS and T Electronic Imaging -Image Processing: Algorithms and Systems VI [681212] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 6812). https://doi.org/10.1117/12.766197
Sohn, Young Wook ; Kang, Moon Gi. / Block artifact reduction in BMA-based super-resolution video processing. Proceedings of SPIE-IS and T Electronic Imaging -Image Processing: Algorithms and Systems VI. 2008. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{0db306b8693a4106b150f715b51ee55f,
title = "Block artifact reduction in BMA-based super-resolution video processing",
abstract = "Super-resolution (SR) video processing method with reduced block artifacts using conventional block-matching algorithm (BMA) is proposed. To get high-quality SR results, accurate motion vectors are necessary in registration process. For real-time applications, block-based motion estimators are widely used, which show block-based motion errors if their motion vectors are employed for the registration. Incorrectly registered pixels due to the block-based motion errors limit the image quality improvement of the SR processing and even degrade the results by causing block artifacts. To reduce the artifacts from the inaccurately registered pixels, a weighting function using three-dimensional confidence measure is proposed in this paper. The measure uses spatial and inter-channel analysis to suppress the weight on incorrectly registered pixels during the SR process. Motion-compensated pixel differences and motion vector variances between previous and current frames are utilized for spatial analysis, and motion vector variance with constant acceleration model and pixel difference variances through LR frames are used for inter-channel analysis. Experimental results show significantly improved results in error regions keeping enhanced quality with accurately registered pixels, when motion vectors are found by conventional BMAs.",
author = "Sohn, {Young Wook} and Kang, {Moon Gi}",
year = "2008",
month = "5",
day = "15",
doi = "10.1117/12.766197",
language = "English",
isbn = "9780819469847",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
booktitle = "Proceedings of SPIE-IS and T Electronic Imaging -Image Processing",

}

Sohn, YW & Kang, MG 2008, Block artifact reduction in BMA-based super-resolution video processing. in Proceedings of SPIE-IS and T Electronic Imaging -Image Processing: Algorithms and Systems VI., 681212, Proceedings of SPIE - The International Society for Optical Engineering, vol. 6812, Image Processing: Algorithms and Systems VI, San Jose, CA, United States, 08/1/28. https://doi.org/10.1117/12.766197

Block artifact reduction in BMA-based super-resolution video processing. / Sohn, Young Wook; Kang, Moon Gi.

Proceedings of SPIE-IS and T Electronic Imaging -Image Processing: Algorithms and Systems VI. 2008. 681212 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 6812).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Block artifact reduction in BMA-based super-resolution video processing

AU - Sohn, Young Wook

AU - Kang, Moon Gi

PY - 2008/5/15

Y1 - 2008/5/15

N2 - Super-resolution (SR) video processing method with reduced block artifacts using conventional block-matching algorithm (BMA) is proposed. To get high-quality SR results, accurate motion vectors are necessary in registration process. For real-time applications, block-based motion estimators are widely used, which show block-based motion errors if their motion vectors are employed for the registration. Incorrectly registered pixels due to the block-based motion errors limit the image quality improvement of the SR processing and even degrade the results by causing block artifacts. To reduce the artifacts from the inaccurately registered pixels, a weighting function using three-dimensional confidence measure is proposed in this paper. The measure uses spatial and inter-channel analysis to suppress the weight on incorrectly registered pixels during the SR process. Motion-compensated pixel differences and motion vector variances between previous and current frames are utilized for spatial analysis, and motion vector variance with constant acceleration model and pixel difference variances through LR frames are used for inter-channel analysis. Experimental results show significantly improved results in error regions keeping enhanced quality with accurately registered pixels, when motion vectors are found by conventional BMAs.

AB - Super-resolution (SR) video processing method with reduced block artifacts using conventional block-matching algorithm (BMA) is proposed. To get high-quality SR results, accurate motion vectors are necessary in registration process. For real-time applications, block-based motion estimators are widely used, which show block-based motion errors if their motion vectors are employed for the registration. Incorrectly registered pixels due to the block-based motion errors limit the image quality improvement of the SR processing and even degrade the results by causing block artifacts. To reduce the artifacts from the inaccurately registered pixels, a weighting function using three-dimensional confidence measure is proposed in this paper. The measure uses spatial and inter-channel analysis to suppress the weight on incorrectly registered pixels during the SR process. Motion-compensated pixel differences and motion vector variances between previous and current frames are utilized for spatial analysis, and motion vector variance with constant acceleration model and pixel difference variances through LR frames are used for inter-channel analysis. Experimental results show significantly improved results in error regions keeping enhanced quality with accurately registered pixels, when motion vectors are found by conventional BMAs.

UR - http://www.scopus.com/inward/record.url?scp=43249086776&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=43249086776&partnerID=8YFLogxK

U2 - 10.1117/12.766197

DO - 10.1117/12.766197

M3 - Conference contribution

AN - SCOPUS:43249086776

SN - 9780819469847

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Proceedings of SPIE-IS and T Electronic Imaging -Image Processing

ER -

Sohn YW, Kang MG. Block artifact reduction in BMA-based super-resolution video processing. In Proceedings of SPIE-IS and T Electronic Imaging -Image Processing: Algorithms and Systems VI. 2008. 681212. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.766197