Perceptually unequal packet loss protection by weighting saliency and error propagation

Hojin Ha, Jincheol Park, Sanghoon Lee, Alan Conrad Bovik

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

We describe a method for achieving perceptually minimal video distortion over packet-erasure networks using perceptually unequal loss protection (PULP). There are two main ingredients in the algorithm. First, a perceptual weighting scheme is employed wherein the compressed video is weighted as a function of the nonuniform distribution of retinal photoreceptors. Secondly, packets are assigned temporal importance within each group of pictures (GOP), recognizing that the severity of error propagation increases with elapsed time within a GOP. Using both frame-level perceptual importance and GOP-level hierarchical importance, the PULP algorithm seeks efficient forward error correction assignment that balances efficiency and fairness by controlling the size of identified salient region(s) relative to the channel state. PULP demonstrates robust performance and significantly improved subjective and objective visual quality in the face of burst packet losses.

Original languageEnglish
Article number5473075
Pages (from-to)1187-1199
Number of pages13
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume20
Issue number9
DOIs
Publication statusPublished - 2010 Sep 1

Fingerprint

Packet loss
Forward error correction
Packet networks

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Electrical and Electronic Engineering

Cite this

@article{43a0b037bf1c4a2795b986d5c5cf7762,
title = "Perceptually unequal packet loss protection by weighting saliency and error propagation",
abstract = "We describe a method for achieving perceptually minimal video distortion over packet-erasure networks using perceptually unequal loss protection (PULP). There are two main ingredients in the algorithm. First, a perceptual weighting scheme is employed wherein the compressed video is weighted as a function of the nonuniform distribution of retinal photoreceptors. Secondly, packets are assigned temporal importance within each group of pictures (GOP), recognizing that the severity of error propagation increases with elapsed time within a GOP. Using both frame-level perceptual importance and GOP-level hierarchical importance, the PULP algorithm seeks efficient forward error correction assignment that balances efficiency and fairness by controlling the size of identified salient region(s) relative to the channel state. PULP demonstrates robust performance and significantly improved subjective and objective visual quality in the face of burst packet losses.",
author = "Hojin Ha and Jincheol Park and Sanghoon Lee and Bovik, {Alan Conrad}",
year = "2010",
month = "9",
day = "1",
doi = "10.1109/TCSVT.2010.2051368",
language = "English",
volume = "20",
pages = "1187--1199",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "9",

}

Perceptually unequal packet loss protection by weighting saliency and error propagation. / Ha, Hojin; Park, Jincheol; Lee, Sanghoon; Bovik, Alan Conrad.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 20, No. 9, 5473075, 01.09.2010, p. 1187-1199.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Perceptually unequal packet loss protection by weighting saliency and error propagation

AU - Ha, Hojin

AU - Park, Jincheol

AU - Lee, Sanghoon

AU - Bovik, Alan Conrad

PY - 2010/9/1

Y1 - 2010/9/1

N2 - We describe a method for achieving perceptually minimal video distortion over packet-erasure networks using perceptually unequal loss protection (PULP). There are two main ingredients in the algorithm. First, a perceptual weighting scheme is employed wherein the compressed video is weighted as a function of the nonuniform distribution of retinal photoreceptors. Secondly, packets are assigned temporal importance within each group of pictures (GOP), recognizing that the severity of error propagation increases with elapsed time within a GOP. Using both frame-level perceptual importance and GOP-level hierarchical importance, the PULP algorithm seeks efficient forward error correction assignment that balances efficiency and fairness by controlling the size of identified salient region(s) relative to the channel state. PULP demonstrates robust performance and significantly improved subjective and objective visual quality in the face of burst packet losses.

AB - We describe a method for achieving perceptually minimal video distortion over packet-erasure networks using perceptually unequal loss protection (PULP). There are two main ingredients in the algorithm. First, a perceptual weighting scheme is employed wherein the compressed video is weighted as a function of the nonuniform distribution of retinal photoreceptors. Secondly, packets are assigned temporal importance within each group of pictures (GOP), recognizing that the severity of error propagation increases with elapsed time within a GOP. Using both frame-level perceptual importance and GOP-level hierarchical importance, the PULP algorithm seeks efficient forward error correction assignment that balances efficiency and fairness by controlling the size of identified salient region(s) relative to the channel state. PULP demonstrates robust performance and significantly improved subjective and objective visual quality in the face of burst packet losses.

UR - http://www.scopus.com/inward/record.url?scp=77956820596&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77956820596&partnerID=8YFLogxK

U2 - 10.1109/TCSVT.2010.2051368

DO - 10.1109/TCSVT.2010.2051368

M3 - Article

AN - SCOPUS:77956820596

VL - 20

SP - 1187

EP - 1199

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 9

M1 - 5473075

ER -