Foveated video compression with optimal rate control

Sanghoon Lee, Marios S. Pattichis, Alan Conrad Bovik

Research output: Contribution to journalArticle

106 Citations (Scopus)

Abstract

Recently, foveated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina. We describe such a framework here where foveated video is created by a nonuniform filtering scheme that increases the compressibility of the video stream. We maximize a new foveal visual quality metric, the foveal signal-to-noise ratio (FSNR) to determine the best compression and rate control parameters for a given target bit rate. Specifically, we establish a new optimal rate control algorithm for maximizing the FSNR using a Lagrange multiplier method defined on a curvilinear coordinate system. For optimal rate control, we also develop a piecewise R-D (rate-distortion)/R-Q (rate-quantization) model. A fast algorithm for searching for an optimal Lagrange multiplier λ* is subsequently presented. For the new models, we show how the reconstructed video quality is affected, where the FPSNR is maximized, and demonstrate the coding performance for H.263,+,++/MPEG-4 video coding. For H.263/MPEG video coding, a suboptimal rate control algorithm is developed for fast, high-performance applications. In the simulations, we compare the reconstructed pictures obtained using optimal rate control methods for foveated and normal video. We show that foveated video coding using the suboptimal rate control algorithm delivers excellent performance under 64 kb/s.

Original languageEnglish
Pages (from-to)977-992
Number of pages16
JournalIEEE Transactions on Image Processing
Volume10
Issue number7
DOIs
Publication statusPublished - 2001 Jul 1

Fingerprint

Image compression
Image coding
Lagrange multipliers
Signal-To-Noise Ratio
Signal to noise ratio
Compressibility
Retina
Sampling
monomethoxypolyethylene glycol

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this

Lee, Sanghoon ; Pattichis, Marios S. ; Bovik, Alan Conrad. / Foveated video compression with optimal rate control. In: IEEE Transactions on Image Processing. 2001 ; Vol. 10, No. 7. pp. 977-992.
@article{895a56f1639b460aa9e9e23871caf431,
title = "Foveated video compression with optimal rate control",
abstract = "Recently, foveated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina. We describe such a framework here where foveated video is created by a nonuniform filtering scheme that increases the compressibility of the video stream. We maximize a new foveal visual quality metric, the foveal signal-to-noise ratio (FSNR) to determine the best compression and rate control parameters for a given target bit rate. Specifically, we establish a new optimal rate control algorithm for maximizing the FSNR using a Lagrange multiplier method defined on a curvilinear coordinate system. For optimal rate control, we also develop a piecewise R-D (rate-distortion)/R-Q (rate-quantization) model. A fast algorithm for searching for an optimal Lagrange multiplier λ* is subsequently presented. For the new models, we show how the reconstructed video quality is affected, where the FPSNR is maximized, and demonstrate the coding performance for H.263,+,++/MPEG-4 video coding. For H.263/MPEG video coding, a suboptimal rate control algorithm is developed for fast, high-performance applications. In the simulations, we compare the reconstructed pictures obtained using optimal rate control methods for foveated and normal video. We show that foveated video coding using the suboptimal rate control algorithm delivers excellent performance under 64 kb/s.",
author = "Sanghoon Lee and Pattichis, {Marios S.} and Bovik, {Alan Conrad}",
year = "2001",
month = "7",
day = "1",
doi = "10.1109/83.931092",
language = "English",
volume = "10",
pages = "977--992",
journal = "IEEE Transactions on Image Processing",
issn = "1057-7149",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "7",

}

Foveated video compression with optimal rate control. / Lee, Sanghoon; Pattichis, Marios S.; Bovik, Alan Conrad.

In: IEEE Transactions on Image Processing, Vol. 10, No. 7, 01.07.2001, p. 977-992.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Foveated video compression with optimal rate control

AU - Lee, Sanghoon

AU - Pattichis, Marios S.

AU - Bovik, Alan Conrad

PY - 2001/7/1

Y1 - 2001/7/1

N2 - Recently, foveated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina. We describe such a framework here where foveated video is created by a nonuniform filtering scheme that increases the compressibility of the video stream. We maximize a new foveal visual quality metric, the foveal signal-to-noise ratio (FSNR) to determine the best compression and rate control parameters for a given target bit rate. Specifically, we establish a new optimal rate control algorithm for maximizing the FSNR using a Lagrange multiplier method defined on a curvilinear coordinate system. For optimal rate control, we also develop a piecewise R-D (rate-distortion)/R-Q (rate-quantization) model. A fast algorithm for searching for an optimal Lagrange multiplier λ* is subsequently presented. For the new models, we show how the reconstructed video quality is affected, where the FPSNR is maximized, and demonstrate the coding performance for H.263,+,++/MPEG-4 video coding. For H.263/MPEG video coding, a suboptimal rate control algorithm is developed for fast, high-performance applications. In the simulations, we compare the reconstructed pictures obtained using optimal rate control methods for foveated and normal video. We show that foveated video coding using the suboptimal rate control algorithm delivers excellent performance under 64 kb/s.

AB - Recently, foveated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina. We describe such a framework here where foveated video is created by a nonuniform filtering scheme that increases the compressibility of the video stream. We maximize a new foveal visual quality metric, the foveal signal-to-noise ratio (FSNR) to determine the best compression and rate control parameters for a given target bit rate. Specifically, we establish a new optimal rate control algorithm for maximizing the FSNR using a Lagrange multiplier method defined on a curvilinear coordinate system. For optimal rate control, we also develop a piecewise R-D (rate-distortion)/R-Q (rate-quantization) model. A fast algorithm for searching for an optimal Lagrange multiplier λ* is subsequently presented. For the new models, we show how the reconstructed video quality is affected, where the FPSNR is maximized, and demonstrate the coding performance for H.263,+,++/MPEG-4 video coding. For H.263/MPEG video coding, a suboptimal rate control algorithm is developed for fast, high-performance applications. In the simulations, we compare the reconstructed pictures obtained using optimal rate control methods for foveated and normal video. We show that foveated video coding using the suboptimal rate control algorithm delivers excellent performance under 64 kb/s.

UR - http://www.scopus.com/inward/record.url?scp=0035397795&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035397795&partnerID=8YFLogxK

U2 - 10.1109/83.931092

DO - 10.1109/83.931092

M3 - Article

VL - 10

SP - 977

EP - 992

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

SN - 1057-7149

IS - 7

ER -