Abstract
Recently, foveated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina. We describe such a framework here where foveated video is created by a nonuniform filtering scheme that increases the compressibility of the video stream. We maximize a new foveal visual quality metric, the foveal signal-to-noise ratio (FSNR) to determine the best compression and rate control parameters for a given target bit rate. Specifically, we establish a new optimal rate control algorithm for maximizing the FSNR using a Lagrange multiplier method defined on a curvilinear coordinate system. For optimal rate control, we also develop a piecewise R-D (rate-distortion)/R-Q (rate-quantization) model. A fast algorithm for searching for an optimal Lagrange multiplier λ* is subsequently presented. For the new models, we show how the reconstructed video quality is affected, where the FPSNR is maximized, and demonstrate the coding performance for H.263,+,++/MPEG-4 video coding. For H.263/MPEG video coding, a suboptimal rate control algorithm is developed for fast, high-performance applications. In the simulations, we compare the reconstructed pictures obtained using optimal rate control methods for foveated and normal video. We show that foveated video coding using the suboptimal rate control algorithm delivers excellent performance under 64 kb/s.
| Original language | English |
|---|---|
| Pages (from-to) | 977-992 |
| Number of pages | 16 |
| Journal | IEEE Transactions on Image Processing |
| Volume | 10 |
| Issue number | 7 |
| DOIs | |
| Publication status | Published - 2001 Jul 1 |
Fingerprint
All Science Journal Classification (ASJC) codes
- Software
- Computer Graphics and Computer-Aided Design
Cite this
}
Foveated video compression with optimal rate control. / Lee, Sanghoon; Pattichis, Marios S.; Bovik, Alan Conrad.
In: IEEE Transactions on Image Processing, Vol. 10, No. 7, 01.07.2001, p. 977-992.Research output: Contribution to journal › Article
TY - JOUR
T1 - Foveated video compression with optimal rate control
AU - Lee, Sanghoon
AU - Pattichis, Marios S.
AU - Bovik, Alan Conrad
PY - 2001/7/1
Y1 - 2001/7/1
N2 - Recently, foveated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina. We describe such a framework here where foveated video is created by a nonuniform filtering scheme that increases the compressibility of the video stream. We maximize a new foveal visual quality metric, the foveal signal-to-noise ratio (FSNR) to determine the best compression and rate control parameters for a given target bit rate. Specifically, we establish a new optimal rate control algorithm for maximizing the FSNR using a Lagrange multiplier method defined on a curvilinear coordinate system. For optimal rate control, we also develop a piecewise R-D (rate-distortion)/R-Q (rate-quantization) model. A fast algorithm for searching for an optimal Lagrange multiplier λ* is subsequently presented. For the new models, we show how the reconstructed video quality is affected, where the FPSNR is maximized, and demonstrate the coding performance for H.263,+,++/MPEG-4 video coding. For H.263/MPEG video coding, a suboptimal rate control algorithm is developed for fast, high-performance applications. In the simulations, we compare the reconstructed pictures obtained using optimal rate control methods for foveated and normal video. We show that foveated video coding using the suboptimal rate control algorithm delivers excellent performance under 64 kb/s.
AB - Recently, foveated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina. We describe such a framework here where foveated video is created by a nonuniform filtering scheme that increases the compressibility of the video stream. We maximize a new foveal visual quality metric, the foveal signal-to-noise ratio (FSNR) to determine the best compression and rate control parameters for a given target bit rate. Specifically, we establish a new optimal rate control algorithm for maximizing the FSNR using a Lagrange multiplier method defined on a curvilinear coordinate system. For optimal rate control, we also develop a piecewise R-D (rate-distortion)/R-Q (rate-quantization) model. A fast algorithm for searching for an optimal Lagrange multiplier λ* is subsequently presented. For the new models, we show how the reconstructed video quality is affected, where the FPSNR is maximized, and demonstrate the coding performance for H.263,+,++/MPEG-4 video coding. For H.263/MPEG video coding, a suboptimal rate control algorithm is developed for fast, high-performance applications. In the simulations, we compare the reconstructed pictures obtained using optimal rate control methods for foveated and normal video. We show that foveated video coding using the suboptimal rate control algorithm delivers excellent performance under 64 kb/s.
UR - http://www.scopus.com/inward/record.url?scp=0035397795&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0035397795&partnerID=8YFLogxK
U2 - 10.1109/83.931092
DO - 10.1109/83.931092
M3 - Article
VL - 10
SP - 977
EP - 992
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
SN - 1057-7149
IS - 7
ER -