Fast algorithms for foveated video processing

Sanghoon Lee, Alan C. Bovik

Research output: Contribution to journalArticle

52 Citations (Scopus)

Abstract

This paper explores the problem of communicating high-quality, foveated video streams in real time. Foveated video exploits the nonuniform resolution of the human visual system by preferentially allocating bits according to the proximity to assumed visual fixation points, thus delivering perceptually high quality at greatly reduced bandwidths. Foveated video streams possess specific data density properties that can be exploited to enhance the efficiency of subsequent video processing. Here, we exploit these properties to construct several efficient foveated video processing algorithms: foveation filtering (local bandwidth reduction), motion estimation, motion compensation, video rate control, and video postprocessing. Our approach leads to enhanced computational efficiency by interpreting nonuniform-density foveated images on the uniform domain and by using a foveation protocol between the encoder and the decoder.

Original languageEnglish
Pages (from-to)149-162
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume13
Issue number2
DOIs
Publication statusPublished - 2003 Feb 1

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Electrical and Electronic Engineering

Cite this