A novel hardware architecture with reduced internal memory for real-time extraction of SIFT in an HD video

Joohyuk Yum, Chul Hee Lee, Jin Sung Kim, Hyuk Jae Lee

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Scale-invariant feature transform (SIFT) includes complex computations that require hardware implementation for real-time operations. Previous works on SIFT hardware acceleration used a large amount of internal memory, which limited a wider use of SIFT. This paper proposes a new SIFT hardware architecture that significantly reduces the amount of required internal memory by storing temporary data into external memory. The use of external memory demands an excessive bandwidth (BW) for the external memory. In order to reduce the external memory BW, this paper proposes three schemes: 1) local-patch reuse; 2) local-patch subsampling; and 3) fraction-bit truncation. As a result, the proposed hardware processes High Definition (HD)-sized (1280 × 720) video at 36.85 frames/s with an external memory BW of 2.37 B/cycle and an internal memory of 396.03 kbits, which are acceptable for practical use with various applications. This is achieved because the external memory access is reduced to only 4.75% of that without the proposed schemes and also because the size of the internal memory is reduced to 10.93% compared with the size required in the previous work.

Original languageEnglish
Article number7295576
Pages (from-to)1943-1954
Number of pages12
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume26
Issue number10
DOIs
Publication statusPublished - 2016 Oct 1

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Electrical and Electronic Engineering

Cite this