Design of DRAM-NAND flash hybrid main memory and Q-learning-based prefetching method

Su Kyung Yoon, Young Sun Youn, Jeong Geun Kim, Shin Dug Kim

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Owing to the increased need for machine learning and artificial intelligence in current cloud computing systems, the amount of data that needs to be processed has exponentially increased. Thus, it is important to optimize memory and storage systems to reduce the energy consumption and execution time of applications. This paper proposes a new Q-learning-based prefetching algorithm for DRAM–NAND flash hybrid main memory architecture. To minimize the computational overheads of learning-based schemes, we have designed two learning policies, namely aggressive learning and lazy learning. The proposed system reduces the energy consumption by about 80% of the memory and storage for Redis, OpenStack Swift which is a cloud computing open source framework and Apache Storm workloads. Further, the overall execution time of workloads in cloud computing applications is reduced by almost half. Using a path generator with a Q-learning-based prefetching algorithm, we realize an increased hit rate of about 21% compared to that with a no-prefetching system, compared to non-prefetching system.

Original languageEnglish
Pages (from-to)5293-5313
Number of pages21
JournalJournal of Supercomputing
Volume74
Issue number10
DOIs
Publication statusPublished - 2018 Oct 1

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Software
  • Theoretical Computer Science
  • Information Systems
  • Hardware and Architecture

Cite this