Locality aware management on NAND flash-based main memory for in-memory database systems

Hyun Jeong Shim, Xian Shu Li, Su Kyung Yoon, Shin Dug Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Conventional database systems manage all data on hard disks, but due to a hard disk's frequent I/O operations, this kind of management exposes critical problems when data is huge or operations are complex and frequent. As the size of the main memory continues to increase, main memory architecture and management becomes the major research trend in big data processing. Thus, we propose an optimized NAND Flash-based main memory (NFMM) structure for in-memory database systems to achieve the goal of having DRAM like performance at the lower cost and power consumption of Flash memory. For this goal, a horizontal combination of DRAM and NAND Flash memory is designed as a main memory model for database applications. A stream buffer and a DRAM buffer are designed to compensate for the slow access latency of Flash memory. Its optimized management method is designed to enhance the accessing locality and manage the stream buffer by prefetching pages. To evaluate the performance, Redis and Yahoo! Cloud Service Benchmark (YCSB) are used. In our experiment, a stream buffer is used to improve the data transfer speed. The result shows that in the proposed system, the execution time can achieve only 1.16x to 1.21x slower on average. At the same time, optimized NAND Flash-based main memory with 40 entries of stream buffer reduces power consumption up to 25% compared to the DRAMbased main memory system.

Original languageEnglish
Title of host publicationProceedings of the 6th International Conference on Emerging Databases
Subtitle of host publicationTechnologies, Applications, and Theory, EDB 2016
EditorsCarson K. Leung
PublisherAssociation for Computing Machinery
Pages90-94
Number of pages5
ISBN (Electronic)9781450347549
DOIs
Publication statusPublished - 2016 Oct 17
Event6th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2016 - Jeju Island, Korea, Republic of
Duration: 2016 Oct 172016 Oct 19

Publication series

NameACM International Conference Proceeding Series

Other

Other6th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2016
CountryKorea, Republic of
CityJeju Island
Period16/10/1716/10/19

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Locality aware management on NAND flash-based main memory for in-memory database systems'. Together they form a unique fingerprint.

Cite this