MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism

Kyungtae Song, Jaehyung Kim, Doogie Lee, Sanghyun Park

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.

Original languageEnglish
Title of host publicationProceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory
EditorsWonik Choi, Wookey Lee, Min Song, Sungwon Jung
PublisherSpringer Verlag
Pages138-150
Number of pages13
ISBN (Print)9789811065194
DOIs
Publication statusPublished - 2018 Jan 1
Event7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017 - Busan, Korea, Republic of
Duration: 2017 Aug 72017 Aug 9

Publication series

NameLecture Notes in Electrical Engineering
Volume461
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Other

Other7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017
CountryKorea, Republic of
CityBusan
Period17/8/717/8/9

All Science Journal Classification (ASJC) codes

  • Industrial and Manufacturing Engineering

Fingerprint Dive into the research topics of 'MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism'. Together they form a unique fingerprint.

  • Cite this

    Song, K., Kim, J., Lee, D., & Park, S. (2018). MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism. In W. Choi, W. Lee, M. Song, & S. Jung (Eds.), Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory (pp. 138-150). (Lecture Notes in Electrical Engineering; Vol. 461). Springer Verlag. https://doi.org/10.1007/978-981-10-6520-0_15