MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism

Kyungtae Song; Jaehyung Kim; Doogie Lee; Sanghyun Park

doi:10.1007/978-981-10-6520-0_15

MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism

Kyungtae Song, Jaehyung Kim, Doogie Lee, Sanghyun Park

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.

Original language	English
Title of host publication	Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory
Editors	Wonik Choi, Wookey Lee, Min Song, Sungwon Jung
Publisher	Springer Verlag
Pages	138-150
Number of pages	13
ISBN (Print)	9789811065194
DOIs	https://doi.org/10.1007/978-981-10-6520-0_15
Publication status	Published - 2018
Event	7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017 - Busan, Korea, Republic of Duration: 2017 Aug 7 → 2017 Aug 9

Publication series

Name	Lecture Notes in Electrical Engineering
Volume	461
ISSN (Print)	1876-1100
ISSN (Electronic)	1876-1119

Other

Other	7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017
Country/Territory	Korea, Republic of
City	Busan
Period	17/8/7 → 17/8/9

Bibliographical note

Funding Information:
Acknowledgement. This research was supported by the MSIP, Korea, under the “SW Starlab” (IITP-2017-0-00477) supervised by the IITP (Institute for Information & communications Technology Promotion).

Publisher Copyright:
© 2018, Springer Nature Singapore Pte Ltd.

All Science Journal Classification (ASJC) codes

Industrial and Manufacturing Engineering

Access to Document

10.1007/978-981-10-6520-0_15

Cite this

Song, K., Kim, J., Lee, D., & Park, S. (2018). MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism. In W. Choi, W. Lee, M. Song, & S. Jung (Eds.), Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory (pp. 138-150). (Lecture Notes in Electrical Engineering; Vol. 461). Springer Verlag. https://doi.org/10.1007/978-981-10-6520-0_15

Song, Kyungtae ; Kim, Jaehyung ; Lee, Doogie ; Park, Sanghyun. / MultiPath MultiGet : An Optimized Multiget Method Leveraging SSD Internal Parallelism. Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory. editor / Wonik Choi ; Wookey Lee ; Min Song ; Sungwon Jung. Springer Verlag, 2018. pp. 138-150 (Lecture Notes in Electrical Engineering).

@inproceedings{536097d3e8954c13bd1e95c1a5933df6,

title = "MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism",

abstract = "Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.",

author = "Kyungtae Song and Jaehyung Kim and Doogie Lee and Sanghyun Park",

note = "Funding Information: Acknowledgement. This research was supported by the MSIP, Korea, under the “SW Starlab” (IITP-2017-0-00477) supervised by the IITP (Institute for Information & communications Technology Promotion). Publisher Copyright: {\textcopyright} 2018, Springer Nature Singapore Pte Ltd.; 7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017 ; Conference date: 07-08-2017 Through 09-08-2017",

year = "2018",

doi = "10.1007/978-981-10-6520-0_15",

language = "English",

isbn = "9789811065194",

series = "Lecture Notes in Electrical Engineering",

publisher = "Springer Verlag",

pages = "138--150",

editor = "Wonik Choi and Wookey Lee and Min Song and Sungwon Jung",

booktitle = "Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory",

address = "Germany",

}

Song, K, Kim, J, Lee, D & Park, S 2018, MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism. in W Choi, W Lee, M Song & S Jung (eds), Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory. Lecture Notes in Electrical Engineering, vol. 461, Springer Verlag, pp. 138-150, 7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017, Busan, Korea, Republic of, 17/8/7. https://doi.org/10.1007/978-981-10-6520-0_15

MultiPath MultiGet : An Optimized Multiget Method Leveraging SSD Internal Parallelism. / Song, Kyungtae; Kim, Jaehyung; Lee, Doogie; Park, Sanghyun.

Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory. ed. / Wonik Choi; Wookey Lee; Min Song; Sungwon Jung. Springer Verlag, 2018. p. 138-150 (Lecture Notes in Electrical Engineering; Vol. 461).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - MultiPath MultiGet

T2 - 7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017

AU - Song, Kyungtae

AU - Kim, Jaehyung

AU - Lee, Doogie

AU - Park, Sanghyun

N1 - Funding Information: Acknowledgement. This research was supported by the MSIP, Korea, under the “SW Starlab” (IITP-2017-0-00477) supervised by the IITP (Institute for Information & communications Technology Promotion). Publisher Copyright: © 2018, Springer Nature Singapore Pte Ltd.

PY - 2018

Y1 - 2018

N2 - Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.

AB - Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.

UR - http://www.scopus.com/inward/record.url?scp=85032473790&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85032473790&partnerID=8YFLogxK

U2 - 10.1007/978-981-10-6520-0_15

DO - 10.1007/978-981-10-6520-0_15

M3 - Conference contribution

AN - SCOPUS:85032473790

SN - 9789811065194

T3 - Lecture Notes in Electrical Engineering

SP - 138

EP - 150

BT - Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory

A2 - Choi, Wonik

A2 - Lee, Wookey

A2 - Song, Min

A2 - Jung, Sungwon

PB - Springer Verlag

Y2 - 7 August 2017 through 9 August 2017

ER -

Song K, Kim J, Lee D, Park S. MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism. In Choi W, Lee W, Song M, Jung S, editors, Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory. Springer Verlag. 2018. p. 138-150. (Lecture Notes in Electrical Engineering). https://doi.org/10.1007/978-981-10-6520-0_15

MultiPath MultiGet: An Optimized Multiget Method Leveraging SSD Internal Parallelism

Abstract

Publication series

Other

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this