Abstract
Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory |
| Editors | Wonik Choi, Wookey Lee, Min Song, Sungwon Jung |
| Publisher | Springer Verlag |
| Pages | 138-150 |
| Number of pages | 13 |
| ISBN (Print) | 9789811065194 |
| DOIs | |
| Publication status | Published - 2018 Jan 1 |
| Event | 7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017 - Busan, Korea, Republic of Duration: 2017 Aug 7 → 2017 Aug 9 |
Publication series
| Name | Lecture Notes in Electrical Engineering |
|---|---|
| Volume | 461 |
| ISSN (Print) | 1876-1100 |
| ISSN (Electronic) | 1876-1119 |
Other
| Other | 7th International Conference on Emerging Databases: Technologies, Applications, and Theory, EDB 2017 |
|---|---|
| Country | Korea, Republic of |
| City | Busan |
| Period | 17/8/7 → 17/8/9 |
Fingerprint
All Science Journal Classification (ASJC) codes
- Industrial and Manufacturing Engineering
Cite this
}
MultiPath MultiGet : An Optimized Multiget Method Leveraging SSD Internal Parallelism. / Song, Kyungtae; Kim, Jaehyung; Lee, Doogie; Park, Sang Hyun.
Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory. ed. / Wonik Choi; Wookey Lee; Min Song; Sungwon Jung. Springer Verlag, 2018. p. 138-150 (Lecture Notes in Electrical Engineering; Vol. 461).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
TY - GEN
T1 - MultiPath MultiGet
T2 - An Optimized Multiget Method Leveraging SSD Internal Parallelism
AU - Song, Kyungtae
AU - Kim, Jaehyung
AU - Lee, Doogie
AU - Park, Sang Hyun
PY - 2018/1/1
Y1 - 2018/1/1
N2 - Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.
AB - Accessing data with low latency is a major issue for big data platforms. Some platforms use a Multiget method when accessing data. The Multiget method can be used efficiently when a server should seek data with multiple keys or many single get requests are waiting in a command queue. The method is implemented to access multiple blocks of data using multiple keys. In this research, we developed MPMG, a novel multipath Multiget method for a solid state drive (SSD)-based key-value storage. In MPMG, we use the open source key-value storage RocksDB, which was developed by Facebook and is one of the most representative key-value NoSQL stores. Current RocksDB system cannot fully utilize the internal parallelism of SSD. The MPMG method was designed to leverage ssd internal parallelism and access data in SSD with parallel approach. The ability to support the parallel access inside SSD is efficient for performance. With multipath approach, the SSD can fully exploit its bandwidth, compared to the original approach. In an experiment, this method showed improvements in speed and throughput. The elapsed time for processing decreased up to 80.
UR - http://www.scopus.com/inward/record.url?scp=85032473790&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85032473790&partnerID=8YFLogxK
U2 - 10.1007/978-981-10-6520-0_15
DO - 10.1007/978-981-10-6520-0_15
M3 - Conference contribution
SN - 9789811065194
T3 - Lecture Notes in Electrical Engineering
SP - 138
EP - 150
BT - Proceedings of the 7th International Conference on Emerging Databases - Technologies, Applications, and Theory
A2 - Choi, Wonik
A2 - Lee, Wookey
A2 - Song, Min
A2 - Jung, Sungwon
PB - Springer Verlag
ER -