The storage hierarchy is not a hierarchy: Optimizing caching on modern storage devices with orthus

Kan Wu; Zhihan Guo; Guanzhou Hu; Kaiwei Tu; Ramnatthan Alagappan; Rathijit Sen; Kwanghyun Park; Andrea C. Arpaci-Dusseau; Remzi H. Arpaci-Dusseau

The storage hierarchy is not a hierarchy: Optimizing caching on modern storage devices with orthus

Kan Wu, Zhihan Guo, Guanzhou Hu, Kaiwei Tu, Ramnatthan Alagappan, Rathijit Sen, Kwanghyun Park, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We introduce non-hierarchical caching (NHC), a novel approach to caching in modern storage hierarchies. NHC improves performance as compared to classic caching by redirecting excess load to devices lower in the hierarchy when it is advantageous to do so. NHC dynamically adjusts allocation and access decisions, thus maximizing performance (e.g., high throughput, low 99%-ile latency). We implement NHC in Orthus-CAS (a block-layer caching kernel module) and Orthus-KV (a user-level caching layer for a key-value store). We show the efficacy of NHC via a thorough empirical study: Orthus-KV and Orthus-CAS offer significantly better performance (by up to 2) than classic caching on various modern hierarchies, under a range of realistic workloads.

Original language	English
Title of host publication	Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021
Publisher	USENIX Association
Pages	307-323
Number of pages	17
ISBN (Electronic)	9781939133205
Publication status	Published - 2021
Event	19th USENIX Conference on File and Storage Technologies, FAST 2021 - Virtual, Online Duration: 2021 Feb 23 → 2021 Feb 25

Publication series

Name	Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021

Conference

Conference	19th USENIX Conference on File and Storage Technologies, FAST 2021
City	Virtual, Online
Period	21/2/23 → 21/2/25

Bibliographical note

Funding Information:
We thank Song Jiang (our shepherd), the anonymous reviewers and the members of ADSL for their valuable input. This material was supported by funding from NSF CNS-1838733, CNS-1763810, VMware, Intel, Seagate, and Microsoft. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and may not reflect the views of NSF or any other institutions.

Publisher Copyright:
© 2021 by The USENIX Association.

All Science Journal Classification (ASJC) codes

Computer Networks and Communications
Hardware and Architecture
Software

Cite this

Wu, K., Guo, Z., Hu, G., Tu, K., Alagappan, R., Sen, R., Park, K., Arpaci-Dusseau, A. C., & Arpaci-Dusseau, R. H. (2021). The storage hierarchy is not a hierarchy: Optimizing caching on modern storage devices with orthus. In Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021 (pp. 307-323). (Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021). USENIX Association.

@inproceedings{1432f03aa97d4cd6b0c7fd6bf735f92d,

title = "The storage hierarchy is not a hierarchy: Optimizing caching on modern storage devices with orthus",

abstract = "We introduce non-hierarchical caching (NHC), a novel approach to caching in modern storage hierarchies. NHC improves performance as compared to classic caching by redirecting excess load to devices lower in the hierarchy when it is advantageous to do so. NHC dynamically adjusts allocation and access decisions, thus maximizing performance (e.g., high throughput, low 99%-ile latency). We implement NHC in Orthus-CAS (a block-layer caching kernel module) and Orthus-KV (a user-level caching layer for a key-value store). We show the efficacy of NHC via a thorough empirical study: Orthus-KV and Orthus-CAS offer significantly better performance (by up to 2) than classic caching on various modern hierarchies, under a range of realistic workloads.",

author = "Kan Wu and Zhihan Guo and Guanzhou Hu and Kaiwei Tu and Ramnatthan Alagappan and Rathijit Sen and Kwanghyun Park and Arpaci-Dusseau, {Andrea C.} and Arpaci-Dusseau, {Remzi H.}",

note = "Funding Information: We thank Song Jiang (our shepherd), the anonymous reviewers and the members of ADSL for their valuable input. This material was supported by funding from NSF CNS-1838733, CNS-1763810, VMware, Intel, Seagate, and Microsoft. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and may not reflect the views of NSF or any other institutions. Publisher Copyright: {\textcopyright} 2021 by The USENIX Association.; 19th USENIX Conference on File and Storage Technologies, FAST 2021 ; Conference date: 23-02-2021 Through 25-02-2021",

year = "2021",

language = "English",

series = "Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021",

publisher = "USENIX Association",

pages = "307--323",

booktitle = "Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021",

}

Wu, K, Guo, Z, Hu, G, Tu, K, Alagappan, R, Sen, R, Park, K, Arpaci-Dusseau, AC & Arpaci-Dusseau, RH 2021, The storage hierarchy is not a hierarchy: Optimizing caching on modern storage devices with orthus. in Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021. Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021, USENIX Association, pp. 307-323, 19th USENIX Conference on File and Storage Technologies, FAST 2021, Virtual, Online, 21/2/23.

The storage hierarchy is not a hierarchy : Optimizing caching on modern storage devices with orthus. / Wu, Kan; Guo, Zhihan; Hu, Guanzhou et al.

Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021. USENIX Association, 2021. p. 307-323 (Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - The storage hierarchy is not a hierarchy

T2 - 19th USENIX Conference on File and Storage Technologies, FAST 2021

AU - Wu, Kan

AU - Guo, Zhihan

AU - Hu, Guanzhou

AU - Tu, Kaiwei

AU - Alagappan, Ramnatthan

AU - Sen, Rathijit

AU - Park, Kwanghyun

AU - Arpaci-Dusseau, Andrea C.

AU - Arpaci-Dusseau, Remzi H.

N1 - Funding Information: We thank Song Jiang (our shepherd), the anonymous reviewers and the members of ADSL for their valuable input. This material was supported by funding from NSF CNS-1838733, CNS-1763810, VMware, Intel, Seagate, and Microsoft. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and may not reflect the views of NSF or any other institutions. Publisher Copyright: © 2021 by The USENIX Association.

PY - 2021

Y1 - 2021

N2 - We introduce non-hierarchical caching (NHC), a novel approach to caching in modern storage hierarchies. NHC improves performance as compared to classic caching by redirecting excess load to devices lower in the hierarchy when it is advantageous to do so. NHC dynamically adjusts allocation and access decisions, thus maximizing performance (e.g., high throughput, low 99%-ile latency). We implement NHC in Orthus-CAS (a block-layer caching kernel module) and Orthus-KV (a user-level caching layer for a key-value store). We show the efficacy of NHC via a thorough empirical study: Orthus-KV and Orthus-CAS offer significantly better performance (by up to 2) than classic caching on various modern hierarchies, under a range of realistic workloads.

AB - We introduce non-hierarchical caching (NHC), a novel approach to caching in modern storage hierarchies. NHC improves performance as compared to classic caching by redirecting excess load to devices lower in the hierarchy when it is advantageous to do so. NHC dynamically adjusts allocation and access decisions, thus maximizing performance (e.g., high throughput, low 99%-ile latency). We implement NHC in Orthus-CAS (a block-layer caching kernel module) and Orthus-KV (a user-level caching layer for a key-value store). We show the efficacy of NHC via a thorough empirical study: Orthus-KV and Orthus-CAS offer significantly better performance (by up to 2) than classic caching on various modern hierarchies, under a range of realistic workloads.

UR - http://www.scopus.com/inward/record.url?scp=85102981521&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85102981521&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85102981521

T3 - Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021

SP - 307

EP - 323

BT - Proceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021

PB - USENIX Association

Y2 - 23 February 2021 through 25 February 2021

ER -

The storage hierarchy is not a hierarchy: Optimizing caching on modern storage devices with orthus

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Other files and links

Fingerprint

Cite this