Exploring the future of out-of-core computing with compute-local non-volatile memory

Myoungsoo Jung, Ellis H. Wilson, Wonil Choi, John Shalf, Hasan Metin Aktulga, Chao Yang, Erik Saule, Umit V. Catalyurek, Mahmut Kandemir

Research output: Contribution to journalArticle

1 Citation (Scopus)


Drawing parallels to the rise of general purpose graphical processing units (GPGPUs) as accelerators for specific high-performance computing (HPC) workloads, there is a rise in the use of non-volatile memory (NVM) as accelerators for I/O-intensive scientific applications. However, existing works have explored use of NVM within dedicated I/O nodes, which are distant from the compute nodes that actually need such acceleration. As NVM bandwidth begins to out-pace point-to-point network capacity, we argue for the need to break from the archetype of completely separated storage. Therefore, in this work we investigate co-location of NVM and compute by varying I/O interfaces, file systems, types of NVM, and both current and future SSD architectures, uncovering numerous bottlenecks implicit in these various levels in the I/O stack. We present novel hardware and software solutions, including the new Unified File System (UFS), to enable fuller utilization of the new compute-local NVM storage. Our experimental evaluation, which employs a real-world Out-of-Core (OoC) HPC application, demonstrates throughput increases in excess of an order of magnitude over current approaches.

Original languageEnglish
Pages (from-to)125-139
Number of pages15
JournalScientific Programming
Issue number2
Publication statusPublished - 2014

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Exploring the future of out-of-core computing with compute-local non-volatile memory'. Together they form a unique fingerprint.

  • Cite this

    Jung, M., Wilson, E. H., Choi, W., Shalf, J., Aktulga, H. M., Yang, C., Saule, E., Catalyurek, U. V., & Kandemir, M. (2014). Exploring the future of out-of-core computing with compute-local non-volatile memory. Scientific Programming, 22(2), 125-139. https://doi.org/10.3233/SPR-140384