Intelligent clustering guided adaptive prefetching and buffer management for stream processing

Sung Min Lee, Young Sun Youn, Su Kyung Yoon, Shin Dug Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Real-time stream data processing is required to handle big data with low latency to process a large amount of incessant streaming data. We propose a clustering based intel-igent prefetching scheme and its associated DRAM-PCM (phase change memory) hybrid memory management policy especially for stream processing. To alleviate stream processing's burden of requests accessing main memory, an intelligence prefetching technique is designed to reflect stream processing behavior to reduce the amount of memory access by improving buffer hit ratio. Because stream processing has to guarantee relatively small latency to the users, it is especially important for stream processsing to process the stream data in strict time. By using a hybrid memory structure, we take such advantages like high performance, low energy consumption, and memory scalability. And by using clustering based smart prefetching, we could improve buffer hit rate and because of this, overall system performance can be enhanced. Our proposed architecture and clustering based prefetching method can improve system performance by 1.15 times, compared with hybrid memory and buffer architecture without any prefetching scheme of conventional model and also energy consumption by 1.23 times, compared with DRAM only conventional model.

Original languageEnglish
Title of host publication2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2498-2503
Number of pages6
ISBN (Electronic)9781538616451
DOIs
Publication statusPublished - 2017 Nov 27
Event2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017 - Banff, Canada
Duration: 2017 Oct 52017 Oct 8

Publication series

Name2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
Volume2017-January

Other

Other2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017
CountryCanada
CityBanff
Period17/10/517/10/8

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications
  • Human-Computer Interaction
  • Control and Optimization

Cite this

Lee, S. M., Youn, Y. S., Yoon, S. K., & Kim, S. D. (2017). Intelligent clustering guided adaptive prefetching and buffer management for stream processing. In 2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017 (pp. 2498-2503). (2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017; Vol. 2017-January). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMC.2017.8122999