DRAW: Investigating benefits of adaptive fetch group size on GPU

Myung Kuk Yoon, Yunho Oh, Sangpil Lee, Seung Hun Kim, Deokho Kim, Won Woo Ro

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Previously, hiding operation stalls is one of the important issues to suppress performance degradation of Graphics Processing Units (GPUs). In this paper, we first conduct a detailed study of factors affecting the operation stalls in terms of the fetch group size on the warp scheduler. Throughout this paper, we find that the size of fetch group is highly involved in hiding various types of operation stalls. The short latency stalls can be hidden by issuing other available warps from the same fetch group. Therefore, the short latency stalls may not be hidden well under small sized fetch group since the group has the limited number of issuable warps to hide stalls. On the contrary, the long latency stalls can be hidden by dividing warps into multiple fetch groups. The scheduler switches the fetch groups when the warps in each fetch group reach the long latency memory operation point. Therefore, the stalls may not be hidden well at the large sized fetch group. Increasing the size of fetch group reduces the number of fetch groups to hide the stalls. In addition, the load/store unit stalls are caused by the limited hardware resources to handle the memory operations. To hide all these stalls effectively, we propose a Dynamic Resizing on Active Warps (DRAW) scheduler which adjusts the size of active fetch group. From the evaluation results, DRAW scheduler reduces an average of 16.3% of stall cycles and improves an average performance of 11.3% compared to the conventional two-level warp scheduler.

Original languageEnglish
Title of host publicationISPASS 2015 - IEEE International Symposium on Performance Analysis of Systems and Software
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages183-192
Number of pages10
ISBN (Electronic)9781479919567
DOIs
Publication statusPublished - 2015 Apr 27
Event2015 15th IEEE International Symposium on Performance Analysis of Systems and Software, ISPASS 2015 - Philidelphia, United States
Duration: 2015 Mar 292015 Mar 31

Publication series

NameISPASS 2015 - IEEE International Symposium on Performance Analysis of Systems and Software

Other

Other2015 15th IEEE International Symposium on Performance Analysis of Systems and Software, ISPASS 2015
CountryUnited States
CityPhilidelphia
Period15/3/2915/3/31

All Science Journal Classification (ASJC) codes

  • Software

Fingerprint Dive into the research topics of 'DRAW: Investigating benefits of adaptive fetch group size on GPU'. Together they form a unique fingerprint.

Cite this