Improving Energy Efficiency of GPUs through Data Compression and Compressed Execution

Sangpil Lee, Keunsoo Kim, Gunjae Koo, Hyeran Jeon, Murali Annavaram, Won Woo Ro

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

GPU design trends show that the register file size will continue to increase to enable even more thread level parallelism. As a result register file consumes a large fraction of the total GPU chip power. This paper explores register file data compression for GPUs to improve power efficiency. Compression reduces the width of the register file read and write operations, which in turn reduces dynamic power. This work is motivated by the observation that the register values of threads within the same warp are similar, namely the arithmetic differences between two successive thread registers is small. Compression exploits the value similarity by removing data redundancy of register values. Without decompressing operand values some instructions can be processed inside register file, which enables to further save energy by minimizing data movement and processing in power hungry main execution unit. Evaluation results show that the proposed techniques save 25 percent of the total register file energy consumption and 21 percent of the total execution unit energy consumption with negligible performance impact.

Original languageEnglish
Article number7600453
Pages (from-to)834-847
Number of pages14
JournalIEEE Transactions on Computers
Volume66
Issue number5
DOIs
Publication statusPublished - 2017 May 1

Fingerprint

Data compression
Data Compression
Energy Efficiency
Thread
Energy efficiency
Percent
Energy Consumption
Energy utilization
Compression
Unit
Parallelism
Redundancy
Chip
Continue
Evaluation
Processing
Energy
Graphics processing unit

All Science Journal Classification (ASJC) codes

  • Software
  • Theoretical Computer Science
  • Hardware and Architecture
  • Computational Theory and Mathematics

Cite this

Lee, Sangpil ; Kim, Keunsoo ; Koo, Gunjae ; Jeon, Hyeran ; Annavaram, Murali ; Ro, Won Woo. / Improving Energy Efficiency of GPUs through Data Compression and Compressed Execution. In: IEEE Transactions on Computers. 2017 ; Vol. 66, No. 5. pp. 834-847.
@article{385840e9a5cf4018895f9ff85fff7a62,
title = "Improving Energy Efficiency of GPUs through Data Compression and Compressed Execution",
abstract = "GPU design trends show that the register file size will continue to increase to enable even more thread level parallelism. As a result register file consumes a large fraction of the total GPU chip power. This paper explores register file data compression for GPUs to improve power efficiency. Compression reduces the width of the register file read and write operations, which in turn reduces dynamic power. This work is motivated by the observation that the register values of threads within the same warp are similar, namely the arithmetic differences between two successive thread registers is small. Compression exploits the value similarity by removing data redundancy of register values. Without decompressing operand values some instructions can be processed inside register file, which enables to further save energy by minimizing data movement and processing in power hungry main execution unit. Evaluation results show that the proposed techniques save 25 percent of the total register file energy consumption and 21 percent of the total execution unit energy consumption with negligible performance impact.",
author = "Sangpil Lee and Keunsoo Kim and Gunjae Koo and Hyeran Jeon and Murali Annavaram and Ro, {Won Woo}",
year = "2017",
month = "5",
day = "1",
doi = "10.1109/TC.2016.2619348",
language = "English",
volume = "66",
pages = "834--847",
journal = "IEEE Transactions on Computers",
issn = "0018-9340",
publisher = "IEEE Computer Society",
number = "5",

}

Improving Energy Efficiency of GPUs through Data Compression and Compressed Execution. / Lee, Sangpil; Kim, Keunsoo; Koo, Gunjae; Jeon, Hyeran; Annavaram, Murali; Ro, Won Woo.

In: IEEE Transactions on Computers, Vol. 66, No. 5, 7600453, 01.05.2017, p. 834-847.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Improving Energy Efficiency of GPUs through Data Compression and Compressed Execution

AU - Lee, Sangpil

AU - Kim, Keunsoo

AU - Koo, Gunjae

AU - Jeon, Hyeran

AU - Annavaram, Murali

AU - Ro, Won Woo

PY - 2017/5/1

Y1 - 2017/5/1

N2 - GPU design trends show that the register file size will continue to increase to enable even more thread level parallelism. As a result register file consumes a large fraction of the total GPU chip power. This paper explores register file data compression for GPUs to improve power efficiency. Compression reduces the width of the register file read and write operations, which in turn reduces dynamic power. This work is motivated by the observation that the register values of threads within the same warp are similar, namely the arithmetic differences between two successive thread registers is small. Compression exploits the value similarity by removing data redundancy of register values. Without decompressing operand values some instructions can be processed inside register file, which enables to further save energy by minimizing data movement and processing in power hungry main execution unit. Evaluation results show that the proposed techniques save 25 percent of the total register file energy consumption and 21 percent of the total execution unit energy consumption with negligible performance impact.

AB - GPU design trends show that the register file size will continue to increase to enable even more thread level parallelism. As a result register file consumes a large fraction of the total GPU chip power. This paper explores register file data compression for GPUs to improve power efficiency. Compression reduces the width of the register file read and write operations, which in turn reduces dynamic power. This work is motivated by the observation that the register values of threads within the same warp are similar, namely the arithmetic differences between two successive thread registers is small. Compression exploits the value similarity by removing data redundancy of register values. Without decompressing operand values some instructions can be processed inside register file, which enables to further save energy by minimizing data movement and processing in power hungry main execution unit. Evaluation results show that the proposed techniques save 25 percent of the total register file energy consumption and 21 percent of the total execution unit energy consumption with negligible performance impact.

UR - http://www.scopus.com/inward/record.url?scp=85018467312&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85018467312&partnerID=8YFLogxK

U2 - 10.1109/TC.2016.2619348

DO - 10.1109/TC.2016.2619348

M3 - Article

AN - SCOPUS:85018467312

VL - 66

SP - 834

EP - 847

JO - IEEE Transactions on Computers

JF - IEEE Transactions on Computers

SN - 0018-9340

IS - 5

M1 - 7600453

ER -