Hierarchical Coding for Distributed Computing

Hyegyeong Park, Kangwook Lee, Jy Yong Sohn, Changho Suh, Jaekyun Moon

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Coding for distributed computing supports low-latency computation by relieving the burden of straggling workers. While most existing works assume a simple master-worker model, we consider a hierarchical computational structure consisting of groups of workers, motivated by the need to reflect the architectures of real-world distributed computing systems. In this work, we propose a hierarchical coding scheme for this model, as well as analyze its decoding cost and expected computation time. Specifically, we first provide upper and lower bounds on the expected computing time of the proposed scheme. We also show that our scheme enables efficient parallel decoding, thus reducing decoding costs by orders of magnitude over non-hierarchical schemes. When considering both decoding cost and computing time, the proposed hierarchical coding is shown to outperform existing schemes in many practical scenarios.

Original languageEnglish
Title of host publication2018 IEEE International Symposium on Information Theory, ISIT 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages5
ISBN (Print)9781538647806
Publication statusPublished - 2018 Aug 15
Event2018 IEEE International Symposium on Information Theory, ISIT 2018 - Vail, United States
Duration: 2018 Jun 172018 Jun 22

Publication series

NameIEEE International Symposium on Information Theory - Proceedings
ISSN (Print)2157-8095


Conference2018 IEEE International Symposium on Information Theory, ISIT 2018
Country/TerritoryUnited States

Bibliographical note

Publisher Copyright:
© 2018 IEEE.

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Information Systems
  • Modelling and Simulation
  • Applied Mathematics


Dive into the research topics of 'Hierarchical Coding for Distributed Computing'. Together they form a unique fingerprint.

Cite this