Design and implementation of a dynamic communication MPI library for the grid

Kyung Lang Park, Hwang Jik Lee, Oh Young Kwon, Sung Yong Park, Hyoung Woo Park, Shin-Dug Kim

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200% can be achieved in performing collective operations and around 130% in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.

Original languageEnglish
Pages (from-to)165-172
Number of pages8
JournalInternational Journal of Computers and Applications
Volume26
Issue number3
Publication statusPublished - 2004 Jul 16

Fingerprint

Message passing
Communication

All Science Journal Classification (ASJC) codes

  • Software
  • Hardware and Architecture
  • Computer Science Applications
  • Computer Graphics and Computer-Aided Design

Cite this

Park, Kyung Lang ; Lee, Hwang Jik ; Kwon, Oh Young ; Park, Sung Yong ; Park, Hyoung Woo ; Kim, Shin-Dug. / Design and implementation of a dynamic communication MPI library for the grid. In: International Journal of Computers and Applications. 2004 ; Vol. 26, No. 3. pp. 165-172.
@article{a3a01da9a4f447e99b434792774d8709,
title = "Design and implementation of a dynamic communication MPI library for the grid",
abstract = "The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200{\%} can be achieved in performing collective operations and around 130{\%} in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.",
author = "Park, {Kyung Lang} and Lee, {Hwang Jik} and Kwon, {Oh Young} and Park, {Sung Yong} and Park, {Hyoung Woo} and Shin-Dug Kim",
year = "2004",
month = "7",
day = "16",
language = "English",
volume = "26",
pages = "165--172",
journal = "International Journal of Computers and Applications",
issn = "1206-212X",
publisher = "ACTA Press",
number = "3",

}

Design and implementation of a dynamic communication MPI library for the grid. / Park, Kyung Lang; Lee, Hwang Jik; Kwon, Oh Young; Park, Sung Yong; Park, Hyoung Woo; Kim, Shin-Dug.

In: International Journal of Computers and Applications, Vol. 26, No. 3, 16.07.2004, p. 165-172.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Design and implementation of a dynamic communication MPI library for the grid

AU - Park, Kyung Lang

AU - Lee, Hwang Jik

AU - Kwon, Oh Young

AU - Park, Sung Yong

AU - Park, Hyoung Woo

AU - Kim, Shin-Dug

PY - 2004/7/16

Y1 - 2004/7/16

N2 - The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200% can be achieved in performing collective operations and around 130% in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.

AB - The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200% can be achieved in performing collective operations and around 130% in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.

UR - http://www.scopus.com/inward/record.url?scp=3042843551&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=3042843551&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:3042843551

VL - 26

SP - 165

EP - 172

JO - International Journal of Computers and Applications

JF - International Journal of Computers and Applications

SN - 1206-212X

IS - 3

ER -