Abstract
The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200% can be achieved in performing collective operations and around 130% in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.
| Original language | English |
|---|---|
| Pages (from-to) | 165-172 |
| Number of pages | 8 |
| Journal | International Journal of Computers and Applications |
| Volume | 26 |
| Issue number | 3 |
| Publication status | Published - 2004 Jul 16 |
Fingerprint
All Science Journal Classification (ASJC) codes
- Software
- Hardware and Architecture
- Computer Science Applications
- Computer Graphics and Computer-Aided Design
Cite this
}
Design and implementation of a dynamic communication MPI library for the grid. / Park, Kyung Lang; Lee, Hwang Jik; Kwon, Oh Young; Park, Sung Yong; Park, Hyoung Woo; Kim, Shin-Dug.
In: International Journal of Computers and Applications, Vol. 26, No. 3, 16.07.2004, p. 165-172.Research output: Contribution to journal › Article
TY - JOUR
T1 - Design and implementation of a dynamic communication MPI library for the grid
AU - Park, Kyung Lang
AU - Lee, Hwang Jik
AU - Kwon, Oh Young
AU - Park, Sung Yong
AU - Park, Hyoung Woo
AU - Kim, Shin-Dug
PY - 2004/7/16
Y1 - 2004/7/16
N2 - The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200% can be achieved in performing collective operations and around 130% in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.
AB - The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200% can be achieved in performing collective operations and around 130% in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.
UR - http://www.scopus.com/inward/record.url?scp=3042843551&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=3042843551&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:3042843551
VL - 26
SP - 165
EP - 172
JO - International Journal of Computers and Applications
JF - International Journal of Computers and Applications
SN - 1206-212X
IS - 3
ER -