TY - JOUR
T1 - Design and implementation of a dynamic communication MPI library for the grid
AU - Park, Kyung Lang
AU - Lee, Hwang Jik
AU - Kwon, Oh Young
AU - Park, Sung Yong
AU - Park, Hyoung Woo
AU - Kim, Shin Dug
N1 - Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.
PY - 2004
Y1 - 2004
N2 - The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200% can be achieved in performing collective operations and around 130% in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.
AB - The authors design and implement a dynamic and effective communication MPI (Message-Passing Interface) library for the grid environment, especially to design collective operations such as broadcast and reduce. The purpose of the grid environment is to aggregate a large number of resources. So, it is inevitable that networks will be heterogeneous, and thus application performance will be affected. However, these issues have not until now been considered in designing communication primitives. Thus, these characteristics from the grid networks are specified and adapted into the communication algorithm design in this research. For an effective solution, we characterize the grid network on the basis of actual measurement, and design an effective communication algorithm called HLOT (Hierarchical Latency Optimal Tree) that can reduce the communication delay by utilizing the network status aggressively. Also, by using the proposed algorithm, we implement various collective communication routines of MPI library and demonstrate their effectiveness. The experimental results show that performance gain of more than 200% can be achieved in performing collective operations and around 130% in performing an applications benchmark, compared to MPICH-G2, that is, conventional grid-enabled MPI library.
UR - http://www.scopus.com/inward/record.url?scp=3042843551&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=3042843551&partnerID=8YFLogxK
U2 - 10.1080/1206212x.2004.11441738
DO - 10.1080/1206212x.2004.11441738
M3 - Article
AN - SCOPUS:3042843551
VL - 26
SP - 165
EP - 172
JO - International Journal of Computers and Applications
JF - International Journal of Computers and Applications
SN - 1206-212X
IS - 3
ER -