A distributed shared object model based on a hierarchical consistency protocol for heterogeneous clusters

Xuli Liu, Hong Jiang, Leen-Kiat Soh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

The significant performance-to-cost ratio advantage of clusters, combined with recent advances in middleware (programming environment) and networking technologies, has made them the single most popular and fastest growing platform for high performance computing in recent years. While message passing interface (MPI) still dominates as a means of parallel programming in clusters, it is nevertheless desirable for programmers to program in a single address space, not only across a cluster but also among multiple, likely heterogeneous, clusters so as to significantly extend the computing power of a single cluster. In this paper, we propose a Distributed Shared Object (DSO) model based on a Distributed Hierarchical Consistency Model(DHCM) protocol for heterogeneous clusters. DHCM, inspired by but significantly improved over the local consistency, is designed to help maintain coherence and consistency in a DSO programming environment and to adapt to different levels of consistency. The notion of adaptive consistency is proposed and partially implemented to improve the efficiency in consistency control, and scalability is addressed as well through the hierarchical structure of the protocol design. We implemented this model purely in Java for portability and heterogeneity. The performance of DHCM is evaluated by executing the LU application chosen from, the SPLASH-2 benchmark suite on a 128-node Linux cluster. The experimental results show that the protocol with a hierarchical structure significantly outperforms the protocol with a single-tier in terms of execution time, indicating higher scalability.

Original languageEnglish (US)
Title of host publication2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004
Pages515-522
Number of pages8
StatePublished - Sep 29 2004
Event2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004 - Chicago, IL, United States
Duration: Apr 19 2004Apr 22 2004

Publication series

Name2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004

Conference

Conference2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004
CountryUnited States
CityChicago, IL
Period4/19/044/22/04

Fingerprint

Network protocols
Scalability
Parallel programming
Message passing
Middleware
Computer programming
Costs

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Liu, X., Jiang, H., & Soh, L-K. (2004). A distributed shared object model based on a hierarchical consistency protocol for heterogeneous clusters. In 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004 (pp. 515-522). (2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004).

A distributed shared object model based on a hierarchical consistency protocol for heterogeneous clusters. / Liu, Xuli; Jiang, Hong; Soh, Leen-Kiat.

2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004. 2004. p. 515-522 (2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Liu, X, Jiang, H & Soh, L-K 2004, A distributed shared object model based on a hierarchical consistency protocol for heterogeneous clusters. in 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004. 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004, pp. 515-522, 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004, Chicago, IL, United States, 4/19/04.
Liu X, Jiang H, Soh L-K. A distributed shared object model based on a hierarchical consistency protocol for heterogeneous clusters. In 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004. 2004. p. 515-522. (2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004).
Liu, Xuli ; Jiang, Hong ; Soh, Leen-Kiat. / A distributed shared object model based on a hierarchical consistency protocol for heterogeneous clusters. 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004. 2004. pp. 515-522 (2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004).
@inproceedings{65c5d0d4396842ac997cc832fd203fd6,
title = "A distributed shared object model based on a hierarchical consistency protocol for heterogeneous clusters",
abstract = "The significant performance-to-cost ratio advantage of clusters, combined with recent advances in middleware (programming environment) and networking technologies, has made them the single most popular and fastest growing platform for high performance computing in recent years. While message passing interface (MPI) still dominates as a means of parallel programming in clusters, it is nevertheless desirable for programmers to program in a single address space, not only across a cluster but also among multiple, likely heterogeneous, clusters so as to significantly extend the computing power of a single cluster. In this paper, we propose a Distributed Shared Object (DSO) model based on a Distributed Hierarchical Consistency Model(DHCM) protocol for heterogeneous clusters. DHCM, inspired by but significantly improved over the local consistency, is designed to help maintain coherence and consistency in a DSO programming environment and to adapt to different levels of consistency. The notion of adaptive consistency is proposed and partially implemented to improve the efficiency in consistency control, and scalability is addressed as well through the hierarchical structure of the protocol design. We implemented this model purely in Java for portability and heterogeneity. The performance of DHCM is evaluated by executing the LU application chosen from, the SPLASH-2 benchmark suite on a 128-node Linux cluster. The experimental results show that the protocol with a hierarchical structure significantly outperforms the protocol with a single-tier in terms of execution time, indicating higher scalability.",
author = "Xuli Liu and Hong Jiang and Leen-Kiat Soh",
year = "2004",
month = "9",
day = "29",
language = "English (US)",
isbn = "078038430X",
series = "2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004",
pages = "515--522",
booktitle = "2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004",

}

TY - GEN

T1 - A distributed shared object model based on a hierarchical consistency protocol for heterogeneous clusters

AU - Liu, Xuli

AU - Jiang, Hong

AU - Soh, Leen-Kiat

PY - 2004/9/29

Y1 - 2004/9/29

N2 - The significant performance-to-cost ratio advantage of clusters, combined with recent advances in middleware (programming environment) and networking technologies, has made them the single most popular and fastest growing platform for high performance computing in recent years. While message passing interface (MPI) still dominates as a means of parallel programming in clusters, it is nevertheless desirable for programmers to program in a single address space, not only across a cluster but also among multiple, likely heterogeneous, clusters so as to significantly extend the computing power of a single cluster. In this paper, we propose a Distributed Shared Object (DSO) model based on a Distributed Hierarchical Consistency Model(DHCM) protocol for heterogeneous clusters. DHCM, inspired by but significantly improved over the local consistency, is designed to help maintain coherence and consistency in a DSO programming environment and to adapt to different levels of consistency. The notion of adaptive consistency is proposed and partially implemented to improve the efficiency in consistency control, and scalability is addressed as well through the hierarchical structure of the protocol design. We implemented this model purely in Java for portability and heterogeneity. The performance of DHCM is evaluated by executing the LU application chosen from, the SPLASH-2 benchmark suite on a 128-node Linux cluster. The experimental results show that the protocol with a hierarchical structure significantly outperforms the protocol with a single-tier in terms of execution time, indicating higher scalability.

AB - The significant performance-to-cost ratio advantage of clusters, combined with recent advances in middleware (programming environment) and networking technologies, has made them the single most popular and fastest growing platform for high performance computing in recent years. While message passing interface (MPI) still dominates as a means of parallel programming in clusters, it is nevertheless desirable for programmers to program in a single address space, not only across a cluster but also among multiple, likely heterogeneous, clusters so as to significantly extend the computing power of a single cluster. In this paper, we propose a Distributed Shared Object (DSO) model based on a Distributed Hierarchical Consistency Model(DHCM) protocol for heterogeneous clusters. DHCM, inspired by but significantly improved over the local consistency, is designed to help maintain coherence and consistency in a DSO programming environment and to adapt to different levels of consistency. The notion of adaptive consistency is proposed and partially implemented to improve the efficiency in consistency control, and scalability is addressed as well through the hierarchical structure of the protocol design. We implemented this model purely in Java for portability and heterogeneity. The performance of DHCM is evaluated by executing the LU application chosen from, the SPLASH-2 benchmark suite on a 128-node Linux cluster. The experimental results show that the protocol with a hierarchical structure significantly outperforms the protocol with a single-tier in terms of execution time, indicating higher scalability.

UR - http://www.scopus.com/inward/record.url?scp=4544267270&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=4544267270&partnerID=8YFLogxK

M3 - Conference contribution

SN - 078038430X

T3 - 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004

SP - 515

EP - 522

BT - 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004

ER -