High-performance message striping over reliable transport protocols

Nader Mohamed, Jameela Al-Jaroodi, Hong Jiang, David Swanson

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

This paper introduces a high-performance middleware-level message striping approach to increase communication bandwidth for data transfer in heterogeneous clusters equipped with multiple networks. In this scheme, concurrency is used for the striping process. The proposed striping approach is designed to work at the middleware-level, between the distributed applications and the reliable transport protocols such as TCP. The middleware-level striping approach provides flexible, scalable, and hardware-, network-, and operating systems-independent communication bandwidth solution. In addition, techniques to enhance the performance of this approach over multiple networks are introduced. The proposed techniques, which minimize synchronization contention and eliminate the striping sequence header, rely on the features of a reliable transport protocol such as TCP to reduce some of the concurrent striping overhead. The techniques have been implemented and evaluated on a real cluster with multiple networks and the results show significant performance gains for data transfer over existing approaches.

Original languageEnglish (US)
Pages (from-to)261-278
Number of pages18
JournalJournal of Supercomputing
Volume38
Issue number3
DOIs
StatePublished - Dec 1 2006

Fingerprint

Transport Protocol
Middleware
High Performance
Data transfer
Network protocols
Data Transfer
Bandwidth
Communication
Synchronization
Distributed Applications
Contention
Concurrency
Operating Systems
Hardware
Concurrent
Eliminate
Minimise

Keywords

  • Network services
  • Parallel data transfer and striping
  • Scalable network bandwidth
  • Socket

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Information Systems
  • Hardware and Architecture

Cite this

High-performance message striping over reliable transport protocols. / Mohamed, Nader; Al-Jaroodi, Jameela; Jiang, Hong; Swanson, David.

In: Journal of Supercomputing, Vol. 38, No. 3, 01.12.2006, p. 261-278.

Research output: Contribution to journalArticle

Mohamed, Nader ; Al-Jaroodi, Jameela ; Jiang, Hong ; Swanson, David. / High-performance message striping over reliable transport protocols. In: Journal of Supercomputing. 2006 ; Vol. 38, No. 3. pp. 261-278.
@article{f65246646b68498fa9f7c395fe1a8f14,
title = "High-performance message striping over reliable transport protocols",
abstract = "This paper introduces a high-performance middleware-level message striping approach to increase communication bandwidth for data transfer in heterogeneous clusters equipped with multiple networks. In this scheme, concurrency is used for the striping process. The proposed striping approach is designed to work at the middleware-level, between the distributed applications and the reliable transport protocols such as TCP. The middleware-level striping approach provides flexible, scalable, and hardware-, network-, and operating systems-independent communication bandwidth solution. In addition, techniques to enhance the performance of this approach over multiple networks are introduced. The proposed techniques, which minimize synchronization contention and eliminate the striping sequence header, rely on the features of a reliable transport protocol such as TCP to reduce some of the concurrent striping overhead. The techniques have been implemented and evaluated on a real cluster with multiple networks and the results show significant performance gains for data transfer over existing approaches.",
keywords = "Network services, Parallel data transfer and striping, Scalable network bandwidth, Socket",
author = "Nader Mohamed and Jameela Al-Jaroodi and Hong Jiang and David Swanson",
year = "2006",
month = "12",
day = "1",
doi = "10.1007/s11227-006-8443-6",
language = "English (US)",
volume = "38",
pages = "261--278",
journal = "Journal of Supercomputing",
issn = "0920-8542",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - High-performance message striping over reliable transport protocols

AU - Mohamed, Nader

AU - Al-Jaroodi, Jameela

AU - Jiang, Hong

AU - Swanson, David

PY - 2006/12/1

Y1 - 2006/12/1

N2 - This paper introduces a high-performance middleware-level message striping approach to increase communication bandwidth for data transfer in heterogeneous clusters equipped with multiple networks. In this scheme, concurrency is used for the striping process. The proposed striping approach is designed to work at the middleware-level, between the distributed applications and the reliable transport protocols such as TCP. The middleware-level striping approach provides flexible, scalable, and hardware-, network-, and operating systems-independent communication bandwidth solution. In addition, techniques to enhance the performance of this approach over multiple networks are introduced. The proposed techniques, which minimize synchronization contention and eliminate the striping sequence header, rely on the features of a reliable transport protocol such as TCP to reduce some of the concurrent striping overhead. The techniques have been implemented and evaluated on a real cluster with multiple networks and the results show significant performance gains for data transfer over existing approaches.

AB - This paper introduces a high-performance middleware-level message striping approach to increase communication bandwidth for data transfer in heterogeneous clusters equipped with multiple networks. In this scheme, concurrency is used for the striping process. The proposed striping approach is designed to work at the middleware-level, between the distributed applications and the reliable transport protocols such as TCP. The middleware-level striping approach provides flexible, scalable, and hardware-, network-, and operating systems-independent communication bandwidth solution. In addition, techniques to enhance the performance of this approach over multiple networks are introduced. The proposed techniques, which minimize synchronization contention and eliminate the striping sequence header, rely on the features of a reliable transport protocol such as TCP to reduce some of the concurrent striping overhead. The techniques have been implemented and evaluated on a real cluster with multiple networks and the results show significant performance gains for data transfer over existing approaches.

KW - Network services

KW - Parallel data transfer and striping

KW - Scalable network bandwidth

KW - Socket

UR - http://www.scopus.com/inward/record.url?scp=33749455676&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33749455676&partnerID=8YFLogxK

U2 - 10.1007/s11227-006-8443-6

DO - 10.1007/s11227-006-8443-6

M3 - Article

AN - SCOPUS:33749455676

VL - 38

SP - 261

EP - 278

JO - Journal of Supercomputing

JF - Journal of Supercomputing

SN - 0920-8542

IS - 3

ER -