A job scheduling design for visualization services using GPU clusters

Wei Hsien Hsu, Chun Fu Wang, Kwan Liu Ma, Hongfeng Yu, Jacqueline H. Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Modern large-scale heterogeneous computers incorporating GPUs offer impressive processing capabilities. It is desirable to fully utilize such systems for serving multiple users concurrently to visualize large data at interactive rates. However, as the disparity between data transfer speed and compute speed continues to increase in heterogeneous systems, data locality becomes crucial for performance. We present a new job scheduling design to support multi-user exploration of large data in a heterogeneous computing environment, achieving near optimal data locality and minimizing I/O overhead. The targeted application is a parallel visualization system which allows multiple users to render large volumetric data sets in both interactive mode and batch mode. We present a cost model to assess the performance of parallel volume rendering and quantify the efficiency of job scheduling. We have tested our job scheduling scheme on two heterogeneous systems with different configurations. The largest test volume data used in our study has over two billion grid points. The timing results demonstrate that our design effectively improves data locality for complex multi-user job scheduling problems, leading to better overall performance of the service.

Original languageEnglish (US)
Title of host publicationProceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012
PublisherIEEE Computer Society
Pages523-533
Number of pages11
ISBN (Print)9780768548074
DOIs
StatePublished - Jan 1 2012
Event2012 IEEE International Conference on Cluster Computing, CLUSTER 2012 - Beijing, China
Duration: Sep 24 2012Sep 28 2012

Publication series

NameProceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012

Other

Other2012 IEEE International Conference on Cluster Computing, CLUSTER 2012
CountryChina
CityBeijing
Period9/24/129/28/12

Fingerprint

Visualization
Scheduling
Volume rendering
Data transfer
Graphics processing unit
Processing
Costs

Keywords

  • GPU clusters
  • job scheduling
  • multi-user volume rendering
  • parallel volume visualizatoin

ASJC Scopus subject areas

  • Software

Cite this

Hsu, W. H., Wang, C. F., Ma, K. L., Yu, H., & Chen, J. H. (2012). A job scheduling design for visualization services using GPU clusters. In Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012 (pp. 523-533). [6337816] (Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012). IEEE Computer Society. https://doi.org/10.1109/CLUSTER.2012.63

A job scheduling design for visualization services using GPU clusters. / Hsu, Wei Hsien; Wang, Chun Fu; Ma, Kwan Liu; Yu, Hongfeng; Chen, Jacqueline H.

Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012. IEEE Computer Society, 2012. p. 523-533 6337816 (Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hsu, WH, Wang, CF, Ma, KL, Yu, H & Chen, JH 2012, A job scheduling design for visualization services using GPU clusters. in Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012., 6337816, Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012, IEEE Computer Society, pp. 523-533, 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012, Beijing, China, 9/24/12. https://doi.org/10.1109/CLUSTER.2012.63
Hsu WH, Wang CF, Ma KL, Yu H, Chen JH. A job scheduling design for visualization services using GPU clusters. In Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012. IEEE Computer Society. 2012. p. 523-533. 6337816. (Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012). https://doi.org/10.1109/CLUSTER.2012.63
Hsu, Wei Hsien ; Wang, Chun Fu ; Ma, Kwan Liu ; Yu, Hongfeng ; Chen, Jacqueline H. / A job scheduling design for visualization services using GPU clusters. Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012. IEEE Computer Society, 2012. pp. 523-533 (Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012).
@inproceedings{f49df3e104964bdebbc4f0be3d7ec37c,
title = "A job scheduling design for visualization services using GPU clusters",
abstract = "Modern large-scale heterogeneous computers incorporating GPUs offer impressive processing capabilities. It is desirable to fully utilize such systems for serving multiple users concurrently to visualize large data at interactive rates. However, as the disparity between data transfer speed and compute speed continues to increase in heterogeneous systems, data locality becomes crucial for performance. We present a new job scheduling design to support multi-user exploration of large data in a heterogeneous computing environment, achieving near optimal data locality and minimizing I/O overhead. The targeted application is a parallel visualization system which allows multiple users to render large volumetric data sets in both interactive mode and batch mode. We present a cost model to assess the performance of parallel volume rendering and quantify the efficiency of job scheduling. We have tested our job scheduling scheme on two heterogeneous systems with different configurations. The largest test volume data used in our study has over two billion grid points. The timing results demonstrate that our design effectively improves data locality for complex multi-user job scheduling problems, leading to better overall performance of the service.",
keywords = "GPU clusters, job scheduling, multi-user volume rendering, parallel volume visualizatoin",
author = "Hsu, {Wei Hsien} and Wang, {Chun Fu} and Ma, {Kwan Liu} and Hongfeng Yu and Chen, {Jacqueline H.}",
year = "2012",
month = "1",
day = "1",
doi = "10.1109/CLUSTER.2012.63",
language = "English (US)",
isbn = "9780768548074",
series = "Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012",
publisher = "IEEE Computer Society",
pages = "523--533",
booktitle = "Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012",

}

TY - GEN

T1 - A job scheduling design for visualization services using GPU clusters

AU - Hsu, Wei Hsien

AU - Wang, Chun Fu

AU - Ma, Kwan Liu

AU - Yu, Hongfeng

AU - Chen, Jacqueline H.

PY - 2012/1/1

Y1 - 2012/1/1

N2 - Modern large-scale heterogeneous computers incorporating GPUs offer impressive processing capabilities. It is desirable to fully utilize such systems for serving multiple users concurrently to visualize large data at interactive rates. However, as the disparity between data transfer speed and compute speed continues to increase in heterogeneous systems, data locality becomes crucial for performance. We present a new job scheduling design to support multi-user exploration of large data in a heterogeneous computing environment, achieving near optimal data locality and minimizing I/O overhead. The targeted application is a parallel visualization system which allows multiple users to render large volumetric data sets in both interactive mode and batch mode. We present a cost model to assess the performance of parallel volume rendering and quantify the efficiency of job scheduling. We have tested our job scheduling scheme on two heterogeneous systems with different configurations. The largest test volume data used in our study has over two billion grid points. The timing results demonstrate that our design effectively improves data locality for complex multi-user job scheduling problems, leading to better overall performance of the service.

AB - Modern large-scale heterogeneous computers incorporating GPUs offer impressive processing capabilities. It is desirable to fully utilize such systems for serving multiple users concurrently to visualize large data at interactive rates. However, as the disparity between data transfer speed and compute speed continues to increase in heterogeneous systems, data locality becomes crucial for performance. We present a new job scheduling design to support multi-user exploration of large data in a heterogeneous computing environment, achieving near optimal data locality and minimizing I/O overhead. The targeted application is a parallel visualization system which allows multiple users to render large volumetric data sets in both interactive mode and batch mode. We present a cost model to assess the performance of parallel volume rendering and quantify the efficiency of job scheduling. We have tested our job scheduling scheme on two heterogeneous systems with different configurations. The largest test volume data used in our study has over two billion grid points. The timing results demonstrate that our design effectively improves data locality for complex multi-user job scheduling problems, leading to better overall performance of the service.

KW - GPU clusters

KW - job scheduling

KW - multi-user volume rendering

KW - parallel volume visualizatoin

UR - http://www.scopus.com/inward/record.url?scp=84870697204&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870697204&partnerID=8YFLogxK

U2 - 10.1109/CLUSTER.2012.63

DO - 10.1109/CLUSTER.2012.63

M3 - Conference contribution

AN - SCOPUS:84870697204

SN - 9780768548074

T3 - Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012

SP - 523

EP - 533

BT - Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012

PB - IEEE Computer Society

ER -