An application-aware data replacement policy for interactive large-scale scientific visualization

Lina Yu, Hongfeng Yu, Hong Jiang, Jun Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

The unprecedented amounts of data generated from large scientific simulations impose a grand challenge in data analytics, and I/O simply becomes a major performance bottleneck. To address this challenge, we present an application-aware I/O optimization technique in support of interactive large-scale scientific visualization. We partition a scientific data into blocks, and carefully place data blocks in a memory hierarchy according to a characterization of data access patterns of user visualization operations. We conduct an empirical study to explore the parameter space to derive optimal solutions. We use real-world large-scale simulation datasets to demonstrate the effectiveness of our approach.

Original languageEnglish (US)
Title of host publicationProceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1216-1225
Number of pages10
ISBN (Electronic)9781538634080
DOIs
StatePublished - Jun 30 2017
Event31st IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017 - Orlando, United States
Duration: May 29 2017Jun 2 2017

Publication series

NameProceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017

Other

Other31st IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017
CountryUnited States
CityOrlando
Period5/29/176/2/17

Fingerprint

Data visualization
Visualization
Data storage equipment

Keywords

  • I/O optimization
  • data replacement
  • large-scale data
  • scientific visualization

ASJC Scopus subject areas

  • Hardware and Architecture
  • Computer Networks and Communications
  • Information Systems

Cite this

Yu, L., Yu, H., Jiang, H., & Wang, J. (2017). An application-aware data replacement policy for interactive large-scale scientific visualization. In Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017 (pp. 1216-1225). [7965175] (Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IPDPSW.2017.16

An application-aware data replacement policy for interactive large-scale scientific visualization. / Yu, Lina; Yu, Hongfeng; Jiang, Hong; Wang, Jun.

Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 1216-1225 7965175 (Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yu, L, Yu, H, Jiang, H & Wang, J 2017, An application-aware data replacement policy for interactive large-scale scientific visualization. in Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017., 7965175, Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017, Institute of Electrical and Electronics Engineers Inc., pp. 1216-1225, 31st IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017, Orlando, United States, 5/29/17. https://doi.org/10.1109/IPDPSW.2017.16
Yu L, Yu H, Jiang H, Wang J. An application-aware data replacement policy for interactive large-scale scientific visualization. In Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 1216-1225. 7965175. (Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017). https://doi.org/10.1109/IPDPSW.2017.16
Yu, Lina ; Yu, Hongfeng ; Jiang, Hong ; Wang, Jun. / An application-aware data replacement policy for interactive large-scale scientific visualization. Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 1216-1225 (Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017).
@inproceedings{be170cd1cb7d4a4eb0f441f21721364e,
title = "An application-aware data replacement policy for interactive large-scale scientific visualization",
abstract = "The unprecedented amounts of data generated from large scientific simulations impose a grand challenge in data analytics, and I/O simply becomes a major performance bottleneck. To address this challenge, we present an application-aware I/O optimization technique in support of interactive large-scale scientific visualization. We partition a scientific data into blocks, and carefully place data blocks in a memory hierarchy according to a characterization of data access patterns of user visualization operations. We conduct an empirical study to explore the parameter space to derive optimal solutions. We use real-world large-scale simulation datasets to demonstrate the effectiveness of our approach.",
keywords = "I/O optimization, data replacement, large-scale data, scientific visualization",
author = "Lina Yu and Hongfeng Yu and Hong Jiang and Jun Wang",
year = "2017",
month = "6",
day = "30",
doi = "10.1109/IPDPSW.2017.16",
language = "English (US)",
series = "Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1216--1225",
booktitle = "Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017",

}

TY - GEN

T1 - An application-aware data replacement policy for interactive large-scale scientific visualization

AU - Yu, Lina

AU - Yu, Hongfeng

AU - Jiang, Hong

AU - Wang, Jun

PY - 2017/6/30

Y1 - 2017/6/30

N2 - The unprecedented amounts of data generated from large scientific simulations impose a grand challenge in data analytics, and I/O simply becomes a major performance bottleneck. To address this challenge, we present an application-aware I/O optimization technique in support of interactive large-scale scientific visualization. We partition a scientific data into blocks, and carefully place data blocks in a memory hierarchy according to a characterization of data access patterns of user visualization operations. We conduct an empirical study to explore the parameter space to derive optimal solutions. We use real-world large-scale simulation datasets to demonstrate the effectiveness of our approach.

AB - The unprecedented amounts of data generated from large scientific simulations impose a grand challenge in data analytics, and I/O simply becomes a major performance bottleneck. To address this challenge, we present an application-aware I/O optimization technique in support of interactive large-scale scientific visualization. We partition a scientific data into blocks, and carefully place data blocks in a memory hierarchy according to a characterization of data access patterns of user visualization operations. We conduct an empirical study to explore the parameter space to derive optimal solutions. We use real-world large-scale simulation datasets to demonstrate the effectiveness of our approach.

KW - I/O optimization

KW - data replacement

KW - large-scale data

KW - scientific visualization

UR - http://www.scopus.com/inward/record.url?scp=85028060092&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028060092&partnerID=8YFLogxK

U2 - 10.1109/IPDPSW.2017.16

DO - 10.1109/IPDPSW.2017.16

M3 - Conference contribution

T3 - Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017

SP - 1216

EP - 1225

BT - Proceedings - 2017 IEEE 31st International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -