Single-Source Shortest Path Tree for Big Dynamic Graphs

Sara Riazi, Sriram Srinivasan, Sajal K. Das, Sanjukta Bhowmick, Boyana Norris

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Computing single-source shortest paths (SSSP) is one of the fundamental problems in graph theory. There are many applications of SSSP including finding routes in GPS systems and finding high centrality vertices for effective vaccination. In this paper, we focus on calculating SSSP on big dynamic graphs, which change with time. We propose a novel distributed computing approach, SSSPIncJoint, to update SSSP on big dynamic graphs using GraphX. Our approach considerably speeds up the recomputation of the SSSP tree by reducing the number of map-reduce operations required for implementing SSSP in the gather-apply- scatter programming model used by GraphX.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 IEEE International Conference on Big Data, Big Data 2018
EditorsYang Song, Bing Liu, Kisung Lee, Naoki Abe, Calton Pu, Mu Qiao, Nesreen Ahmed, Donald Kossmann, Jeffrey Saltz, Jiliang Tang, Jingrui He, Huan Liu, Xiaohua Hu
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages4054-4062
Number of pages9
ISBN (Electronic)9781538650356
DOIs
StatePublished - Jan 22 2019
Externally publishedYes
Event2018 IEEE International Conference on Big Data, Big Data 2018 - Seattle, United States
Duration: Dec 10 2018Dec 13 2018

Publication series

NameProceedings - 2018 IEEE International Conference on Big Data, Big Data 2018

Conference

Conference2018 IEEE International Conference on Big Data, Big Data 2018
CountryUnited States
CitySeattle
Period12/10/1812/13/18

Fingerprint

Graph theory
Distributed computer systems
Global positioning system

Keywords

  • Apache Spark
  • Big Dynamic Graphs
  • Map- Reduce
  • Single-Source Shortest Path (SSSP)

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems

Cite this

Riazi, S., Srinivasan, S., Das, S. K., Bhowmick, S., & Norris, B. (2019). Single-Source Shortest Path Tree for Big Dynamic Graphs. In Y. Song, B. Liu, K. Lee, N. Abe, C. Pu, M. Qiao, N. Ahmed, D. Kossmann, J. Saltz, J. Tang, J. He, H. Liu, ... X. Hu (Eds.), Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018 (pp. 4054-4062). [8622042] (Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BigData.2018.8622042

Single-Source Shortest Path Tree for Big Dynamic Graphs. / Riazi, Sara; Srinivasan, Sriram; Das, Sajal K.; Bhowmick, Sanjukta; Norris, Boyana.

Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018. ed. / Yang Song; Bing Liu; Kisung Lee; Naoki Abe; Calton Pu; Mu Qiao; Nesreen Ahmed; Donald Kossmann; Jeffrey Saltz; Jiliang Tang; Jingrui He; Huan Liu; Xiaohua Hu. Institute of Electrical and Electronics Engineers Inc., 2019. p. 4054-4062 8622042 (Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Riazi, S, Srinivasan, S, Das, SK, Bhowmick, S & Norris, B 2019, Single-Source Shortest Path Tree for Big Dynamic Graphs. in Y Song, B Liu, K Lee, N Abe, C Pu, M Qiao, N Ahmed, D Kossmann, J Saltz, J Tang, J He, H Liu & X Hu (eds), Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018., 8622042, Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018, Institute of Electrical and Electronics Engineers Inc., pp. 4054-4062, 2018 IEEE International Conference on Big Data, Big Data 2018, Seattle, United States, 12/10/18. https://doi.org/10.1109/BigData.2018.8622042
Riazi S, Srinivasan S, Das SK, Bhowmick S, Norris B. Single-Source Shortest Path Tree for Big Dynamic Graphs. In Song Y, Liu B, Lee K, Abe N, Pu C, Qiao M, Ahmed N, Kossmann D, Saltz J, Tang J, He J, Liu H, Hu X, editors, Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018. Institute of Electrical and Electronics Engineers Inc. 2019. p. 4054-4062. 8622042. (Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018). https://doi.org/10.1109/BigData.2018.8622042
Riazi, Sara ; Srinivasan, Sriram ; Das, Sajal K. ; Bhowmick, Sanjukta ; Norris, Boyana. / Single-Source Shortest Path Tree for Big Dynamic Graphs. Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018. editor / Yang Song ; Bing Liu ; Kisung Lee ; Naoki Abe ; Calton Pu ; Mu Qiao ; Nesreen Ahmed ; Donald Kossmann ; Jeffrey Saltz ; Jiliang Tang ; Jingrui He ; Huan Liu ; Xiaohua Hu. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 4054-4062 (Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018).
@inproceedings{be0c06b283bf4aa694f3d152e940bfc3,
title = "Single-Source Shortest Path Tree for Big Dynamic Graphs",
abstract = "Computing single-source shortest paths (SSSP) is one of the fundamental problems in graph theory. There are many applications of SSSP including finding routes in GPS systems and finding high centrality vertices for effective vaccination. In this paper, we focus on calculating SSSP on big dynamic graphs, which change with time. We propose a novel distributed computing approach, SSSPIncJoint, to update SSSP on big dynamic graphs using GraphX. Our approach considerably speeds up the recomputation of the SSSP tree by reducing the number of map-reduce operations required for implementing SSSP in the gather-apply- scatter programming model used by GraphX.",
keywords = "Apache Spark, Big Dynamic Graphs, Map- Reduce, Single-Source Shortest Path (SSSP)",
author = "Sara Riazi and Sriram Srinivasan and Das, {Sajal K.} and Sanjukta Bhowmick and Boyana Norris",
year = "2019",
month = "1",
day = "22",
doi = "10.1109/BigData.2018.8622042",
language = "English (US)",
series = "Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "4054--4062",
editor = "Yang Song and Bing Liu and Kisung Lee and Naoki Abe and Calton Pu and Mu Qiao and Nesreen Ahmed and Donald Kossmann and Jeffrey Saltz and Jiliang Tang and Jingrui He and Huan Liu and Xiaohua Hu",
booktitle = "Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018",

}

TY - GEN

T1 - Single-Source Shortest Path Tree for Big Dynamic Graphs

AU - Riazi, Sara

AU - Srinivasan, Sriram

AU - Das, Sajal K.

AU - Bhowmick, Sanjukta

AU - Norris, Boyana

PY - 2019/1/22

Y1 - 2019/1/22

N2 - Computing single-source shortest paths (SSSP) is one of the fundamental problems in graph theory. There are many applications of SSSP including finding routes in GPS systems and finding high centrality vertices for effective vaccination. In this paper, we focus on calculating SSSP on big dynamic graphs, which change with time. We propose a novel distributed computing approach, SSSPIncJoint, to update SSSP on big dynamic graphs using GraphX. Our approach considerably speeds up the recomputation of the SSSP tree by reducing the number of map-reduce operations required for implementing SSSP in the gather-apply- scatter programming model used by GraphX.

AB - Computing single-source shortest paths (SSSP) is one of the fundamental problems in graph theory. There are many applications of SSSP including finding routes in GPS systems and finding high centrality vertices for effective vaccination. In this paper, we focus on calculating SSSP on big dynamic graphs, which change with time. We propose a novel distributed computing approach, SSSPIncJoint, to update SSSP on big dynamic graphs using GraphX. Our approach considerably speeds up the recomputation of the SSSP tree by reducing the number of map-reduce operations required for implementing SSSP in the gather-apply- scatter programming model used by GraphX.

KW - Apache Spark

KW - Big Dynamic Graphs

KW - Map- Reduce

KW - Single-Source Shortest Path (SSSP)

UR - http://www.scopus.com/inward/record.url?scp=85062588193&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062588193&partnerID=8YFLogxK

U2 - 10.1109/BigData.2018.8622042

DO - 10.1109/BigData.2018.8622042

M3 - Conference contribution

T3 - Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018

SP - 4054

EP - 4062

BT - Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018

A2 - Song, Yang

A2 - Liu, Bing

A2 - Lee, Kisung

A2 - Abe, Naoki

A2 - Pu, Calton

A2 - Qiao, Mu

A2 - Ahmed, Nesreen

A2 - Kossmann, Donald

A2 - Saltz, Jeffrey

A2 - Tang, Jiliang

A2 - He, Jingrui

A2 - Liu, Huan

A2 - Hu, Xiaohua

PB - Institute of Electrical and Electronics Engineers Inc.

ER -