SDTMA-NDN: Scientific data transfer management architecture using named data networking

Mohammad Alhowaidi, Byrav Ramamurthy, Brian Bockelman, David Swanson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Named Data Networking (NDN) is one of the promising future internet architectures, which focuses on the data rather than its location (IP/host-based system). NDN has several characteristics which facilitate addressing and routing the data: Fail-over, in-network caching and load balancing. This makes it useful in areas such as managing scientific data across a distributed infrastructure. The CMS experiment on the Large Hadron Collider (LHC) runs such an infrastructure and has a data access pattern amenable to content-centric networking. In this paper, we propose SDTMA-NDN (Scientific Data Transfer Management Architecture using NDN) to distribute CMS's software to worker-nodes and end-users. We build on top of CERN Virtual Machine File System (CVMFS), a global, distributed filesystem designed to be used with cache-friendly workloads. CVMFS maintain its data by using content-addressable storage, which makes it suitable for NDN and a reasonable starting point for CMS. We examine the effect of in-network caching of NDN on the latency, how NDN provides transparent path selection to avoid high latency in the path, and how it balances several paths for retrieving the data. We compare SDTMA-NDN to the HTTP proxies used in the existing CVMFS-Content distribution Network (CDN). We find that SDTMA-NDN is more resilient and outperforms CVMFS-CDN in the presence of network delays, while the CVMFS-CDN outperforms SDTMA-NDN in ideal cases where there is no delay.

Original languageEnglish (US)
Title of host publication11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-6
Number of pages6
ISBN (Electronic)9781538623473
DOIs
StatePublished - Jun 12 2018
Event11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017 - Bhubaneswar, India
Duration: Dec 17 2017Dec 20 2017

Publication series

Name11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017

Other

Other11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017
CountryIndia
CityBhubaneswar
Period12/17/1712/20/17

Fingerprint

Data transfer
Electric power distribution
Associative storage
HTTP
Colliding beam accelerators
Resource allocation
Virtual machine
Internet
Experiments

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing

Cite this

Alhowaidi, M., Ramamurthy, B., Bockelman, B., & Swanson, D. (2018). SDTMA-NDN: Scientific data transfer management architecture using named data networking. In 11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017 (pp. 1-6). (11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ANTS.2017.8384167

SDTMA-NDN : Scientific data transfer management architecture using named data networking. / Alhowaidi, Mohammad; Ramamurthy, Byrav; Bockelman, Brian; Swanson, David.

11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017. Institute of Electrical and Electronics Engineers Inc., 2018. p. 1-6 (11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Alhowaidi, M, Ramamurthy, B, Bockelman, B & Swanson, D 2018, SDTMA-NDN: Scientific data transfer management architecture using named data networking. in 11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017. 11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017, Institute of Electrical and Electronics Engineers Inc., pp. 1-6, 11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017, Bhubaneswar, India, 12/17/17. https://doi.org/10.1109/ANTS.2017.8384167
Alhowaidi M, Ramamurthy B, Bockelman B, Swanson D. SDTMA-NDN: Scientific data transfer management architecture using named data networking. In 11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1-6. (11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017). https://doi.org/10.1109/ANTS.2017.8384167
Alhowaidi, Mohammad ; Ramamurthy, Byrav ; Bockelman, Brian ; Swanson, David. / SDTMA-NDN : Scientific data transfer management architecture using named data networking. 11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1-6 (11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017).
@inproceedings{a17ff9a99698462db4b82cd8cdd44693,
title = "SDTMA-NDN: Scientific data transfer management architecture using named data networking",
abstract = "Named Data Networking (NDN) is one of the promising future internet architectures, which focuses on the data rather than its location (IP/host-based system). NDN has several characteristics which facilitate addressing and routing the data: Fail-over, in-network caching and load balancing. This makes it useful in areas such as managing scientific data across a distributed infrastructure. The CMS experiment on the Large Hadron Collider (LHC) runs such an infrastructure and has a data access pattern amenable to content-centric networking. In this paper, we propose SDTMA-NDN (Scientific Data Transfer Management Architecture using NDN) to distribute CMS's software to worker-nodes and end-users. We build on top of CERN Virtual Machine File System (CVMFS), a global, distributed filesystem designed to be used with cache-friendly workloads. CVMFS maintain its data by using content-addressable storage, which makes it suitable for NDN and a reasonable starting point for CMS. We examine the effect of in-network caching of NDN on the latency, how NDN provides transparent path selection to avoid high latency in the path, and how it balances several paths for retrieving the data. We compare SDTMA-NDN to the HTTP proxies used in the existing CVMFS-Content distribution Network (CDN). We find that SDTMA-NDN is more resilient and outperforms CVMFS-CDN in the presence of network delays, while the CVMFS-CDN outperforms SDTMA-NDN in ideal cases where there is no delay.",
author = "Mohammad Alhowaidi and Byrav Ramamurthy and Brian Bockelman and David Swanson",
year = "2018",
month = "6",
day = "12",
doi = "10.1109/ANTS.2017.8384167",
language = "English (US)",
series = "11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1--6",
booktitle = "11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017",

}

TY - GEN

T1 - SDTMA-NDN

T2 - Scientific data transfer management architecture using named data networking

AU - Alhowaidi, Mohammad

AU - Ramamurthy, Byrav

AU - Bockelman, Brian

AU - Swanson, David

PY - 2018/6/12

Y1 - 2018/6/12

N2 - Named Data Networking (NDN) is one of the promising future internet architectures, which focuses on the data rather than its location (IP/host-based system). NDN has several characteristics which facilitate addressing and routing the data: Fail-over, in-network caching and load balancing. This makes it useful in areas such as managing scientific data across a distributed infrastructure. The CMS experiment on the Large Hadron Collider (LHC) runs such an infrastructure and has a data access pattern amenable to content-centric networking. In this paper, we propose SDTMA-NDN (Scientific Data Transfer Management Architecture using NDN) to distribute CMS's software to worker-nodes and end-users. We build on top of CERN Virtual Machine File System (CVMFS), a global, distributed filesystem designed to be used with cache-friendly workloads. CVMFS maintain its data by using content-addressable storage, which makes it suitable for NDN and a reasonable starting point for CMS. We examine the effect of in-network caching of NDN on the latency, how NDN provides transparent path selection to avoid high latency in the path, and how it balances several paths for retrieving the data. We compare SDTMA-NDN to the HTTP proxies used in the existing CVMFS-Content distribution Network (CDN). We find that SDTMA-NDN is more resilient and outperforms CVMFS-CDN in the presence of network delays, while the CVMFS-CDN outperforms SDTMA-NDN in ideal cases where there is no delay.

AB - Named Data Networking (NDN) is one of the promising future internet architectures, which focuses on the data rather than its location (IP/host-based system). NDN has several characteristics which facilitate addressing and routing the data: Fail-over, in-network caching and load balancing. This makes it useful in areas such as managing scientific data across a distributed infrastructure. The CMS experiment on the Large Hadron Collider (LHC) runs such an infrastructure and has a data access pattern amenable to content-centric networking. In this paper, we propose SDTMA-NDN (Scientific Data Transfer Management Architecture using NDN) to distribute CMS's software to worker-nodes and end-users. We build on top of CERN Virtual Machine File System (CVMFS), a global, distributed filesystem designed to be used with cache-friendly workloads. CVMFS maintain its data by using content-addressable storage, which makes it suitable for NDN and a reasonable starting point for CMS. We examine the effect of in-network caching of NDN on the latency, how NDN provides transparent path selection to avoid high latency in the path, and how it balances several paths for retrieving the data. We compare SDTMA-NDN to the HTTP proxies used in the existing CVMFS-Content distribution Network (CDN). We find that SDTMA-NDN is more resilient and outperforms CVMFS-CDN in the presence of network delays, while the CVMFS-CDN outperforms SDTMA-NDN in ideal cases where there is no delay.

UR - http://www.scopus.com/inward/record.url?scp=85049947293&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049947293&partnerID=8YFLogxK

U2 - 10.1109/ANTS.2017.8384167

DO - 10.1109/ANTS.2017.8384167

M3 - Conference contribution

AN - SCOPUS:85049947293

T3 - 11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017

SP - 1

EP - 6

BT - 11th IEEE International Conference on Advanced Networks and Telecommunications Systems, ANTS 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -