VSFS: A searchable distributed file system

Lei Xu, Ziling Huang, Hong Jiang, Lei Tian, David Swanson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

In this paper, we propose a Versatile Searchable File System, VSFS, which builds POSIX-compatible namespace using a novel Namespace-based File Query Language (NFQL). This enables analytics applications to utilize VSFS high-performance file-search service without changing their data model. VSFS versatile file-indexing mechanism is designed to offer great flexibility for applications to control indices to satisfy analytics needs. The evaluations driven by two real-world analytics applications demonstrate VSFS' high scalability and powerful data-filtering functionality.

Original languageEnglish (US)
Title of host publicationProceedings of PDSW 2014
Subtitle of host publication9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages25-30
Number of pages6
ISBN (Electronic)9781479970254
DOIs
StatePublished - Jan 20 2014
Event9th Parallel Data Storage Workshop, PDSW 2014 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014 - New Orleans, United States
Duration: Nov 16 2014 → …

Publication series

NameProceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis

Other

Other9th Parallel Data Storage Workshop, PDSW 2014 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014
CountryUnited States
CityNew Orleans
Period11/16/14 → …

Fingerprint

Query languages
Data structures
Scalability

Keywords

  • Distributed Systems
  • File System Managements
  • Indexing Methods
  • Information Filtering

ASJC Scopus subject areas

  • Hardware and Architecture
  • Software

Cite this

Xu, L., Huang, Z., Jiang, H., Tian, L., & Swanson, D. (2014). VSFS: A searchable distributed file system. In Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 25-30). [7016279] (Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PDSW.2014.10

VSFS : A searchable distributed file system. / Xu, Lei; Huang, Ziling; Jiang, Hong; Tian, Lei; Swanson, David.

Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc., 2014. p. 25-30 7016279 (Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Xu, L, Huang, Z, Jiang, H, Tian, L & Swanson, D 2014, VSFS: A searchable distributed file system. in Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis., 7016279, Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis, Institute of Electrical and Electronics Engineers Inc., pp. 25-30, 9th Parallel Data Storage Workshop, PDSW 2014 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014, New Orleans, United States, 11/16/14. https://doi.org/10.1109/PDSW.2014.10
Xu L, Huang Z, Jiang H, Tian L, Swanson D. VSFS: A searchable distributed file system. In Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc. 2014. p. 25-30. 7016279. (Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis). https://doi.org/10.1109/PDSW.2014.10
Xu, Lei ; Huang, Ziling ; Jiang, Hong ; Tian, Lei ; Swanson, David. / VSFS : A searchable distributed file system. Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 25-30 (Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis).
@inproceedings{cefa7b59b50c43a19dce6b697321d2b3,
title = "VSFS: A searchable distributed file system",
abstract = "In this paper, we propose a Versatile Searchable File System, VSFS, which builds POSIX-compatible namespace using a novel Namespace-based File Query Language (NFQL). This enables analytics applications to utilize VSFS high-performance file-search service without changing their data model. VSFS versatile file-indexing mechanism is designed to offer great flexibility for applications to control indices to satisfy analytics needs. The evaluations driven by two real-world analytics applications demonstrate VSFS' high scalability and powerful data-filtering functionality.",
keywords = "Distributed Systems, File System Managements, Indexing Methods, Information Filtering",
author = "Lei Xu and Ziling Huang and Hong Jiang and Lei Tian and David Swanson",
year = "2014",
month = "1",
day = "20",
doi = "10.1109/PDSW.2014.10",
language = "English (US)",
series = "Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "25--30",
booktitle = "Proceedings of PDSW 2014",

}

TY - GEN

T1 - VSFS

T2 - A searchable distributed file system

AU - Xu, Lei

AU - Huang, Ziling

AU - Jiang, Hong

AU - Tian, Lei

AU - Swanson, David

PY - 2014/1/20

Y1 - 2014/1/20

N2 - In this paper, we propose a Versatile Searchable File System, VSFS, which builds POSIX-compatible namespace using a novel Namespace-based File Query Language (NFQL). This enables analytics applications to utilize VSFS high-performance file-search service without changing their data model. VSFS versatile file-indexing mechanism is designed to offer great flexibility for applications to control indices to satisfy analytics needs. The evaluations driven by two real-world analytics applications demonstrate VSFS' high scalability and powerful data-filtering functionality.

AB - In this paper, we propose a Versatile Searchable File System, VSFS, which builds POSIX-compatible namespace using a novel Namespace-based File Query Language (NFQL). This enables analytics applications to utilize VSFS high-performance file-search service without changing their data model. VSFS versatile file-indexing mechanism is designed to offer great flexibility for applications to control indices to satisfy analytics needs. The evaluations driven by two real-world analytics applications demonstrate VSFS' high scalability and powerful data-filtering functionality.

KW - Distributed Systems

KW - File System Managements

KW - Indexing Methods

KW - Information Filtering

UR - http://www.scopus.com/inward/record.url?scp=84946687180&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84946687180&partnerID=8YFLogxK

U2 - 10.1109/PDSW.2014.10

DO - 10.1109/PDSW.2014.10

M3 - Conference contribution

AN - SCOPUS:84946687180

T3 - Proceedings of PDSW 2014: 9th Parallel Data Storage Workshop - Held in Conjunction with SC 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis

SP - 25

EP - 30

BT - Proceedings of PDSW 2014

PB - Institute of Electrical and Electronics Engineers Inc.

ER -