A coherent measurement of web-search Relevance

William Mahoney, Peter Hospodka, William Sousan, Ryan Nickell, Qiuming Zhu

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

We present a metric for quantitatively assessing the quality of Web searches. The Relevance-of-Searching-on-Target index measures how relevant a search result is with respect to the searcher's interest and intention. The measurement is established on the basis of the cognitive characteristics of common user's online Web-browsing behavior and processes. We evaluated the accuracy of the index function with respect to a set of surveys conducted on several groups of our college students. While the index is primarily intended to be used to compare the Web-search results and tell which is more relevant, it can be extended to other applications. For example, it can be used to evaluate the techniques that people apply to improve the Web-search quality (including the quality of search engines), as well as other factors such as the expressiveness of search queries and the effectiveness of result-filtering processes.

Original languageEnglish (US)
Pages (from-to)1176-1187
Number of pages12
JournalIEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans
Volume39
Issue number6
DOIs
StatePublished - Nov 1 2009

Fingerprint

Search engines
World Wide Web
Students

Keywords

  • Human factors
  • Network interfaces
  • Search methods

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering
  • Computer Science Applications
  • Human-Computer Interaction
  • Information Systems
  • Software

Cite this

A coherent measurement of web-search Relevance. / Mahoney, William; Hospodka, Peter; Sousan, William; Nickell, Ryan; Zhu, Qiuming.

In: IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans, Vol. 39, No. 6, 01.11.2009, p. 1176-1187.

Research output: Contribution to journalArticle

@article{736759039a4448f6abcb3dd1620cbca5,
title = "A coherent measurement of web-search Relevance",
abstract = "We present a metric for quantitatively assessing the quality of Web searches. The Relevance-of-Searching-on-Target index measures how relevant a search result is with respect to the searcher's interest and intention. The measurement is established on the basis of the cognitive characteristics of common user's online Web-browsing behavior and processes. We evaluated the accuracy of the index function with respect to a set of surveys conducted on several groups of our college students. While the index is primarily intended to be used to compare the Web-search results and tell which is more relevant, it can be extended to other applications. For example, it can be used to evaluate the techniques that people apply to improve the Web-search quality (including the quality of search engines), as well as other factors such as the expressiveness of search queries and the effectiveness of result-filtering processes.",
keywords = "Human factors, Network interfaces, Search methods",
author = "William Mahoney and Peter Hospodka and William Sousan and Ryan Nickell and Qiuming Zhu",
year = "2009",
month = "11",
day = "1",
doi = "10.1109/TSMCA.2009.2027610",
language = "English (US)",
volume = "39",
pages = "1176--1187",
journal = "IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.",
issn = "1083-4427",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "6",

}

TY - JOUR

T1 - A coherent measurement of web-search Relevance

AU - Mahoney, William

AU - Hospodka, Peter

AU - Sousan, William

AU - Nickell, Ryan

AU - Zhu, Qiuming

PY - 2009/11/1

Y1 - 2009/11/1

N2 - We present a metric for quantitatively assessing the quality of Web searches. The Relevance-of-Searching-on-Target index measures how relevant a search result is with respect to the searcher's interest and intention. The measurement is established on the basis of the cognitive characteristics of common user's online Web-browsing behavior and processes. We evaluated the accuracy of the index function with respect to a set of surveys conducted on several groups of our college students. While the index is primarily intended to be used to compare the Web-search results and tell which is more relevant, it can be extended to other applications. For example, it can be used to evaluate the techniques that people apply to improve the Web-search quality (including the quality of search engines), as well as other factors such as the expressiveness of search queries and the effectiveness of result-filtering processes.

AB - We present a metric for quantitatively assessing the quality of Web searches. The Relevance-of-Searching-on-Target index measures how relevant a search result is with respect to the searcher's interest and intention. The measurement is established on the basis of the cognitive characteristics of common user's online Web-browsing behavior and processes. We evaluated the accuracy of the index function with respect to a set of surveys conducted on several groups of our college students. While the index is primarily intended to be used to compare the Web-search results and tell which is more relevant, it can be extended to other applications. For example, it can be used to evaluate the techniques that people apply to improve the Web-search quality (including the quality of search engines), as well as other factors such as the expressiveness of search queries and the effectiveness of result-filtering processes.

KW - Human factors

KW - Network interfaces

KW - Search methods

UR - http://www.scopus.com/inward/record.url?scp=77955086153&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77955086153&partnerID=8YFLogxK

U2 - 10.1109/TSMCA.2009.2027610

DO - 10.1109/TSMCA.2009.2027610

M3 - Article

VL - 39

SP - 1176

EP - 1187

JO - IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.

JF - IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.

SN - 1083-4427

IS - 6

ER -