Toward visualization-specific heuristic evaluation

Alvin Tarrell, Camilla Forsell, Ann L Fruhling, Georges Grinstein, Rita Borgo, Jean Scholtz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This position paper describes heuristic evaluation as it relates to visualization and visual analytics. We review heuristic evaluation in general, then comment on previous process-based, performance-based, and framework-based efforts to adapt the method to visualization-specific needs. We postulate that the framework-based approach holds the most promise for future progress in development of visualization-specific heuristics, and propose a specific framework as a starting point. We then recommend a method for community involvement and input into the further development of the heuristic framework and more detailed design and evaluation guidelines.

Original languageEnglish (US)
Title of host publicationProceedings - Beyond Time and Errors
Subtitle of host publicationNovel Evaluation Methods for Visualization, BELIV 2014 - 5th Bi-Annual Workshop
EditorsPetra Isenberg, Tobias Isenberg, Michael Sedlmair, Heidi Lam
PublisherAssociation for Computing Machinery
Pages110-117
Number of pages8
ISBN (Electronic)9781450332095
DOIs
StatePublished - Nov 10 2014
Event5th Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014 - Paris, France
Duration: Nov 10 2014 → …

Publication series

NameACM International Conference Proceeding Series
Volume10-November-2015

Other

Other5th Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014
CountryFrance
CityParis
Period11/10/14 → …

Fingerprint

Visualization

Keywords

  • Evaluation
  • Heuristic evaluation
  • Visual analytics
  • Visualization

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Cite this

Tarrell, A., Forsell, C., Fruhling, A. L., Grinstein, G., Borgo, R., & Scholtz, J. (2014). Toward visualization-specific heuristic evaluation. In P. Isenberg, T. Isenberg, M. Sedlmair, & H. Lam (Eds.), Proceedings - Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014 - 5th Bi-Annual Workshop (pp. 110-117). (ACM International Conference Proceeding Series; Vol. 10-November-2015). Association for Computing Machinery. https://doi.org/10.1145/2669557.2669580

Toward visualization-specific heuristic evaluation. / Tarrell, Alvin; Forsell, Camilla; Fruhling, Ann L; Grinstein, Georges; Borgo, Rita; Scholtz, Jean.

Proceedings - Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014 - 5th Bi-Annual Workshop. ed. / Petra Isenberg; Tobias Isenberg; Michael Sedlmair; Heidi Lam. Association for Computing Machinery, 2014. p. 110-117 (ACM International Conference Proceeding Series; Vol. 10-November-2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tarrell, A, Forsell, C, Fruhling, AL, Grinstein, G, Borgo, R & Scholtz, J 2014, Toward visualization-specific heuristic evaluation. in P Isenberg, T Isenberg, M Sedlmair & H Lam (eds), Proceedings - Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014 - 5th Bi-Annual Workshop. ACM International Conference Proceeding Series, vol. 10-November-2015, Association for Computing Machinery, pp. 110-117, 5th Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014, Paris, France, 11/10/14. https://doi.org/10.1145/2669557.2669580
Tarrell A, Forsell C, Fruhling AL, Grinstein G, Borgo R, Scholtz J. Toward visualization-specific heuristic evaluation. In Isenberg P, Isenberg T, Sedlmair M, Lam H, editors, Proceedings - Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014 - 5th Bi-Annual Workshop. Association for Computing Machinery. 2014. p. 110-117. (ACM International Conference Proceeding Series). https://doi.org/10.1145/2669557.2669580
Tarrell, Alvin ; Forsell, Camilla ; Fruhling, Ann L ; Grinstein, Georges ; Borgo, Rita ; Scholtz, Jean. / Toward visualization-specific heuristic evaluation. Proceedings - Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014 - 5th Bi-Annual Workshop. editor / Petra Isenberg ; Tobias Isenberg ; Michael Sedlmair ; Heidi Lam. Association for Computing Machinery, 2014. pp. 110-117 (ACM International Conference Proceeding Series).
@inproceedings{12e1fd19d41244e6bb454e4d7c5f959f,
title = "Toward visualization-specific heuristic evaluation",
abstract = "This position paper describes heuristic evaluation as it relates to visualization and visual analytics. We review heuristic evaluation in general, then comment on previous process-based, performance-based, and framework-based efforts to adapt the method to visualization-specific needs. We postulate that the framework-based approach holds the most promise for future progress in development of visualization-specific heuristics, and propose a specific framework as a starting point. We then recommend a method for community involvement and input into the further development of the heuristic framework and more detailed design and evaluation guidelines.",
keywords = "Evaluation, Heuristic evaluation, Visual analytics, Visualization",
author = "Alvin Tarrell and Camilla Forsell and Fruhling, {Ann L} and Georges Grinstein and Rita Borgo and Jean Scholtz",
year = "2014",
month = "11",
day = "10",
doi = "10.1145/2669557.2669580",
language = "English (US)",
series = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",
pages = "110--117",
editor = "Petra Isenberg and Tobias Isenberg and Michael Sedlmair and Heidi Lam",
booktitle = "Proceedings - Beyond Time and Errors",

}

TY - GEN

T1 - Toward visualization-specific heuristic evaluation

AU - Tarrell, Alvin

AU - Forsell, Camilla

AU - Fruhling, Ann L

AU - Grinstein, Georges

AU - Borgo, Rita

AU - Scholtz, Jean

PY - 2014/11/10

Y1 - 2014/11/10

N2 - This position paper describes heuristic evaluation as it relates to visualization and visual analytics. We review heuristic evaluation in general, then comment on previous process-based, performance-based, and framework-based efforts to adapt the method to visualization-specific needs. We postulate that the framework-based approach holds the most promise for future progress in development of visualization-specific heuristics, and propose a specific framework as a starting point. We then recommend a method for community involvement and input into the further development of the heuristic framework and more detailed design and evaluation guidelines.

AB - This position paper describes heuristic evaluation as it relates to visualization and visual analytics. We review heuristic evaluation in general, then comment on previous process-based, performance-based, and framework-based efforts to adapt the method to visualization-specific needs. We postulate that the framework-based approach holds the most promise for future progress in development of visualization-specific heuristics, and propose a specific framework as a starting point. We then recommend a method for community involvement and input into the further development of the heuristic framework and more detailed design and evaluation guidelines.

KW - Evaluation

KW - Heuristic evaluation

KW - Visual analytics

KW - Visualization

UR - http://www.scopus.com/inward/record.url?scp=84955471812&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84955471812&partnerID=8YFLogxK

U2 - 10.1145/2669557.2669580

DO - 10.1145/2669557.2669580

M3 - Conference contribution

AN - SCOPUS:84955471812

T3 - ACM International Conference Proceeding Series

SP - 110

EP - 117

BT - Proceedings - Beyond Time and Errors

A2 - Isenberg, Petra

A2 - Isenberg, Tobias

A2 - Sedlmair, Michael

A2 - Lam, Heidi

PB - Association for Computing Machinery

ER -