Sky Writer

Sketch-based collaboration for UAV pilots and mission specialists

Zachary Henkel, Jesus Suarez, Brittany A Duncan, Robin R. Murphy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Sky Writer is a collaborative communication medium that augments the traditional display of a UAV pilot and allows other stakeholders to communicate their needs and intentions to the pilot. UAV pilots engaging in time-critical missions, such as urban disaster responses, often must allocate most of their cognitive capacity towards flight tasks, making communication and collaboration with other stakeholders difficult or dangerous. Sky Writer addresses the needs of stakeholders while requiring minimal cognitive effort from the UAV pilot. The application presents stakeholders with an interface that provides contextual flight information and a live video stream of the flight. Stakeholders are able to sketch directly on the video stream or use a spotlight indicator that is mirrored across all displays in the system, including the pilot's display. The application can be used in any modern web browser and works with traditional and touch devices. Concept experimentation performed at Disaster City with two pilots indicated that the spotlight feature was particularly useful while the UAV was in motion, and the sketching features were most useful while the UAV was stationary. The system will be tested with professional responders soon to determine its efficacy in a simulated response, and to inform the ongoing design process.

Original languageEnglish (US)
Title of host publicationHRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction
PublisherIEEE Computer Society
Pages172-173
Number of pages2
ISBN (Print)9781450326582
DOIs
StatePublished - Jan 1 2014
Event9th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2014 - Bielefeld, Germany
Duration: Mar 3 2014Mar 6 2014

Publication series

NameACM/IEEE International Conference on Human-Robot Interaction
ISSN (Electronic)2167-2148

Other

Other9th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2014
CountryGermany
CityBielefeld
Period3/3/143/6/14

Fingerprint

Unmanned aerial vehicles (UAV)
Display devices
Disasters
Web browsers
Communication

Keywords

  • Sketch interface
  • Unmanned aerial vehicles

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Electrical and Electronic Engineering

Cite this

Henkel, Z., Suarez, J., Duncan, B. A., & Murphy, R. R. (2014). Sky Writer: Sketch-based collaboration for UAV pilots and mission specialists. In HRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction (pp. 172-173). (ACM/IEEE International Conference on Human-Robot Interaction). IEEE Computer Society. https://doi.org/10.1145/2559636.2559838

Sky Writer : Sketch-based collaboration for UAV pilots and mission specialists. / Henkel, Zachary; Suarez, Jesus; Duncan, Brittany A; Murphy, Robin R.

HRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. IEEE Computer Society, 2014. p. 172-173 (ACM/IEEE International Conference on Human-Robot Interaction).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Henkel, Z, Suarez, J, Duncan, BA & Murphy, RR 2014, Sky Writer: Sketch-based collaboration for UAV pilots and mission specialists. in HRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. ACM/IEEE International Conference on Human-Robot Interaction, IEEE Computer Society, pp. 172-173, 9th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2014, Bielefeld, Germany, 3/3/14. https://doi.org/10.1145/2559636.2559838
Henkel Z, Suarez J, Duncan BA, Murphy RR. Sky Writer: Sketch-based collaboration for UAV pilots and mission specialists. In HRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. IEEE Computer Society. 2014. p. 172-173. (ACM/IEEE International Conference on Human-Robot Interaction). https://doi.org/10.1145/2559636.2559838
Henkel, Zachary ; Suarez, Jesus ; Duncan, Brittany A ; Murphy, Robin R. / Sky Writer : Sketch-based collaboration for UAV pilots and mission specialists. HRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. IEEE Computer Society, 2014. pp. 172-173 (ACM/IEEE International Conference on Human-Robot Interaction).
@inproceedings{f5741b7180ae4207834dbef73792da15,
title = "Sky Writer: Sketch-based collaboration for UAV pilots and mission specialists",
abstract = "Sky Writer is a collaborative communication medium that augments the traditional display of a UAV pilot and allows other stakeholders to communicate their needs and intentions to the pilot. UAV pilots engaging in time-critical missions, such as urban disaster responses, often must allocate most of their cognitive capacity towards flight tasks, making communication and collaboration with other stakeholders difficult or dangerous. Sky Writer addresses the needs of stakeholders while requiring minimal cognitive effort from the UAV pilot. The application presents stakeholders with an interface that provides contextual flight information and a live video stream of the flight. Stakeholders are able to sketch directly on the video stream or use a spotlight indicator that is mirrored across all displays in the system, including the pilot's display. The application can be used in any modern web browser and works with traditional and touch devices. Concept experimentation performed at Disaster City with two pilots indicated that the spotlight feature was particularly useful while the UAV was in motion, and the sketching features were most useful while the UAV was stationary. The system will be tested with professional responders soon to determine its efficacy in a simulated response, and to inform the ongoing design process.",
keywords = "Sketch interface, Unmanned aerial vehicles",
author = "Zachary Henkel and Jesus Suarez and Duncan, {Brittany A} and Murphy, {Robin R.}",
year = "2014",
month = "1",
day = "1",
doi = "10.1145/2559636.2559838",
language = "English (US)",
isbn = "9781450326582",
series = "ACM/IEEE International Conference on Human-Robot Interaction",
publisher = "IEEE Computer Society",
pages = "172--173",
booktitle = "HRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction",

}

TY - GEN

T1 - Sky Writer

T2 - Sketch-based collaboration for UAV pilots and mission specialists

AU - Henkel, Zachary

AU - Suarez, Jesus

AU - Duncan, Brittany A

AU - Murphy, Robin R.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Sky Writer is a collaborative communication medium that augments the traditional display of a UAV pilot and allows other stakeholders to communicate their needs and intentions to the pilot. UAV pilots engaging in time-critical missions, such as urban disaster responses, often must allocate most of their cognitive capacity towards flight tasks, making communication and collaboration with other stakeholders difficult or dangerous. Sky Writer addresses the needs of stakeholders while requiring minimal cognitive effort from the UAV pilot. The application presents stakeholders with an interface that provides contextual flight information and a live video stream of the flight. Stakeholders are able to sketch directly on the video stream or use a spotlight indicator that is mirrored across all displays in the system, including the pilot's display. The application can be used in any modern web browser and works with traditional and touch devices. Concept experimentation performed at Disaster City with two pilots indicated that the spotlight feature was particularly useful while the UAV was in motion, and the sketching features were most useful while the UAV was stationary. The system will be tested with professional responders soon to determine its efficacy in a simulated response, and to inform the ongoing design process.

AB - Sky Writer is a collaborative communication medium that augments the traditional display of a UAV pilot and allows other stakeholders to communicate their needs and intentions to the pilot. UAV pilots engaging in time-critical missions, such as urban disaster responses, often must allocate most of their cognitive capacity towards flight tasks, making communication and collaboration with other stakeholders difficult or dangerous. Sky Writer addresses the needs of stakeholders while requiring minimal cognitive effort from the UAV pilot. The application presents stakeholders with an interface that provides contextual flight information and a live video stream of the flight. Stakeholders are able to sketch directly on the video stream or use a spotlight indicator that is mirrored across all displays in the system, including the pilot's display. The application can be used in any modern web browser and works with traditional and touch devices. Concept experimentation performed at Disaster City with two pilots indicated that the spotlight feature was particularly useful while the UAV was in motion, and the sketching features were most useful while the UAV was stationary. The system will be tested with professional responders soon to determine its efficacy in a simulated response, and to inform the ongoing design process.

KW - Sketch interface

KW - Unmanned aerial vehicles

UR - http://www.scopus.com/inward/record.url?scp=84896997666&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84896997666&partnerID=8YFLogxK

U2 - 10.1145/2559636.2559838

DO - 10.1145/2559636.2559838

M3 - Conference contribution

SN - 9781450326582

T3 - ACM/IEEE International Conference on Human-Robot Interaction

SP - 172

EP - 173

BT - HRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction

PB - IEEE Computer Society

ER -