Stereoscopic vision-based robotic manipulator extraction method for enhanced soft tissue reconstruction

Jȩdrzej Kowalczuk, Eric Psota, Lance C Perez

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The availability of digital stereoscopic video feedback on surgical robotic platforms allows for a variety of enhancements through the application of computer vision. Several of these enhancements, such as augmented reality and semi-automated surgery, benefit significantly from identification of the robotic manipulators within the field of view. A method is presented for the extraction of robotic manipulators from stereoscopic views of the operating field that uses a combination of marker tracking, inverse kinematics, and computer rendering. This method is shown to accurately identify the locations of the manipulators within the views. It is further demonstrated that this method can be used to enhance 3D reconstruction of the operating field and produce augmented views.

Original languageEnglish (US)
Pages (from-to)235-241
Number of pages7
JournalStudies in Health Technology and Informatics
Volume184
DOIs
StatePublished - 2013

Fingerprint

Depth Perception
Robotics
Manipulators
Tissue
Inverse kinematics
Augmented reality
Biomechanical Phenomena
Surgery
Computer vision
Identification (control systems)
Availability
Feedback

Keywords

  • Augmented reality
  • Robotic surgery
  • Surgical modeling

ASJC Scopus subject areas

  • Biomedical Engineering
  • Health Informatics
  • Health Information Management

Cite this

Stereoscopic vision-based robotic manipulator extraction method for enhanced soft tissue reconstruction. / Kowalczuk, Jȩdrzej; Psota, Eric; Perez, Lance C.

In: Studies in Health Technology and Informatics, Vol. 184, 2013, p. 235-241.

Research output: Contribution to journalArticle

@article{f79c743dfd1e4a7b831e5f91ee6c0585,
title = "Stereoscopic vision-based robotic manipulator extraction method for enhanced soft tissue reconstruction",
abstract = "The availability of digital stereoscopic video feedback on surgical robotic platforms allows for a variety of enhancements through the application of computer vision. Several of these enhancements, such as augmented reality and semi-automated surgery, benefit significantly from identification of the robotic manipulators within the field of view. A method is presented for the extraction of robotic manipulators from stereoscopic views of the operating field that uses a combination of marker tracking, inverse kinematics, and computer rendering. This method is shown to accurately identify the locations of the manipulators within the views. It is further demonstrated that this method can be used to enhance 3D reconstruction of the operating field and produce augmented views.",
keywords = "Augmented reality, Robotic surgery, Surgical modeling",
author = "Jȩdrzej Kowalczuk and Eric Psota and Perez, {Lance C}",
year = "2013",
doi = "10.3233/978-1-61499-209-7-235",
language = "English (US)",
volume = "184",
pages = "235--241",
journal = "Studies in Health Technology and Informatics",
issn = "0926-9630",
publisher = "IOS Press",

}

TY - JOUR

T1 - Stereoscopic vision-based robotic manipulator extraction method for enhanced soft tissue reconstruction

AU - Kowalczuk, Jȩdrzej

AU - Psota, Eric

AU - Perez, Lance C

PY - 2013

Y1 - 2013

N2 - The availability of digital stereoscopic video feedback on surgical robotic platforms allows for a variety of enhancements through the application of computer vision. Several of these enhancements, such as augmented reality and semi-automated surgery, benefit significantly from identification of the robotic manipulators within the field of view. A method is presented for the extraction of robotic manipulators from stereoscopic views of the operating field that uses a combination of marker tracking, inverse kinematics, and computer rendering. This method is shown to accurately identify the locations of the manipulators within the views. It is further demonstrated that this method can be used to enhance 3D reconstruction of the operating field and produce augmented views.

AB - The availability of digital stereoscopic video feedback on surgical robotic platforms allows for a variety of enhancements through the application of computer vision. Several of these enhancements, such as augmented reality and semi-automated surgery, benefit significantly from identification of the robotic manipulators within the field of view. A method is presented for the extraction of robotic manipulators from stereoscopic views of the operating field that uses a combination of marker tracking, inverse kinematics, and computer rendering. This method is shown to accurately identify the locations of the manipulators within the views. It is further demonstrated that this method can be used to enhance 3D reconstruction of the operating field and produce augmented views.

KW - Augmented reality

KW - Robotic surgery

KW - Surgical modeling

UR - http://www.scopus.com/inward/record.url?scp=84879542559&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84879542559&partnerID=8YFLogxK

U2 - 10.3233/978-1-61499-209-7-235

DO - 10.3233/978-1-61499-209-7-235

M3 - Article

C2 - 23400163

AN - SCOPUS:84879542559

VL - 184

SP - 235

EP - 241

JO - Studies in Health Technology and Informatics

JF - Studies in Health Technology and Informatics

SN - 0926-9630

ER -