Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery

Jȩdrzej Kowalczuk, Avishai Meyer, Jay Carlson, Eric T. Psota, Shelby Buettner, Lance C Perez, Shane M Farritor, Dmitry Oleynikov

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Background: Accurate real-time 3D models of the operating field have the potential to enable augmented reality for endoscopic surgery. A new system is proposed to create real-time 3D models of the operating field that uses a custom miniaturized stereoscopic video camera attached to a laparoscope and an image-based reconstruction algorithm implemented on a graphics processing unit (GPU). Methods: The proposed system was evaluated in a porcine model that approximates the viewing conditions of in vivo surgery. To assess the quality of the models, a synthetic view of the operating field was produced by overlaying a color image on the reconstructed 3D model, and an image rendered from the 3D model was compared with a 2D image captured from the same view. Results: Experiments conducted with an object of known geometry demonstrate that the system produces 3D models accurate to within 1.5 mm. Conclusions: The ability to produce accurate real-time 3D models of the operating field is a significant advancement toward augmented reality in minimally invasive surgery. An imaging system with this capability will potentially transform surgery by helping novice and expert surgeons alike to delineate variance in internal anatomy accurately.

Original languageEnglish (US)
Pages (from-to)3413-3417
Number of pages5
JournalSurgical endoscopy
Volume26
Issue number12
DOIs
StatePublished - Dec 2012

Fingerprint

Laparoscopy
Laparoscopes
Computer-Assisted Image Processing
Minimally Invasive Surgical Procedures
Anatomy
Swine
Color
Surgeons

Keywords

  • Augmented reality
  • Computer-integrated surgery
  • Image-based reconstruction
  • Minimally invasive surgery
  • Real-time stereo matching
  • Robotic surgery

ASJC Scopus subject areas

  • Surgery

Cite this

Kowalczuk, J., Meyer, A., Carlson, J., Psota, E. T., Buettner, S., Perez, L. C., ... Oleynikov, D. (2012). Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery. Surgical endoscopy, 26(12), 3413-3417. https://doi.org/10.1007/s00464-012-2355-8

Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery. / Kowalczuk, Jȩdrzej; Meyer, Avishai; Carlson, Jay; Psota, Eric T.; Buettner, Shelby; Perez, Lance C; Farritor, Shane M; Oleynikov, Dmitry.

In: Surgical endoscopy, Vol. 26, No. 12, 12.2012, p. 3413-3417.

Research output: Contribution to journalArticle

Kowalczuk, J, Meyer, A, Carlson, J, Psota, ET, Buettner, S, Perez, LC, Farritor, SM & Oleynikov, D 2012, 'Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery', Surgical endoscopy, vol. 26, no. 12, pp. 3413-3417. https://doi.org/10.1007/s00464-012-2355-8
Kowalczuk, Jȩdrzej ; Meyer, Avishai ; Carlson, Jay ; Psota, Eric T. ; Buettner, Shelby ; Perez, Lance C ; Farritor, Shane M ; Oleynikov, Dmitry. / Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery. In: Surgical endoscopy. 2012 ; Vol. 26, No. 12. pp. 3413-3417.
@article{7c202d95be354ad484ef1a6603ecdd10,
title = "Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery",
abstract = "Background: Accurate real-time 3D models of the operating field have the potential to enable augmented reality for endoscopic surgery. A new system is proposed to create real-time 3D models of the operating field that uses a custom miniaturized stereoscopic video camera attached to a laparoscope and an image-based reconstruction algorithm implemented on a graphics processing unit (GPU). Methods: The proposed system was evaluated in a porcine model that approximates the viewing conditions of in vivo surgery. To assess the quality of the models, a synthetic view of the operating field was produced by overlaying a color image on the reconstructed 3D model, and an image rendered from the 3D model was compared with a 2D image captured from the same view. Results: Experiments conducted with an object of known geometry demonstrate that the system produces 3D models accurate to within 1.5 mm. Conclusions: The ability to produce accurate real-time 3D models of the operating field is a significant advancement toward augmented reality in minimally invasive surgery. An imaging system with this capability will potentially transform surgery by helping novice and expert surgeons alike to delineate variance in internal anatomy accurately.",
keywords = "Augmented reality, Computer-integrated surgery, Image-based reconstruction, Minimally invasive surgery, Real-time stereo matching, Robotic surgery",
author = "Jȩdrzej Kowalczuk and Avishai Meyer and Jay Carlson and Psota, {Eric T.} and Shelby Buettner and Perez, {Lance C} and Farritor, {Shane M} and Dmitry Oleynikov",
year = "2012",
month = "12",
doi = "10.1007/s00464-012-2355-8",
language = "English (US)",
volume = "26",
pages = "3413--3417",
journal = "Surgical Endoscopy and Other Interventional Techniques",
issn = "0930-2794",
publisher = "Springer New York",
number = "12",

}

TY - JOUR

T1 - Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery

AU - Kowalczuk, Jȩdrzej

AU - Meyer, Avishai

AU - Carlson, Jay

AU - Psota, Eric T.

AU - Buettner, Shelby

AU - Perez, Lance C

AU - Farritor, Shane M

AU - Oleynikov, Dmitry

PY - 2012/12

Y1 - 2012/12

N2 - Background: Accurate real-time 3D models of the operating field have the potential to enable augmented reality for endoscopic surgery. A new system is proposed to create real-time 3D models of the operating field that uses a custom miniaturized stereoscopic video camera attached to a laparoscope and an image-based reconstruction algorithm implemented on a graphics processing unit (GPU). Methods: The proposed system was evaluated in a porcine model that approximates the viewing conditions of in vivo surgery. To assess the quality of the models, a synthetic view of the operating field was produced by overlaying a color image on the reconstructed 3D model, and an image rendered from the 3D model was compared with a 2D image captured from the same view. Results: Experiments conducted with an object of known geometry demonstrate that the system produces 3D models accurate to within 1.5 mm. Conclusions: The ability to produce accurate real-time 3D models of the operating field is a significant advancement toward augmented reality in minimally invasive surgery. An imaging system with this capability will potentially transform surgery by helping novice and expert surgeons alike to delineate variance in internal anatomy accurately.

AB - Background: Accurate real-time 3D models of the operating field have the potential to enable augmented reality for endoscopic surgery. A new system is proposed to create real-time 3D models of the operating field that uses a custom miniaturized stereoscopic video camera attached to a laparoscope and an image-based reconstruction algorithm implemented on a graphics processing unit (GPU). Methods: The proposed system was evaluated in a porcine model that approximates the viewing conditions of in vivo surgery. To assess the quality of the models, a synthetic view of the operating field was produced by overlaying a color image on the reconstructed 3D model, and an image rendered from the 3D model was compared with a 2D image captured from the same view. Results: Experiments conducted with an object of known geometry demonstrate that the system produces 3D models accurate to within 1.5 mm. Conclusions: The ability to produce accurate real-time 3D models of the operating field is a significant advancement toward augmented reality in minimally invasive surgery. An imaging system with this capability will potentially transform surgery by helping novice and expert surgeons alike to delineate variance in internal anatomy accurately.

KW - Augmented reality

KW - Computer-integrated surgery

KW - Image-based reconstruction

KW - Minimally invasive surgery

KW - Real-time stereo matching

KW - Robotic surgery

UR - http://www.scopus.com/inward/record.url?scp=84871607100&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84871607100&partnerID=8YFLogxK

U2 - 10.1007/s00464-012-2355-8

DO - 10.1007/s00464-012-2355-8

M3 - Article

C2 - 22648119

AN - SCOPUS:84871607100

VL - 26

SP - 3413

EP - 3417

JO - Surgical Endoscopy and Other Interventional Techniques

JF - Surgical Endoscopy and Other Interventional Techniques

SN - 0930-2794

IS - 12

ER -