The NEAR Project: Neuroendoscopy towards Augmented Reality
-
Upload
matteo-ciucci -
Category
Education
-
view
1.213 -
download
0
description
Transcript of The NEAR Project: Neuroendoscopy towards Augmented Reality
![Page 1: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/1.jpg)
Dr. M. Ciucci 1
Intraoperative Endoscopic Augmented Reality in Third
Ventriculostomy
Meeting 10.03.2010
Dr. M. Ciucci
Institute for Process Control and Robotics (IPR)Karlsruhe Institute of Technology (KIT)
![Page 2: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/2.jpg)
Dr. M. Ciucci 2
1. Medical Introduction
2. Technical Introduction
3. Project Setup4. Project Results
Agenda
![Page 3: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/3.jpg)
Dr. M. Ciucci 3
Medical Introduction
![Page 4: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/4.jpg)
Dr. M. Ciucci 4
Minimally Invasive Surgery: key-hole surgery carried out through a cavity or an anatomical opening which uses endoscopic devices with indirect observation of the surgical field.
Medical Introduction
Neurosurgery: surgery discipline focused on the central nervous system, peripheral nervous systems and spinal column. Neuroendoscopy: neurosurgical MIS technique where an endoscope is inserted into the patient’s brain.
![Page 5: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/5.jpg)
Dr. M. Ciucci 5
Ventricularsystem
Base of the third
ventricle: fenestration
point
Endoscopic Third Ventriculostomy
![Page 6: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/6.jpg)
Dr. M. Ciucci 6
Find 3rd ventricle floorLocate the entrance pointPerform the fenestrationCheck the fenestration
ETV: Surgeon’s view
![Page 7: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/7.jpg)
Dr. M. Ciucci 7
Technological Introduction
![Page 8: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/8.jpg)
Dr. M. Ciucci 8
The operation room: surgical navigation
Source: Biomedical Optics & Medical Imaging An open source software toolkit for image-guided surgery
Kevin Cleary, Luis Ibanez, David Gobbi, and Kevin Gary
![Page 9: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/9.jpg)
Dr. M. Ciucci 9
Surgical Navigation: simplified version
Tracking systemEndoscope
Surgical Navigation
Image from “Three-Dimensional Reconstruction and Surgical Navigation In Pediatric Epilepsy Surgery”, Chabrerie A. et alii, 1998.
Patient rigid body
![Page 10: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/10.jpg)
Dr. M. Ciucci 10
The NEAR Project
![Page 11: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/11.jpg)
Dr. M. Ciucci 11
The NEAR Project
NEAR: Neuroendoscopy towards Augmented Reality
Goal: build a navigation software with AR support for ETV
![Page 12: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/12.jpg)
Dr. M. Ciucci 12
Material and Methods
Optical Tracking system
Endoscope and camera
Image Source: “Three-Dimensional Reconstruction and Surgical Navigation In Pediatric Epilepsy Surgery”, Chabrerie A. et al., 1998.
Surgical phantom
NDI Polaris, IR passive tools,60 Hz 0.35 mm
R. Wolf single port endoscope, 6 mm, 0 °Sumix M72 2M 48fps + C-mountLucy, neurosurg. Phantom(courtesy of Prof. Dr. C. R. Wirtz and Dr. Paraskevopoulos)
![Page 13: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/13.jpg)
Dr. M. Ciucci 13
System Setup
![Page 14: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/14.jpg)
Dr. M. Ciucci 14
System Overview
Calibration
Simulation
![Page 15: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/15.jpg)
Dr. M. Ciucci 15
Results
![Page 16: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/16.jpg)
Dr. M. Ciucci 16
Augmented Reality
![Page 17: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/17.jpg)
Dr. M. Ciucci 17
Triangulation
1. Track pose 2. Triangulation2. Track features (LTK optical flow)
![Page 18: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/18.jpg)
Dr. M. Ciucci 18
Local Triangulation
![Page 19: The NEAR Project: Neuroendoscopy towards Augmented Reality](https://reader035.fdocuments.us/reader035/viewer/2022062419/558d29e8d8b42aa52a8b4687/html5/thumbnails/19.jpg)
Dr. M. Ciucci 19
NEAR
Thank you for your attention.
Acknoledgements:
Prof. H. Woern, Dr. J. Raczkowsky, University of Karlsruhe (TH), Germany; Prof. C. R. Wirtz and Prof. M.-E. Halatsch, Neurosurgical Dept. of Ulm and Günzburg, Germany; the EU for the Marie Curie FP6; the R. Wolf Company for the endoscopes; the SPL of Boston for the image of 3D Slicer and the model of the brain ventricles.