Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08....

34
Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

Transcript of Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08....

Page 1: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

Color Imaging in

Endoscopy and Laparoscopy

May. 08. 2013Olympus Medical Systems Corp.

Hiroyuki Homma

Page 2: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted2 2013/5/15

Outline1. Introduction - Endoscopy Imaging Systems 2. Factors that affect color in endoscopic

imaging 3. White light endoscopy4. Narrow band imaging (NBI)5. Color management6. Summary & Area for practical improvement

Page 3: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

第 章

3 2013/5/15

Introduction: Endoscopy imaging systems

2Chap.1

Page 4: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted4 2013/5/15

Basic types of Endoscopes:

Fiberscope

Rigid Telescope

Videoscope

Direct Viewing – Optical Image

Video Endoscopes – Displayed on Monitor

Page 5: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Self Contained Endoscopes

5 2013/5/15

Battery-powered, portable endoscope

Capsule endoscope

Page 6: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted6 2013/5/15

Video Imaging System

Monitor

Light Source

Video Processor

Recording device Rigid Telescope

+ External Camera

RigidVideo Endoscope

FlexibleVideo Endoscope

Fiberoptic

Flexible Endoscope+ External Camera

Page 7: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Thoracic

Gastroenterology

Intubation

Bronchoscopy

General Surgery

ENT

UrologyOrthopedics

ENT

Esophagoscopy

Gynecology

GynecologyUrology

7

Page 8: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted8 2013/5/15

Factors that affect color in endoscopic imaging

2Chap.2

Page 9: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted9 2013/5/15

Factors affecting color

Illumination system:Light source Endoscope

Observation system:Optical System

(direct viewing endoscopes)Image Sensor

(video endoscopes)Video processorMonitor

Page 10: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted10 2013/5/15

Illumination System

LIGHT SOURCE

Light Guide(Fiber optic bundle)

Simplified model of illumination system

Lamp

ENDOSCOPE

TissueFilter

Page 11: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted11 2013/5/15

Illumination System

Light guide bundleLamp

Characteristics of Light Guide Bundle

Different types of illumination systems have different color characteristics

Characteristics of the Lamp

Filter

Xenon Lamp

Halogen Lamp

LED

Page 12: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted12 2013/5/15

Direct Viewing EndoscopesSimplified model of observation system

Rod Lens Telescope

Fiberscope

Spectral transmissionof a series of rod lenses

Spectral transmission of image guide fibers

Page 13: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted132013/5/15

Video Endoscopes

Image sensor in distal end

Image sensor in proximal end

Color Characteristicsof Image Sensor

Page 14: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted14 2013/5/15

Video Monitor

Observation Monitor

Page 15: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted15 2013/5/15

White Light Endoscopy

2Chap.3

Page 16: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Basic images for clinical examinationUsers are looking for ‘natural’ looking colorIdentifying abnormal tissue & targeting a biopsy

Gastroenterological endoscopy

16

Page 17: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted17 2013/5/15

Narrow Band Imaging (NBI)

2Chap.4

Page 18: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted18 2013/5/15

Human Tongue: Image varies with wavelength

415nm 445nm 500nm 540nm 600nm

400 450 500 550 600 nm

Narrow Band Imaging (NBI)

Page 19: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted19 2013/5/15

Structure of Vessels in Human Tongue

415nm 445nm 500nm 540nm 600nm

Narrow Band Imaging (NBI)

Page 20: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted2013/5/15

540 nmIllumination

415 nmIllumination

White Light NBIClinical images courtesy of Roy Soetikno, MD

NBI Filter

Narrow-Band Illumination

Narrow Band Imaging (NBI)

20

Page 21: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted21 2013/5/15

White Light NBI

Clinical images courtesy of Tonya Kaltenbach, MD & Roy Soetikno, MD

NBI enhances microvasculature and surface morphology

Narrow Band Imaging (NBI)

Page 22: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted22 2013/5/15

Color management

2Chap.5

Page 23: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Color Management

23 2013/5/15

Things that cannot be (easily) changed:

Color temperature of various types of lamps (xenon vs. halogen)Light sources change their color output as their lamps ageColor transmission characteristics of glass and fiberoptic bundles

Page 24: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Color Management

24 2013/5/15

Factors under the control of the manufacturer:

Manufacturing variations from device to deviceProvision of an “auto white-balance” featureAttempt to produce the most “natural” color

possible given the constraints of customer requirements, even with low-cost, battery-powered, portable systems.

Page 25: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Color Management

25 2013/5/15

Factors NOT under the control of the manufacturer:

Users mix components from various manufacturers

Users adjust the controls on the monitor to their own liking

Page 26: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted26 2013/5/15

Color Management

Due to the nature of endoscopy, the level of tissue illumination is often very uneven. Illumination follows an inverse square law.Color varies with brightness.

Brightness varies inversely by the square of the distance Clinical image courtesy of Roy Soetikno, MD

Page 27: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted27 2013/5/15

Therefore, even if an endoscope provided accurate color reproduction under ideal test conditions, actual tissue color will vary constantly during live endoscopy.

Endoscopic photo of test card with uniform color

Color Management

Clinical image courtesy of Roy Soetikno, MD

Page 28: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Prior to the mid 1980’s gastroenterologists were accustomed to seeing the reddish-yellow images produced by fiber optic instruments with halogen light sources.When video endoscopes were introduced, the new technology allowed for image color similar to viewing under sunlight (i.e., higher color temperature). However, users complained that the video image did not appear to be “natural”and requested that the video endoscope’s color be adjusted to match the fiberscope’s image.

28 2013/5/15

Color Fidelity

Page 29: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Color FidelityIn the 1990s, laparoscopy was quickly and widely adopted. Initially, laparoscopic image color was designed to be similar to that of open surgery under operating room lights.

Original pictureOriginal picture

Yellowish colorYellowish color Reddish colorReddish color29

Page 30: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

The goal is not to realize the precise color reproduction equivalent to the color seen under sunlight.

The monitor and video processor can be adjusted to match the user’s own color preferences.

The important point for endoscopic color imaging is to provide the specific image information that the user wants to see.

Color Fidelity

30

Page 31: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted31 2013/5/15

Summary & Area for practical improvement

2Chap.6

Page 32: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Summary

There are many different types of endoscopesEndoscopic systems can be complexThe color of the endoscopic image is affected by the source of illumination, the physical components of the endoscope, the method of observation, and the video monitor.Many of the factors which affect color cannot be changed. Others are uncontrolled.However, the current level of color across the broad spectrum of endoscopes appears to be acceptable to end users.

32 2013/5/15

Page 33: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma

No data copy / No data transfer permitted

Area for practical improvementWhile endoscopists generally focus on real-time imaging, image documentation is gradually becoming more important.As PACS systems and electronic medical record (EMR) systems become more integrated, there is a need for a standard format & common method of sharing and archiving color endoscopic images.In the area of filing system, for example, extended file format with color parameters for displaying images would be practical improvement.

33 2013/5/15

Page 34: Color Imaging in Endoscopy and Laparoscopy · Color Imaging in Endoscopy and Laparoscopy May. 08. 2013 Olympus Medical Systems Corp. Hiroyuki Homma