Bringing Hyperspectral Imaging Into the Mainstream · The number of proven indices has surpassed...

Bringing Hyperspectral Imaging

Into the Mainstream

Rich Zacaroli

Product Line Manager, Commercial Hyperspectral Products

Corning Advanced Optics

August 2018

© 2018 Corning Incorporated .© 2018 Corning Incorporated

Corning Incorporated is one of the world’s leading innovators in materials science. For more than 165

years, Corning has applied its unparalleled expertise in glass science, ceramics, and optical physics to

develop products and processes that have transformed industries and enhanced people’s lives.

Founded:

1851

Headquarters:

Corning, New York

Employees:

~46,000 worldwide

2017 Core Sales:

$10.3 billion

Fortune 500 Ranking (2018):

293

3Advanced Optics © 2018 Corning Incorporated

Corning has a proven track record of innovation

2012Ultra-Slim

Flexible Glass

2000Low-Density

LCD Glass

2013All-Optical

Converged

Cellular &

Wi-Fi Solution

Antimicrobial

Glass

2016High-Transmission

Light-Guide Plate

for LCD Displays

Advanced

Glass for

Wearables

Gasoline

Particulate

Filters

2017Damage-Resistant

Pharmaceutical

Glass Packaging

Ultra-Bendable

Optical Fiber

2007Tough, Thin

Cover Glass

for Mobile

Devices

2015Light, Tough

Automotive

Glass

2006High

Throughput

Cell Culture

Solutions

1982Liquid Crystal

Display Glass

1877Signal Lenses

1879Glass Bulb

for Edison’s

Electric Light

1912Railroad

Lanterns

1915Heat-Resistant

PYREX®Glass

1935Hale

Telescope

Mirror

1947Television

Picture Tube

Processes

1952Glass-Ceramics

1964Fusion

Overflow

Process

1970Low-Loss

Optical Fiber

1972Ceramic

Substrates

for Catalytic

Convertors

1932High-Purity

Fused Silica

1934Silicones

1961Space

Window Glass


Presentation Agenda

• Practicalizing hyperspectral imaging

• Use cases

• Corning Hyperspectral Products


Hyperspectral vs. Multispectral Imaging Technology

• Spectroscopy is the branch of science concerned with the

investigation and measurement of spectra when matter

reflects electromagnetic radiation.

• Hyperspectral imagers (HSI) cover many dozens to hundreds

of spectral bands contiguously

• Multispectral imagers (MSI) cover a selected set of bands

non-contiguously• Spectral information critical for research and development

applications may be missing

• Number of spectral bands is insufficient to address multitude of

developed and proven applications

• Ease of deployment and low cost makes MSI attractive for

many applications

• A product that can be both HSI and MSI and is reasonably

priced provides high flexibility for research and practical

applicationsSource: NASA (public domain information)

Reflected

Energy

Absorbed

EnergyTransmitted

Energy


Spectral Data Cube Formation

• High performance hyperspectral sensors are scanning instruments• In an airborne application the spectral data cube is formed using

aircraft motion

• In a field application a rotational stage may be used to form a spectral

data cube by scanning the HSI camera

• In a laboratory or field application a linear stage is used to translate

the subject matter across the camera field-of-view

• In an in-line processing environment the product is scanned as it is

moving along a conveyor


What is driving the need for Hyperspectral Sensors?Four main points…

• All new applications and indices are developed using hyperspectral imagery

data, and are often simplified for MSI

• The number of proven vegetation indices has surpassed the capability of

multispectral sensors

• New algorithms/applications are being developed that use the entire

spectrum to increase probability of detection, identification, and classification

• The size, weight, and cost of hyperspectral imaging sensors and systems

now approaches higher end multispectral sensors and systems


The number of proven indices has surpassed capability of MSI sensors

• ENVI incorporates 60 vegetation indices for:• Broadband Greenness

• Narrowband Greenness

• Canopy Nitrogen

• Canopy Water Content

• Dry or Senescent Carbon

• Leaf Pigments Light Use Efficiency

• New vegetation indices are expanding beyond the

visible-near-IR spectrum (> 1000 nm)

• ENVI also incorporates non-agriculture applications

44+ spectral

narrow bands

60 vegetation

indices

…are used to generate…

9Advanced Optics

Use of the entire spectrum increases probability of detection, identification, and classification(Imagery from Corning® microHSI™ 410 SHARK provided by MTSI, Inc.)

Healthy Vegetation

Dark Vehicle Paint

Gravel

Vehicle Glass


Size, weight, and cost of hyperspectral imaging sensors and systems now

approaches higher end multispectral sensors and systems

1

10

100

1000

# of spectral bands

Weight (grams)

Volume (cm2)

Estimated price

Corning microHSI 410 Sensor Tetracam mini MCA-6 Tetracam mini MCA-12 Sequoia Parrot

Hyperspectral

cameras can cost

less than the most

capable MSI

cameras

Hyperspectral

cameras provide

higher spectral

performance and

flexibility compared to

MSI cameras

Hyperspectral cameras

are comparable in size

and weigh less than the

most capable MSI

cameras

(Comparisons based on published information)


Integrated Airborne Hyperspectral System Miniaturization(Images are approximately to scale)

2008 2013 2018

Now

adaptable

to small

UAS!

> One order of

magnitude cost

reduction!

12Advanced Optics

Hyperspectral Imaging Use Cases


Crop Growth and Health Assessment/Management

• Enables the evaluation of vegetation stress, often before it is visible to the human

eye or with other sensors

• Enables the visualization of change in crop growth and health, and yield

prediction throughout the growing season

Early season Late season Post-harvest

Early stage or stressed Late stage/ robust growth


Seed Performance Analysis

• Hyperspectral imagery enables the evaluation of crop performance for different seed stocks

• The below spectral map clearly shows defined boundaries for three different Roma tomato stocks

and crop performance.

July 31 Survey

---------Seed stock #1-------- --Seed stock #2-- ---Seed stock #3----------


Native Virginia Forest(Data collected by MTSI with Corning ® microHSI™ 410 SHARK)

Modified

Red Edge

NDVI

Red Green

Ratio Index

RGBGeo-

referenced

Water Band

Index


Nitrogen Fertilization Recommendation

Nitrogen Fertilization

Recommendation

(kg/ha)


Augmentation/Replacement of Manual Processes

• HSI applications that replicate results

obtained using reliable and stable

processes that:• Are labor intensive

• Cost of equipment is high

• Successful implementation can

significantly reduce operating costs

• Co-develop with University Research

Centers• Often leveraging grant funding


Coastal and Fresh Water Lake Environmental Surveys

• Corning Hyperspectral System was flown on UAV over

shallow reef, sea grass in Florida Keys for climate

change assessment (2014)

• Corning Hyperspectral System was deployed on ISS

for sea environment assessments (2009-2014)

• Corning providing equipment and funding for

detection/classification of harmful algal blooms in New

York fresh water lakes (2018)

3-band composite image over

Cheeca Rocks coral study area;

lower image used glint

reduction algorithm

3-band composite image

over seagrass study area;

lower imageused glint

reduction algorithm

(Image processing applied by University of South Florida College of Marine Science)

Hyperspectral Imager

for the Coastal Ocean

(HICO)


Other Remote Sensing Applications

Coastal

Contamination

Open Water

Surface Contamination

Mineral and petroleum

exploration

(Public domain images)


Applications in Health and Medicine

• Cancer detection and comparison with pathological

results

• Studies underway for detection of sepsis

• Positive indications

• Moving into clinical trials

• Requires exploitation of the entire spectrum,

not just selected bands


Industrial Processing Applications


Corning® microHSI™ 410 Family of Products

410 Sensor

410 Application Development Kit

(ADK)Selectable Hyperspectral

Airborne Remote Sensing Kit (SHARK)

Spectrometer Sub-AssemblySpectrometer Core


Introduction to Corning® MicroHSI™ 425 Sensor

• World’s first commercially available hyperspectral sensor

covering entire visible range through extended short

wave infrared range from 400nm to 2500nm in a single

high spatial resolution (640 spatial pixels) sensor• One focal plane array

• One optical path

• 460 spectral bands

• Lower size, weight and power than two sensor

configuration• 2.4 kg (5.3 lb), 35 watts

• Eliminates need for precise alignment of focal length and

field-of-view of two sensors, and a more complicated

mechanical and electrical integration

microHSI™ 425 Sensor

False color image from microHSI™ 425 Sensor

Bringing Hyperspectral Imaging Into the Mainstream · The number of proven indices has surpassed...

Documents

Transcript of Bringing Hyperspectral Imaging Into the Mainstream · The number of proven indices has surpassed...