Interactive Simulation Awareness WorkshopUniversitry of California – San Diego

25 May 2010

Vince Ambrosia

NASA - Ames Research Center

870

NASA

INNOVATIVE SOLUTIONS FOR AIRBORNE FIRE MONITORING: UAS, INTELLIGENT SENSORS, AND DATA VISUALIZATION SYTEMS

“Build It and They Will Come”

“NASA Science Serving Society”

“Turning Swords Into Plowshares”

Adaptation of UAVs to Support Civilian UseNASA Ikhana with Sensor Pod

under-wing mount

NASA “Ikhana” UAVThe Ikhana is a derivative of the Predator B (MQ-9) “Reaper” UAV, designed as a NASA science and research platform. “Ikhana” is a Native American Choctaw-nation word meaning: “Intelligence, Conscience or Aware”

Length: 36 feet,Wingspan: 66 feetOperations: ~50K ft; Endurance: ~24-hoursSpeed: 170-200 ktsPayload: 2400 lbs of instrumentsMax T/O weight: 10,500 poundsC&C and sensor telemetry: C-band (local) & Ku-band (global)

Autonomous Modular Sensor (AMS)

AMS Wildfire Sensor Two environmental enclosures (data disks & GPS; and power supplies & controllers)

Scan Head

Data System

Enclosure

Sensor System: AMS Wildfire Instrument

Band Wavelength m1 0.42 - 0.452 0.45 - 0.52 (TM1)3 0.52 - 0.60 (TM2)4 0.60 - 0.625 0.63 - 0.69 (TM3)6 0.69 - 0.757 0.76 - 0.90 (TM4)8 0.91 - 1.05 9 1.55 - 1.75 (TM5) (high

gain)10 2.08 - 2.35 (TM7) (high

gain) 11 3.60 - 3.79 (VIIRS M12)

(high gain) 12 10.26 - 11.26 (VIIRS M15)

(high gain)13 1.55 - 1.75 (TM5) (low gain)14 2.08 - 2.35 (TM7) (low

gain) 15 3.60 - 3.79 (VIIRS M12)

(low gain) 16 10.26 - 11.26 (VIIRS M15)

(low gain)

Total Field of View: 42.5 or 85.9 degrees (selectable)

IFOV: 1.25 mrad or 2.5mrad ( “ )

Spatial Resolution: 3 – 50 meters (variable)

Automated On-Board ProcessingDevelop automated on-board product-generation

processes for different collection scenarios: Day / Night fire imagery; R/T Hot Spot (Fire) Algorithms; R/T BAER

and Post-Fire NBR Algorithms

Hot Spot Detection

Night

BAERNormalized Burn Ratio

“NASA Science Serving Society”

Station Fire, CA

Day

Collaborative Decision Environmentsupporting UAV wildfire monitoring missions

Objectives: • Integrate varied decision support data sets in one application

• Disseminate flight status and near-real-time sensor data

• Collaborate between remote users

Client Apps: Google Earth, Openlayer, Jabber, QuickTime, Twitter

CDE used by mission and incident management teams during 2007, 2008 and 20009 wildfire seasons.

San Diego EOC, Oct 2007

Flight plan andMODIS fire data,Oct. 24, 2007

Group IMStatus updates Streaming Video

Rice Fire 10/24-25/2007

WMSviewer

Basin Fire, 7/8/2008

• Goals – Mission planning– Situational awareness– Data visualization– Collaboration among distributed

team

• Users – Mission Development Team– Data Products Users

COLLABORATIVE DECISION ENVIRONMENT

Real-Time Information Sharing and Visualization

Sensor Data Visualization

• Camera placemarks appear when images are available

• Click on icon to display thumbnail image

• Download image from server

• “Hot Pixel” detections are available on separate layer

• Adjust 3D view of data draped on terrain

Procedure for viewing sensor data in CDE

Web-Map Services Data AccessAn enhanced browser-based viewer allows fire images and flight

tracks to be displayed on a user-selectable base-map layer.

Currently available base map layers include road, satellite and hybrid maps from Yahoo, Google and OpenStreetMap. Microsoft's "Bing" base maps will also be incorporated in the final version (2010).

“NASA Science Serving Society”

WSFM Flights 2007

August 16(10 Hrs)CA

August 29-30(16 hours);CA, NV, UT,

ID,MT, WY

September 7-8

(20 hrs)CA, OR, WA

Sept 27(10 hrs)

CABAER

Imagery

Mission NumberMission

EnduranceDate Fire Imaged Location of Fire

WSFM #1 10 Hours 8/17/2007 Zaca Fire CaliforniaTar Fire California

Colby Fire CaliforniaBabcock Fire Yosemite NP, CA

WSFM #2 16.1 Hours 8 / 29-30 / 2007 Jackrabbit Fire CaliforniaTrapper Ridge Fire IdahoCastle Rock Fire Idaho

WH Fire MontanaColumbine Fire Wyoming

Hardscrabble Fire WyomingGranite Creek Fire Wyoming

WSFM #3 20 Hours Sept 7-8 2007 Butler Fire CaliforniaNorth Fire California

Fairmont Fire CaliforniaGrouse Fire California

Lick Fire CaliforniaBald Fire California

Moonlight Fire CaliforniaGW Fire Oregon

Big Basin Fire OregonDomke Lake Fire WashingtonSouth Omak Fire Washington

Zaca Fire California

WSFM #4 9.9 Hours 9/27/2007

BAER Assessment Butler, Lick,

Moonlight Fire California

Total Mission Time: 56 HoursTotal Fires Flown: 26

States Travesed During Missions: California, Oregon, Washington, Nevada, Utah, Idaho, Montana, Wyoming

Moonlight Fire (CA)

Castle Rock Fire (ID)

So. CA Missions October 2007

~1350 nm / mission

~9 hour missions

October 24

October 25

October 26

October 28

SoCA Firestorms Mission SummaryMission Number

Mission Endurance

Date Fire Imaged

SoCA #1 9.0 Hours 10/24/2007 HarrisMcCoy

Witch / PoomachaHorno / Ammo

SlideGrass ValleyBuckweed

RanchMagic

SoCA #2 8.7 Hours 10/25/2007 HarrisMcCoy

Witch / PoomachaHorno / Ammo

SlideGrass ValleyBuckweed

Ranch

SoCA #3 7.8 Hours 10/26/2007 HarrisMcCoyRice

Witch Poomacha

AmmoSantiago

Slide

SoCA #4 7.1 Hours 10/28/2007 HarrisWitch

PoomachaRice

Horno / AmmoSantiago

SlideGrass valley

RanchBuckweed

Esperanza (BAER)Total Mission Time: 32.6

Total Fires Flown: 11 different

Poomacha / Witch Fires

Grass Valley & Slide Fire

Santiago Fire

CDE In-Use at San Diego County EOC

2008 No CA Firestorm Missions

Mission NumberMission

EnduranceDate Fire Imaged

NoCA #1 9.5 Hours 7/8/2008 Piute

Clover

Silver

North Mountain

American River

Cub Complex

Canyon Complex

Basin

Gap

NoCA #2 5.03 Hours 7/19/2008 American River

Camp

Cub Complex

Canyon

Engineering Check 3.0 Hours 9/17/2008 Piute (BAER)

Mission #3 3.5 Hours 9/19/2008 Cascadel

Hidden

Total Mission Time: 21.0

Total Fires Flown: 16

Northern California Fires Mission Summary 2008

Cub Complex

Piute Fire

Basin Fire

2009 Station Fire Mission

BAER Imagery

Flight Plan & Route

Sensor Swath Visualization

Using Instruments Together: SensorWeb

Early Days Baby Steps

• Manual coordination of acquisitions (telephone calls and Post-It notes).• Handcrafting of images and derived products.• Filled critical need, in above case (Oct. 2003 So. California wildfires).

• Use of GOES sounder to

determine which of two alternative targets is likely to be cloud free.• EO-1 added onboard classification algorithms.• Multiple images

collected 2004-2006 fire seasons.

The Teenage Years

• Coordination of multiple assets (MODIS, EO-1, ASTER and Ikhana UAS).• USAF cloud predicts.• OGC-compliant data and processing interfaces.• Bi-directional tasking

and flight planning (2007-2009).

THE FUTURE: Automated on-demand tasking and processing of multiple, heterogeneous self-registered assets including orbital, airborne and in situ sensors. Optimization of the tasking plan, post-processing, and delivery of the data are transparent to the end-user. Flight hardware segment (IPM) capable of conducting complex and custom image processing onboard with near real-time distribution to the end user via Direct Broadcast. Classifier Toolbox for ease of use.

cFE/SWA

MO

SensorWeb 3G in NASA SensorWebExtend Access and Standards into Flight Software

Users

GM

SEC

SCL/ASE

cFE/SWA

MO

I N T E R N E T

ST-5 FlatSatST-5 FlatSat

Earth Observing 1(EO-1)

Midshipman Space Technology Application

Research(MidSTAR)

Terra and AquaAlaska Ground

Station

Naval Academy Ground Station

HyspIRI

Dryden igloo

Control Centers

NASA/AMES Predator Ikhana

Berkeley Ground Station

WCPS

Next Steps

• Continued support to the Nation in 2010 & 11 with wildfire imaging capabilities on NASA and other agency (USFS) platforms.

• Transfer NASA- (and industry)-derived capabilities to operational entities

• Collaborate with International community to share and transfer capabilities.

“NASA Science Serving Society”

Accessing the Wildfire CDEStep 1: Add Network Link

Step 2: Enter URL:

http://sggate.arc.nasa.gov:9518/GoogleEarth/CDE.kml