Upper Ontology Design for Application-Based Spatial

Ontologies

Eric Little, PhDD’Youville College

National Center for Ontology Research (NCOR)National Center for Multisource Information Fusion (NCMIF)

Buffalo, NY USA

little@dyc.edueglittle@eng.buffalo.edu

The Structure of an Ontology

• Upper-Level (Formal):Upper-Level (Formal):– Most general categories of existence (e.g.,

existent item, spatial region, dependent part).– This Level of the ontology is rationally driven,

meaning it is the product of philosophical reasoning.

– Relies on a sound metaphysical description of the world (e.g., realism).

The Structure of an Ontology

• Domain-Specific LevelDomain-Specific Level– Contains categories that are specific to a

particular domain of interest (disaster, military/defense, medicine).

– This level of the ontology is empirically driven, meaning it is produced by gathering expert knowledge about a given domain of interest.

– The expert knowledge is used to create a consistent and comprehensive lexicon of terms.

Synthesized Ontology Model

FormalFormalOntologyOntology(Rational)(Rational)

Application-BasedApplication-BasedFormal OntologyFormal Ontology

Collection of Non-Formal Collection of Non-Formal Information NeedsInformation Needs

(Empirical)(Empirical)

Ontologies vs. Taxonomies

Urban Environment Taxonomy

IED TaxonomyDirty BombTaxonomy

Taxonomy A Taxonomy B Taxonomy C

ONTOLOGY

ETC…

Using Knowledge Representation & Reasoning (KRR) to Conjoin Taxonomies

SPAN Taxonomy (Temporal Items)

SNAP Taxonomy (Spatial Items)

Transcategorical RelationsRepresented in KRR

Example:An Intentional Act is a Psychological Actthat depends on an agent to instantiate it. It stands in a relation of dependence toother items such as neuro-biologicalstates.

Relating Ontology to Other Engineering Practices

• Ontologies inform the design of other engineering systems (e.g., agent-based sys, decision support sys, predictive analytics, etc.) by providing a structured comprehensive picture of their domains.– Many engineering practices require a more principled basis

for their design.

• Engineering systems constrain the ontology by providing inputs such as:– User needs– Domain specificity– Computational tractability

• If you give philosophers carte blanche, remember … fools and their $ are easily parted.

Higher Level FusionThe purpose of higher level fusion is to develop probable explanations of a situation based on prior knowledge and incoming transient information to produce a coherent composite picture of the current situation along with a prediction of consequences.

A dynamic situational picture is the result of reasoning about objects, attributes, aggregates, relationships and their behavior over time within a specific context.

The process of building the dynamic situational picture requires formally structured and computationally tractable domain representation.

The purpose of higher level fusion is to develop probable explanations of a situation based on prior knowledge and incoming transient information to produce a coherent composite picture of the current situation along with a prediction of consequences.

A dynamic situational picture is the result of reasoning about objects, attributes, aggregates, relationships and their behavior over time within a specific context.

The process of building the dynamic situational picture requires formally structured and computationally tractable domain representation.

What kinds of ontologies are needed for High-level fusion & STA?

• Low – level fusion can be done (to a large degree) using existing tools such as OWL, Protégé, DAML - Oil, etc.

• However, higher-level fusion processing is concerned with providing comprehensive and consistent descriptions of highly complex world states.

• Hence we need a more “industrial strength” (cf. Musen) approach than is provided by current fusion ontologies.

InterclassIntraclass

TemporalSpatial

InterclassIntraclass

TemporalSpatial

Relations Between Situational Objects at Different Levels of Granularity

Events-Events(event aggregation)

Events-Events(event aggregation)

PO- Aggregates of POPO- Aggregates of POElementary Situation-Elementary situation(ES-ES)

Elementary Situation-Elementary situation(ES-ES)

Physical objects –Physical objects (PO-PO)

Physical objects –Physical objects (PO-PO)

Aggregates- Aggregates

Aggregates- Aggregates

CES-ESCES-ES

Combinations of ES (CES) –Combinations of ES

Combinations of ES (CES) –Combinations of ES

Processes-Processes (process aggregation)

Processes-Processes (process aggregation)

Relations

• Inter - Relationships: 1) Relationships between situational items of different types. 2) Relationships between items and aggregates of items of a different type. 3) relationships between aggregates of objects of different types

• Intra - Relationships: 1) Relationships between different physical objects or their respective attributes/properties. 2) Relationships between different clusters/aggregates of objects in the same group.

• Inter - Relationships: 1) Relationships between situational items of different types. 2) Relationships between items and aggregates of items of a different type. 3) relationships between aggregates of objects of different types

• Intra - Relationships: 1) Relationships between different physical objects or their respective attributes/properties. 2) Relationships between different clusters/aggregates of objects in the same group.

Ontologize this…Ontologize this…

J O CJ IC

U U V

G P S

S A T C O M

D S PN A T IO N A L

S E N S O R

C S G

E S GS O F

C o n t r o l

E n g a g e

T r a c k ( p r e c is e p o s i t io n a n d t im e )

E n r o u t e G u id a n c e

G P S G u id a n c e

T e r m in a l G u id a n c e

F O R C E n e t2 5 A p r i l 2 0 0 3

D R A F T

L in k 4 /1 1 /1 6 /2 2C E C /V o ic e /D a t a

L in k 4 /1 1 /1 6 /2 2V o ic e /D a t a

C O M M U N IC A T IN G

S E N S I N G

CN

D

C N DM A G T F

M P F ( F )

In t r a - T h e a t e r N e t w o r k s

L o c a l P la t f o r mN e t w o r k s

J o in t S e n s o r s

S p a c e S e g m e n tN e t w o r k s

B r o a d c a s t

T a c t ic a l S e n s o r s

C o m m a n d & C o n t r o l

C A S

T a r g e t in g

M in e R e c o n n a i s s a n c e

O u t b o a r dS e n s o r

L in k 1 6 /E P L R SV o ic e /D a t a

T h e a t e r S e n s o r s

D IS N

J F A C C

J F M C C

M in eH u n t in g -

U n d e r W a t e rR e c o n n a i s s a n c e

M C M

A c o u s t icS e a r c h

2 5 A p r i l 2 0 0 3

D R A F T

C O M M U N IC A T IN G

S E N S IN G

A T T A C K IN G

B R O A D C A S T

N O C

T e le p o r t in g

Frank White (Workshop II on Ontologies and Higher-lvl Fusion – Beaver Hollow

Existing fusion ontology models often confuse Existing fusion ontology models often confuse various kinds of relationsvarious kinds of relations

Situation Awareness (SAW) Ontology Model for Battlefield Relations (C. J. Matheus, M. M. Kokar, and K. Baclawski. (2003)

Spatial Relations

Temporal Relations

It gets worse…It gets worse…

Complex Relation

Type

Examples of Important Examples of Important RelationshipsRelationships

Topology/mereology

Direction Distance Size

DisjointJointOverlapCoverReachableUnreachableContainA part of

AlongTowardsEastWestSouthNorthSimilarOpposite

FarVery farNearVery near

Small (er)Large(r)Same

SNAP relations

Relationships between time points

Before, At the same time, Start, Finish, Soon, Very soon, Resulting in, Initiating

Relationships between time intervals

Disjoint, Joint, Overlap, Inside, Equal

SPAN relations

“Close to a hospital”

“Cluster A is larger than before”

“Along the wind direction”

“Distance between Clusters A and B is smaller than before”

“Casualty cluster A overlaps with building cluster C”

Disaster Examples:

Building Reasoning Processes with Ontologies

SNAPOntology

-Spatial ItemsOf Interest

TranscategoricalOntology

(Objects + Processes)

SPANOntology

-Temporal ItemsOf Interest

Reasoning aboutrelations represented

in Ontology

FUSION

Segment of SNAP Kharkiv Nuclear Facility Ontology

Nuclear Facility

Spatial Region

Camara

Independent Substance

ImmobileSite

Home

Concertina Wire

Mine

Facility

Building

Security System

ComputerSystem

Is located at

Site

Room

Lot

Urban Region

Neighborhood

Has State

Is located at

Is controlled by

Enduring Spatial Item

contains

Mobile Item

Soldier

Combatant

Person

Hacker

Civilian

Govt. Official

Non-combatant

Mobile Site

Has role

Has role

ALpha

Alert LevelCharlie

Bravo

Delta

Law EnforcementOfficer

Fissile StorageSection

Perimeter Back Door

Aggregates of Substances

Vehicles

Groups of People

Overlaps

TNT

Segment of SPAN ontology for Kharkiv Nuclear Facility

Setting Process

Action

Attack

Physical

Nonphysical

Cyber Attack

DecideIdentify

Freindly

Hostile

Time Period

Footprinting Sniffing

Scanning Enumerating

Recon

Intruding

Root

Other

User

EscalatingPrivaledge

Service OS

Other

Rationalize

Consolidate Reassign

Standardize Specialize

Cooperate &Interoperate

PsychologicalAttack

Sabotage

InterfereObstruct

InjureDestroy

Air AttackGround Attack

Seize

Recover Capture

Destroy

Destroy Damage

Engage

Pursue

ConventionalUnconventional

Forming ofAttitudes

Ideologies

Motives

Manifested In

Enduring Item

Spatial RegionDependent Item

Independent Item

Free Portion of Space(FIAT)

Physically BoundPortion of Space(BONA FIDE)

Stationary

Affected Area

Mobile

Quality

Quasi-Quality

Substance

Structure

Aggregate ofSubstances

Resources

Active

Inactive

Affected

UnaffectedArea

Affected

Unaffected

Agent

Civilian

Military

AlternateLocation(FEMA)

Alternate Site(Business)

Alternate WorkArea

Ambulance

Available

Incident Base(Logistics)

Base SupportInstallation(Military)

Camp(Incident Personnel)

Damage

Physical

Psychological Severe-Minor

Catchment Area

Census Tract

CensusTract

Staging Area

Check-inLocations

(Resources)

HelicopterAccomodations

Capacity

Military Items

Non-MilitaryItems

Hospital

TransportationServices

Equipment

Facilities

Systems

Roads/Highways

Bridges/TunnelsAirportsSubways

Buses

Ambulances

911 Centers

HAZUS

Construction/Removal

Response/ReliefArea (Mil/Civ)

Recovery Area(Business)

Response/ReliefAreas (Mil/Civ)

Recovery(Business)

CommandCenter

(Temporary)

IncidentCommand

Post/Center

Contents

Structural

Food

Clothing

Furniture

MajorAppliances

ContingencyPlanning Zone Severe

Crew Transport

EmergencyResponse Vehicle

Police Car

DisasterVolunteer

Moderate

Light

Designated Area(President)

Quasi-Area??

Crew Leader

DisasterCoordinating Officer

Disaster FieldOffice (DFO)

(FEMA)

Disaster Prone

BusinessRecovery

Coordinator

CoordinatingAuthority

DisasterVulnerability

Dispatch Center(Gen. Resources)

DisplacedPersons

Emergency(State of)

Foreign

Domestic

Enemy AttackInsurrection

Civil Disturbance

Earthquake

Fire

FloodMudslide

Donor

Donor

FacilitiesServices

materials

Funds

FacilitiesServices

materials

Funds

Dwelling

Home/HouseMobile Home

ApartmentHouse Boat

Non-Dwelling

Business/Commercial

PropertyBarn

Retaining WallWind Mill

Fault Line

Instrument SeismographSeisometer

Seismogram

Medical

Emergency Doctor

Emergency Nurse

Emergency MedicalTechnician (EMT)

Police

Fire

Emergency MedicalTechnician-Paramedic(EMT-P)

Govt. Official

State

Local

Federal

EmergencyOperations

Center (EOC)(Civil Govt.)

IncidentCommand System

(Facilities)

Emergency Shelter

Hypocenter Epicenter

Evacuation Area

Evacuees

Unaffected

Affected (Victim)

Displaced PersonRefugee

Evacuee

Casualty

Client (RedCross)

EmergencyPatient

Family

Injury

Level 1

Level 2

Level 3Level 4Bodily Death

Federal ResponseCenter (FEMA)

Class A (combustible solids)

Class B (gasses/liquids)

Class C (electrical equip)

Class D (combustible metals)

Focal Zone

Focus

Earthquake Area

General Pain/Suffering

Health Facility

Health Facility

Helibase

Helipad

Alternate Site

High Hazard Area(planning purposes)

Impact Area

Hot Site

Computing Facilities

TelecommunicationsFacilities

EnvironmentalInfrastructure

Individual (solemember of household)

Malnourished

RadiationExposureChemicalExposure

Trauma

TransportationMedical

Inpatient Beds

PersonnelHospital

Public

Military Personnel

Internal

External

Recovery Site

Interim Site(Temporary)

New Home Site

Response/ReliefAreas (Mil/Civ)

Recovery(Business)

Original HomeSite

Items ofAssistance

(Red Cross)

Goods

Services

JointInformationCenter (JIC)(News media)

Message Center

MobilizationCenter

(Temporary)

Oil

Off-site Storage

Duplicate VitalRecords

DuplicateDocumentation

On-Scene Coordinator(Hazardous Substance

Removal)DoD

USCGEPA

DoE

Operating Site StructuralCollapse

OperationalFacilities

PackagedDisaster Hospital

200-Bed Hospital

ShelterShort-Term

Long-Term

Receiving Area

Receiving Area

Reception CenterEvacuee

RegistrationNeeds

Assessment

RegionalOperations

Center (ROC)

ROC(post DFO)

Rescue Company(Specified Equip.)

Rescue Medical(Gen. Vehicle)

Risk Area(PlanningPurposes)

RiskHazard/Disaster

Type

Hazard/DisasterIntensity

Risk Map(Representation)

Rumor ControlCenter

Federal CoordinatingOfficer

State CoordinatingOfficer

Scientific SupportCoordinator

(SSC)

National Oceanic andAtmospheric

Administration (NOAA)

EnvironmentalProtection Agency (EPA)

Seismic Zone

SeismographStation

Red Cross Crew Leader

Scientist Seismologist

Shelteree

Shelter Manager

Situation Room

Situation Room

Spontaneous

Local

FoundationFloors

Load-bearingWalls

Ceiling

Roof

Fixed Utilities

GasElectricWaterSewage

Heating/CoolingSystems

SevereModerate

Light

Supply EmergencyResponse Vehicle

(SERV/SRV)

Logistics InitialResponse Vehicle

(LIRV)

Basic Supplies

Forms

Office Equipment

TargetPopulation

TemporaryHousing

HotelMotel

Rental Housing

Red CrossFacility

TransportAccident(State of)

Air

Road

Boat

Rail

Vulnerability(State of)

Event

Hazard

Demographics

Age ofEnvironmentResilience ofEnvironmentTechnology

Social DiversityRegional

EconomicsGlobal

Economics

Politics

Warm Site

Cold Site

Loss(State of)

Materials

Contents

Power OutageComputer Sys.

(Network)

Terminals

Workstations

Processors

Quality Scale(Metric)

State

Scope(of Disaster)

Total Affected

AffectedJurisdictions

Resources Neededfor Effective

Response

InjuredAffectedHomeless

Power

Force ofEarthquake

Cost/Price

Business Interruption

GovernmentalLevel of DisasterRelief Operation

(Red Cross)

Level 1 <$10,000

Level 2 <$50,000

Level 3 <$250,000

Level 4 <$2.5 Mill.

Level 5 $2.5 Mill. +Simluation

System Model

Mathematical

Animal

Other

Simluation

Simluation

State of Water,Gas, Electricity

Systems

State ofTransportationInfrastructure(passability,

traffic)State of

GeographicalFeatures/

Earth,Vegetation

Location, State ofPopulation(Casualties,Evacuees)

Question toEric: Is this civilinfrastructure?

Are youshowing civilinfrastructureelsewhere? Ifnot, it might be

useful torepresent it.

Question for Eric:What does this

mean?

LandAtmosphere

Hospital

Location,State,

Capacityv.Load ofFixed and

MobileResources

Location, State ofPopulation(Casualties,Evacuees)

Location,State,

Capacityv.Load ofFixed and

mobileResources

State of Water,Gas, Electricity

Systems

I am not sure about this one

CivilInfrastructure

CivilianResponders

Location,State,

Capacityv.Load ofFixed and

MobileResources

Planning andIntelligenceProcesses

Location, State ofPopulation(Casualties,Evacuees)

AmbulanceDispatchCenter/System Fire Stations

PoliceStations

Pre-IncidentDatabases

MedicalPersonnel

FirePersonnel Rescue

Personnel

PoliceOfficers

Fire Rescue/EMT

TransportationInfrastructure

CommunicationsInfrastructure

Location, State ofBuildings, Type of

Construction

Also, need torepresent state

and type ofconstruction

Eric: what about physical “damage” toparts of communications system ?

Economicbalance???

Risk v. benefitbalance ???

Small Representative Sample of the SNAP Dis-ReO Ontology w/ CWA

Bisantz, A., Rogova, G., Little, E. (2004) “On the Integration of Cognitive Work Analysis within a Multisource Information Fusion Development Methodology,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, New Orleans