DARPA Object Services and Consulting, Inc.. CoAX – Coalition Agents eXperiment AFRL, AIAI, BBN,...

DARPADARPA

Object Services and Consulting, Inc.

CoAX – Coalition Agents eXperimentCoAX – Coalition Agents eXperiment

AFRL, AIAI, BBN, Boeing, Dartmouth,AFRL, AIAI, BBN, Boeing, Dartmouth,DSTO, Lockheed Martin ATL, Michigan,DSTO, Lockheed Martin ATL, Michigan,

OBJS, QinetiQ, USC/ISI, UWF/IHMCOBJS, QinetiQ, USC/ISI, UWF/IHMCSupport from DREV, DSTL, GITI, ISX, MITRE, MIT Sloan, Schafer, Stanford, TTCPSupport from DREV, DSTL, GITI, ISX, MITRE, MIT Sloan, Schafer, Stanford, TTCP

http://www.aiai.ed.ac.uk/project/coax/http://www.aiai.ed.ac.uk/project/coax/

DARPADARPA

CoAX

CoAX/Briefing - 3

CoAXBriefing OutlineBriefing Outline

Context and ScenarioContext and Scenario What’s NewWhat’s New CoAX Binni 2001 DemoCoAX Binni 2001 Demo Technical DetailTechnical Detail Next StepsNext Steps Transition PlansTransition Plans

CoAX/Briefing - 4

CoAXContextContext

Increasing military requirements for coalition Increasing military requirements for coalition operationsoperations

Belief that agent computational model can Belief that agent computational model can support:support: Coalition interoperability requirementsCoalition interoperability requirements Dynamic and Decentralized C3IDynamic and Decentralized C3I

International Agent Research ProgrammesInternational Agent Research Programmes US DARPA Control of Agent Based Systems (CoABS)US DARPA Control of Agent Based Systems (CoABS) UK DSTL/QinetiQ Agents ProjectUK DSTL/QinetiQ Agents Project Australian and Canadian Agents and Coalition WorkAustralian and Canadian Agents and Coalition Work TTCP C3I Groups for international involvementTTCP C3I Groups for international involvement

Need for “middleware” such as is provided by Need for “middleware” such as is provided by CoABS Grid InfrastructureCoABS Grid Infrastructure

CoAX/Briefing - 5

CoAXAim of Coalition TIEAim of Coalition TIE

To addressTo address unique aspects of coalition operations through unique aspects of coalition operations through the development and evaluation of:the development and evaluation of: agent domain management servicesagent domain management services agent task, process and event management servicesagent task, process and event management services Specific agent servicesSpecific agent services

Aim will be met through delivery of:Aim will be met through delivery of: Phased technical demonstrations of increasing complexityPhased technical demonstrations of increasing complexity Integration of diverse agent systemsIntegration of diverse agent systems Development of generic Coalition-oriented grid servicesDevelopment of generic Coalition-oriented grid services

Requirements:Requirements: Use of a wide variety of different agent systemsUse of a wide variety of different agent systems Use of existing military (non-agent) applicationsUse of existing military (non-agent) applications

CoAX/Briefing - 6

CoAXDemonstration ScheduleDemonstration Schedule

1-month demo at kick-off in February 2000 showing direct connection between DERA MBP and LM ATL AODB

6-month integration milestone in July 2000 showing initial integration of selected CoAX components for year 2000 demo

CoAX Binni 2000 demo in Fall 2000: Briefing the CoAX TIE and Binni scenario Showing full integration of selected CoAX components in Binni Telling a relevant “story” about agents for information

gathering CoAX Binni 2001 demo in Fall 2001:

Fully integrating all CoAX components in a rich coalition scenario

Expanding scope to cover dynamic re-planning CoAX Binni 2002 demo in Fall 2002:

Showing dynamic aspects of coalition organization, domain management, tasking and event handling

Expanding scope to cover dynamic planning, coordination and execution.

CoAX/Briefing - 7

CoAXThe CoABS GridThe CoABS Grid

J iniLookupS ervice

D iscover ,J oin,

L ookup

Regist erCapabilit ies

Rout eS ent inel

I nf or mat ionM ediat or

A gentCommunity 2

L E I FA pplicat ion

L E I FA pplicat ion

A gentCommunity

3

D ist r ibut edO bj ect

A gentCommunity 1

Gr id S ervice H elper

Gr id I nf r ast r uct ur e S er vicesA r iadne

W ebT rader

EGents

Gr id A gent H elper

D ist r ibut edO bj ect



S endM essage

S ear ch

S ear ch



Gr id A gent H elperGr id S ervice H elper




USC/IS IARIADNE

USC/IS ITheseus

USC/IS ITEAMCORE

SRI Maestro

SRI Multi-Modal Map SRI W eather

Agent

SRI F lightAgent

OGIQuickSet

OGI AAA

CMUExPressCMU Route

P lanner CMUMessenger

CMU FlightAgent BBN/Kestrel

CAMPS

OBJSMBNLI

OBJSW ebTrader

Grid A wareS ervices

The CoABS/Infrastructure code provides a framework for integrating diverse agent-based systems, and provides additional common services.

The Grid allows agents to find services and other agents so that agent teams can be dynamically formed to solve context-based tasks.

The Grid is built using JiniTM technology. Direct agent communication is provided using message queues built on JAVA RMI. Grid Logging Markup Language based on XML.

CoAX/Briefing - 8

CoAX CoAX ComponentsCoAX Components

LAN

LAN

LANGrid DARPADARPACoABS GridCoABS Grid(GITI, ISX)(GITI, ISX)

Agent FrameworksAgent FrameworksKAoS Agents (IHMC, Boeing)KAoS Agents (IHMC, Boeing)NOMADS Mobile Agents (IHMC)NOMADS Mobile Agents (IHMC)EMAA/CAST Agents (LMEMAA/CAST Agents (LM--ATL)ATL)GMAS (Dartmouth, IHMC, LM-ATL)GMAS (Dartmouth, IHMC, LM-ATL)D’Agents (Dartmouth)D’Agents (Dartmouth)eGents (OBJS)eGents (OBJS)

Agent Grid ServicesAgent Grid ServicesTaskTask, Process, Process and Even and Event t Management (AIAI)Management (AIAI)Domain Management Services (IHMC, Boeing)Domain Management Services (IHMC, Boeing)Asynchronous Wireless Connectivity (OBJS)Asynchronous Wireless Connectivity (OBJS)Plan Deconfliction (Michigan)Plan Deconfliction (Michigan)

Military Military SystemsSystemsCAMPS (AFRL,GITI, BBN)CAMPS (AFRL,GITI, BBN)MBP (MBP (QinetiQQinetiQ))Situation Viewer (QinetiQ)Situation Viewer (QinetiQ)……

Agents on the GridAgents on the GridAODB Agent (LMAODB Agent (LM--ATL)ATL)Observer Agents (Dartmouth)Observer Agents (Dartmouth)eGents E-mail Agents (OBJS)eGents E-mail Agents (OBJS)Malicious Agents (IHMC)Malicious Agents (IHMC)Web Weather Agent (USC/ISI)Web Weather Agent (USC/ISI)……

CoAX/Briefing - 9



CoAX/Briefing - 10

CoAXNew Parts in 2001 DemoNew Parts in 2001 Demo

• Generic servicesGeneric services• IHMC/Boeing - Domain management - KAoS Grid Helper for IHMC/Boeing - Domain management - KAoS Grid Helper for

easy integration of any grid agent, use of resource and easy integration of any grid agent, use of resource and conversation management to up pace, integration with grid conversation management to up pace, integration with grid security services, hierarchical domains, DAML-based KAoS security services, hierarchical domains, DAML-based KAoS Policy RepresentationPolicy Representation

• AIAI/QinetiQ - Task/process/event management - multiple AIAI/QinetiQ - Task/process/event management - multiple panels, issue passing, reporting, more generic approach, XML panels, issue passing, reporting, more generic approach, XML process models, initial process librarian, “catch-all” for any process models, initial process librarian, “catch-all” for any issue and report (in simple way), can use partial knowledgeissue and report (in simple way), can use partial knowledge

• New Agent Communications MechanismsNew Agent Communications Mechanisms• OBJS - eGents e-mail and wireless/untethered agentsOBJS - eGents e-mail and wireless/untethered agents• Dartmouth/IHMC/LM-ATL - GMAS mobile agentsDartmouth/IHMC/LM-ATL - GMAS mobile agents

• New functional partsNew functional parts• Michigan - Plan Deconfliction AgentMichigan - Plan Deconfliction Agent• Dartmouth - Observer AgentsDartmouth - Observer Agents• OBJS – MBNLI natural language data base queriesOBJS – MBNLI natural language data base queries• QinetiQ – Interface Agents and Semantic Interoperability (XSLT)QinetiQ – Interface Agents and Semantic Interoperability (XSLT)• All - Shared models and messages in XML formatAll - Shared models and messages in XML format

CoAX/Briefing - 11



CoAX/Briefing - 12

CoAX CoAX Demo EmphasisCoAX Demo Emphasis

Recovery

• Conflict resolution• Re-deployment• Peace support

Linear

Initial Planning

• Political aims• Military guidance• Campaign planning• Commander's intent• Deployment

Linear

Focus of theCoAX Binni 2000

Demo

Execution

• Variable Organizations• An opponent• Campaign re-planning• Short-notice taskings• Operation execution• Execution monitoring• Reporting / feedback• Outcome assessment

Dynamic / iterativeuncertain

Focus of theCoAX Binni 2001

Demo

W E

N

S

CapeVincent

CapeAmstado

Cac

a

KasoLagoon

Amisa

Jacal

Pra

Ankobra

Tana

Ofin

Afr

am

Daka

Black Caca

Kapowa

White C

aca

Mawli

LAKE CACA

Forces separated by Firestorm

AGADEZ

GAO

BinniBinni

Laki SafariPark

Gaoforces

AgadezForces

False Agadezforces

FIRESTORM

False Gaoforces

GRID / Agent-enabled Intrastructure / Admin ToolsGRID / Agent-enabled Intrastructure / Admin Tools

Process PanelProcess Panel

Com

mon

/ S

hare

d In

tel

Com

mon

/ S

hare

d In

tel

Db1Db1

MCAMCACoalition / JTFHQCoalition / JTFHQ

ObserversObservers D'agentD'agent

e-gente-gent

D'AOD'AO

D'GOD'GO

Db2Db2

JFAC HQJFAC HQ

AODBAODB

AL PlanAL Plan

MBP PlansMBP Plans

Db3Db3

CAOC / Combat OpsCAOC / Combat Ops

MBP OpsMBP Ops

Event PanelEvent Panel CODBCODB

Db4Db4

US National HQUS National HQ

AODBAODB EMAAEMAA ALDBALDB

CAMPSCAMPS

DbiiDbii

Intel USIntel USUK National HQUK National HQ

Intel UKIntel UKDbiDbi

Other National HQOther National HQ

OtherOther

Gao IntelGao Intel

Gao ObsGao Obs

DbiiiDbiii

NO

MA

DS

Gua

rded

“O

bser

vers

”UNSGSRUNSGSR

UN PanelUN Panel

CoAX 18-month Demo - Agent DomainsCoAX 18-month Demo - Agent Domains

CYBERSPACECYBERSPACEWeatherWeatherAriadneAriadne e-gentse-gentsMBNLIMBNLI

Grid / Common / Shared Coalition dataGrid / Common / Shared Coalition data

JFAC HQ

The Coalition

JTFHQ US HQ UK HQ

Top-level task to JFACCand 3 sub-tasks

Combat Ops

Eve

nt P

anel

Eve

nt P

anel

EventsI-DEEL

Part 1: 1505 - Firestorm media issue at UN - JTFC considers alternatives to Firestorm and tasks JFACC to report.

UNTasking

Pro

cess

Pan

elP

roce

ss P

anel

I-LEED

COAs


JFAC HQ

Combat Ops

The Coalition

JTFHQ US HQ UK HQ

Pro

cess

Pan

elP

roce

ss P

anel

Confirm task underwayReport times to JTFC

I-LEED

Eve

nt P

anel

Eve

nt P

anel

EventsI-DEEL

MB

P O

psM

BP

Ops

Evaluatetiming

info (First aircraft arealready airborne,

48 minutes to commit,106 mins left before TOT,)

Part 2: 1515 - Cbt Ops staff enter tasking events into the Event Panel and use MBP Ops to find out time left for decisions.

The World(Binni)

CYBERSPACECYBERSPACE


JFAC HQ

Combat Ops

The Coalition

JTFHQ US HQ UK HQ

LakiLaki

e-gente-gent

Bro

wse

rB

row

ser

(3) Subscribe

Bro

wse

rB

row

ser

MBNLIMBNLI

(4, 8) Herd data

Part 3: 1520 - Cbt Ops staff locate wildlife info via Internet. Staff subscribe to the e-Gents service. MBNLI used.

KAoS / The GridKAoS / The Grid

JFAC HQJFAC HQ(5) e-gents on(5) e-gents onelephants areelephants are

emailed and anemailed and aninfo update requestedinfo update requested

(2) JFACC then requests(2) JFACC then requestsinformation (RFI) aboutinformation (RFI) about

movements of mammalsmovements of mammalsin the Firestorm areain the Firestorm area

JTF HQJTF HQ Laki Safari ParkLaki Safari Park

ee

eeee

ee

ee

eeee

Laki Safari Park Home PageLaki Safari Park Home Page

Update Elephant InformationUpdate Elephant Information

WFPW DatabaseWFPW Database

(7) which then(7) which thenupdates siteupdates site

data / data / content content

SiteSitedatadata

(6) e-gents on(6) e-gents onelephants returnelephants return

updated dataupdated data

(1) JTFC requests confirmation the Firestorm(1) JTFC requests confirmation the Firestormwon't create media problem over wildlifewon't create media problem over wildlife


(3) JFAC staff(3) JFAC staffsearch web and findsearch web and find

Laki web site andLaki web site anduse subscribe linkuse subscribe link

WebWebBrowserBrowser

(4, 8) Non-english (4, 8) Non-english operatoroperator

uses MNBLI to find outuses MNBLI to find outherd migration dataherd migration data

MBNLIMBNLIinterfaceinterface

WebWebBrowserBrowser

The World(Binni)



JFAC HQ

Combat Ops

The Coalition

JTFHQ

AriadneAriadne

US HQ UK HQ

M&SM&S

'Pre-canned' elephantmovement dataLakiLaki

e-gente-gent

XSLT InterfaceXSLT Interface(9) Wrap

Part 4: 1525 - Combat Ops staff create feed from Laki site to MBP Ops / SitView using Ariadne wrapper / XSLT Translator.

KAoS / The GridKAoS / The Grid

Laki Safari ParkLaki Safari Park

ee

eeee

ee

ee

eeee

Laki Safari Park Home PageLaki Safari Park Home Page

Update Elephant InformationUpdate Elephant Information

WFPW DatabaseWFPW Database

JFAC HQJFAC HQ


(2) JFACC then requests information (RFI) (2) JFACC then requests information (RFI) about movements of mammalsabout movements of mammals

in the Firestorm areain the Firestorm area(10) Information returned ...(10) Information returned ...

EPEP

MBPMBPOpsOps

SituationSituationViewerViewer

HerdHerdIconIcon

HerdHerdDataData

JTF HQJTF HQ (1) JTFC requests confirmation that(1) JTFC requests confirmation thatthe Firestorm won't create mediathe Firestorm won't create media

problem over wildlifeproblem over wildlife(11) Response recieved(11) Response recievedPPPP

SiteSitedatadataAriadneAriadne

wrapperwrapper

(9) CAOC staff use Ariadne-wrapped(9) CAOC staff use Ariadne-wrappedsite data to feed CAOC / observers domainsite data to feed CAOC / observers domain

XSLT Inter-XSLT Inter-face Agentface Agent

XSLT InterfaceXSLT Interface(9) Wrap

The World(Binni)



JFAC HQ

The Coalition

JTFHQ US HQ UK HQ

FirestormFirestormGO!GO!

Observers 'db'

Provide Observer data

D'GOD'GO Grid helperGrid helper

ObsObsDbDb

Gao ObsGao Obs

D'AOD'AO

JSTARSJSTARS

SitV

iew

SitV

iew

'Rea

l-tim

e' fe

ed

MB

P O

psM

BP

Ops

Part 5: 1526 - JTFC authorises Firestorm 'Go'. Laki / observer info dynamically redisplayed on MBP Ops / SitViewer.

The World(Binni)



JFAC HQ

Combat Ops

The Coalition

JTFHQ US HQ UK HQD

econ

flict

Dec

onfli

ct

Plan changes in,deconflictions out

MCA

Eve

nt P

anel

Eve

nt P

anel

EventsI-DEEL

Plan OK/ not OK

AODBAODB

ALDBALDB

Intel USIntel US Intel UKIntel UKCODBCODB

Other 'plan' information

Plan changes out,deconflictions in

MB

P O

psM

BP

Ops

Part 6: 1535 - 2ndry target plan from MBP must now be deconflicted with existing plans.

Combat Ops

I-DEELI-DEEL(Chief of (Chief of

Combat Ops)Combat Ops) 1) Event: avoid elephants -Entered into IDEEL

MBP OpsMBP Ops2) MBP Operator told to re-plan / revise to avoid elephants

4) MCA gets other plans from other agents (or from file or URL or stored in memory)

5) Progess reported to I-DEEL and finished [OK / NOT OK]

MCAMCA

3) MBP requests deconfliction of modified plans from MCA

6) MCA detailed results can be viewed in GUI

Iterate

The World(Binni)



JFAC HQ

Combat Ops

The Coalition

JTFHQ US HQ UK HQ

Intel USIntel US Intel UKIntel UK

M&SM&S

Pre

-can

ned

data

to d

rive

SitV

iew

out

,au

thor

ised

cha

nges

in.

FirestormFirestormGO!GO!

SitV

iew

SitV

iew

'Rea

l-tim

e' fe

ed

Pro

cess

Pan

elP

roce

ss P

anel

Eve

nt P

anel

Eve

nt P

anel

Agadez Attack!!!

EventsI-LEED

I-DEEL

InterfaceInterface

NRT Data

Agadez HVAAAgadez HVAA

ObsObsDbDb

D'AOD'AO

Gao ObsGao Obs

Observers 'db'

Grid helperGrid helper

JSTARSJSTARSD'GOD'GOKPATKPAT

GoGo

Part 7: 1601 - Agadez fighters start HVAA, JSTARS must 'regress' and observer agents on board 'SCRAM' elsewhere.

CoAX/Briefing - 26



CoAX/Briefing - 27

CoAXTechnical DetailsTechnical Details

UWF/IHMC – Domain Management and UWF/IHMC – Domain Management and Mobility & Security ServicesMobility & Security Services

Edinburgh/AIAI – Process and Event PanelsEdinburgh/AIAI – Process and Event Panels QinetiQ – Shared Visualisations and QinetiQ – Shared Visualisations and

Data Translation Data Translation OBJS – eGents Agents Over E-mailOBJS – eGents Agents Over E-mail USC/ISI – Open Information AccessUSC/ISI – Open Information Access Michigan – Plan CoordinationMichigan – Plan Coordination

CoAX/Briefing - 28

CoAXAgent DomainsAgent Domains

A

A

AAA

AA

AA

A

A

AA

DM

•Group of agents registered with a common Domain Manager•Can be distributed across multiple hosts•Can be hierarchical/nested or “overlapping”(2002 implementation)•Provides for common administration and enforcement of domain-wide, VM-specific, and agent-specific policies.

CoAX/Briefing - 29

CoAX

OtherNation's'Domain'

US CountryUS Country'Domain''Domain'

UK Country'Domain'

JFAC HQ'sOrganizational 'Domain' JTFHQ's Organizational

'Domain'

Tactical AirTactical AirOperations FunctionalOperations Functional

'Domain''Domain'

Coalition Domain Types

CoAX/Briefing - 30

CoAXPolicy Concerns Go Beyond Policy Concerns Go Beyond

Typical Security IssuesTypical Security Issues

Access management: Who can access what services? Access management: Who can access what services? Registration management: Who can join the domain Registration management: Who can join the domain

under what circumstances?under what circumstances? Resource management: Who can have which kind Resource management: Who can have which kind

and how much of a given computing resource?and how much of a given computing resource? Mobility management: What constraints should be Mobility management: What constraints should be

placed on mobile code?placed on mobile code? Communication management: What constraints Communication management: What constraints

govern conversations among agents? govern conversations among agents? Obligation management: Are agents meeting their Obligation management: Are agents meeting their

commitments?commitments?

CoAX/Briefing - 31

CoAXNew Development: KAoS New Development: KAoS Agent Registration HelperAgent Registration Helper

Generic KAoSGuard is instantiated automaticallyGeneric KAoSGuard is instantiated automatically Registration of Guard with Domain Manager handledRegistration of Guard with Domain Manager handled Guard enforces policies or delegates to other Guard enforces policies or delegates to other

enforcersenforcers Expanding set of policies that generic Guard can Expanding set of policies that generic Guard can

enforceenforce Domain Registration is handled automaticallyDomain Registration is handled automatically

KAoSAgentRegistrationHelper registers both with the KAoSAgentRegistrationHelper registers both with the Grid and with the Domain ManagerGrid and with the Domain Manager

Domain Manager verifies that agent is guardedDomain Manager verifies that agent is guarded Domain-aware agents will be able to:Domain-aware agents will be able to:

register simultaneously with multiple domainsregister simultaneously with multiple domains register and unregister at willregister and unregister at will

Collaboration with GITI resulted in many improvements in Collaboration with GITI resulted in many improvements in the latest CoABS Grid Releasethe latest CoABS Grid Release

CoAX/Briefing - 32

CoAXNext Steps: KAoS Policy Next Steps: KAoS Policy

Representation (KPR)Representation (KPR) DAML (DARPA Agent Markup Language) extends *ML semantics:DAML (DARPA Agent Markup Language) extends *ML semantics:

XML allows users to add arbitrary structuresXML allows users to add arbitrary structures RDF extends XML, meaning expressed in subject-RDF extends XML, meaning expressed in subject-

verb-object triplesverb-object triples DAML extends RDF to express taxonomies and DAML extends RDF to express taxonomies and

inference rulesinference rules Is being defined by DARPA and the W3C Is being defined by DARPA and the W3C

(www.daml.org)(www.daml.org) KPR DescriptionKPR Description

DAML-based ontologiesDAML-based ontologies Distinguishes between authorizations and obligationsDistinguishes between authorizations and obligations

Provides basis for:Provides basis for: Policy conflict resolutionPolicy conflict resolution Policy disclosure managementPolicy disclosure management Reasoning about actionsReasoning about actions Policy specificationPolicy specification

CoAX/Briefing - 33

CoAXNOMADS Mobility and NOMADS Mobility and

SecuritySecurity NOMADS adds mobility services to the CoABS GridNOMADS adds mobility services to the CoABS Grid

Allows new agents to be launched to systems as neededAllows new agents to be launched to systems as needed Allows agents to move across systemsAllows agents to move across systems

Mobility may be forced (external event driven) or autonomousMobility may be forced (external event driven) or autonomous Forced mobility scenario – Scramming agents from J-STARS to Forced mobility scenario – Scramming agents from J-STARS to

Ground Platform (18-month demo)Ground Platform (18-month demo) NOMADS provides secure execution of agentsNOMADS provides secure execution of agents

Custom Aroma Java Virtual Machine provides extensive Custom Aroma Java Virtual Machine provides extensive resource control capabilitiesresource control capabilities

Enforces resource policies specified through KAoSEnforces resource policies specified through KAoS Protects against Denial-of-service attacks (shown in 9-Protects against Denial-of-service attacks (shown in 9-

month demo)month demo) Dynamically adjusts resources based on mission priorities Dynamically adjusts resources based on mission priorities

(30-month demo)(30-month demo) Working with Sun Labs to transition resource control into Working with Sun Labs to transition resource control into

commercial Javacommercial Java

CoAX/Briefing - 34





CoAX/Briefing - 35

CoAX Aim is a Workflow “Catch All”Aim is a Workflow “Catch All” Can take ANY requirement to:Can take ANY requirement to:

Handle an issueHandle an issue Perform an activityPerform an activity Respect a constraintRespect a constraint

Deals with these via:Deals with these via: Internal capabilitiesInternal capabilities External capabilitiesExternal capabilities Manual activityManual activity Reroute or delegate to other panels or agentsReroute or delegate to other panels or agents Plan and execute a composite of these capabilitiesPlan and execute a composite of these capabilities

Receives reports and interprets them to:Receives reports and interprets them to: Understand current status of issues, activities and constraintsUnderstand current status of issues, activities and constraints Understand current world state, especially status of process Understand current world state, especially status of process

productsproducts Help user control the situationHelp user control the situation

Copes with partial knowledgeCopes with partial knowledge

CoAX/Briefing - 36

CoAX I-X ApproachI-X Approach

The I-X approach involves the use of shared models for The I-X approach involves the use of shared models for task directed communication between human and task directed communication between human and computer agents who are jointly exploring (via some computer agents who are jointly exploring (via some process(es)) a range of alternative options for the process(es)) a range of alternative options for the synthesis of an artifact such as a design or a plan (termed synthesis of an artifact such as a design or a plan (termed a product).a product).

I-X system or agent has two cycles:I-X system or agent has two cycles: Handle IssuesHandle Issues Respect Domain ConstraintsRespect Domain Constraints

I-X system or agent carries out a (perhaps dynamically I-X system or agent carries out a (perhaps dynamically determined) process which leads to the production of (one determined) process which leads to the production of (one or more alternative options for) a synthesised artifact.or more alternative options for) a synthesised artifact.

I-X system or agent views the synthesised artifact as being I-X system or agent views the synthesised artifact as being represented by a set of constraints on the space of all represented by a set of constraints on the space of all possible artifacts in the domain.possible artifacts in the domain.

CoAX/Briefing - 37

CoAX I-TEST, I-LEED & I-DEELI-TEST, I-LEED & I-DEEL

LA N

LA N

LA NGrid

DARPADARPACoABS GridCoABS Grid

CoAX/Briefing - 38




Data TranslationData Translation OBJS – eGents Agents Over E-mailOBJS – eGents Agents Over E-mail USC/ISI – Open Information AccessUSC/ISI – Open Information Access Michigan – Plan CoordinationMichigan – Plan Coordination

CoAX/Briefing - 39

CoAXQinetiQ Technical InputQinetiQ Technical Input

Storyboard & scenario dataStoryboard & scenario data Systems integration leadSystems integration lead Master Battle PlannerMaster Battle Planner Flexible VisualisationFlexible Visualisation

Use of Embodied Interface Agents / NLPUse of Embodied Interface Agents / NLP Translation and forwarding agentsTranslation and forwarding agents Semantic Web Technology Semantic Web Technology

investigationinvestigation

CoAX/Briefing - 40

CoAXMaster Battle PlannerMaster Battle Planner

CoAX/Briefing - 41

CoAXFlexible VisualisationFlexible Visualisation

Allow customisable visualisation of any Allow customisable visualisation of any coalition datacoalition data

Map-based visualisation using Map-based visualisation using OpenMap (BBN Technologies)OpenMap (BBN Technologies)

Multiple projections; terrain data etcMultiple projections; terrain data etc Layers allow clean separation of Layers allow clean separation of

information and rapid addition of new information and rapid addition of new requirementsrequirements

Agent-enabled for distributed Agent-enabled for distributed visualisation of dynamic datavisualisation of dynamic data

Data translation allows almost any XML Data translation allows almost any XML input...input...

CoAX/Briefing - 42

CoAXFlexible VisualisationFlexible Visualisation

CoAX/Briefing - 43

CoAXTranslation AgentsTranslation Agents

Agent using XSL Transformations allows Agent using XSL Transformations allows complete reformatting of XML messagecomplete reformatting of XML message

Input via Grid (active or passive), file, Input via Grid (active or passive), file, HTTP...HTTP...

Automatic translation and forwarding Automatic translation and forwarding once set up (to any number of agents).once set up (to any number of agents).

Rapid integration and change possible Rapid integration and change possible due to declarative mappingdue to declarative mapping

Result: general-purpose “glue” for agent Result: general-purpose “glue” for agent integrationintegration

CoAX/Briefing - 44


Stylesheet

OtherAgents

<?xml version="1.0"?> <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0"> <xsl:output method="xml" indent="yes"/>

<xsl:template match="obmsg"><MBPDATA><xsl:apply-templates select="obs|obsvr"/></MBPDATA></xsl:template>

Grid

HTTP

Files

CoAX/Briefing - 45


<agent_output date='Tue Jul 17 13:52:24 GMT+01:00 2001'><OBJECT>

<ROW><hname>Big_Bill</hname><location>34.51.80E/17.01.70N</location><altitude>270</altitude><velocity>5</velocity><airtemp>91</airtemp><humidity>31</humidity><bodytemp>99</bodytemp><bloodpressure>110/50</bloodpressure><pulse>72</pulse><basalskinresponse>430</basalskinresponse><time>2012/09/24_17:00:00</time>

</ROW></OBJECT></agent_output>

<?xml version="1.0" encoding="UTF-8"?><MBPDATA> <MBPOBJECT> <GROUND> <ID>Elephant_Big_Bill</ID> <NOTES>Elephant data from Egents</NOTES> <LOCATION EW="E" NS="N" LON="34.8722" LAT="17.0361"/> <ALLEGIANCE VALUE="3"/> <STATUS VALUE="2"/> <DESCRIPTION>Elephant Herd Leader</DESCRIPTION> <MOBILITY VALUE="2"/> </GROUND> </MBPOBJECT></MBPDATA>

CoAX/Briefing - 46

CoAXSemantic WebSemantic Web

Investigations into Resource Investigations into Resource Description Framework (RDF), DARPA Description Framework (RDF), DARPA Agent Markup Language/Ontology Agent Markup Language/Ontology Inference Layer (DAML+OIL) and the Inference Layer (DAML+OIL) and the W3C Semantic Web initiativeW3C Semantic Web initiative

““The way the web was meant to be”The way the web was meant to be” Powerful and flexible storage and Powerful and flexible storage and

search of data - beyond databases search of data - beyond databases Potential for automated discovery and Potential for automated discovery and

invocation of agents and services invocation of agents and services Publication in SWWSPublication in SWWS

CoAX/Briefing - 47

CoAXRDF BrowserRDF Browser

CoAX/Briefing - 48

CoAXSemantic Web - ExamplesSemantic Web - Examples

Backing knowledge base for SitViewerBacking knowledge base for SitViewer Auto translation (unique names; URIs)Auto translation (unique names; URIs) ACL (more flexible than XML) ACL (more flexible than XML) Assembly of partial data, with Assembly of partial data, with

timestamp, origin and other metadatatimestamp, origin and other metadata Markup of human-readable documentsMarkup of human-readable documents

CoAX/Briefing - 49





CoAX/Briefing - 50

CoAX OBJS eGents: OBJS eGents: Agents over E-mailAgents over E-mail

OBJS eGents: OBJS eGents: Agents over E-mailAgents over E-mail

• Thesis: Integration of agent technology with pervasive Web-ORB-E-mail backplanes is a route to making agent technology open, pervasive and robust.

• eGents are agents which communicate over e-mail. eGents leverages pervasive, robust email infrastructure, inherits support for disconnected operations, message queueing, mobile users, firewalls, filtering, logging, and security. eGents use FIPA or KQML Agent Communication Language (ACL) encoded in XML. No ACL parser needed. Status: Prototype, NEO demo, gridified, on wireless Palm. Spec submitted to FIPA. In progress: packaging and numerous extensions.

ProblemProblem CoAX ImpactCoAX Impact

ApproachApproach

• Dynamic military situations are often disconnected and asynchronous. Need a scalable way to deliver agent messages to 1000’s of (wireless) platforms.

• Agent systems are often closed and require a lot of specialized agent technology. Email is a common denominator in coalition situations.

• By 2012 imagine free eGents attached to sensors, actuators, people, equipment, & locations as pervasive observers & actors

• Anyone with e-mail can create an agent service that anyone else can use. New eGent apps can be downloaded to the field as situations change.

In one eGents application, each evacuees are given a Personal Status Monitor, which measures location, vital signs, etc.

The PSM contains an eGent which intermittently communicates to subscribing entities using email protocols.

Liaison

Command Post

Family Member

Medevac

Evacuees

eGentsInside

CoAX/Briefing - 51

CoAX OBJS eGents: OBJS eGents: Agents over E-mailAgents over E-mail

OBJS eGents: OBJS eGents: Agents over E-mailAgents over E-mail

CoAX/Briefing - 52





CoAX/Briefing - 53

CoAX USC/ISI Open USC/ISI Open Information AccessInformation Access

Provide real-time access to Web data sourcesProvide real-time access to Web data sources Tools for learning wrappers to extract data for Tools for learning wrappers to extract data for

semi-structured sourcessemi-structured sources Agents learn the structure of data to support:Agents learn the structure of data to support:

Source verificationSource verificationautomatically detect when the source no longer automatically detect when the source no longer

provides correct data (possibly because the provides correct data (possibly because the source has changed)source has changed)

Source reinductionSource reinductionautomatically revise wrapper when site changeautomatically revise wrapper when site change

CoAX/Briefing - 54

CoAX

CoAX/Briefing - 55





CoAX/Briefing - 56

CoAXSome SolutionSome Solution

ConceptsConcepts

Agents’ plans can be represented hierarchically, Agents’ plans can be represented hierarchically, where abstract levels summarize the where abstract levels summarize the (alternative) activities they encompass(alternative) activities they encompass

Operation_FirstAidFLY USS_H_Clinton Ingress1

FLY Egress2 USS_H_Clinton

Provide_Supply

Supply_via_Depot2Supply_via_Trucks

FLY Trucks Egress2

Supply_Trucks

FLY Ingress1 Trucks

FLY Depot2 Egress2

Supply_Depot2

FLY Ingress1 Depot2

CoAX/Briefing - 57

CoAXSome SolutionSome Solution

Concepts (cont)Concepts (cont)

Abstract plan spaces can be searched more Abstract plan spaces can be searched more efficiently (top-down) to discover potential efficiently (top-down) to discover potential conflicts and to evaluate potential resolutionsconflicts and to evaluate potential resolutions

Choosing the level for resolving conflicts Choosing the level for resolving conflicts balances coordination effort with the quality of balances coordination effort with the quality of concurrent activity and plan robustnessconcurrent activity and plan robustness

CoAX/Briefing - 58

CoAX Top-Down CoordinationTop-Down Coordination

CoAX/Briefing - 59


CoAX/Briefing - 60


CoAX/Briefing - 61


CoAX/Briefing - 62


CoAX/Briefing - 63


CoAX/Briefing - 64


CoAX/Briefing - 65


CoAX/Briefing - 66


CoAX/Briefing - 67

CoAX MCA: Multi-Level MCA: Multi-Level Coordination AgentCoordination Agent

MCA implemented as a Grid-aware serviceMCA implemented as a Grid-aware service Demonstrated applicability in various tasksDemonstrated applicability in various tasks MCA integrated into Coalition Agents eXperiment MCA integrated into Coalition Agents eXperiment

TIETIE Receives intended plan information from Master Receives intended plan information from Master

Battle Planner, along with plans from “other” allied Battle Planner, along with plans from “other” allied agentsagents

Notifies user(s) through process panel of any Notifies user(s) through process panel of any conflicts and alternative ways of deconflictingconflicts and alternative ways of deconflicting

Respects hard time commitments of MBP and of Respects hard time commitments of MBP and of activities already in progressactivities already in progress

Allows user to select an option (or none)Allows user to select an option (or none)

CoAX/Briefing - 68

CoAX

Deconfliction OptionsDeconfliction Options

CoAX/Briefing - 69

CoAX

Future PlansFuture Plans

Increasing the ability to work quickly and effectively Increasing the ability to work quickly and effectively in non-episodic cases (e.g., incremental coalition in non-episodic cases (e.g., incremental coalition formation)formation)

Distributing MCA services across multiple agents to Distributing MCA services across multiple agents to improve reliability and scalabilityimprove reliability and scalability

Design and analyze extensions for efficiently Design and analyze extensions for efficiently discovering and exploiting synergistic interactionsdiscovering and exploiting synergistic interactions

Experiment on increasingly difficult (Coalition) Experiment on increasingly difficult (Coalition) scenariosscenarios

Transition: CoAX, STRATCOM?, NASA-JPLTransition: CoAX, STRATCOM?, NASA-JPL

CoAX/Briefing - 70



CoAX/Briefing - 71

CoAX CoAX Binni 2002CoAX Binni 2002 (Fall 2002) Demo Plan (Fall 2002) Demo Plan

Dynamic “come as you are” coalition formation Dynamic creation of ‘virtual coalition organization’ Agents and domains added to coalition structure ‘on-the-fly’ Dynamic coalition tasks and processes

Tailored visualizations / interface agents Tools to improve human / software agent interaction High-level tools usable without specialized training Packaged generic Grid services:

Domain management and DAML-based policy analysis Task, process, and event management

Involvement of more countries and organizations USA – BBN – Mixed initiative agents & dynamic information flow Australia – DSTO – Logistics planning and information analysis Canada – DREV - discussions begun

CoAX/Briefing - 72



CoAX/Briefing - 73

CoAXCoAX Transition ProgramCoAX Transition Program

2000 2001 2002 2003

CoAX Binni

CoAX Air (MC/JFEX 2002)

CoAX Navy? (FBE-J, OC 2004)

CoAX International?

CoAX Rescue? (Civilian)

CoAX/Briefing - 74

CoAXCoAX Transition PlanCoAX Transition Plan

CoAX "PI Team" clarified: Jeff Bradshaw (UWF/IHMC), Austin Tate CoAX "PI Team" clarified: Jeff Bradshaw (UWF/IHMC), Austin Tate (AIAI, Edinburgh), Patrick Beautement and Mike Kirton (QinetiQ, (AIAI, Edinburgh), Patrick Beautement and Mike Kirton (QinetiQ, Malvern).Malvern).

Structure for outreach or transitioning of the CoAX work:Structure for outreach or transitioning of the CoAX work: CoAX BinniCoAX Binni CoAX AirCoAX Air CoAX NavyCoAX Navy

AgreementsAgreements Name CoAX used only if approved by the PI TeamName CoAX used only if approved by the PI Team Any number of current CoAX and other participantsAny number of current CoAX and other participants Lead need not be a member of PI TeamLead need not be a member of PI Team Report back to CoAX participants will be givenReport back to CoAX participants will be given

CoAX Outreach Program" structure allows for future flexibility CoAX Outreach Program" structure allows for future flexibility and possibilitiesand possibilities CoAX InternationalCoAX International CoAX Rescue – Civilian Disaster ReliefCoAX Rescue – Civilian Disaster Relief

KSCO – Knowledge Systems for Coalition OperationsKSCO – Knowledge Systems for Coalition Operations

CoAX/Briefing - 75

CoAXFurther DetailsFurther Details

http://www.aiai.ed.ac.uk/project/coax/http://www.aiai.ed.ac.uk/project/coax/

Materials for this briefing are at: Materials for this briefing are at: http://www.aiai.ed.ac.uk/project/coax/ttcp/http://www.aiai.ed.ac.uk/project/coax/ttcp/

CoAX/Briefing - 76

CoAXUnused SlidesUnused Slides

CoAX/Briefing - 77

CoAX Agent Domain Agent Domain Management in CoAXManagement in CoAX

Broadens typical distributed security concerns to include:Broadens typical distributed security concerns to include: Access management: Who can access what services? Access management: Who can access what services? Registration management: Who can join the domain under what Registration management: Who can join the domain under what

circumstances?circumstances? Resource management: Who can have which kind and how much Resource management: Who can have which kind and how much

of a given computing resource?of a given computing resource? Mobility management: What constraints should be placed on Mobility management: What constraints should be placed on

mobile code?mobile code? Communication management: What constraints govern Communication management: What constraints govern

interaction between conversing agents? interaction between conversing agents? Obligation management: Are agents meeting their Obligation management: Are agents meeting their

commitments?commitments?

Initial capability shown in 9-month demoInitial Capability slated for 18-month demoInitial capability slated for 30-month demo

CoAX/Briefing - 78

CoAX Task, Process, and Event Task, Process, and Event Management in CoAXManagement in CoAX

Initially maintains an overview of the current status of the Initially maintains an overview of the current status of the coalition C2 processes in accessible shared military terms.coalition C2 processes in accessible shared military terms.

Can take on and address “issues” in the C2 process.Can take on and address “issues” in the C2 process. Later adds the ability to monitor, plan and control the coalition Later adds the ability to monitor, plan and control the coalition

C2 processes and deal with events arising from execution.C2 processes and deal with events arising from execution. Links to and assists with domain management, authority, Links to and assists with domain management, authority,

exception management and other Grid management services.exception management and other Grid management services. To be packaged as generic task and process management To be packaged as generic task and process management

facilities that can be made available to other Grid applications.facilities that can be made available to other Grid applications.

Initial capability shown in 9-month demoInitial Capability slated for 18-month demoInitial capability slated for 30-month demo

CoAX/Briefing - 79

CoAXTechnical ContributionsTechnical Contributions

GITI - CoABS Grid InfrastructureGITI - CoABS Grid Infrastructure Boeing and UWF/IHMC- KAoS Domain ManagementBoeing and UWF/IHMC- KAoS Domain Management AIAI - Process Panels – Task, Process and Event ManagementAIAI - Process Panels – Task, Process and Event Management QinetiQ - Master Battle Planner, Interface Agents, Situation Viewer and QinetiQ - Master Battle Planner, Interface Agents, Situation Viewer and

Demonstration Systems IntegrationDemonstration Systems Integration LM ATL - EMAA/CAST AODB - Restricted Data Base AccessLM ATL - EMAA/CAST AODB - Restricted Data Base Access AFRL/BBN/GITI - CAMPS Air Logistics Support ToolAFRL/BBN/GITI - CAMPS Air Logistics Support Tool USC/ISI Ariadne - Open Information AccessUSC/ISI Ariadne - Open Information Access UWF/IHMC - NOMADS Mobile AgentsUWF/IHMC - NOMADS Mobile Agents Dartmouth - Observer AgentsDartmouth - Observer Agents Michigan – Plan Deconfliction AgentMichigan – Plan Deconfliction Agent OBJS – eGents (e-mail connected Field Agents) and MBNLI (natural OBJS – eGents (e-mail connected Field Agents) and MBNLI (natural

language interface wrappers) language interface wrappers) BBN - TBDBBN - TBD DSTO - TBDDSTO - TBD DREV -TBDDREV -TBD

JSTARS

ObsObsDbDb

BEFORE SCRAM

Picking up troop movement data

ObsObsDbDb

Local

D'GOD'GO


SitV

iew

SitV

iew

'Rea

l-tim

e' fe

ed

D'AOD'AO

Gao ObsGao Obs


Observers 'db' System

Stream of updates, many about GAO, few

about Agadez

NOMADSStream of updates,

many about Agadez, few about Gao

Stream of updates, many about Agadez,

few about Gao

Feeds Agadez info to Gao

AFTER SCRAMUpdates from Observers in

the field

KPATKPAT

Go

ObsObsDbDb

JSTARS(Regresses)

D'GOD'GOD'AOD'AO

Gao ObsGao Obs


Loss of JSTARS db service after SCRAM - asset information no

longer available

NOMADSStream of updates,

many about Agadez, few about Gao S

itVie

wS

itVie

w'R

eal-t

ime'

feedJSTARS db

asset symbols 'grey out' on SitView after time lapse

Agent 'SCRAMs' away from JSTARS

using G-MAS

Stream of updates, many about Agadez,

few about Gao

Feeds Agadez info to Gao

Off

Agadez HVAA - JSTARS - DGO agents SCRAM

The World(Binni)


Bro

wse

rB

row

ser

Bro

wse

rB

row

ser

JFAC HQ

Combat Ops

The Coalition

Pro

cess

Pan

elP

roce

ss P

anel

Dec

onfli

ctD

econ

flict

JTFHQ

LakiLaki

e-gente-gent

AODBAODB

ALDBALDB

CAMPSCAMPS

Intel USIntel US

US HQ

Intel UKIntel UK

UK HQ

MB

P O

psM

BP

Ops

Wea

ther

Viz

Wea

ther

Viz

SitV

iew

SitV

iew

Eve

nt P

anel

Eve

nt P

anel

FA

ST

/ M

BP

Pla

nsF

AS

T /

MB

P P

lans M&SM&S

Pre

-can

ned

data

to d

rive

SitV

iew

out

,au

thor

ised

cha

nges

in.

Pla

n ch

ange

s ou

t,de

conf

lictio

ns in

'Rea

l-tim

e' fe

ed

Pla

n ch

ange

s in

,de

conf

lictio

ns o

ut

MBNLIMBNLI

D'AOD'AO D'GOD'GO

Gao ObsGao ObsFirestormFirestorm

GO!GO!

KPATKPAT

MBNLIMBNLI


WeatherWeatherAriadneAriadne

XSLT InterfaceXSLT Interface Grid helperGrid helper

ObsObsDbDb

Observers 'db'

JSTARSJSTARS

D'GOD'GO

DARPA Object Services and Consulting, Inc.. CoAX – Coalition Agents eXperiment AFRL, AIAI, BBN,...

Documents

Transcript of DARPA Object Services and Consulting, Inc.. CoAX – Coalition Agents eXperiment AFRL, AIAI, BBN,...