Scott Fouse Director, Lockheed Martin

Advanced Technology Laboratories

February 28, 2013

2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in

Situation Awareness and Decision Support (CogSIMA)

The Art of Defining Generation-After-Next Capabilities:

The Command Post of the Future

Experience

Today’s Challenges: Big Data -> Data to Decisions Current Approach Receive, tag, store and process all of the data

If we need to process all of

this data?

How to employ the expertise

of others?

What decisions we are trying to

support?

What should be automated?

manual?

How we can make this data useful to the

user?

Path to Defining Generation-After-Next Capabilities

“A good hockey player plays where the puck is. A great hockey player plays where the puck is going to be.” Wayne Gretzky

Co-Evolution of Technology & CONOPs

Technology

Experimentation

ConOps

The General Process of Co-Evolution

1. Understand first-hand how it’s done today

2. Develop a story based on a catastrophic event in the future, including: • multiple actors • decision making • the way they do business

3. Plan a series of immersive events, with ‘suspension of disbelief’, to enact the story

4. Summarize insights from operators and technologists, focusing on what can/cannot be done today, and identify possible solutions for the gaps

~~~~~ ~~~~ ~~~~

Example: Command Post of the Future (CPoF)

Four CPoF Program Phases:

• Technology Centric - Command Theater Concept – January 1997 thru February 1999

• Command & Control University

– February 1999 through June 2000

• Double Helix – Co-Evolution of Technology and CONOPs – June 2000 through October 2003

• Deployment - Support for Army Operations in Baghdad

– October 2003 to present

Example: Command Post of the Future (CPoF)

Four CPoF Program Phases:

• Technology Centric - Command Theater Concept – January 1997 through Feb 1999

• Command & Control University

– February 1999 through June 2000

• Double Helix – Co-Evolution of Technology and CONOPs – June 2000 through October 2003

• Deployment - Support for Army Operations in Baghdad

– October 2003 to present

Components & Capabilities

• Battlespace Theater – High Resolution Displays – Electronic Sand-Table – Tailored Visualizations – Speech & Gesture Interaction – Natural Language Queries – Knowledge-Based Reasoning – Collaboration Services – Decision-Centered Environment

• Information Center – Staff Anchor Desks – External Connections – Interfaces to C4I Applications – Information Integration Tools – Decision-Centered Retrieval – Modular, Extensible Architecture

Command Post of the Future

Tailored Visualizations

Immediate Understanding Match user’s cognitive model Data => Information => Knowledge Intuitive visual presentations

Abstract as well as geospatial Temporal as well as static

Decision-Centered Information tailored to decisions Show decision-relevant details Highlight relevant changes, anomalies,

exceptions Uncover battlespace patterns Portray uncertainties

Tailored to User Current echelon, task & situation User’s functional role User’s background & preferences

Intuitive Human-Computer Interaction

Natural User Interface Speech & gesture commands Minimal keyboard input

Easy Exploration “Fly-through” and “drill-down” Question answering Computer generated explanations

Integrated Environment Integrated display surfaces Coordinated presentations Uniform manipulation Room-wide drag and drop

Collaboration Support Collaborative visualization Group collaboration services

Adaptive Decision Environment Decision Focused

Immediate access to tailored information

Operable by immediate staff Computing is transparent and

embedded in the environment Context Tracking

Environment tracks Command Post situation: people, roles, tasks, decisions

Dialog Management User requests are interpreted in

terms of current context Adaptive Presentation

Presentations are tailored to current context

System Architecture

C2/

Plan

ning

A

pplic

atio

ns

Dyn

amic

D

atab

ase

Dat

a So

urce

s (B

AD

D)

CO

MM

C

hann

els

Battlespace Reasoning, Analysis, and Simulation

Displays, PDAs, Sensors

Visualization and Human-Computer Interaction

Decision-Centered Information Management

Commander’s Perception and Understanding

of the Battlespace

Technology-Centric Summary

• Generated entirely from technologists, whose only understanding of the problem is from movies and books

• Interesting product, but ultimately not very relevant

Example: Command Post of the Future (CPoF)

Four CPoF Program Phases:

• Technology Centric - Command Theater Concept – January 1997 through February 1999

• Command & Control University

– February 1999 through June 2000

• Double Helix – Co-Evolution of Technology and CONOPs – June 2000 through October 2003

• Deployment - Support for Army Operations in Baghdad

– October 2003 to present

Command and Control University (C2U) C2U Objectives

– Educate the Technology Developers – Educate the Graybeards – Establish a Forum for Discussion – and Practice what we Preach - Use the Technology!

C2U Organization –Tier One: Installation Visits

• February 1999 – Camp Pendleton • May 1999 - Fort Leavenworth • November 1999 – Joint Readiness Training

Center (JRTC) –Tier Two: Workshops

• March 2000 - Urban Operations: Past, Present, and Future

–Tier Three: Distance Learning • Tactical Decision Games • Seminars / Discussions

Tier One Event: JRTC - Nov 8-11, 1999

Tier Two Event - Urban Ops Workshop

Two Types of Events eDiscussion: Online seminars eTDG: Tactical Decision Games

Schedule: 3 Aug: eTDG1 (The Battle Along the Tziepov) 17 Aug: eTDG2 (The Battle Along the Tziepov) 31 Aug: eDiscussion: DM Theory - Gary Klein 13 Sep: eTDG3 (The Battle of Johnsonburg) 19 Oct: eDiscussion: Art & Science of Battle Command - Col John Rosenberger 26 Oct: eTDG4 (Battle of Rocky Run Hollow) 23 Nov: eTDG5 (Battle in the Box) 14 Dec: eTDG6 (Operation Lump Sum) 15 Feb: eTDG7 (The Evacuation of Enniottu City) 22 Feb: eTDG8 (The Evacuation of Enniottu City) 29 Feb: eTDG9 (The Battle for Hue City) 4 Apr: eTDG10 (Flank Guard at Teutopolis) 11 Apr: eTDG11 (Flank Guard at Teutopolis)

Tier Three - Distance Learning

eTDG1 - Battle Along the Tsiepov

eTDG2 - Battle Along the Tsiepov (Cont.)

eTDG3 - Battle of Johnsonburg

eTDG4 - Battle of Rocky Run Hollow

eTDG4 - As Viewed by the Teacher

eTDG5 - Battle in the Box

eTDG6 - Operation Lump Sum

eTDG6 - Based on LAM SON 719

eTDG7,8 - The Evacuation of Enniottu City

C2U Summary • Provided to the technologists some

appreciation of the problems of Command and Control

• Provided to the SMEs some notions of what technology might provide

• Generated a rich collection of “tactical” experiences that provided common ground for both the technologists and military subject matter experts (SMEs)

• Ultimately was the key to success for generating a disruptive concept

Example: Command Post of the Future (CPoF)

Four CPoF Program Phases:

• Technology Centric - Command Theater Concept – January 1997 through February 1999

• Command & Control University

– February 1999 through June 2000

• Double Helix – Co-Evolution of Technology and CONOPs – June 2000 through October 2003

• Deployment - Support for Army Operations in Baghdad

– October 2003 to present

Double Helix Implementation

• A creative process involving visionary technologists and visionary SMEs • Need to be careful about who you call your expert!

• Critical to select right starting point, to enable zero-

baselining • Do not want concept to be overly constrained by current practices

• Focus on design of exercise vice implementation

• Use many stimulation techniques

Block Parties

Exploratory Experiments

• Designed to focus on one aspect of vision or technology, essentially exploring one aspect of a future space

• Key aspect of experiment is "suspension of disbelief", which is achieved through combination of content and facilitation

• Need to be careful about metrics, since they may be tied to current, conventional thinking, and they may not apply in this future space

Team develops new intuition about this future environment

Executing the Double Helix Guidance

General Paul Gorman, Chair (USA) LtGen Paul Van Riper (USMC)

1st Order: Knowledge/Experimentation

BGen Keith Holcomb (USMC) BG Pat O’Neal (USA) MG Tom Garrett (USA)

Major John Schmitt (USMC)

2nd Order: Senior Domain Experts General Anthony Zinni (USMC) LtGen Paul Van Riper (USMC)

3rd Order: Active Service

Army Officers, Fort Leavenworth Marine Corps Officers, Quantico

Researchers

Researchers

Researchers

Example: Command Post of the Future (CPoF)

Four CPoF Program Phases:

• Technology Centric - Command Theater Concept – January 1997 through February 1999

• Command & Control University

– February 1999 through June 2000

• Double Helix – Co-Evolution of Technology and CONOPs – June 2000 through October 2003

• Deployment - Support for Army Operations in Baghdad

– October 2003 to present

Command Post of the Future: Distributed Command Collaborative visualizations provide each user with the ability to interact

with the system and other users using visualizations tuned to their specific

perspective

Information management tools provide access to military databases in a scalable, distributed

architecture Touch Screen

Multi-Modal Inputs provide a natural interface for users.

Using speech and sketch to capture user queries and the commanders understanding

Collaboration Technology: Marrying the commander’s expertise to information technology in order to see/understand information and create understanding which can be shared and acted upon

Automated reasoning agents called sentinels, provide the commander with information

filtering and conditional alerting, and low level data analysis

capabilities

The BattleBoard

Information

Understanding

Collaboration is more than shared pixels or

data. The collaboration provides tools for linking

interpretations and understanding to data

The Result

Distributed collaboration enables the elimination of place-based

command posts. Commanders and staff can be

distributed across the battlefield during all phases of tactical

operations

BDE CP Users CDR S3 PLN BDE CP Users

BDE CP Users

BDE CP Users

1st Cav Div CP

Forward Operating

Base

1.5Mb-8Mb Tactical 100Mb Special

CDR S3 PLN

CDR S3 PLN

CDR S3 PLN

Deployed Users at DIV CP

CPOF 1Gb LAN

DIVCDR ADC ADC ENG

ENG

CAV FSE G4 G2 G3 G3 G3

G5

G4 G2 G3

Plans Plans Plans Plans Plans

2D map & Pasteboard Work area

Work areas of others - Shared

3D map & Animation Area

Left Display Center Display Right Display

CPoF: A Disruptive Innovation

• Collaborative Visualization, which operates at the speed of thought

• Focused not only at presenting information to the commander, but also capturing commander’s situation understanding

• The commander uses the tool to describe his understanding of the situation, enabling incredibly rich shared understanding!

2. Develop a story

3. Plan a series of immersive events

~~~~~ ~~~~ ~~~~

Applying These Techniques to the Challenges of ‘Big Data’ and ‘Data To Decisions’

Anti-Access/Aerial Denial (A2AD)

in Sandiegoland

~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

UAV Video

(Powerpoint)

4. Summarize insights and ISR gaps drive game-changing development of new capabilities!

1. Understand first-hand how it’s done today, e.g.:

• Red Flag • Empire Challenge • Army Network Integration Experiment • Trident Spectre

QUESTIONS?