AD-A268 606

(VD

.1 ýUW-wu00

j0

WS

cQO

C. n

!i la

C MER NOTICE

THIS DOCUMENT IS BEST

QUALITY AVAILABLE. THE COPY

FURNISHED TO DTIC CONTAINED

A SIGNIFICANT NUMBER OF

PAGES WHICH DO NOT

REPRODUCE LEGIBLY.

Form Approved

REPORT DOCUMENTATION PAGE j Fo 07o04-01880

bI C reo'orn buJrden for this collection of mformatvor is esmaited to average I hour per rSpor'e, incliuding the ti'Ie for fe, ewrig instruction$, se. rcmq exist-n; cata source$,;an•er~n.; d mmaintainng t d4ata reeded, and completing and reniewmg -?%e cclieclion of information Send comments regarding this burden estimate or aru Other It•Oc, of thiscc::ectci ,f tnIOmathOn9includin9 suggestons for reducing this burden tO Washington H4eadquarters Services. Directorate for £rnormalt,on Operations and RePotS, 1215 Jeffersoni

Hags M; aV. Su,te 1204. Arlington. VA 22202-4302. and to the Office of Management and Budget Paeer~vori Reduction Pro)e"t (0104-0t4). Washrigton, DC 20503.

1. AGENCY USE ONLY (Leave blank) 2. REPORT DATE 3 REPORT TYPE AND DATES COVERED9 April 1993 Final, 2-4 November 1992

4. TITLE AND SUBTITLE 5. FUNDING NUMBERS

DMSO Research and Development Functional Working Group PR 88600Workshop Proceedings, 2-4 November 1992

6. AUTHOR(S)

Howard J. Carpenter, Project Leader

7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) 8. PERFORMING ORGANIZATION

The MITRE Corporation REPORT NUMBER

7525 Colshire.DriveMcLean, VA 22102 N/A

9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSORING/ MONITORING

The Defense Modeling and Simulation Office AGENCY REPORT NUMBER

1901 N. Beauregard Street, Suite 501Alexandria, VA 22311 N/A

11. SUPPLEMENTARY NOTES

12a. DIST RiaUTION AVAILABILITY STATEMENT 12b. DSTRICUTION CODE

Approved for public releaseDistribution is unlimited

13. ABSTRACT (Maximum 200 words)During 1992, a series of workshops was conducted in support of the Defense Modelingand Simulation Office (DMSO) to determine the modeling and simulation (M&S) needs ofthe defense M&S community. This community is partitioned into five major areas:Education, Training and Military Operations (ETMO), Research and Development (R&D),Test and Evaluation (T&E), Production and Logistics (P&L), and Analysis. Each ofthese areas has a Functional Working Group (FWG) representing its interests to theDMSO and other interested parties. Workshops were conducted to assist the FWGs indetermining the "requirements pull" to be considered in the development of the DMSOMaster Plan.

This report presents the results of the Research and Development (R&L) Workshop fordeveloping Modeling and Simulation (M&S) needs for the R&D community. The executivesummary provides an overview of the background, objectives, organization, and summaryresults of the R&D Workshop. The body presents the workshop background and objectivesdescribes the working groups, process, and products, and provides an expandedsummarization of the workshop results.

14. SUBJECT TERMS IS. NUMBER OF PAGES

modeling, simulation, research, development, workshop, needs, 104 pages

R&D 16. PRICE CODE

17. SECURITY CLASSIFICATION 18. SECURITY CLASSIFICATION 19. SECURITY CLASSIFICATION 20. LIMITATION OF ABSTRACTOF REPORT OF THIS PAGE OF ABSTRACT UNLIMITED

UNCLASSIFIED UNCLASSIFIED UNCrLASSIFID 1

NSN 7540-01-280-5500 Standard Fo-m 298 (Rev 2-89)P,"CrIbeO bh ANSI StO ZIS-18298- 102

091

CIO)

cn c

ozo zoj-v

C4 6

ow zPW-

CC

o t9

VI 0 -A*

Q.I- E

ooCc C

,a C

6) 4~C CA

Z0

E * g

o E cu

a, E4)

L) 6'

V2

0.0cc %0 c f

.0E w gold -~ -0G =" nI

Gn gun~ t'

0 c g.00

0c 0 5

to. v -4 ..

CE~ cc0c

Eo

s..4 00 c 0 ow

C 00 L)

4.)~~ co 0 B70: C= lu . c

C) 040-ig0C'= 0 0-I 2

c. - - -= w )U,4

EI S.C -0 0= E=~~~~ .. c > ~ g *c *

0 0cis-'-,C~ U .- .% HC E

r 5c

E 0

G~c < cco

oE a0..

cn 00 to L .2 - 8 > o 0n2 0 0 0 CO caucc 6

0~C *0~*. .. 80 E % o C ~0 9~ '.5m'.

.4C.

= zCs 0 CA b

0 -v

caU~ W .- 02-uESE -O "E P v

Z'E o. -_ U;>M, 0

f-U r, 00 X =o -C >

co~

fA 0

45 G~ > t 4

o . > -,'T3 0 ~I~ tk LLE)o

= 0'

U, -a

r U, goc E!C-8u

.0.0"a~ 0 v C- E

0 czci

V a0 >

E 0. 0,0o

0. (A " C " ý

w~~ - F 0 "I0 E R 04.

00 0u0 0: Ow

'S Cb V=E M

4 DO = -rw

ci ~~bo u0 4 = UF0A* ~ *'

U 0 -a. 4. bfl8

*-0 E CC b

cc - CI 0 a -

~c E 8

,; . .4

•_ _ .. .4) •U

3 -0) M CIO

U3 4) OC

U .)

=- 0=tR n-•EE >oO.. o.

4-1 ,•• 0 •

r

W|C V

Sc v E

& ~ ~UrU.

w)~ 0o.old

>-* 4E 'aM4.) '0 cc0 :>, 46

0

0

Ono

CIO

Elmo~ on BMW,

0l m cc

*00S w Cu 000

0, 00 -0

w~ .0 W

.0Lum *Cu

Sc c. 4025Q ow *on ~ ~0 ~ ~own

a~c0 ~04w-

Z Z

0 0 0 a

C- 04

9~~ 0~ m0.-.

aid S 10.

(#2 ME.2

E~U

-E N

Ub.Uc 0

Cd, C. M

C 04) 4)

-c 0 o Vu

-0 S 0; 0Muo a00c

Z)4

00~ 0..

.00FO 7 5 -

Lai

czC

W Lou

*em.-

0 l: cu C

0 C.-

0~~ 40;-~ ~E

I ~ C Cc CZ 0

= ~0

Cu" E.C LLaNo

z-0 cc

C 7B 4)

0 C

-N 00.4

* 0 0 0 0

*cu 00 COrC

-

E- - >

E --

E 00

LD 00 0=0=>c00

cn~ . ' -. 4

4.)~ 0

UE.Ca E

0 CUcbO. Old)0

SC CZ >

0U

0 2, Eu M 0 4.c

o C

v 4u 0

6) 0 0-. .= Et :,04.

V 0

OT) SO T c7E-c

'z*

'D Z

zzZ< ;D00

A.~0 &M~U

06 -U)

Z 0

A 7 FU- .- i~~vC.)0 now oo-'r - u.(i r % .!!; w F.

~ ~ GD.J SL

0 A. :,:~GD GDU) -.>Lu .-c

-L Cu

A)

C V

0

06 g

ccU

b.L4

I-U

0)

0.~

z it

~ :Q

04)r 4)

ID0 0-4

CL 0 A

0 E0

- -0 r

ca 0. 0

0*0

02. 00 0

CC 0 U

00 0

0 0 0~

C0 V) 0

CA (

c . 4)

= >ma3 N eý

CA >-5 M t

~ ~.4 c

t; 0-0 C: (A

4 CL.

>~( 0UMC4..~ V c=g,

~~4Z<A vc .- =0<9 r-'

o 0 0 .0 -5 CS

C619 0Go% = >> ~

(n V4Mý c C ~

G.O0

4) bd a ~ Ad 0

4..!

cn6

cc

fe C

Ccu

C cu

m 5

0w - -

V 0 cl r0u~ Cu cbm C

4"F 0 CW U,) U

0 Cu r

0: ~ ~ V L:

0~~ 0dca

00

Z 0 I ! 8 -

0~u ?

CA ~ cce Q00

78 t : U0u09 &.0 ci

o -

o~t cis..o.& CflO

040

--

Q~>l - V-0~~~U

z -a 2:, S,-5 . r t o = ,'s I"

_d a

cc0 0

00 b. uS> -3 0 .s "ao #4-;

~~. 0 -2 . *

Z)-. R. e- d

cc -or

nE 0=r- J= I.

Cc ý 07 4

.0 c

VL C

Cu6

Cu L-" .0 nC

0ý CuL_ 6

- Lu cc

m co2ZC

44 c

t4- ý .-O. UTg

4)0

-aa.

tu Co

104c c r. )0 C 4

81 29 ;b.. 8ccc bb L

9:~ Lu g2 =-2

-) - a

too -0C E 0 Ct3I5

.- ~01*8 ~'*

> A)

L) LL o

ve o

Ono.

9z

Cc own

00rApian

z 00 0W

h ap-0 _

C CuC 2

0 C

-0

z 0. -0 0cc

0c-cc cc

4" 4

W W) Cuu A

-> 0 000 E

r- r- U Cc C4

E0 v

U.0 wo V

ot c o r_ t r 0 2 M.0r- , 0

a 0 < 9 u ý .0 u J

cc g ;dQ 4 '. V o.C -a -) 0 0 s m m *S c 0 Nc

z00 CAC0 o0 ~ -- ý',0" t

- 4)0m 0 or

U, W

F=4F=4t

La Cua000 C

0 hi -Samu

Poo,

"ONE00

0..0EEO w

00 U0

00 .0 v~u

00 co 2 4)C C .

CCA

-. -, >0n -0ES- u~ 0O0 = ca ~ ~ U0-

0 0 > ca 0

0 0 boOC

- ~ ~ .- ti- 2 c U~

c > 0-73 old.2 - E c

gn00

too W 0

-V. *- u

>~ 9

e .- 1%- 'SI w 0-j t-cs C..24:2 -Z~h v -

> 0-4)~~C z ; )

:r 4z>0cýc0~US~ E >-044. *ý> " =.-

cc 4.)moS

. E

o 0o

u~ IV 4I.0

Ono 2u Lw On

CZuLoL cu ) *,06_ ~ .E > i- Lo L

Uw> 4067

o -o- -0cp2

&W, 0 2~~~r CZU U- o -* 0~ cc~

cc ~

- a cc6)6) 914V-..

~~tt

*0 VV

.- 0 tv4

~N e

00

= U6 0 dd> v 48. v .= >

'= ~ CO = ~. = E -cC

oo Q 006

(A. 8 = *9 01 -u.

o ej . = CU~CIg~O c f

L) -0

~r Eccu 0A

*6~ cc 0W.= 8 Da

w t 0.4 co

U C~

cis O ~~=M

Saw

osEEO~

cc .

ENO0

co CuLC

E-0

0 e 0 01 OW

'U

4E.

4),.'

IV- *a >C

C ,-.Q-U C. a

rAo>11~ quu

OR cc

CJO)

z Cisw 0.C

~9:6SAW. L

00 c

v~

Eno

F=4

0co CY

Goz co

OVOo Co CO'JO

CoSC LO LO ib4n

M CfJ _MC * YL

to ý@ Cl Lo P

C 0(aC Eo

EikiC

0 0

<o Ch C 0 _o 0

cc IV %-i Ca 0! < 4occ~WC 010 0 ~oc

E (a U-00 NC

L) >0 .03/:, c a) Cfl 0C -' W

a-I Z Ci).. Z ~ diL a4L -- ccI

Oz ~ ~ ~~a r- :c. d C s*

0) C. ) 0 d0

2~ -'3 00-

CDCO

E2 0

cU) V- Amm*m 8CUc N

ýw W 0W, .ý

E c cm (0

-u CDC:

w 0A E § .-0

.<L C C6"Dw CDw &- # 0 COC . U)

ui 0

CL i - LL0 ~ 0

L: CU

C~o 0

CU 0

a. V

CD I

Go E

U2CC

w -q Lbg

E CYLGo do U'

5oSa ac. aZ 0--a

0 00 Ul

00 m cr.S m E Ln

A m-

a C/) Lp0So CL x IS -j zfýC

U.0

ho ci

0E E

(D~ Cc ca cca

I U*) cc)cD) cc COCO

a V-- cc E (0 c) !IaCOJ Vv, Cn OV ) CDvCVU0) V0r D> 4too I0 V_ *3 o

in (D r-W M CM V 0) icvM CM

too Cr

CIOz -) 0 L ) ZP.

L.O x m0 0 'm mz

C/)CO)~ C/)

C Com~ m c

L m, m CMC V

I o0 oP44 CM0UC

0 0

0 -n CD 325-l) ca % 03

Uk!. E

- 0 0c1IJ r MV) -- C)

C c v .- M 0 v - CMN C\1 V CO

C)~~S COIV b-.

cO U' ;C

00o "L CO-,-cr

V.Z- <~ CD < C

w L MQLL 2 MaL 0Zci L- Z'i

C 000

Z0 C 0Looc 0 OF 0L

0o CU0..

CL. IL P

cmJ

cZOc C~oCOE

Loo

C)f

cov , rZ> arci

Cf CO u tg m

CoC

2~ 00

0 cvcm'

z wwC CJ0 L0

cl: 2 E COC N 0 0 C

< <co 6ý U c20 4)4) O <r-8

Cl zz (1 CO) LL0q M CCI

C\j C% C 1

C\ - 0)LnU0l CDl KIt CV

C) 0 U) 0 Ni- NO- 1f 0LI)

CW XU- X1, XCV XJ U01fl

CLA

0..C0 U. 0 00 CD

X CD0 Zo

.0 a -= Z 05 .cZ cb - C 0~&. 1 0 .EC-J 1J~~ -J CV).. 0' C<

CU C/) 0 - w o P O m.2 m> Cc >

OOO< t wO.L D4(O CLl% ZJ o

2-c 0 -Cu> 0 GC > Imu 003

0M 0 -P 0 JL L <C j o3 C<. -. z C ý

Cu 0 alE0 ~ Go<U-LLL D I o .0c

(7 81 0) A Dco

C~jO 'tO Ql00C%j(CfD0C Q¼C0.O ILt) V co OcD

0~ <0

(U 0 0

06M C)

0 Z .

wY w (D oc ,nPC). UY CJ.0 a

IO r. CD LOLO

C,. cm CJM

5a. 10 -D ýL

E5 0.v

- ~og0~Zif E0ou 80 -

mU 00.

0 =0

8C0 0

0 8 E

Ea0

_~ Ca

m 0 C) W £0Cvl

m 3 N w 2 -C

CO CO 0)@ \.Co. COSh £ ) _\ - M

go 0 %0 C y C 0 OOP-u 0 (0P%

O\-"o 21 SL t1) 0r ZEi C

Cc0 0

00)

CO \CL NrUl

00 C

b- .0 0 1-30 1 U

oo 8 li 0 Cl 00

CD n in 7S

cv, (D(U ")

cvOw e) fv E

E EE0)c cc~

IAI 1

cOUl IUo(Sn U) CO (

06g Ojo( CV) Vc -) 0) m

0 CL- >d

0 Cl)

zoo zooM<

0

o E0 cc

.20

0

U. V o 0 0) a)0)(DC)L 0co c

0 W .f,- 0 ) C~~- Cb _O ic V ) U

0 C0)O n Le) l

xV x)<L~o o~ x

cc U

o~c m)oU

oL (a C ~ 2o

0- - in LO N) (

CL CO00

00 *C )b.~~~ 0 yM< 2C

cc -o0

oo cdgo 0 e

V V 0 0 r

0) IW V I

U) r'- & 4cLbCO)

CD M(c CMJ

oo M-i

ICL M,

co 0 IV.co 3 1* oo LO LO L

COO 4 00.

0o 0

ad rb ~ 0 <<I

CC C~ 0 CU C/)l CO

&. LO 1

3o coCWL urM CU. C c0

iEECD I

APPENDIX B

GROUP 1 REPORT

Modeling & Simulation Needsfor

Research & Development

Group I

Modeling lslatiaon Needs; in Rlemach I Developent•

Group 1

Overview

Needs for successful outcomes* Front end planning and proper preparation

t Verlflestlon, Valkation and Accreditation of each model In

the Intemetted simulation

* Proper selection of the models used* Scenario preparation• Long term management sponsorship

* Oversefllng* Modeling and simulation as the product* Exoesolve/undeflned collection of data

S Selection of models with fidelty/resolution limitations* Caution Is urged In the W&A process to assure models are

Improved

B-2

Modeline & SimuleUon Need for Reeerch & DevelOpmenlGroup 1Approach and Preliminary Findings

Approach

"* User of model"* Developer of models

Preliminary Findings

"* Technology available to achieve largescale simulation networks

"• Assemble teams with cross disciplinaryexpertise

B-3

Modellnll & SImuwtlon Neede f1w RU roh & DevlopmeaGroup I

Pre-Execution Near Term Needs

* Training to use model*Library

-Industry

- security"- users groups

acooptod date base (regional data bases)- teat Oases- lessons learned- communications

* Need common eoonerlos- Joint scemrios with service support/sign-up

User responsibility for currency, common environment,weather, littoral shallow water, etc.

* W&A* Wide band links

B-4

Modeling & Sluiasiaion Needs hor Reoearch & Development

Group 1Pre-Execution Long Term Needs

"* Funding, resources"* Futuristic scenarios, need for POC for joint future scenarios"• Streamline acquisition process for M&S technology access"* Institutionalize large scale Internetted simulations"* Simulation support tools

- Smulation Imagery- Rapid prototyping

"* M&S Training for senior leadership and through the ranks

B-5

Mo 1deig & himmfUon Need hr Remach & Deveop menGroup I

Pre-Execution Critical Issues

"• Funding (Near & Long term)"* Detailed standardized joint scenario(s)"* ousllmed personnel"* Maintaining state-of-the-art"* Network of high frequency events

- Latency- Message traffic

"* M&S Training for senior leadershipM&S Training thru the ranks

B4

Modeling & WmulsUon Needs fr Rsarch & DevelopmentGroup 1

Execution Near and Long Term Needs

"* On-line GA"* Data collection/reductlon

- On-line data capture (network vs stand-alone)"* Real-time scene dynamics"* Standards, Protocols, and Common Interfaces for

Interoperabllity"• Increasing processing power and computation speed of

hAw and Ww

"* Understanding limitations of M&S (overselling)

B-7

MoIreng Simulation Nee r nmsarch & DeveopmentGroup 1

Execution Critical Issues

* Real-time high fidelity sensor simulation* Dynamic environment/terrain representation

* Infrastructure for large scale Internetted systems not yetmature If It exists

* Common software modules

* Visual display systems

- high fidelity- resolution

- processor speed/update rates

- field of view

- 3-D

B-8

Modeling & Simulsko Needs for Resewrch & DevelopmentGroup 1Post-Execution Near Term Needs

"* More emphasis on analysis"* Formalizing lessons-leamed"* Output vlisuallzation/formallzatlon"* Data extraction

. discrete. tabulation- Configuration management of data flies. collection plan

"* immedlate after action feedback"* Model caveats/statement of assumptions

B-9

Moa•dn & tlmfmtln Needs 4fr Sekeah & De*eopmenGroup 1

Post-Execution Critical Issues

* Long term planning (continuity)* Data processing techniques

- data extraction- data analysis- data base management- management of output data from

different simulations* Facilitate lessons-learned collection I

retrieval* Documentation* Multi-level security

3-10

Maddtng & SimuAistan Needs I r Resemrch & OevetapmneGroup 1

Post-Execution Long Term Needs

"* Compute power"* Technology transfers/insertions

DOD .- Commercial"* Update and upgrade to state-of-the-art"* Central archive of simulation files and data

bases"* Data processing techniques

- data extraction- data analysis- data base management- management of output data from

different simulationsB-11

Moden & 1mukftim Needs I Resewch & D1eeo9p

Group 1

General M&S Critical Issues

"* R&D of M&S in support of P&L (-ilitites analysis)"* M&S investment strategy

- central/government facilities"• Underutilized defense contractor facilities

- personnel,equipment"* Develop/support long term In-house facilities"* Improved M&S for decision support along the

acquisition cycle- M&S for risk reduction

"* Need for formal education in academia andServices

"* Multi-level security"* Communications

B-12

Modeling & WMIdn eed lb Re uesh & DevelopmentGroup 1Short List

* Library* Joint, Common, Future Scenarios

* Standards, Protocols, Common Interfaces* Data processing techniques

B-13

Modeln I Simulation Nede for Reeeero a Develomen

Group 1

Unique R&D Characteristics

What is unique about the R&D community regarding models andsimulations

"* The tech base used In M&S Is produced by the R&D community andapplied by all communities

"* For M&S the R&D community Is on the high end of the spectrum In- use of first principles science based M&S- temporal resolution requirements- resolution of detail- need for diagnostics Information (why something happened)

weapon system life cycle cost Impact (most of cost Isdetermined at end of concept definition)

- leveraging M&S research capability of Industry- freedom to explore variations

" For M&S, the R&D community Is In the low end of the spectrum- predefined requirements

3-14

Modding & AlmulWum Need* fot Reserob & DevelapmewGroup 1

Crosswalk of Stated Needs

Test and Evaluation High

Education, Training, and MediumMilitary Operations

Production and Logistics LowAnalysis High

B-15

APPENDIX C

GROUP 2 REPORT

Modeling & Simulation Needsfor

Research & Development

Group 2

MldIklng a SlmhtUlan Need.f h Resarch Oeveapmefl

Group 2

M&S RolesSummary of M&S Roles Typical of ParticipantsLooking At:

* Concepts • Prototypes • Existing SystemsExploration and Assessnent of:

"* Doctrine and Tactics • Systems of Systems • System Integration"• Systems • Processes • Information Flow"* Sub-systems • Components • Technologies

In the Context of:

• Mission • Threat • EnvironmentAgainst Crlteri of:

* Warlighting Effectiveness • System Performance • Feasibility- Staff Reqs/Human Pert • Logistics Demands * Risk Assessment0 Cost • RAM • Safety

C-2

Modeling & 8imiuation Need. for Reeerch & Development

Group 2

M&S Roles (Concluded)Repreaentative Examples of M&Sbaamd Explorations

"• Engineering Analysis - Compatibtlity & Integration"• Understanding * Experimental Design"• Investment Strategy • Documentation of System

"* Trade-off Studies * Weather/Environment• Environmental Quality * Multi-Spectral Propagation* Electromagnetic Env Effects * System Stimulation• Target Simulators * Threat System Modeling

Additional Future Roles"* Stimulate Data Collection • Software Performance"* Systems/Procedure Design for Non-Traditional Missions/Robs

C-3

Modeling a SinleUon Needf for Reearch A Development

Group 2

M&S TypesDimensions of M&S

"* Stochastic vs Deterministic"* Man-in-Loop vs Interactive vs Batch"* Real Time vs Non-Real Time"* Pure Math Models vs Dynamic Simulations

"* Discrete Event vs Continuous"* Event Driven vs Time Stepped"• Functional vs Object-Oriented

"* Stand-Alone vs Netwnrked

C-4

Uodding & SlmulhUon Needs Ir Reserch & Dovapan•t

Group 2

M&S Types (Concluded)

M&S Pyramid

"• Policy

"* Theater"* Campaign"• Engagement"• System"• Engineering Component"* Physics and basic science

C-5

Uoisngo & SlmdUIon Neds WW Reesch & Osvel"pmstGroup 2

M&S Problem Areas"* Non-Standardized, Validated or Accredited:

- Models - Scenarlo. - Environment Data- Red/Blue/Grey DB - Doctrine Rep - Human Performance

"• Lack of CM • Poor Maintainability * Life-Cycle Cost"• Lack of Information on Available Model Capabilities

"* Over reliance on Contractors for M&S"• Fundamental Knowledge • Vlaualization • Environmental Rep

"* Execution Inefficiency - Portability • Interoperabillty

"• M&S Installation and Operational Complexity (Usability)

"* Lack of Good Ouality Empirical/Fleld Data

"• Models Available Often Inappropriate for their Desired Use

"* Data Transmission Needs often Exceed Transmission Bandwidth

"* Voice Data Capture and Generation

"* Access to Black System Capabilitles • MLS

C-6

Modeling & Simwlation Needs for Research & Development

Group 2M&S Needs - Pre-Execution Activities

"* Find the model or build the model"* Acquire/develop the data base"* Define/select the scenario"* Problem definition"* Evaluation criteria"* Identify critical issues for model coverage test plan"* Validate (VV&A)"* Find resources"* Define Inputs and outputs"* Manage expectations

C-7

Modeling & Simulation Needs for Rmarch & DevlopmentGroup 2

M&S Needs

" Model Ubraries and Repositories- On-line information clearinghouse- Easily accessible products- Centers of expertise (on models and applications)- Centralized coordination & distributed Implementation

(proponents)- Multi-level Security

" Data Repositories- On-line information clearinghouse- Easily accessible products- Standardized and accredited- Centralized coordination & distributed Implementation

(proponents)- Multi-level security (Including proprietary and sensitive data)- Rainbow spectrum of force data

C-8

Modding & 31mulUon N e or Rerch & DWvopmrntGroup 2M&S Needs (Continued)

"* Standardized VV&A process, procedures and policy- Models and confederations of models

"* Education end training for M&S and data users (DOD-sponomed)- Civilian and military career path Integration- Training materials and user handbook

"* Common DOD M&S architectures- Portability- Simulation control standards- Standard SW and languages

Open systems Including reference modelSimulation control standards

"* Increased awareness of management and leadership

C-9

Modeling a Simu"i NeedH r Reert & DeveopwntGroup 2

M&S Needs (Continued)

* Advanced Simulation Support Environment- Graphical User Interface- Object/Class Ubrarles- Automated data Introduction- Scenario development tools

- Audit Trail- Automatic report generation (with graphics)- Tools to estimate resource requirements (HW, Comm)

- Assist In data capture

C-10

Moduing & Shmulsdon Weed for Reesc & OevelopuGroup 2

M&S Needs (Continued)

Scenario definition and repository- Multiple levels of scope (combined - one-on-one)- Approvediaccepted- Realistic and stressul environments- Mufti-level Security- Automated/electronic

C-11

Modeling & Simulegic Needs for R"esenh & Development

Group 2

M&S Needs (Continued)

* Runtime monitoring, reduction, & presentation

"* Better, faster graphics

"* Faster execution

" Real-time environmental data

"* More flexible HW & SW procurement policy

* R&D access to warriors and training & testing exercises

• R&D community involvement In DIS PDU definition

* M&S should cover complete spectrum of military & non-militaryoperations

C-12

Ma"d A 81mulson Need fr Resewch & DemnenlGroup 2M&S Needs (Continued)

"• Understanding of what raw data should be retained

"* Faster data reduction - Including video and audio

" Capturing lessons learned Into repository- Model development- Model use- Feeds back to M&S requirements

"* Intoroperablllty- DOD-wide- Interface and documentation standards (DIDS)- Multi-domaln/discipline M&S

C-13

MoIdeling I =mufmt Needs for Reseereh I Developmeni tGroup 2

M&S Needs (Continued)

"* Hyperrnedla

"* Adequate funding for- Simulation technology- Infrastructure

" Procurement policy appropriate for need & potential of M&S- Mandatory use of M&S- Data rights- Acquisition strategy

C-14

Mofeling & Swliefin Needs I Reserch & DevelpmnmGroup 2M&S Needs (Concluded)

NEW MODEL FUNCTIONAITY

"* Model of human behavior In C2 (decision making Including

variability)

"* Standardized environmental models

"* Multispectral visualization

"• Dynamic spatial resolution

"* Natural/man-made environmental dynamics

C-15

Modeln A lmumla* Needs for Remerch & DelopmntGroup 2

M&S Long-Term Needs

& Next generation simulation support environment- Intelligent Simulation Management Tool

- Intelligent Simulation Maintenance Aid

. Seamless Interfaces between simulations & outside world

- Multiple resolution levels

- Multi-echelons

* Standardized data journallng capabilities embedded InM&S (user selectable)

0 Supplement M&S with embedded Instrumentation andfield data collection

C-16

Modeling & Simulation Needsfor

Research & DevelopmentResults

GROUP 2

Nedethg & nUlll1w 1eedslo Research & DevelOlmen

Wroup 2

High Priority Near-Term Needs(ORDERED)Adequate funding assumed for:

- Simulation technology- Infrastructure

"* Standardized VV&A process, procedures and policy- Models and confederations of models

" Model Ubrarles and Repositories- On-line Information clearinghouse- Easily accessible products- Centers of expertise (on models and applications)- Centralized coordination & distributed Implementation (proponents)

- Multi-level security

"* Model of human behavior in C2 (decision making Including variability)

C-18

Modeling & Simulation Needs or Res*e'ch & Development

Group 2

High Priority Near-Term NeedsData Repositories- On-line Information clearinghouse- Easily accessible products- Standardized and accredited- Centralized coordination & distributed Implementation

(proponents)- Multi-level security (Including proprietary and sensitive data)- Rainbow spectrum of force data

Interoperablilty- DOD-wide- Interface and documentation standards (DIDS)- Multl-domaln/dlscipllne M&S

C-19

Modsig & Simulaftn Peeds of Resewr.h & 0 epGroup 2

High Priority Near-Term Needs

" Common DOD M&S architectures- Portability- Simulation control standards- Standard SW and languages- Open systems Including reference model- Simulation control standards

" Standardized environmental models

C-20

Nosding •& Olnwution Needs for Research & DevelopmeN

Group 2

Medium Priority Near-Term Needs"* Education and training for M&S and data users (DOD-sponsored)

- Civilian and military career path Integration- Training materials and user handbook- Increased awareness by management and leadership

" Scenario definition and repository- Multiple levels of acope (combined- one-on-one)- Approved/accepted- Realistic and stressful environments- Multi-level security- Automated/electronic

"* R&D community involvement In DiS PDU definition

"* Faster data reduction - Including video and audio

C-21

Modlng A S& Uon Neesot W eeerch & DeopenGroup 2

Medium Priority Near-Term Needs

• Advanced Simulation Support Environment- Graphical User Interface- Object/Class Libraries- Automated data Introduction- Scenario development tools- Audit trail- Automatic report generation (with graphics)- Tools to estimate resource requirements (HW, Comm)

- Assist in data capture

C-22

Modelng & Simulaton Needs Wfr Reeserh & Deneopment

Group 2

Medium Priority Near-Term Needs0 Capturing lessons learned Into repository

- Model development

- Model use- Feeds back to M&S requirements

. Procurement policy appropriate for need and potential of M&S- Mandatory use of M&S- Data rights- Acquisition strategy

0 Natural/man-made environmental dynamics

* Faster execution

* Real-time environmental data

C-23

Group 2

Low Priority Near-Term Needs. M&S should cover complete spectrum of military & non-military

operations

. Dynamic spatial resolution

* Runtime monitoring, reduction, & presentation

0 Better, faster graphics

. More flexible HW & SW procurement policy

* UnderstandIng of what raw data should be retained

0 Hypermedia

C-24

Nudglng S& 5mufmn Need1s 1o Reserch & Development

Group 2

Prioritized Long-Term Needs (Ordered)"• Next generation simulation support environment

- Intelligent Simulation Management Tool- intelligent Simulation Maintenance Aid

"• Seamless Interfaces between simulations & outside world- Multiple resolution levels- Multi-echelons

"• Supplement M&S with embedded Instrumentation and fielddata collection

"* Standardized data-Journaling capablitfies embedded InM&S (user selectable)

C-25

Mol h&den S Smultm1o Needs fr o esearch & Ievelopmen

Group 2

M&S Needs - Critical Issues" People not available"• Corporate vision"* Communication between activitiestpeople"* Education of developersimplementors, users, and decision makers"* Mission definition flux"* Distributed network management managing contederation of net members"* Collect data on human C3 decision-making behavior"• Simulation technology PE (service & DOD)"* Adequate funding for:

- Simulation technology- Infrastructure

"* Data needs defined, responsibilities fixed, tlmelines established, data basepopulated

"* More efficient code, powerful HW and high-speed communications networks"• Advantageous utilization of distributed processing

C-26

APPENDIX D

GROUP 3 REPORT

Modeling & Simulation Needsfor

Research & DevelopmentResults

GROUP 3

Modeling & Simulation Nede I, Research & DevelopmentGroup 3

M&S Types

0 Training

0 Manpower/Personnel

0 Medical- Operational Combat Medicine

Health Risk Assessment- Basil Bimedicsl Sciences- Man Machine Interface

* NBC

0 Civil Engineering

0 Environmental Quality

* Textile/Food

0 Fuels and Lubricants

D.2

Modeling & Simulation Needs for Research & Development

Group 3M&S Problem Areas

Technical Problems Identified In Topical Subjects"* Inadequate Software "llItls" and Configuration Management"* Deficient W&A"* Inadequate Warrior Models"* Modelers Are Data Poor, Simulators Are Measure Poor"* Insufficient Tools"* M&S Inventory Problem"* Visualization and Graphic Display of Results

D-3

Modeling & SinitiUWon Need for Reeseereb& DevelopmnentGroup 3

M&S Problems (concluded)

Management Problems"* Models and Simulations Are Poorly Defined"• Developers, Owners and Users Not Clear"* Stovepipe Approach to M&S Development and Use"* Care and Feeding of Infrastructure (People and Resources)"* M&S Phobia at the Top, Paradigm Shift Needed

D-4

Modeling & Smulekmln Needs 1ow Reseerch & Oevelopment

Group 3

Training - Pre-Execution"* Good definition of the prbkern or the gggi the simulation must

address"* Iterative, pro-active participatlon/interface between user &

designer/bulder"• Consistent policy to work toward common goals of Intaroporablllty

exchange, and use/reuse by a 'community of users' vice single userwhere possible

"* Clear achievable standards as goals for all to strive to"• Data bases - usable, changeable, and compatible"• M&S tools to build training"• Library- Inventory assistance,

- VV&A of M&S,

- Access tools"* User- Need - Requirement- Result user " modeler 0 simulator"* Access Tools u

- multi-use,

- flexible fidelity and low costD-5

Modelng & Slmutlema Need fr Research & Development

Group 3

Training - Pre-Execution (Continued)

* Visible olilties (VV&Aed)* Standards* Vision - Strategy - Policy* Man-Machine Interface• Behavioral modolaSDetermine data collection requirements

.4

Modeling & Simulaton Needs for Researh & DevelopmentGroup 3

Training - Execution

"* iterative feedback from user In a timely fashion, coupled withIterative feedback Involving DMSO

"* Joint Policy/Guldance that forces joint communications, dataexchange and realistic tests/demos of Interoperablilty

"* Develop and maintain joint test beds which are reconfigurabieand/or adaptable for different scenarlos/uses

"* Auto data coilectlon/processing"* Intrusion while executing"• Monitoring system (ID auspect areas)

D-7

Modeling & Simuiation Needs for Reeuoh & Deveoapment

Group 3

Training - Post-Execution

" Review of simulation used- Meet requirements (fidelity, reliability, maintainability in support oftraining??)- Can it be adapted I used I reused for other users?

"* Commitment / Decision on follow-up (kill project, add to It, "export" tocommercial use, etc.)

"* Review for "common concepts" and MOE"* Data processing / transfer"* Documentation/ VV&A update system"* Configuration management"* CAD / CAM concurrent engineering standard output

D4

Modeling I Simuou Needs fr F Rearch DevelopmentGroup 3R&D Training Needs

"* Training testbed that allows seeing, doing, & learning with enoughrealism

"* Teastbeds that are flexible & modular (including scenario and database generation) that am user friendly

"• Task/training specific models of human subsystems (e.g., visual,cognitive, propreceptive, ergonometric models)

"* Measurement and feedback methods linked to task & trainingobjectives

"* Methodology for projecting slmulatlon and modeling needs fortraining use

D4

Modeling & Smulaton Needts or Reweroh & DevelopmemnGroup 3

Manpower / Personnel

"* Force, organization duty cycle, and functional trade-offmodels (including Reserve, National Guard Integration)

"* Manpower allocation by system and function"* Methods of modeling workload Including crew/team Interaction"* Determinants of combat success Including motivation,

cohesion, and other sociological Issues"* Classfioatlion and testing models

D.10

Medein1 & -imu1lton Nifd R1eesec & DevelopmeGroup 3Health Risk Assessment Needs

Interaction of multiple "streasors" on Individual

- Biological - chemical warfare- Industrial environment. Environmental qualitySUlfe-cycle costs of acquisition

0-11

Modelin & maton Needsfot Re*eeh & DeelopmenGroup 3

Operational/Combat Medicine

"* Skills enhancement In wartime acenarlos, battlefield wounds/njuries,"virtual" cadavers

"* Logistios/euppfles/skllia/equipment packages specific toscenario/threat

"* Remote delivery of skillsSsurgeon @ medical center in communication with medic in field

D-12

Modding & Simulatlan Hoefd in Research & DevelopmenGroup 3

MEDICAL

Impacting manpower/porsonnel training"* Casualty streams"* Workplace safety/injury"* Ergonomics"* Infectious disease"* "Environmental" stresses, heat, cold, etc."* Health promotlon/ilntervention

- Drugs & alcohol- Physical fitness

0-13

Modeling & SimulaUon Neede fto Research & DevelapmentGroup 3

Basic Biomedical Sciences

"* Integration of anatomic functional, biochemicalparadigms of brain function

"* Vaccine development"* Molecular biology"• Enhanced performance drugs"* Rest-sleep cycles

D-14

Modeling & Simulation Neede for Reeearch & DevelopmentGroup 3

Man-Machine Interface

"* Validated life sclence/physiologlcal models"* High performance AC enclosed environments"* Human factors"* Aircraft accident reconstruction"* Bio-mechanioal

D-15

Modeling & Smmiletion Needle tot Reeerch & Development

Group 3

NBC"* Multiple problems of handling combined wounded & NBC

contaminated casualties from triage to cure

"* Preventive NBC- Future threat agents- Future threat cures

" Light weight/breathing combined contaminate bullet proofing

"* Befter NBC Detection Sensors

"• Accurate Environmental Models

D-16

Modelng & WUmidUon Needs for Reearch & Deelopmen

Group 3

Civil Engineering

"* Muitiple.-use Joint Services teot beds for VV&A"* Visualization capabilities for voluminous Input I output data

"• Common conceptual basis to help simulation developers

"* Upgrade material / Interaction models"* Develop facility I mission relationships"• Modeling human factora/perceptions"* Standardized architecture for heterogeneous data bases"• Improve model efficiency (vectorlze, adaptive grids)"* Develop accurate failure models"* Expert systems for damage assessment"* Concurrent engineering models for facility acquisition

0-17

Modeling A SlmuUon N"e ftw Resear D&eopmentGroup 3

Environmental Quality(EQ)

"* Common conceptual basis for modeling environmental qualityrelated processes

"* Object-orlented geographic Information system that can handleboth raster and vector information

"• Object-oriented M&S environment that integrates proceduraland declarative programming

"* Rapid prototyping capability (simulations)

"* Corporate environmental quality knowledge I data bases"* EQ "execuive agent""* Better understanding of the physical and biological processes

affecting EQ"* Bettor understanding of how to model sociological aspects of

EQ

0-la

Modding & retaration N..d. Io Reserch & Developmet

Group 3

Textiles / Food" Individual warrior model and simulations

- Unk high resolution kern/component models to lowresolution, macro theater-level simulations- Facilitate DOD technology investment decisions for Thrust 8- Optimize combat effectiveness for the individual combatant- Assess Impacts on survivability resulting from changes Inwarfighter equipment, training, and doctrine

" User friendly interface- Facilitate development- Reduce start up effort- Saves time & resources

"* Automated forces - eliminate any requirement for other nodesto be "present" when running simulations and R&D excursions

D-19

Modeling & lmnulmuon Need. otr ReeNerch & Development

Group S

Textiles / Food (Continued)

"* Electronic catalog - data bose of what's available & POCSeinstructions for use / help

"• Multiple use models - address multiple requirements Iproblems with single application

"* Standard framework for scenarlo excursionAbility to explore options - desert, arctic, etc

D020

Modeling & Sinuladon Needs fr eseearch & OevekommdGroup 3Fuels / Lubricants / Consumables

" Campaign-level modeling to Identify logistics problems insustainment- Replenishment requirements- Bulk storage requirements- Distribution requirements - need year's inventory- Threat proof- Methods i doctrine to shrink requirements weight/cube(dehydration)

"* Environmental safety/occupational health"* A/C fuel system virtual prototyping

- Leak avoidance

0-21

Modeling A SinmufUon Needs for Research & Develo penw

Group 3

Wrap-Up"• How Did It Work? Oults Well!

- Group adopted a solutions-orlented approach early on"* What Worked Particularly Well?

- Organization into subgroup speciality areas- Point Man ("Expert") In each area to develop products. Concurrent overview to distill solutions that apply across theboard

"* What Didnt Work Well?- Diversity of TopICS. Group felt that each subgroup was worthy of consideration as itsown working group

"* Recommendations: Are solution oriented"* Our Question: To what extent will recommendations be adopted?

0-22

Modef&lng l~l I Utuw~o Nes rNewch An Deelpmnt

Group 3

PRE-EXEC EXEC POST EXECNDW~l bWW~iehudOlecmfit9 108kM IDeaia 6~ OsmaneeaelvVA d.e.bm

E 60"lOi " 6800 ~ seftsl VYSA. A * lal eeluueeeeý

A cviwmarPre.00 upeaaam" iSMORM~R ereIeI Add.. gehahel bmed en *- tUeflm~w/w~

T W~wfm Oft t ed by M"S?E pmgueeeltcempoe mdi .guheaue Updde $pIuNu -ee1@~R ApftUmeebe3 .,NAM dMa delug khuSU meahpb am ,ees d"e mmW n

M" Pess - coEACmMWfl ___ __ _ __ __

Toplew" "aw tw Teshnetw" aenlete hued on %'do* pot - SOPHOWmF weyin a (painsg ed onA PMf OW feW" euegR G eb4 peseet spo (deaNtef~lfg 00detePulm

T swwm by: .ebg1pty) P~Pre&md (daaueieet ude Meewfthm -wE tacics ( lm b"el nefld wtlR *%.bewe (cometme"aetm - mellemSmie

nude"e 'Ur up-W

D-23

Modeling& Sinmuwlato Neds hReearch ADevelpnmen

Group 3

Information Flow ParadigmBreaking the Stovepipea

[OS:D c 100DARPADJ

MORS

D-24

MOdelin & Ulnnuls~m Need OW Reeeech & Deveopen

Group 3

Problems --> SolutionsProblem: Models and Simulations are Poorly Defined" Near-term Solutions

- M&S to support warfighter systemEstablish top-down applications tool book- multiple use models

"te data- p&SIolicy for COEA/ORD/TF.MP. user-oriented desktop reference

- Bas on strategy-tactlc-technology-pollcy related towenario/threat

"* Far-term Solutions- Establish (top-down) M&S standards for decision support

- M&S for Strategy/Polliy Decision Support- M&S for Force Level Tactics Decision Suppor- MMS for Campaign Outcome for yStms Dcision Support- M&S for Systems Engineering at Platform LevelSCombat Systemeh(put lead on target)

Combat Support systemsCombat Service Support Systems

- M&S for Engineering (to physics) at Subsystem Level- Data Management based on the above

Group 3

Problems --> Solutions

P: Developers, owners, and users not clear

S: Involve owners and users by providing solutions tostrategy/tactica technology deficiencies (user focus)

S: Define role of owner/user and Interaction with DecisionSupport Force

- System Engineer- EvaluatorlAnalyst- Modeler/Coder- Tester

91-25

Md•aong a 8mukUom Needs fr Remach & Oevew mentGroup 3Problems --> Solutions

P: Stovepipe Apprcach to M&S Development/Uso

S: Educate socqulItlon force at DSMC (customer/user;decision makerldecision support force)

S: Orient DOD M&S directive to customer/user desktopreference on M&S

S: Make better use of Information sharing by MilitaryOperations Research Society

D-27

iadeling A Simulalon Neede IrW Reserah & DeerlomenitGroup 3

Problems --> Solutions

P: Reluctance to use M&S by top-level Management

S: Dao technology solutions on current top-levelstrategy-tactics-technology (needs) /future scenario threat

S: Take top-level solutions to top-level executives8: Make top-level solutions understandableS: Educate top level executives as they come up through the pipeline

- DSMC- service schools

S: Implement paradigm by providing user (decision maker) withunderstandable graphics visualization of statistical outcome

0-.3

Modeling & almulatlon Needs kw Research & DoveokpmentGroup 3Problems --> Solutions

P: Care and feeding of Infrastructure

S: Include M&S decision support work force In DAWIA trainingS: Train decision support force at DSUC

- system analyst/operations researcher- modelerisimulations developers

S: Provide resources ,) train and retain highly qualifiedInfrastructure

D-29

Modenng & Simuaton Needs #or Research & DevelopmWnt

Group 3

Critical Issues"* MAINTAIN USER PERSPECTIVE

- Know who user (customer) Is- Know what his strategy/tactics are- know what decision support user needs- Know difference between decision support team and user

" BREAK DOWN STOVE-PIPES (NOT ENOUGH IPPD)- Production and logistics (P&L) community abrnc"- Range community absence- Analytical community absence

" TOP-LEVEL LEADERSHIP TO INSTITUTE M&S- Policy- Resource allocation- Education- User Involvement In the process

BOTTOM LINE: USER FOCUS! USER FOCUS! USER FOCUS!

S ,• i • • •i ii¢m m m mmmo m

APPENDIX E

GROUP 4 REPORT

Modeling & Simulation Needsfor

Research & DevelopmentResults

GROUP 4

Modeing & Sinuuatton Needs a Research & Oeve~cmu* tGroup 4

M&S Roles

"* Requirements generation and validation"* Concept validation"• Sub-system performance and design"* Technology demonstration and development"* Software design and validation"* Testing and training

E-2

Modeling iwmulation Needs for Research A DevelopmentGroup 4

M&S Types

" Digital"* Hardware-in-the-loop"* Man-In-the-loop"* Distributed Interactive Simulation"* Hybrid (analog/digital representations)"* Physical effects models (e.g., computational

fluid dynamics)

E-3

Modelng & UinwWUon Needs I Reewrch & ee uGroup 4

M&S Problem Areas

"* Inability to identify what is available In the community"* Lack of standards across the community"* Lack of available highly capable user friendly tools that can

be used across a broad set o1 computer platforms"* Current engineering approaches to model development

limits reusablilty"• Current simulation cannot be used to meet the emerging

requirements of the new world situation (e.g, joint regionalconfilct)

"* Lack of communication/coordination of developers andapplication

E-4

Mod•in & Smnulet Need. br t Rech & evelome

Group 4

M&S Problem Areas (Continued)"* Lack of concurrent simulation (in terms of performance,

producibllity, logistics, testing, and training)"* Computational speed Is still a limitation for a class of R&D

simulations"* Lack of adequate sources of truth for validation"* Data/databases

- Lack of data- Knowledge of available data- Validation/certification

"* Sensor simulation for hardware In the loop- Multispectrum- Clutter background- Countermeasures- Complex targets

"* Ability to model behavioral representation

E-5

ModolIng & Simlaion Needs lot Resarch & DevelopmentGroup 4

M&S Policy Problems

"* Lack of a consistent clear mufti-yearobjective and vision (R&D simulationInfrastructure)

"* Inability to maintain simulation expertise Ina climate of resource reductions (e.g.,personnel, budgets)

E-6

Madding & S1mulaftm Need lot Research & Dmvlopenw

Group 4

Prioritized Near-Term NeedsTop Level Methodology

" Need to develop M&S top level approach for R&D Includingmodel/simulation sultablilty/applicebllity

" Requirement to Include all design factors (performance, cost,produceabillty, logistics, etc.) Into Integrated M&S methodology/approachto support the entire acquisition life cycle

" Development a process to define Operational Situation circumstancesfrom which scenarios can be drawn with the objective of defining factorssuch as environment, order of battle, tactics, threats, etc.

"* Process needs to focus on producing a highly flexible method forassessing rapidly changing scenarios which provides the basis for clearstatement of M&S objectives

"* Need to identify appropriate Measures of Effectiveness to be used InSynthetic Environments that represent a spectrum of Joint operations toases the value added as a result of technology alternatives andenhancements

E-7

Modeing & Simulaion Needs lot Research & Development

Group 4

Prioritized Near-Term NeedsInfrastructure

" Develop standards which address:

- Documentation- Configuration Management

- VV&A- Architecture

to achieve Interoperablllty across simulation environments (virtual,constructive, real) and software reusability, transportability andshare-ability

" Establish methodologies and procedures for verification andvalidation for levels of simulation accepted by the services

E-8

ModelWng & 1wmisUmi Needs for Reearch & Development

Group 4

Prioritized Near-Term NeedsInfrastructure (Continued)

Create robust Distributed Interoperable Simulation- Reconfigurable simulator to support virtual prototyping- Methodology to reflect fidelity from lower level simulations Into DIS- Computer generated forces/Human behavioral representation- Virtual Reality - porting the Individual Into the environment- Dynamic Environment representation- Configuration testing for network assets- Display technology- Intelligent gateways/bandwidth- Correlation techniques for dissimilar simulator linkage

E-9

ModeUng & lmuleUoN Needs M or Reeeroh & D@velopment

Group 4

Prioritized Near-Term NeedsInfrastructure (Continued)

* Requirement to establish standards for databases, a data dictionary andprocedures for accrediting (traceability) data, also methodology how todeal with data voidsDatabase tool to automatically provide data based on level of simulationfidelityDatabase tool needs to address the M&S architecture consideration toprovide required data

* Need a electronic M&S library which can be used to provide M&S user acatalog of existing validated M&S, documentation, databases, softwaremodules and an assessment of useAlmitationNeed to develop an AA tool to support query of model catalogNeed software source code repository as standardization becomes a wayof life

E-10

Modeling am& S tmutman Needs for Reea" h & DOvelapmen(

Group 4

Prioritized Near-Term NeedsR&D S&T World

" User friendly simulation development tools and run timeenvironment are required- speeds development- enhances user understanding of technology capability- reduces errors

"* Develop advanced targeVenvironment presentation system forhardware-in-the-loop slmulationNeeds to address multispectrum, clutter background,configuration management, countermeasures, etc.To conduct evaluation and testing of developmental hardware In alaboratory environment

"* Develop common support models for: threats which provideperformance characteristics, countermeasures, multispectrumsignatures, and environmental representations of clutter,background, atmosphere, etc.

E-11

Modelfng a SiniAUeon Needs for Remseh a Developmem

Group 4

Prioritized Near-Term Needs"* Number 1: Standards (Infrastructure)"* Number 2: Top Level Approach for R&D (Top Level methodology)"* Number 3: Concurrent Engineering (Top Level Methodology)"• Number 4: VV&A Methods & Procedures for Reusablity (infrastructure)"* Number 5: User Friendly Tools and Environment (R&D S&T)"* Number 6: Scenarios for Joint Operations (Top Level Methodology)"* Number 7: Representation System for HITL (R&D S&T)"* Number 8: Robust DIS Synthetic Environment (infrastructure)"* Number 9: Common Support Models (R&D S&T)"* Number 10: Database Standards/DIctlonary (infrastructure)"* Number 11: MOE@ (Top Level Methodology)"* Number 12: M&S Library/Tools (Infrastructure)

E-12

Moeing &81aWWhA Need. bI Neh & DeveleA mentGroup 4Critical Issues

"• Development/retention of simulation expertise"* Clear multi-year vision/objectlive for the M&S community

(Line item Investment strategy)"* Interservice cooperation for Information exchange In

M&S"• ReusablIlty Isn't taken serious - Remains fiction"* Suitablilty of force-on-force to measure military worth of

S&T products

E-13

Modeling & 5Imu•Uon Need. lo Reeereh & Develpment

Group 4

M&S Needs1 Development of Joint Operational Scenarios

Need a process to define Operational Situation circumstances fromwhich scenarios c•n be drawn with the objective of defining factors suchas environment, order of battle, tactics, threats, etc.Process needs to focus on producing a highly flexible method forassessing rapidly changing scenarios which provides the basis whichprovides the basis for clear statement of M&S objectivesThis should should be viewed as a starting point to a process. Unless welook at this as an entire process our efforts will be able to be mergedtogetherAlthough scenario generation Is tyle ally seen asa policy Issue -Issued to the Servies as pert of 11: DG -- it Is our view that there aretechnologies that can be brought to bear in a process to help thosepolicy makers provaid quickly, more detailed, meaningful scenario datato the M&S communityThis would greastly enhance focusing the M&S effort to make them moresuitable and applicable to the study effort

E-14

Modeling & Simultion Needs I1W Reserch & DevelopmentGroup 4M&S Needs (Continued)

2 Need to Identify appropriate Measures of Effectiveness to be used inSynthetic Environments that represent a spectrum of joint operations toassess the value added as a result of technology alternatives andenhancements

3 Requirement to Include all design factors (performance, cost,produceability, logistics, etc.) Into Integrated M&S methodology/approach tosupport the entire acquisition life cycle

4 Develop advanced target/environment presentation system forhardware-In-the-loop simulation. Needs to address multi-spectrum, clutterbackground, configuration management, countermeasures, etc.To conduct evaluation and testing of developmental hardware in alaboratory environment

5 Establish methodologles and procedures for verification and validation forlevels of simulation accepted by the services

E-15

Modeling & Simulation Needs for Remarch & Development

Group 4

M&S Needs (Continued)6 Requirement to establish standards for databases, a data dictionary and

procedures for accrediting (traceability) data, also methodology how todeal with data voidsDatabase tool to automatically provide data based on level of simulationfidelityThe database tool needs to address the M&S architecture consideration toprovide required data

7 Develop standards which address:

- Documentation- Configuration Management- VV&A- Architecture

to achieve Interoperabillty across simulation environments (virtual,constructive, real) and software reusability, transportability andshare-ability

E-16

Modeling & 91Simaon Needs fo Reeamrch & DevelopmentGroup 4

M&S Needs (Continued)

8 User friendly simulation development tools and run timeenvironment are required. speeds development- enhances user understanding of technology capability- reduces errors

9 Need a electronic M&S library which can be used to provideM&S user a catalog of existing validated M&S, documentation,databases; software modules and an assessment ofuse/llmitailonNeed to develop an Al tool to support query of model catalogNeed software source code repository as standardizationbecomes a way of life

E-17

Modellng & 81mlation Needs fm Reearch & Development

Group 4

M&S Needs (Concluded)10 Create robust Distributed Interoperable Simulation

- Reconfigurable simulator to support virtual prototypIng- Methodology to reflect fidelity from lower level simulations Into

DIS- Computer generated forces/Human behavioral representation- Virtual reality - porting the Individual Into the environment- Dynamic environment representation- Configuration testing for network assets- Display technology- Intelligent gatoways/bandwidth- Correlation techniques for dissimilar simulator linkageo

11 Develop common support models for: threats which provideperormance characteristics, countermeasures, multispectrumsignatures, and environmental representations of clutter,background, atmosphere, etc.

12 Need to develop M&S top level approach for R&D Includingmodeol/smulation sultablinty/applicablllty

E-18

APPENDIX F

GROUP 5 REPORT

Modeling & Simulation Needsfor

Research & Development

Results

GROUP 5

ModelWing & Smulatlon Need. *o Reserch & Development

Group 5

Grouped Roles of M&S

1. Technical"* Engineering design tradeoffs"* Test driver (DT/OT) (2)"* Test design"* Development & evaluation of design concepts"* Human factors engineering (2)" Performance analysis and projections (2)" "ltles" Impact assessment - produceablilty, maintainability,

reliability supportability, survivability, vulnerability, shop floorlayout, (a1l)

"• Safety analysis (2)"* Accident analysis (2)"• Concepts tradeoffs (all)"* Security (essential technology protection)

F4

Modeling & Smulabton Needs lo Raeuch & DeveopmentGroup SGrouped Roles of M&S

2. Operational"* Requirements refinement"* Tactics development"* Nuclear safe sscaps weapons delivery (1)"* Conventional safe escape weapons delivery (1)"* Mission planning3. Economic"* Cost & schedule projection and analysis (economic model) (4)"* COEA (4)"* Analytical basis of Investment strategy (4)"• Affordability/quantities analysis4. Management• Audit trail of acquisition process (1)

F-4

Modeling & Simulaton Neede Sow Reearch & DeveopmentGroup 5

M&S Types in Member's Organization

Campaign

Scenario-threat Mission

cost PlatformSubsystem

Engineering (specific)

"Database*

F.4

Modeling & Simulation Needs Ar Research & OevelopmentGroup 5

Grouped M&S Problems

1. TechnIcalLack of Interoperablllty (4)Imprecise kno-mledge of physical process (physics)

Lack of data element description (4)

Inadequate/Incormct resolution (granularity lsstujaX3)Poor user Interacdon practice during mode! de"- (t,4)

Imprecise vocabulary (4)

2. Operational

Imprecise requirement definition (4)

Requirement Instablilfty (4)

F4

Modeling & Simulatlon Needs Ow Pemch & DevelopmentGroup 5

Grouped M&S Problems

3. EconomicCost growth (4)Resource competition (M&S vs other uses of resources (4)

Resources to set up model to run (4)

inadequate resources (funding, manpower/skils,

equipment, facilities, mgmt commitment) (4)

F4

Modeling & smulnano Needs fr Reewarh & DevelopmentGroup 5Grouped M&S Problems

4. ManagementConfiguration control (documentation, etc.)

VV&A (high cost & lack of method) (3)Standards

Imprecise "approved" scenarlos (or no approved scenario)(2)Lack of common library (duplication of effort)Career path

Blind use / overselling of models (1)

Lack of adequate communications Infrastructure (3,1)

-.7

Modeling & Simulation Needs Ior Reeearch & DevelopmentGroup 5

Priority M&S Problems

"* Lack of common library (duplication of effort)"* VV&A (high cost & lack of method)"* Lack of interoperablity

"* Inadequate resources (funding, manpower/skills,

equipment, facilities, management commitment)"* Standards

.4

Moddling & Simulation Needs lf Reeearoh & Development

Group 5

Prioritized NeedsResources

- Management Commitment- Availability(Before, During, After)

PersonnelFacilitiesModeling and SimulationFunding

Management Infrastructure

Library- Repository

Models & SimulationsStandard DataArchivos/Reports

. Clearing HouseModels &SimulationsFacilitiesOther

Fp-

Modeling & Simulmtion Needs lot Rmreh & Develapmen

Group 5

Prioritized Needs (Continued)

Standards- Definitions- Interfaces/Interoperability- Open system Architecture- W&A- Databases- Scenarios

Communications- infrastructure- Multi-level Security

Feedback Into M&S process- Lessons learned from M&S use (development, DT/OT, etc)- Adequacy, applicability, and utility of M&S used

F-IO

Modeling & SimulsUan Needts fo Rereh & Development

Group 5

Prioritized Needs (Concluded)Expertise Renewal

- Centers, labs, facilities, personnel- M&A support- Continuous M&S Improvement- Foster M&S R&D, and availability

Configuration controlIncreased Involvement and support of M&S

.User- Customer- Management

Determine when/where M&S is appropriate for applicationIndependent W&A

- Referral serviceRapid M&S reconfiguration capabilityUser responsive technical supportJoint M&S users groupDetailed execution planRapid, automated data reduction, analysis, and presentation

p-11