#isss2016 Berlin - Kaufmann - Requirement Analysis on a virtual reality training system for CBRN...

Requirement Analysis on a Virtual Reality Training System for

CBRN Crisis PreparednessAnnette Mossel, Andreas Peer, Johannes Göllner, Hannes Kaufmann

International Society for the Systems Sciences

Hannes Kaufmann | ISSS | 02.-07.08.2015 | Berlin, Germany | [email protected]

Motivation

Effective training is cornerstone of disaster preparedness Disaster readiness of first responders influenced by

– Quality, – Consistency,– Frequency of training

Extent of real-life drills limited by – Time, cost and safety– Especially for training of integrated disaster teams


Training in Virtual Reality (VR) Can overcome limitations of existing training (i.e CBRN)

Important factor is immersion (1) To increase presence; (2) to create stressful training situations-> Thus training effect

Only few solutions provide immersive VR training – Solely designed for military training– Highly cost-intensive (more than $100.000) – Require extensive technical knowledge for system setup

First responder agencies require flexible immersive VR system – Multi-user, interdisciplinary team training – At different command levels – In various training scenarios


Contribution Comprehensive state of the art analysis

– Focus: Capabilities of existing VR systems for multi-user training.

A requirement analysis of two stakeholders– Stakeholders

• Austrian Federal Ministry of Defense and Sports (BMLVS)• Red Cross Innsbruck, Austria

– Focus: CBRN training tasks– 3 training use cases for future training in VR

Final Analysis


State of the Art Analysis Aim: Analyze available VR training systems

– Military applications– First responders, civil use

Criteria & Aspects– Intended use/application scenarios– Flexibility

• Applicability for different deployment scenarios• Freedom of movement for user

– State of the art of proposed hard- and software– Content generation/editor capabilities– Training performance evaluation


Analysis of the State of the Art Not studied

– Single user training systems– Training for negotiation & language skills

• Bilateral Negotiation Trainer (BiLAT), US ARMY• Operational Language and Culture Training System (Iraqi, Dari,

Pashto), US Army– Augmented Reality for Live Exercises

• Using GPS tracking and Head up Displays• Applied Research Associates, DARPA

Focus on– Virtual reality training systems (desktop based, immersive)– Capable of multi-user training


Single Task but Multiple Users Aircraft simulators (> 1600 military aircraft simulators in

service)– Full Flight Simulators (FFS)

• Navy MH-60 Romeo • Eurofighter Aircrew Synthetic Training Aids (ASTA)

– Unmanned Aircraft Systems (UASs) simulators• Predator Mission Aircrew Training System (PMATS)• MQ-8 Fire Scout Unmanned Helicopter (Northrop Grumman)

Training for shooting/gun operation– Simulated Weapon Environment Testbed (SWeET)– Small Arms Trainer with 180 Degree Visuals (180SAT) / ameldefense

Tank operation training– LEOPARD Gunnery Skills Trainers (LGST) / Rheinmetall Defence

Naval operations– Maritime Composite Training System (MCTS), UK– VR Team Trainer / Szenaris GmbH


Multiple Scenarios and Multiple Users Virtual Battle Space 3 Advanced Network Trainer (ANTares) Dismounted Soldier Training System VirtSim Law Enforcement/Military XVR-VR Training Software for Safety and Security


Virtual Battle Space 3 (VBS3) Bohemia Interactive, Australia Available: March 2014 (US Army), July 2014 (commercial use) Costs: upon request

Intended Use • Soldier Training (tactical, mission rehearsal)• cost-effective training tool in the "crawl" phase of soldier training• train unit tactics, techniques and procedures in Decisive Actions

Used by • U.S. Army, U.S. Marine Corps• UK Ministry of Defence, Australia Defence Force, Canadian Armed Forces, and New Zealand Defense Force• Bundeswehr, Italian Army• NATO

Example Systems based on VBS3

• eurosimtec GmbH (Düsseldorf, D) uses VBS since 2008 to develop a number of projects for Bundeswehr, i.e. UAS-TS (Unmanned Aircraft System Training) for tactic drone LUNA

• Bundeswehr Atellerieschule: C3I-TS (Command, Control, Communication Training System) for JFST (Joint Fire Support Team) for classroom education

• GefSimZH (Gefechtssimulationszentrum der Bundeswehr) in Wildflecken uses VB-Edit as real-time editor for fast and easy 3D object creation, i.e. to populate terrain data

• GefÜbZH: MALE UAS (Medium Altitude Long Endurance - Unmanned Aircraft Systems): • joined training of air force and ground-based forces


VBS3 Hardware

• Desktop-based non-immersive VR• 2D monitor• Stereo sound + microphone • Keyboard + mouse (egocentric controlling of virtual avatar)

• Multiuser• Enables complex training scenarios, more than 100 users• Optimized for large networked scenarios

VBS3 Software

Software Architecture • Open software platform• Enables 3rd party products to extend the simulation environment and functionality.• Comes with several built-in applications that support development training capabilities

• mission editors, after-action review module, development suite, content library• Connects VBS with other military simulations or interconnects many VBS servers together

3D Content Creation • 3D modeling software Oxygen 2 • create buildings, edit terrains and convert 3D models to the VBS3

• Procedural generation of terrain• create terrain features from source data• on-the-fly generation of biotopes (i.e., vegetation) as they are needed

3D Content & Editor • High-Quality Rendering and Physics (Game Engine Real Virtuality 3 + Nvidia's PhysX)• Offline mission editor (OME) to create scenarios

• At air, land, sea• Prepare terrain, objects, avatars, vehicles, weather (weather, sun, etc)

• Real-time editor (RTE)• Influence scenario during training

• Simulation module: • First person environment that supports mounted and dismounted operations. • Ground and air vehicles, small arms and vehicle mounted weapons, communications, and

interactive opposing forces.


VBS3

Performance/Evaluation After Action Review Module (AAR) • Conduct post-training analysis with the ability to fast-forward or rewind to events• Track Statistics: statistics on casualties, engagement time, rounds fired, etc• Review scenarios from any perspective within VBS3:

• trainers and trainees can view scenario from any perspective including 3D, 2D, and from any player's perspective.

• Administrators can switch from a bird's eye view of a battle to the enemy's perspective or follow the path of a bullet to a target.

• The field-of-view feature allows to check where squads or individual soldiers are observing during a scenario.

• After-action review timeline to visualize timely dependent all statistics

Flexibility • Applicable for different deployment scenarios• Very high

• Freedom of movement for user• Low: only sitting in real environment

Advanced Network Trainer (ANTares) Rheinmetall Defence, Germany Available: unclear information, exhibited at ITSEC 2013 Costs: upon request

Intended Use • Land, air, naval weapon system simulator for tactical training operations• Main battle tanks• Transport helicopters• Ground control stations for unmanned aerial vehicles

• Modular training system in a networked environment• crew-coordination training • tactical mission rehearsal of complex operations

Used by • Deutsche Bundeswehr (planned)

Hardware Modular cubicle concept with individual simulation cubicles • can be arranged as plug-and- play components • in any customer-defined configuration • set up in a classroom environment or mobile container

Simulation cubicles use• 2D screens, HMDs• Keyboard, mouse, joysticks, force-feedback devices• Fully equipped maneuver stations with actual hardware

Open architecture provides for the integration of different systems to form a complex networked mission scenario.


Advanced Network Trainer (ANTares)

3D Content & Creation • Uses TacSi Reloaded + Virtual Battle Space 2 (VBS2)• Rheinmetall TacSi Reloaded: provides computer generated forces and game engine

Performance/Evaluation • Uses VBS2 system

Flexibility • Applicable for different deployment scenarios• High

• Freedom of movement for user• Medium: Sitting, standing

DSTS - Dismounted Soldier Training System Intelligent Decisions, USA

– Available: since 2012– Costs: ~ $ 500.000 (one suite)

Intended Use • Multiuser Dismounted Soldier Training (Infantry)• Simulation of vehicle, plan and rocket systems

Used by • U.S. Army’s Program Executive Office for Simulation, Training and Instrumentation

• Army plans with 102 test sites for 2012Hardware DSTS suite:

• Covers area of approx. 170 sqm• Setup in approx. 4h• 5x Virtual Soldier Multifunction Workstations• 9x Virtual Soldier Manned Modules• 1x Staff Control Station• 1x After Review Space

Virtual Soldier Manned Module (fully wearable)• Helmet with HMD and headset (audio, microphone)

• 3DOF head tracking (Intersense)• Vest with attached mobile (notebook) processing unit

• 3DOF Torso tracking (Intersense)• Gun with 3DOF tracking target (Intersense)


DSTS - Dismounted Soldier Training System Intelligent Decisions, USA

– Available: since 2012– Costs: ~ $ 500.000 (one suite)


DSTS - Dismounted Soldier Training System3D Content & Editor • High Quality Rendering & Physics (CryEngine)

• Content Editor: • Unlimited training scenarios with semi-automated forces and live participants • Training scenarios can be modified in real-time

• Simulation Module: • Movement of ground vehicles, aircraft, dismounted infantry• Day time, weather effects

Performance/Evaluation • After Action Review (AAR) • Records all relevant data during the training scenario

• tactical voice and radio communications• movement techniques• weapons positions• critical events• engagements (i.e. Situational Decision Points)

• immediate feedback can be provided to soldiers


• Freedom of movement for user• Good: orientation tracking, standing, sitting, crouching,


VirtSim Law Enforcement/Military Motion Reality, Inc. , USA (created by US defense contractor Raytheon in 2009)

– Available– Costs: > $100.000

Intended Use • Training for officer, clearing teams, active shooter drills and SWAT team missions.

Used by US agencies, i.e. FBI

Hardware • Multi-user wearable immersive VR • Egocentric stereoscopic 3D scene viewing (standard HMD)• Optical outside in tracking (Vicon)

• Head, Body, Gun• Real walking

• larger sized physical spaces (20x20m) • User-carried notebook

• Performs processing, rendering and networking. • Hardware setup is complex, bulky and costly


VirtSim Law Enforcement/Military3D Content & Creation • Content Editor

• Provides range of reconfigurable environments• Law Enforcement: User- customizable scenarios within these environments to train individuals

in weapon discipline, making deadly force decisions, covering danger areas, team clearing techniques, use of cover and concealment, and communications among team members.

• Military: User-customizable scenarios within these environments to train individuals in direct action, counter-terrorism, react to contact, or other Tactics, Techniques and Procedures (TTPs) based on the Current Operating Environment (COE)

Performance/Evaluation VIRTSIM After Action Report (AAR) • basic individual maneuvers of participants • team and squad maneuvers• playback of all actions and shots from every angle, and from each participant’s perspective • All trainee body motions and all shots fired by every participant are recorded and displayed• Every training session is automatically catalogued and stored • Sessions are available for replay at any time.

Flexibility • Applicable for different deployment scenarios• Medium

• Freedom of movement for user• High: free to run, jump, or crawl throughout the full volume


XVR-VR Training Software for Safety and Security E-Semble, Netherlands

– Available– Costs: > € XX.000

Intended Use • Train & Exercise emergency response professionals. • Scenarios:

• Scene command level up to strategic decision makers• Single users and multiple users

Used by • Emergency services, industry, critical infrastructureHardware • Single to multi user desktop-based VR

• Each PC displays a single link in the emergency services chain. • Mostly 2D screens• Keyboard, mouse• Joysticks, 6DOF interaction devices

• Scenarios• 1 on 1 training – i.e. for on scene commanders• Team Training – single & multi agency• On Site – mobile and remote training• Hybrid – combine live and virtual reality training scenarios


XVR-VR Training Software for Safety and Security3D Content & Creation • Combination of 3D virtual simulation, map-based information, photography and videos

• Egocentric view of participant on the information allocated to its specific role• Content Editor

• Configuration of a region, incident or disaster scene• Type, scale and location of an incident can be determined• Realistic configurations of countries, regions, emergency services stations by drag and drop• Customer-specific settings (i.e. number of rescue vehicles, personal on call, etc) • -> participants are forced to take into account logistic aspects (call-up and transport times)

• Simulation Module for Students:• Use joystick to navigate around the XVR environment (walk, drive, fly)• Assess risks and dangers of an incident in a created scenario• Decide on measures and which procedures to apply

• Simulation Module for Instructors:• Can give instant feedback to challenge students with questions throughout the exercise• Can respond to a student’s decision by activating events in the virtual scenario

Performance/Evaluation Creation of assessment scenarios (predictable, repeatable) for unbiased assessment of participants


• Freedom of movement for user• Low: only sitting in real environment


Requirement Analysis Two stakeholders for disaster relief

– Austrian Federal Ministry of Defense and Sports (BMLVS)– Ambulance Team of the Red Cross Innsbruck, Austria.

Identification of requirements of both stakeholders’ CBRN defense elements

Development of use cases – To derive demands on VR training system– Within scenarios we focus on

• Involved command levels• Target groups• Required training content.


Requirement Analysis

NBC defense skill catalogue as base

Skill bundles

Urban searchand rescue Water

purification

CBRN Defense Recce Urban Search and Rescue

Aircraft Rescue and CBRN Defense


USE CASE 1: CBRN Defense RecceMajor mission tasks are Observation, Detectionand decontamination 30 km² virtual area


USE CASE 1: CBRN Defense Recce Single user, team, group up to platoon training Decision making process training for all levels Specific areas and surroundings (hazards,

weather conditions, …) easy to implement


USE CASE 2: Urban Search and RescueMajor mission tasks are Exploration & Searching, Rescue of persons and Clearing

urban area; buildings, lifelines, …cultural realities !!


USE CASE 2: Urban Search and Rescue Training and education of decision makers of all

levels of an USAR platoon Easy to simulate various damages

Easy to implementvarious hazards and other conditions(weather, daytime, …) aswell as the number ofcasualties and the kindand grade of injuries


Use Case 3: Aircraft Rescue and CBRN Defense be on site within 90 seconds after crash finish fire fighting after 2-3 minutes after crash rescue the pilot

Various parameters of different aircraft types

Large number of differenton site hazards

Safety devices must beknown DRILL TRAINING


Summarization of Requirements 1/2 Demands on VR Training Environment

– Fully immersive to exploit the advantages of learning in VR– 3D object interaction (selection and manipulation)– Natural walking for navigation and to realistically simulate

exhaustion– Multi-user capable to allow for collaborative training.

Demand on Hardware Setup– Fully wearable– Quick to setup– Requires a small amount of hardware to lower price and

system complexity.


Summarization of Requirements 2/2

Demands on Software System– Creation of new 3D training scenarios– Customization of scenario parameters before and

during the training,– High quality 3D rendering with physics support– After action reviewing for trainee evaluation.


Comparison Stakeholder requirements are not met entirely by

any existing system– Dismounted Solder Training System

• Fully immersed multi-user training• No natural walking and no 3D object interaction

– VirtSim• Full immersion multi-user training • 3D interaction and natural walking• No unbound creation of new training scenarios

– Virtual Battle Space & XVR• 3D scenario generation, parameter customization, after action

review • Work with standard hardware, system can be extended with VR

hardware• Not fully immersive, no natural walking


Conclusion No existing system focuses on immersive VR

training for CBRN crisis preparedness– Immersive VR systems offer tactical training for soldier

or police squad units– Desktop-based systems for crisis preparedness provide

training for different command levels On-Site squad members are subject to stress and

exhaustion in reality– Natural walking should be included into VR training

simulation– Future research efforts are necessary to meet the

stakeholders’ requirement

Thank you! [email protected]

#isss2016 Berlin - Kaufmann - Requirement Analysis on a virtual reality training system for CBRN...

Science

Transcript of #isss2016 Berlin - Kaufmann - Requirement Analysis on a virtual reality training system for CBRN...