Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace...

16
Airspace Encounter Models - 1 MIT Lincoln Laboratory Airspace Encounter Models for Conventional and Unconventional Aircraft Matthew W. Edwards, Mykel J. Kochenderfer, Leo P. Espindle, James K. Kuchar, and J. Daniel Griffith Eighth USA/Europe Air Traffic Management Research and Development Seminar 29 June 2 July 2009 This work is sponsored by the United States Air Force, Department of Homeland Security, and Federal Aviation Administration under Air Force Contract #FA8721-C-05-0002. Opinions, interpretations, conclusions, and recommendations are those of the author and are not necessarily endorsed by the U.S. Government. Approved for public release; distribution is unlimited.

Transcript of Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace...

Page 1: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 1

MIT Lincoln Laboratory

Airspace Encounter Models for

Conventional and Unconventional Aircraft

Matthew W. Edwards, Mykel J. Kochenderfer,

Leo P. Espindle, James K. Kuchar, and J. Daniel Griffith

Eighth USA/Europe Air Traffic Management

Research and Development Seminar

29 June – 2 July 2009

This work is sponsored by the United States Air Force, Department of Homeland Security, and Federal Aviation Administration under Air Force

Contract #FA8721-C-05-0002. Opinions, interpretations, conclusions, and recommendations are those of the author and are not necessarily

endorsed by the U.S. Government.

Approved for public release; distribution is unlimited.

Page 2: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 2

MIT Lincoln Laboratory

Future Needs for Collision Avoidance

Collision avoidance systems have an important role in the future of aviation

• Integration of unmanned aircraft into the airspace will require sense and avoid capability with proven target level of safety

• Next generation of air traffic control concepts will require enhancement of existing collision avoidance system onboard manned aircraft (TCAS)

Before deployment of new systems, rigorous safety analysis is required

• Determine required surveillance performance

• Evaluation of performance on different categories of aircraft

• Assessment of interoperability with existing systems

Cooperative Aircraft

Unmanned Aircraft

Non-cooperative Aircraft

Page 3: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 3

MIT Lincoln Laboratory

Problem Statement and Requirements

What are the encounter geometries that a collision avoidance

system needs to resolve in the airspace?

• Statistically-representative of actual encounters– Approx. 1 minute window near point of closest approach

– Provide realistic mix of encounter geometries and situations

• Physically-realistic dynamics– Aircraft equations of motion

– Three-dimensional, able to handle multiple maneuvers / accelerations

– Derived from operational data

• Cooperative and non-cooperative intruder characteristics– Cooperative situations may include ATC intervention

– Wide range of possible aircraft performance characteristics

• Support fast-time simulation

Page 4: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 4

MIT Lincoln Laboratory

Safety Assessment Simulation Framework

Raw

radar dataTracking and fusion

Feature

extraction

Track

database

Aircraft

flight profiles

and dynamics

Collision

avoidance

system models

(sensors,

algorithms)

Collisions per encounter

Collisions per flight-hour

Encounter

rate estimation

Encounters

per flight-hour

Density

models

Encounter

models

Relative risk analysis

Target Level of Safety

risk analysis

Sensor

environment

model

Cooperative: Observed encounters per flight-hour

Non-coop: Proportional to traffic density and

airspeeds

Fast-time

simulation

Density

processing

Page 5: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 5

MIT Lincoln Laboratory

Encounter Model Development History

ICAO (U.S. & Europe)

MITRE (US)

1980 1985 1990 1995 2000 2005 2010

TCAS Mandate (US) TCAS Mandate (Worldwide)

Eurocontrol (Europe)

3D, single acceleration periods

3D, multiple acceleration periods

12 radar sites 1683 encounters

6 radar sites 2387 encounters

134 radar sites 427,367 encounters

Lincoln Laboratory (US)

Vertical-motion encounters only

Increasing fidelity and data requirements

Page 6: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 6

MIT Lincoln Laboratory

Encounter Model Categories

• Correlated (cooperative)– Prior U.S. model needed to be

updated, captures RVSM

– Assumes ATC involvement

• Uncorrelated 1200-code (non-cooperative surrogate)– First model to capture

encounters between VFR aircraft

– Assumes no ATC involvement

• Uncorrelated(unconventional aircraft)– Models vehicles unlikely to carry

transponders

– Assumes no ATC involvement

Discrete

code1200/VFR

Discrete code

1200/VFR

Non-cooperative

Conventional

Non-cooperative

Unconventional

Aircraft of interest

Intr

ud

er

aircra

ft

Conventional: General Aviation typical of 1200-code aircraft

Unconventional: balloons, gliders, ultralights,…

Appropriate Model

Page 7: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 7

MIT Lincoln Laboratory

Data Sources

Radar Coverage

1200-Code Aircraft (VFR)

Observed Encounters

Models based on continuous, real-time radar

data from Air Force 84th Radar Evaluation

Squadron (RADES)

• Includes raw and unprocessed data for both cooperative and non-cooperative aircraft

• 134 ASR and ARSR sensors used in model

• Total airspace coverage results in traffic density characterization

Difficult to create an encounter model using primary only tracks

• Unconventional models created using pilot-uploaded GNSS data

Page 8: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 8

MIT Lincoln Laboratory

Encounter Model Taxonomy

Unconventional model composed of 9 individual models

• Need to simulate against each type to determine specific system deficiencies

Unconventional AircraftNo Transponder Equipment

Conventional Aircraft

Heavier-than-Air Other

Skydivers

Lighter-than-AirCorrelated Model

Receiving ATC Services

Uncorrelated ModelNo ATC Services

Ultralights Light-Sporting

Unpowered Powered Unpowered Powered

GlidersParamotorsParagliders

Rigid Hang

Gliders

Flexible Hang

Gliders

Hang Gliders

Free Balloons Airships

Weather Balloons Hot Air Balloons

Included in

Uncorrelated Model

Legend

ModelsAircraft Categories

Page 9: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 9

MIT Lincoln Laboratory

Model Development Overview

Radar

tracker

Radar

tracker

Radar

tracker

Encounter

Database

Airspace

Statistics

Fusion

tracker

Un

co

rrela

ted

Mo

del

Co

rrela

ted

Mo

del

134 radar sites

~10 GB per day

Models nominal

VFR flight

~100,000 VFR flight

hours

6 variables

Models encounters between two aircraft

~800,000 encounters; 16 variables

VFR Track

Database

Feature

Extraction

Feature

Extraction

GPS

tracker

GPS Post-

Processing

Un

co

nv

en

tio

nal

Mo

del

Feature

Extraction

Models

unconventional

aircraft—e.g.,

paragliders,

balloons, skydivers

~100,000 flight

hours

5 variables

i.e.,

Class D airspace

1200 ft AGL

3 deg/s turn

1500 ft/min climb

80 kt airspeed

0 kt/s acceleration

Page 10: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 10

MIT Lincoln Laboratory

Model Development Process

Observed

Track

Database

outliers

Outlier removal

Track smoothing

Interpolation

Tu

rn r

ate

t

Feature Extraction

Feature Smoothing

Quantization

P(turn rate at t + 1 |

turn rate at t, altitude)

Table Construction

Tu

rn r

ate

t

Track Generation Feature Sampling

Synthetic

Track

Database

Sampling

Encounter Model

Page 11: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 11

MIT Lincoln Laboratory

Encounter ConstructionU

nco

rrela

ted

Mo

del

Co

rrela

ted

Mo

del

Uncorrelated Encounters Correlated Encounters

Un

co

rrela

ted

Mo

del

AC1 Trajectory AC2 Trajectory

Randomly initialize AC2 trajectory

on surface of the encounter

cylinder centered on AC1

AC1 Trajectory AC2 Trajectory

Configure trajectories so that

the sampled horizontal miss

distance, vertical miss

distance, relative heading,

and relative bearing are

accomplished at time of

closest approach

Page 12: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 12

MIT Lincoln Laboratory

Model Validation

• Unmodeled features of randomly-generated encounters compared to observed

– Altitude crossing and slow closure encounter rates

• Compared uncorrelated model characteristics against true primary-only tracks

– Model characteristics similar to a large class of non-cooperative tracks

– Other non-cooperative aircraft tracks captured by unconventional model

• Examined seasonal and regional variations

– Densities very sensitive

– Trajectory characteristics not sensitive

East (NM)

Radar Tracks

No

rth

(N

M)

-0.6 -0.4 -0.2 0 0.2 0.4 0.60

0.2

0.4

0.6

0.8

1

1.2

East (NM)

Sampled Tracks

-0.6 -0.4 -0.2 0 0.2 0.4 0.6

Pa

rtic

le D

en

sity

10

100

Nominal

Path

Sampled TracksObserved Radar Tracks

Page 13: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 13

MIT Lincoln Laboratory

Encounter Model Products

Current users

– JHU/APL

– MITRE/CAASD

– MTSI

– Northrop Grumman Corp.

– USAF Simulation and Analysis Facility (SIMAF)

• Model description reports

• Data tables

• Software to generate trajectories

• Traffic density database

Page 14: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 14

MIT Lincoln Laboratory

Applications

TCAS Latency Response on Global Hawk*(Mode S Intruder)

*Risk Ratio = P(Near Mid-Air Collision with System)/P(Near Mid-Air Collision without System)

TCAS Safety Analysis

• Re-analyzed the performance of TCAS II versions 7.0 and 7.1

• Used to determine relative benefits of logic and surveillance modifications

Unmanned Collision Avoidance Systems

• Examined the use of TCAS on Global Hawk UAS, focusing on sensitivity to latency

• Models used to analyze candidate systems for Global Hawk and Predator B UAS

• Demonstrated electro-optical field of view and range trade-off study

Page 15: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 15

MIT Lincoln Laboratory

Future Development and Applications

a)

East (NM)

15 s

No

rth

(N

M)

-0.6 -0.4 -0.2 0 0.2 0.4 0.60

0.2

0.4

0.6

0.8

1

1.2

b)

East (NM)

30 s

-0.6 -0.4 -0.2 0 0.2 0.4 0.6

Pa

rtic

le D

en

sity

10

100

1000

10000Possible Avoidance Maneuver

No Maneuver

Nominal Intruder Path

Notional Threat Logic

• Multi-threat encounter model

– Encounters between more than two aircraft occur more often than anticipated

• Update encounter models and density database to reflect future changes in the airspace

• Exploit models within future collision avoidance architecture, involving probabilistic intruder trajectory propagation

Page 16: Airspace Encounter Models for Conventional and Unconventional … · 2010-07-08 · Airspace Encounter Models - 3 MIT Lincoln Laboratory Problem Statement and Requirements What are

Airspace Encounter Models - 16

MIT Lincoln Laboratory

Summary

• Developed a new statistical approach to encounter modeling, optimally leveraging recorded data

– Models validated using several quantitative and qualitative techniques

• Created first encounter models that capture non-cooperative aircraft, including conventional and unconventional aircraft

• Models are being used by several organizations for manned and unmanned collision avoidance system development and analysis

– Models and software to generate samples are publicly available