TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED...
Transcript of TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED...
![Page 1: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/1.jpg)
TRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM
1
![Page 2: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/2.jpg)
COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM
Staff Instruction (SI) SUR 001 – Surveillance Policy SI SUR 002 – Enhanced Monitoring SI SUR 009 – National Surveillance Planning Standard Civil Aviation Directive (CAD) 008 – Surveillance Policy National Aviation Safety Information Management
System (NASIMS) Civil Aviation Surveillance Information Management
System (CASIMS)
2
![Page 3: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/3.jpg)
3
In May 2007, a working group, comprised of various technical specialties, was formed to develop a comprehensive risk indicator program.
As a result of the working group’s recommendations, the risk module of NASIMS was developed.
The working group recommended the use of generic risk questions to help quantify risk within a set of specific hazard areas.
BACKGROUND TO RISK INDICATOR DATABASE (NASIMS)
3
![Page 4: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/4.jpg)
4
Hazard Areas:1. Labour Difficulties;2. Management Practices;3. Quality Assurance;4. Change In Scope, Product Line Or Facility;5. Change In Contracting For Goods And/Or Services;6. Turnover in personnel;7. Change in key personnel;8. Safety record;9. Regulatory record; and10. Seasonal or specialized operations
OVERVIEW OF THE RISK INDICATOR DATABASE
4
![Page 5: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/5.jpg)
5
Each of the hazard areas is further defined by a set of specific yes or no questions.
There is an identical set of questions for each certificate held by an enterprise.
Each question has been weighted based on the nature of its subject matter and its importance relative to other questions.
HOW THE DATABASE WORKS
5
![Page 6: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/6.jpg)
6
There are three stages of data entry:
Baseline
Conducted when a new certificate is entered in the system.
Day-to-day
On going database updates whenever risk information is detected.
Annual Validation
A review carried out on or before the regional planning date to ensure risk scores are valid and therefore appropriate for use in surveillance planning
DATA GATERING AND DATA ENTRY
6
![Page 7: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/7.jpg)
7
The database produces two types of risk scores: Enterprise Score
Certificate Score
The certificate score is generated directly from answering the risk questions as they relate to each of an enterprise’s certificates.
The enterprise score is calculated automatically by combining answers from all enterprise certificates and using only the highest responses to answer the questions.
THE RISK INDICATOR SCORE
7
![Page 8: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/8.jpg)
RISK INDICATOR SCORE - EXAMPLE
Airline operators with aircraft 100+ seats
Relative risk score
8
![Page 9: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/9.jpg)
EXAMPLE QUESTIONS
9
![Page 10: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/10.jpg)
The database is intended to be a real time tool. It should be updated as information is received.
Standardized approach to the use of key risk indicators Limit the use of ‘unknown’ as a response. Inspectors
are expected to contact the company, review records, etc., in order to gather the information needed to update the database.
Record sufficient details when changes are made to the database, its validity relies on having enough details recorded to support the risk score.
SUMMARY OF KEY POINTS
10
![Page 11: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/11.jpg)
SURVEILLANCE PLANNING PROCESS OVERVIEW
CAD SUR-008 - Surveillance PolicyAnd
SI SUR-009 - National Planning Standard 11
![Page 12: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/12.jpg)
INTRODUCTION
Purpose: Provides a standardized, risk-based approach to
surveillance planning
Takes into account all available safety information
Includes all TCCA certificate holders
Provides a 5-Year Outlook
Utilizes Surveillance Intervals based on a safety
risk profile12
![Page 13: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/13.jpg)
Surveillance intervals are moving from a fixed intervals to individual intervals determined by risk level for each enterprise.
The interval is set using the Safety Risk Profile of the company.
A 5 year regional surveillance plan is then put in place and updated annually.
Enterprise surveillance intervals can be changed as risk changes.
On-going unplanned monitoring continues on a regular basis
SURVEILLANCE INTERVALS
13
![Page 14: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/14.jpg)
The Safety Risk Profile is a composite of two parts.
1. Risk Indicator Level; and2. Impact
THE SAFETY RISK PROFILE
14
![Page 15: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/15.jpg)
The RIL is derived from:the Risk Score from the Risk Indicator Database;results of pervious surveillance (i.e. severity of
findings);availability of surveillance information (i.e. CADORS
and/or Internal reporting systems); andwhether or not the enterprise has implemented a
Safety Management System.
RISK INDICATOR LEVEL
15
![Page 16: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/16.jpg)
The impact value of an enterprise is generated considering the size and scope of an operation and includes:How many certificates in different categories are
held;The number of employees and bases.The number and different types of aircraft;The type of operations (e.g. specialized AMO, 704,
international, etc)
IMPACT VALUE
16
![Page 17: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/17.jpg)
+ 0
+ 5
+ 0
+ 0
+ 0
= 5Likelihood = ( 5 )
17
![Page 18: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/18.jpg)
+ 1
+ 1
+ 3
+ 2
+ 1
+ 1
+ 0
+ 0
= 9Impact = ( B )
18
![Page 19: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/19.jpg)
SURVEILLANCE INTERVAL MATRIX
19
![Page 20: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/20.jpg)
SURVEILLANCE INTERVALS
20
![Page 21: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/21.jpg)
Planning is done in accordance with Staff Instruction SUR-009
The planning process takes into consideration realistic available hours for inspectors and the complexity of enterprises.
Surveillance intervals and plans are reviewed at least annually, however,
Significant changes in risk indicators or impact levels could result in immediate changes to surveillance intervals and scheduling taking place.
SURVEILLANCE PLANNING BASED ON RISK
21
![Page 22: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/22.jpg)
Surveillance Planning CalculationsComplexity of Enterprise
» Low, Medium or High
Type of Enterprise» AOC Holder, AMO, Airports
Type of Activity» PVI or Assessment
Number of Inspectors (required) on Team
Team Composition (Specialty, knowledge)» Team Member or Manager
22
![Page 23: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/23.jpg)
CONCLUSIONS
National, standardized risk-based approach to surveillance planning
Considers complexity of the enterprise and its impact on the aviation system
More accurate and realistic planning tool Provides predictability in order to anticipate future
resource requirements Allows flexibility to develop options and run
scenario analysis for resource optimization
23
![Page 24: TRANSPORT CANADA'S RISK BASED SURVEILLANCE · PDF fileTRANSPORT CANADA'S RISK BASED SURVEILLANCE AND PLANNING SYSTEM 1. COMPONENTS OF TCCA’S SURVEILLANCE PROGRAM Staff Instruction](https://reader033.fdocuments.us/reader033/viewer/2022052305/5ab74e0d7f8b9ad3038b7141/html5/thumbnails/24.jpg)
QUESTIONS?
24