AusAID - Bureau of Meteorology - WMO

Public Sector Linkages Program

QM Internal Auditor Training

for SW Pacific Meteorological Services 2012 - 2014

Bryan Boase & Helen Tseros

Australian Bureau of Meteorology

• Key Drivers for the Activity: ICAO - WMO

• WMO QM Task Team

• ISO 9001

• Scope of Activity; Aim & Methodology

• Stage 1

• Stage 2

• Stage 3

• Sustaining the QMS

Topics:

Key Drivers for the Activity …

2.2.3 From 15 November 2012, each Contracting State shall ensure

that the designated meteorological authority ... establishes and

implements a properly organized quality system ...

2.2.4 Recommendation - The quality system established ... should

be in conformity with the International Organization for

Standardization (ISO) 9000 series of quality assurance standards

and should be certified by an approved organization.

2.2.7 Recommendation.— Demonstration of compliance of the

quality system applied should be by audit. If nonconformity of the

system is identified, action should be initiated to determine and

correct the cause. All audit observations should be evidenced and

properly documented.

Aviation Industry - IATA

Economy

+

Safety

Quality of Aviation

Weather Services

ICAO:

Regulatory body: policy &

standards

WMO:

Supports the underpinning

science to deliver the suite of

aviation weather services

Scope of the Activity

WMO Perspective

WMO QM Task Team …

• Assist Members in the implementation & certification of a QMS

• Develop a “twinning/mentor” framework between Members with a

well-developed QMS & others commencing a QM approach

Key Terms of Reference:

WMO QMTT – Risk Analysis

Risk to the Service Provider (Met Service) not adopting a QM approach:

Risk for the Service Provider (Met Service)

Description of Risk Likelihood Consequences Residual

Risk

Loss of the legal ability/right to undertake cost recovery Almost certain High Severe

Consideration given to the removal of service provider status Almost certain High Severe

Potential legal consequences in not meeting statutory and/or

legislative requirements Likely Extreme Severe

Insurance of the service provider becomes invalid Almost certain Extreme Severe

Loss of marketability of the service provider to attract high quality

employees Likely Medium Major

Negative impact on products and services other than aviation Almost certain Extreme Severe

Loss of reputation and credibility Almost certain Extreme Severe

The ability to upgrade service provider infrastructure – equipment Likely High High

Loss of competitiveness Almost certain Extreme Severe

WMO QMTT – Risk Analysis

Risk for the Country if a QM approach not adopted by the Met Service:

Risk for the country

Description of Risk Likelihood Consequences Residual Risk

Airlines reconsider the viability of the country as a destination or

alternate port Moderate Medium Significant

Increase in insurance premiums Likely Medium Major

Threat to economic development Likely Medium Major

Loss of the legal ability to charge and therefore a loss of revenue

from aviation industry Almost certain High Severe

The very viability of the Met Service is put under threat Likely Medium Major

Infrastructure such airports become “stranded investment” for the

country Moderate High Major

Reduction in tourism due safety concerns Moderate High Major

Cost of air transport increases Almost certain High Severe

Activity Scope, Aim & Methodology …

10 SW Pacific Met Services that provide aviation weather

services:

Cook Islands; Fiji; Kiribati; Niue; Papua New Guinea; Samoa;

Solomon Islands; Tonga; Tuvalu; Vanuatu

Aim of the Activity

• Assist counterpart organisations (PICs) to develop a QMS to meet

the ICAO requirements to deliver their aviation weather services in

conformity with the ISO 9000 series of quality assurance standards

and in particular, the international AS/NZS ISO 9001:2008 Quality

Management Standard (ISO 9001).

• To encourage all PICs to achieve third party certification of

compliance with ISO 9001 through an external certification body

approved by the Accreditation System of Australia & New Zealand

(JAS-ANZ).

STAGE 1: QM Internal Auditor Training Workshop – Vanuatu (Nov 2012)

STAGE 2: Practical training - internal audits performed in Australia (2013)

STAGE 3: Lead Auditor Training – Fiji (2014)

Foundation Statement: The critical success factor for a QMS is a

rigorous auditing schedule conducted by internal and external auditors.

Note: This supports ICAO Annex 3 - 2.2.7 ... Demonstration of

compliance of the quality system applied should be by audit ...

As such, a three-staged approach was developed & implemented for this

training:

Methodology

Stage 1: Theory & Practical - Vanuatu

• 5 day training workshop

• 22 participants from 10 SW Pacific NMHSs

• Recognised qualification as an internal QM auditor

Training Timetable

Training Modules

• Policy & procedure writing

• Introduction to ISO19011

• Principles of auditing

• Internal auditor techniques

• Audit case studies

• Practical audits

• Developing an implementation plan for certification

• Third party Certification

Class & Team Work

Graduation …

Certificates …

Stage 2: Practical QM Auditing - Australia

Stage 2

• Participants that successfully completed the internal auditor training

invited to conduct supervised audits on Bureau Weather & Ocean

Services Sections located in Melbourne, Sydney, Canberra, Perth &

Darwin

• Provides an ideal opportunity to consolidate the internal workshop

training in a practical environment & enhance their audit techniques.

• Face-to-face guidance on issues faced developing & implementing

their own QMS.

• Enhance PIC QM network & provide a forum for benchmarking.

• Encourage third party certification of compliance with ISO 9001

through an external certification body approved by the Accreditation

System of Australia & New Zealand (JAS-ANZ).

Phase 2: Training Schedule

Day 1: Introduction &

Familiarisation with the auditee’s

activities

Day 2: Development of the

audit documentation, framework

& associated questions

Day 3: Opening audit meeting,

perform audit & document findings

Day 4: Formal write-up of the

audit & findings

Day 5: Close-out audit meeting,

review of auditor’s performance &

debrief.

Stage 2: Feedback

Stage 3: Lead Auditor Training - Fiji

I. Amkeene IRCA reference AO4525

All 11 participants passed!

Name

Met Service

or Other

Organisation

Criteria 1 Criteria 2 Criteria 3 Criteria 4 Criteria 5 Criteria 6

Overall

Assessment

Score

Konny Nato PNG (CASA) 5 5 5 4 9.9 5 34

Benjamin Malai PNG 3 5 4 5 8.8 5 31

Esesee Ah Ken Samoa 4 5 4 5 7.4 4 29

Moleni Tu'uholoaki Tonga 4 4 3 5 9.4 4 29

Atish Kumar Fiji 5 4 5 2 9.8 3 29

Reginald Hingano Tonga 4 4 5 2 10 3 28

Solomon Sammy Solomon Is 4 2 3 4 9.7 5 28

Tinapa Faletiute Tuvalu 4 3 4 3 8.5 2 25

Nathan Tisam Cook Is 3 1 4 3 8.4 5 24

Harish Pratap Fiji 4 3 3 3 9.2 2 24

Sean Tukutama Niue 3 2 2 2 8 2 19

Criteria:

1. Theoretical and practical knowledge and skills demonstrated during Phases 1, 2 & 3.

2. Demonstrated Leadership during Phases 1, 2 & 3.

3. Demonstrated ability to communicate and articulate with clarity.

4. Ability/demonstrated knowledge of the Weather Services delivery environment.

5. Lead Auditor Written Exam Result – score out of 10

6. Long Term Potential to Contribute to Capacity Building maturity, position, “political”

implications

Sustaining the QMS …

1. Cost recovery – establish regulatory/legislative framework:

• ICAO Doc. 9802/4 “Statements by the Council to Contracting

States on Charges for Airports and Air Navigation Services”

• ICAO Doc. 9161-AT/724 “Manual on Air Navigation Services Economics” (Appendix 6)

• WMO-No. 904, “Guide on Aeronautical Meteorological Services Cost Recovery”.

Sustaining the QMS …

2. Achieving AS/NZS ISO 9001 Certification of compliance

• Common SW Pacific Certification body?

• Costs – economies of scale/location?

3. SW Pacific “inter – Met Service” audits

• Investigate feasibility

• Costs etc ...

QUESTIONS?