W O R L D M E T E O R O L O G I C A L O R G A N I Z A T I O N

PUBLIC WEATHER SERVICES EXPERT TEAM ONPRODUCT DEVELOPMENT AND VERIFICATION AND

SERVICE EVALUATIONHONG KONG, CHINA

23-27 November 1999

FINAL REPORT

1. Introduction

1.1 A meeting of the Public Weather Services (PWS) Expert Team on Product Development

and Verification and Service Evaluation was held at the Hong Kong Observatory, in Hong

Kong, China from 23 to 27 November 1999. The meeting was opened by Mr. C.Y. Lam,

Assistant Director of the Hong Kong Observatory and chaired by Mr. K. O’Loughlin

(Australia). Ms H. Kootval (WMO Secretariat) welcomed the Participants on behalf of the

Secretary-General and provided background information on the structure of the PWS

Programme within the CBS OPAG framework, and especially on the objectives and expected

outcome of the Expert Meeting. These are deliverables under the four Terms of reference

(TOR) as defined by the Commission for Basic Systems (CBS) as follows:

TOR 1: Investigate and document, with the other relevant OPAGs, the particular

technical requirements of data and products to support Public Weather

Services;

TOR 2: Develop guidelines and training material for developing countries on graphical

presentation (design, contents, etc.) and modules of graphical educational

material;

TOR 3: Prepare recommendations on standardised verification techniques for public

warnings and forecasts;

TOR 4: Prepare guidelines on technical and user-oriented verification mechanisms

including measures of overall satisfaction with the service.

1.2 Each TOR was led by an expert in a small group that discussed and prepared a report

on the details of its work. The composition of each group is shown below:

TOR 1 : W. Kusch (Germany), E. McCallum (UK), K. O’Loughlin (Australia)

TOR 2 : K. O’Loughlin (Australia), S.S. Shongwe (Swaziland), W. Kusch (Germany)

TOR 3 : N. Gordon (New Zealand), E. McCallum (UK), J. Shaykewich (Canada)

TOR 4 : J. Shaykewich (Canada), C.C. Chan (Hong Kong, China)

1.3 The list of participating experts is given in Appendix A. The Programme of the meeting

is contained in Appendix B.

2. Background

2.1 At its eleventh session in 1996, the Commission for Basic Systems (CBS) established

the Working Group on Public Weather Services to keep under review and develop guidelines

and advice on the overall implementation of the Public Weather Services Programme. The

Working Group was composed of experts designated by each regional association, as

rapporteurs to form the core membership of the group and to take on the responsibilities in

accordance with the projects identified by Congress. The Working Group met in Uruguay in

August 1998 and reviewed a number of issues of special concern to the PWS Programme

and formulated a number of recommendations. The report of the meeting was presented to

the extraordinary session of CBS in October 1998. The same session of CBS also adopted a

new working structure for the Commission and the way in which the activities of the World

Weather Watch Programme and the Public Weather Services Programme, which is an

element of the Applications of Meteorology Programme but is placed under the overall

responsibility of CBS, will be carried out in the future.

2.2 The Working Group on Public Weather Services was replaced by the Open Programme

Area Group (OPAG) on Public Weather Services with terms of reference that cover all the

basic issues of concern to the PWS Programme. CBS requested that the new OPAG on

PWS coordinate all activities related to public weather services, in particular the work of the

Expert and Implementation/Coordination Teams and/or rapporteurs established by the

Commission under the responsibility of the OPAG and to liaise and cooperate with the other

OPAGs and the Regional Working Groups on the World Weather Watch.

2.3 The 22nd session of the CBS Advisory Working Group met in January 1999 and

approved the structures of all WWW and PWS teams under the new structure and agreed on

their terms of reference. Under this agreed structure, the work of the PWS Programme is

now carried out through three expert teams and an implementation and coordination team.

These are The Expert Team on Product Development and Verification and Service

Evaluation (ET/PDVSE); the Expert Team on Media Issues (ET/MI); the Expert Team on

Warnings and Forecasts Exchange Issues (ET/WAFEI); and the

Implementation/Coordination (IC) Team on PWS. The IC Team is due to meet in December

1999, and in addition to addressing its own Terms of Reference, will review the results of

work of the PWS expert teams. The memberships of the teams have been considered

3

carefully to reflect a balance of both regional representations and expertise.

2.4 The Expert Team reviewed the decisions of Thirteenth Congress including the Fifth

Long-Term Plan and those recommendations of the PWS Working Group and the ET/MI that

were of particular relevance to its own terms of Reference before proceeding to discuss the

TORs. The results of work under each TOR, and discussion on the particular matter of

improved access to warnings follow below.

3. Improved Access to Warnings

3.1 At its meeting (Orlando, June 1999) the ET/MI had discussed ways to improve relations

and cooperation between NMSs and the international media. It had requested the ET/

PDVSE to study the issue of access by the international media to official warnings issued by

NMSs in order to avoid dissemination of conflicting information to the public and to facilitate

giving attribution to the NMSs responsible for issuing the warnings. The Expert Team

debated this topic, and discussed options of making warnings of severe weather (and

eventually public weather forecasts) issued by NMSs readily and conveniently available for

access.

3.2 The E/T PDVSE proposed that an Internet site be developed in a phased manner for

this purpose. As warnings of tropical cyclones constitute the most important category of

warnings in terms of areal coverage and impact, lifetime, and with visuals suited to television

presentation, the team agreed that these be dealt with in the first phase. In addition, a

centralised web site, with voluntary contribution from participating NMSs, has the following

advantages:

(a) if the forecast tracks are consistent, broadcasters will be able to make statements with

more confidence without the danger of causing public confusion;

(b) if the forecast tracks are diverse, broadcasters will have to be careful before committing

to any specific scenarios or quoting directly from raw model outputs; should they fail to

refer their audience to the respective national warnings, then they have to face the

consequences of misinformation on their own;

(c) alternative information on the web site, such as significant weather facts or news

headlines on human or social aspects, will add another dimension to the weather story of

the tropical cyclone, which can be used by broadcasters if they so wish;

(d) having made use of the specific information and knowing full well where it comes from,

the broadcasters will be able to readily acknowledge the source;

4

(e) the exposure and attribution so gained will encourage other NMSs to contribute

information to the web site.

I.3 To achieve the first phase, the following steps were proposed:

I. Establish, as a pilot project to demonstrate the viability of one or more sites for tropical

cyclone warnings, a static web page hosted by a volunteer NMS. This will list links

pointing to web pages of other participating NMSs and RSMCs carrying warnings issued

by NMSs on tropical cyclones.

II. Develop consistent and uniform mechanisms for the warnings to be provided and

exchanged by RSMCs and NMSs. At a minimum, this will require a standard mechanism

to indicate that there is at least one currently valid tropical cyclone warning on a web site.

A simple example would be a standard file on a web site with links to the warning(s), or

else with an indicator such as NO meaning that there are no valid warnings. At the other

extreme, standards could define the format of a warning, including giving in a

standardised format information such as the issue time, validity period, tropical cyclone

name, location, direction of movement, areas affected by warnings, and so on.

Formulation of appropriate standards and mechanisms, leading to operational

procedures, will need to be developed in consultation with the participating NMSs, and

the media users. This could perhaps be done by an expert team or rapporteur under the

CBS OPAG on Information Systems and Services, with input from the PWS ET on

Exchange of Warnings and Forecasts.

III. A further step in this process will be the display of information on a web site as contained

in Attachment I. The following diagram shows an initial concept of how such a page

could look:

5

3.4 Recognizing that it would be important to make early progress on this pilot project, the

meeting noted with gratitude the offer by Hong Kong, China to host and develop a

demonstration site for steps (I) and (II) above. Results would be demonstrated at CBS-XII in

the year 2000. This project will be implemented in close coordination with the Tropical

Cyclone Programme.

3.5 The Expert Team saw the possibility that, as a longer-term goal, the scheme could be

extended to warnings of other severe weather events (as also discussed in Attachment I).

4. Technical requirements for Data and products for Public Weather Services

4.1 The Expert Team considered the impact of the increase in demand for meteorological

data and products due to rapid advances in communications and computing technology, and

especially the rapid growth in the Internet. It agreed that these emerging technologies are

having a marked impact on the Information System of NMSs and the WMO.

4.2 The Team noted in particular:

6

The results of the survey of WMO Members conducted in 1997 and published in 1999 –

“Public Weather Services in Focus” WMO/TD No. 974 which showed that;

i. A high percentage (82 per cent) of NMSs have full responsibility for the packaging of

products (warnings, forecast, information and the educational products);

ii. The Internet had expanded rapidly and that the number of NMSs with access to the

Internet had grown from 34 per cent (time of survey in 1997) to 70 per cent by the time of

publication in early 1999;

The issues discussed at the meeting of the Inter-programme Task Team on the Future

WMO Information Systems held in Melbourne (1 to 5 November 1999), including

developments such as the Internet Data Distribution (IDD) system, the EMWIN, and the

efforts of the open GIS consortium which is trying to harmonise standards for the

exchange and application of geo spatial information.

4.3 The Expert Team considered that these developments emphasised the need to focus

not only on the standards for routine exchange of data and products under the WWW, but

also on the specific and changing needs for efficient and effective delivery of public weather

services by NMSs to their domestic users and also for more effective exchange

internationally where needed. The experts noted that, while the “information revolution”

presented many challenges and was seen by some NMSs as a threat, the changing

technology also presented many opportunities to improve access to meteorological

information and to provide more effective, timely and relevant public weather services

products including critical warnings.

4.4 To approach these issues from a public weather services perspective, the Expert Team

considered that in order to provide seamless services in a timely and convenient manner, a

key success factor was to take account of the needs of the end users, and the available

communication channels with the users such as the mass media and the Internet, while at

the same time keeping in mind internal requirements for information flow within the NMS.

4.5 The experts identified some of the key issues to be addressed as:

The scope of and changing demand for public weather services including:

Observational data including real-time data, satellite and radar data;

Forecast and warning products, increasingly including graphical products;

Information products including climate information;

7

Increased requirement for international exchange of public weather products;

Increased efforts to assess the impacts of changing technology both for meteorology and

related disciplines and for the users of meteorological and related services;

The need to identify standards related to the dissemination of public weather services

products with emphasis on taking account of the standards being followed in:

telecommunications systems;

the different media (TV, radio and press);

the Internet;

other service delivery channels such as direct computer to computer transfer;

The need to adapt standards used in the internal operations of NMSs that impact on the

service provision function and facilitate seamless service provision, including:

Computing and communications standards;

Integrated systems;

Dissemination and access systems;

Provision for quick feedback on and response to issues affecting system performance

and service quality;

Standards for international exchange of public weather services products on the future

WMO Information System, with particular emphasis on the issue of improved exchange

of warnings (See Section 3), and some of the issues identified by the CBS Inter-

Programme Task Force on Future WMO Information Systems, including:

Greater use of the Internet and related protocols;

More attention to developments such as Internet Data Distribution and the Open GIS

Forum.

4.6 The Expert Team developed a framework for more detailed guidance on these issues as

shown at Attachment IV. The experts undertook to expand on these in collaboration with the

WMO Secretariat and other CBS OPAGs as appropriate.

4.7 As an interim measure, the meeting agreed that it would be useful to include in this

report sample descriptions and specifications on technical aspects of systems to produce

and deliver graphical public weather services products to television and newspapers. (See

examples following Attachment IV).

4.8 In concluding this topic, the Expert Team felt strongly that the rapid pace of development

8

called for action on two broad fronts:

Efforts within the CBS should be accelerated to keep abreast of these developments and

take advantage of technology to improve the effectiveness of the WMO Information

System. At the same time greater emphasis should be given to the rapidly evolving

needs of NMSs to deliver public weather services in this new environment;

Ongoing guidance should be provided to NMSs, especially smaller Services and those in

developing countries, to assist them to keep pace with the developments in technology.

5. Guidelines on Graphical Presentation of Public Weather Services Products

5.1 The Expert Team reviewed the situation regarding the growing demand for graphical

versions of meteorological and related products in recent years due to the rapid

emergence of new technologies. It stressed the importance of recognising the wide

scope of public weather services products which included meteorological information on

all time scales, and the need to integrate this information with other graphical standards

such as GIS and the technical standards of communication and display systems. It was

noted for example that it is now common to have both text and graphics version of

forecasts and warnings. There is also a marked increase in demand for graphical

display of real-time information products. This emphasised the need for appropriate

specialised training for meteorological service staff in design and content of graphics

material.

5.2 Some of the key training issues to be considered are:

Graphical products need to be designed to suit the particular medium, e.g. TV,

newspapers and the Internet, which have their own particular design and content

requirements as well as some aspects that are common to all;

NMSs need to develop some expertise “in house” and work with design experts on more

complex tasks;

the media will often make available their own expertise in these areas to assist with

design, and to train NMS staff;

Because of the increased demand, need for quick response, and to avoid delays or

mistakes due to re-packaging, it is often important to have products that are able to be

delivered ready for use in the different media (print, broadcast, radio) or placed directly

9

on Web sites;

It is also increasingly important that the information appears in a way that meets the

needs of users and conveys the message in an understandable way;

To effectively implement improvements in these areas, NMSs need to have staff trained

in elements such as:

i. Working with the users and media to establish the type and level of services;

ii.Technical aspects of relevant production and communications systems, including back-

up systems;

iii. Design of products;

iv. Quality monitoring.

5.3 The Team discussed the need for guidelines on training for production of the specific

public weather services products for the print media and agreed that such guidelines should

cover the basics for a presentation system, including both technical and design aspects. This

could often be approached with the use of standard hardware and software packages, and it

is possible for NMSs to implement such systems with in-house expertise.

5.4 Graphics for television on the other hand, are somewhat more complex in both the

design and hardware/software systems required. It was noted however that some small

Meteorological Services had successfully implemented systems using PCs, standard

software and existing guidance material on Public Weather Services from WMO. Graphics for

the Internet is a rapidly expanding area and the experts noted that there was considerable

material available on how to design and implement Web sites.

5.5 It was also noted that other technology such as digital radio are making the wider

dissemination of digital products possible and that training guidelines should take this into

account.

6. 5.6 The Expert Team developed a framework for the guidelines (Attachment III) and

agreed that the relevant experts in the team would develop these further in consultation

with the Secretariat to make them suitable for distribution to NMSs.

6. Performance Assessment of Public Weather Services

6.1 In addressing TORs 3 and 4, the Expert Team noted that there was some overlap

10

between them. The issues were therefore dealt with as a combined topic.

6.2 With respect to TOR 3: “Prepare recommendations on standardised verification

techniques for public warnings and forecasts”, the experts felt that the key requirement was

to prepare guidance, particularly for developing countries, on why and how to actually go

about verification. There are already many documents available with definitions of scores,

but very little on “best practices”, and what the pitfalls could be of a verification programme.

Similarly, with respect to TOR 4: “Prepare guidelines on technical and user-oriented

verification mechanisms, including measures of overall satisfaction with the service”, the

team noted that there was a particular need for guidance on why and how such information

would be used, and on best practices for how to go about an overall performance evaluation

programme.

6.3 Overall performance evaluation is being increasingly required in all countries,

particularly with the evident need for NMSs to be accountable for their performance in

delivery of services, including public weather services to taxpayers and users. One aspect of

this was the trend towards establishment of service charters, or pledges.

6.4 An assessment programme was seen by the experts in the context of a quality system,

where it was important to ensure that the information gathered and processed was focussed

on user requirements, with the purpose of being used in making decisions and taking actions

to improve performance, rather than just being an exercise in data collection. In essence, the

object of an assessment programme is to ensure a sustainable and cost-effective system

delivering quality public weather services.

6.5 The Team noted that there were three key purposes for a performance evaluation

programme:

1. Ensuring that public weather services were responding to user requirements

2. Ensuring the effectiveness of the overall public weather services system

3. Ensuring the overall credibility and proven value of public weather services.

Furthermore, the team stressed that an assessment programme should be designed to

gather information to enable the NMS to take actions in the following areas:

1. Product definition

2. Delivery mechanisms

3. Production system

11

4. Research and development

5. Staff training and development

6. Communication.

6.5 It was recognized that there are two kinds of information gathered in an assessment

programme. One is technical evaluation – for example, forecast accuracy. The second is

information gathered from users about their needs and measures of overall satisfaction with

the service, referred to here as “user-based assessment”. Tools which could be used for this

includ:

Formal structured surveys

Formal service audits

Focus groups

Monitoring public opinion

Direct feedback and response

Consultation

Post-Event Review and Debrief

Collection of Anecdotal Information

6.6 The Team agreed that the following key "guiding principles" applied to both technical

evaluation and user-based assessment:

Know why you are evaluating, it is more than just an exercise in collecting and

processing information and then filing it away

Be prepared to take actions based on the results

Gather information designed to help the NMS make strategic decisions about all

aspects of public weather services

Favour simplicity where possible, rather than overly complicated schemes

Be very careful about the statistical significance of results based on small samples

or short records

Provide regular reports to stakeholders

Make relevant, interpreted, information available to the public

6.7 Specifically for technical evaluation (verification), the team agreed on the following key

"guiding principles":

Choose weather elements and scores that are relevant to user needs, including the

more sophisticated users employing probabilistic information

12

Use consistent elements, locations, methods and scores, so that trends can be

tracked over time.

Keep the original raw data, so that if methods or scores change, the results can be

recomputed back in time

Verify for point locations if possible

Know about the difference between measures of accuracy and skill and use these

as appropriate

Avoid using just a single score to measure overall performance – no one score can

do this

When designing schemes, take into account the strengths and weaknesses of

objective versus subjective techniques, and where possible use objective measures

(though subjective measures can also have their place)

Automate if possible, but avoid using lack of automation as an excuse not to get

started

Give immediate feedback on verifications to forecasters

Be aware that compositing lots of information from different places or forecast

periods may result in loss of useful information for improvements

Be careful about comparisons with other areas in the same country or elsewhere

with different climates – comparisons may be totally meaningless.

6.8 Similarly, for user-based assessment the team agreed on the following additional key

"guiding principles":

Establish an overall userbased plan employing a variety of methods, rather than the

odd one-off survey or workshop

Conduct fewer, well-planned assessments (e.g., surveys), rather than numerous

less credible and well-planned ones

Collaborate with other relevant authorities (e.g, emergency management) where

useful

Use another organization to carry out surveys independently of the NMS if possible,

or at least obtain professional advice on how to survey, but avoid using lack of any

external assistance as an excuse not to do any surveys

Check out other “best practice” examples of assessments when designing yours

Pilot test a proposed assessment exercise (particularly a survey or focus group)

before carrying it out in full

Establish a good system for storing and archiving all information gathered.

6.9 In terms of fulfilling TORs 3 and 4, the Expert Team recalled that some material was

13

already included in the second edition of the Guide to PWS Practices. However, given the

additional aspects and more structured approach that had been explored at this meeting, it

felt that it would be appropriate to develop specific guidance material covering Service

Assessment. An interim outline of what could be contained in such guidance material is

given in Attachment IV.

7. Conclusions and Further Action

7.1 The key conclusions arising from the Expert Team Meeting can be summarised as:

1. To improve access to NMSs’ warnings a mechanism will be developed and a pilot

project established to demonstrate the viability of one or more sites for tropical cyclone

warnings.

2. To improve identification and documentation of technical requirements of public

weather service data and products, the Team developed an outline for more detailed

guidance on these issues and the relevant experts undertook to expand on these in

collaboration with the WMO Secretariat and the other relevant CBS OPAGs. The Team

encouraged CBS to accelerate its work on the future WMO Information System, giving

greater attention to the needs of NMSs to deliver public weather services. It would also

be necessary to provide ongoing guidance to NMSs, especially smaller Services and

those in developing countries, to assist them to keep pace with the developments in

technology.

3. In recognition of the increased demand for graphical public weather service products,

the Team developed an outline of guidance for developing countries on graphical

presentation.

4. To fulfil the work required under TORs 3 and 4 concerning verification and user-based

performance assessment, the Team developed an outline for guidance material,

including specific recommendations on best practices covering these two aspects.

7.2 The Team requested its Chairman to convey the results of this Expert Team meeting

and its suggestions for further work to the forthcoming meeting of the IC Team on PWS to be

held in Offenbach in December 1999, and to seek comments, which would be used in

completing the material in time for reporting to CBS-XII in the year 2000.

7.3 The Expert Team agreed on the following schedule to produce the guidelines based on

14

the outlines given in the report:

1. Final review by experts of the outlines of all guidance material to be produced.

Comments to be sent to the Secretariat (and all team members) by END

DECEMBER 1999.

2. First drafts of all guidance materials based on the revised and agreed outlines

to be sent to the Secretariat (and all team members) by END MARCH 2000.

3. All consultations within the team, and comments on the guidance, to be

completed by END APRIL 2000.

4. Secretariat to produce the final and edited versions of all guidance materials

by END JUNE 2000.

7.4 The meeting agreed on lead author responsibilities for completing the guidance

materials under the relevant TORs as:

Wolfgang Kusch – TOR 1

Kevin O’Loughlin – TOR 2

Neil Gordon and Joseph Shaykewich for TOR 3 and 4.

7.5 In concluding the meeting, the Experts noted that, following the completion of the

guidance material, the tasks assigned to them resulting from the CBS Extraordinary Session

in Karlsruhe, Germany, 1998, will have been successfully completed. However, in view of

the rapid developments and opportunities afforded by new technological developments for

provision of effective public weather services, there would be a need for specific expertise to

continue to be devoted to assisting Members, in particular those in developing countries in

this area.

7.6 The meeting closed at 1700 on Saturday, 27 November 1999.

15

Appendix A

LIST OF PARTICIPANTS AT THE EXPERT TEAM ON PRODUCT DEVELOPMENT AND VERIFICATION AND SERVICES EVALUATION

Hong Kong, China 23-27 November 1999

Kevin O'Loughlin, ChairBureau of Meteorology

GPO Box 1289K

MELBOURNE VIC 3001

Australia

Tel: (613) 9669 4968

Fax: (613) 9663 4092

Email: k.oloughlin@bom.gov.au

Chik-Cheung CHAN

Hong Kong Observatory

134A Nathan Road

KOWLOON

Hong Kong, China

Tel: (852) 2826 8371

Fax: (852) 2311 9448

Email: ccchan@hko.gcn.gov.hk

Neil Gordon

Meteorological Service of New Zealand Ltd

30 Salamanca Road P.O. Box 722

WELLINGTON 6015

New Zealand

Tel: (644) 470 0762

Fax: (644) 473 5231

Email: neil.gordon@met.co.nz

Wolfgang Kusch

Deutscher Wetterdiesnt

Zentralamt. Frankfurter Str. 135

D-63067 OFFENBACH

Germany

Tel: (49 69) 8062 2802

Fax: (49 69) 8062 2004

Email: wkusch@dwd.d400.de

Ewen McCallum

UK Met Office

London road Bracknell

BERKSHIRE RG12 2SZ

United Kingdom

Tel: (44 1344) 856 176

Fax: (44 1344) 854 462

Email: emccallum@meto.gov.uk

Joseph Shaykewich

National Weather Services

Environment Canada

4905 Dufferin St.

DOWNSVIEW, ONTARIO

Canada M3H 5T4

Tel: (1 416) 739 4702

Fax: (1 416) 739 4700

Email: joseph.shaykewich@ec.gc.ca

Sam Shongwe

National Meteorological Service

P.O. Box 58

MBABANE

Swaziland

Tel:

Fax:

Email: weather@realnet.co.sz

 WMO SecretariatHaleh Kootval

Chief, Public Weather and Operational

Information Service

Tel: (4122)730 8333

Fax: (4122) 730 8021

Email: hkootval@www.wmo.ch

Local Participants from Hong Kong ObservatoryW.L.Chang

Email: wlchang@hko.gcn.gov.hk

C.M.Tam

Email: cmtam@hko.gov.hk

PUBLIC WEATHER SERVICE EXPERT TEAM ON PRODUCT DEVELOPMENT APPENDIX BAND VERIFICATION AND SERVICE EVALUATION

(HONG KONG, CHINA, 22 to 26 November 1999)Provisional Programme

Monday, 22 November Tuesday, 23 November Wednesday, 24 November Thursday, 25 November Friday, 26 November

AM

0900

Opening TOR 3: Status report Expert Team Work

TORs 1,2,3 and 4

Presentation of work plans

to the expert team

Preparation of report of the

expert team to CBS

(continue)

Background information and

Objectives

Discussion of key issues

related to TOR 3

General discussion

General discussion

TOR 1: status report

1200

Discussion of key issues

related to TOR 1

Lunch Lunch Lunch Lunch Lunch

PM

1330

TOR 2: status report TOR 1: Work Plan (development

of steps)

Arrangements for

follow-up action

Preparation of report of the

Review and adoption of

the report of the expert

team Discussion of key issues

related to TOR 2

TOR 2: Work Plan (development

of guidelines)

1700

TOR 4: status report

TOR 3: Work Plan (preparation

of recommendations)

expert team to CBS Close

Visit to Hong Kong Observatory

Discussion of key issues

related to TOR 4

TOR 4: Work Plan (preparation

of guidelines)

(Individual group work under

each TOR)

ATTACHMENT I

Improved Access to Warnings

Edwin S.T. Lai, Hong Kong Observatory

1. Introduction

The PWS Expert Team on Media Issues met in Orlando, Florida, USA on 20-24 June 1999. One of the recommendations was to set up a centralized web site for broadcasters and media to access the latest information on severe weather events around the world. Since the meeting, members of the Expert Team have exchanged views and ideas via email on the conceptual design and contents of the proposed web site.

At the PWS Expert Team on Product Development, Verification and Service Evaluation held in Hong Kong on 23-27 November 1999, the idea was discussed further and some technical aspects also considered. It was suggested that a pilot phase focussing on tropical cyclones only could be launched at an experimental web site (s) hosted by an NMS (or RSMC). Should the web site gain widespread support, the idea can then be extended to cover other severe weather events around the world.

2. Rationale for the Pilot Experiment

Tropical cyclone is chosen as the starting point because of its extensive impact that transcends national boundaries. Its week-long longevity is ideal for day-to-day news coverage without overstepping the limit of the audience’s attention span. It is visually captivating and hence well suited to the TV treatment. Major problems to be resolved are mostly in connection with the warnings of tropical cyclones, particularly the single voice and attribution issues.

A centralised web site, with voluntary contribution from participating NMSs, has the following advantages:

(f) if the forecast tracks are consistent, broadcasters will be able to make statements with more confidence without the danger of causing public confusion;

(g) if the forecast tracks are diverse, broadcasters will think twice before committing to any specific scenarios or quoting directly from raw model outputs; should they fail to refer their audience to the respective national warnings, then they have to face the consequences of misinformation on their own;

(h) alternative information on the web site, such as significant weather facts or news headlines on human or social aspects, will add another dimension to the weather story of the tropical cyclone, which can be used by broadcasters if they so wish;

(i) having made use of the specific information and knowing full well where it comes from, the broadcasters can readily acknowledge the source;

(j) the exposure and attribution so gained will encourage other NMSs to contribute information to the web site.

3. Conceptual Design of Tropical Cyclone Web Site

As a preliminary concept, information could be displayed on the proposed web site to look something like this:

22

All currently active tropical cyclones will be represented by the standard icon on a world map (locations of tropical cyclones may vary among weather centres but the differences are unlikely to be noticeable on the scale of a world map; for display purpose, the RSMC-analyzed position will be taken as reference). By clicking on the icon, centres issuing warnings will be shown and the broadcasters can link directly to the relevant web sites for more details. At the bottom on the left, users can retrieve previous information. On the right, tables and listings of summarized warnings by countries/territories in different tropical cyclone basins are also made available upon selection of buttons.

4. Long-term Development

Extending the concept further to cover other major weather events, the front page of the centralized web site may look something like this:

Different weather events are represented by different symbols. One glance at the world map will immediately give the broadcasters the story outline for the day. To focus on

23

specific weather phenomenon, the display can be changed by toggling on and off the buttons in the box at the bottom right. For more details, users can again click directly on the icon on the world map. To go back in time or for listings by countries or territories, users can go to the box at the bottom left.

24

ATTACHMENT II

TECHNICAL REQUIREMENTS FOR DATA AND PRODUCTS FOR PUBLIC WEATHER SERVICES

1. Introduction

2. Scope of Public Weather Services Data and Products

2.1 Data

2.1.1 Observations

2.1.2 Satellite Data

2.1.3 Radar Data

2.1.4 Numerical Weather Prediction Data

2.2 Forecast Products

2.2.1 Forecasts

2.2.2 Warnings

2.2.3 Special Forecasts

2.3 Information Products

2.3.1 Weather Summaries

2.3.2 Climate Information and Bulletins

3. Impact of Changing Technology

3.1 Convergence of Technologies

3.2 Satellite Technology

25

3.3 Globalisation of the Media

3.4 Internet

3.5 GIS

3.6 Integrated System

4. Standards Related to the Needs of Public Weather Services

4.1 Integration of All Data and Products

4.1.1 Speed and ease of access

4.1.2 Portability across systems

4.2 Dissemination

4.2.1 Television

4.2.1.1 Graphics quality

4.2.1.2 Audio-visual formats

4.2.1.3 Animation

4.2.1.4 Individualised designs,

4.2.1.5 Networked/local broadcasts

4.2.1.6 Timely broadcast of warnings

4.2.2 Radio

4.2.2.1 Broadcast quality voice lines

4.2.2.2 Value of immediacy

4.2.3 Print

4.2.3.1 Graphics quality

26

4.2.3.2 “Ready to print” Weather Pages

4.2.3.3 Electronic delivery

4.2.4 Internet

4.2.4.1 Web based formats

4.2.4.2 Demand for real-time information

4.2.4.3 Combined text and graphics

4.2.5 Fixed and Mobile Communications Systems

4.2.5.1 Fixed telephone lines

4.2.5.2 Mobile telephone

4.2.5.3 Pagers

4.2.5.4 Fax on demand

4.2.6 Other

4.2.6.1 Computer to Computer

4.2.6.2 FTP Server

4.2.6.3 Desktop publishing

4.2.6.4 Public electronic displays

5. Standards Related to NMS Operations

5.1 Data Standards and Formats

5.2 Communications Standards and Protocols

5.2.1 Local Area Networks

27

5.2.2 Wide Area Networks

5.2.3 Intranet

5.3 Computing Standards

5.3.1 Hardware

5.3.2 Software

5.4 Integrated Systems

5.5 Dissemination and Access

5.6 Feedback on Systems Performance and Service Quality

6. Standards Related to PWS Use of the Future WMO Information Systems

6.1 Development of the Future WMO Information System

6.2 Compatibility with PWS Needs

6.3 The Internet

6.4 Other Information Systems

28

7. Improving International Cooperation on Technical Aspects of Public Weather Services

7.1 Cooperation on Public Weather Services Data and Products

7.1.1 Data and Forecast Products

7.1.2 Coordination of Warnings

7.2 Coordination on Global Media

7.2.1 Routine Products

7.2.2 Warnings

7.2.3 PWS on the Internet

29

ATTACHMENT III

GUIDELINES ON GRAPHICAL PRESENTATION OF PUBLIC WEATHER SERVICES PRODUCTS

1. Introduction

2. Scope of Public Weather Services Guidelines on Graphical Representations

2.1. Television

2.2. Print

2.3. Internet

2.4. Other

3. User Requirements

3.1. Integrated systems

3.2. Ready to print/broadcast/post (to web) products

3.3. Design of graphical products

4. Content of Graphical Products

4.1. Data

4.1.1. Observations

4.1.2. Satellite Data

4.1.3. Radar Data

4.1.4. Numerical Weather Prediction Data

4.2. Forecast Products

4.2.1. Forecasts

30

4.2.2. Warnings

4.2.3. Special Forecasts

4.3. Information Products

4.3.1. Weather Summaries

4.3.2. Climate Information and Bulletins

5. Technical and Basic Design of Graphical Products

5.1. Basic aspects of presentation systems

5.1.1. Television

5.1.2. Print

5.1.3. Internet

5.1.4. Others

5.2. Technical aspects

5.2.1. Use of NMS standard systems

5.2.1.1. Hardware

5.2.1.2. Software

5.2.1.3. Dissemination

5.2.1.4. Access to Data, Products and GIS

5.2.2. Desktop publishing systems

5.2.3. System compatibility and portability

5.3. Design aspects

5.3.1. User-oriented approach

5.3.2. Use of expert advice

31

5.3.3. Corporate design

6. Production Set Up

6.1. Customer coordination

6.2. Operational testing

6.3. Backup systems

6.4. Quality monitoring

6.5. Additional service

32

ATTACHMENT IV

PRELIMINARY OUTLINE OFPROPOSED GUIDANCE ON PERFORMANCE ASSESSMENT

1. Introduction

1.1Response to TORs 3 and 41.2The need for performance assessment1.3The methods available-verification and user-based1.41.4 The importance of balance

2. Key Purposes2.1Ensure user requirements are met2.2Ensure public weather services system effectiveness2.3Ensure public weather services system credibility

3. Areas that actions are required to meet the Key Purposes (as a response to evaluation information gathered)3.1Product Definition

3.1.1 Start with identification of user requirements and evaluation criteria 3.1.2 Research on evaluation methods and expertise available3.1.3 Determine the evaluation mode and design of evaluation scheme for

peer review3.1.4 Modify evaluation scheme as required3.1.5 Implement required changes following results of evaluation

3.2Delivery Mechanisms3.2.1 Identification of users access capabilities and criteria for success3.2.2 Research on evaluation methods for assessing the effectiveness of

delivery systems3.2.3 Determine the evaluation mode and design of evaluation scheme for

peer review3.2.4 Modify evaluation scheme as required3.2.5 Implement required changes following results of evaluation

3.3Production system

33

3.3.1 Determine criteria for success3.3.2 Research on evaluation methods for assessing the effectiveness of

production system3.3.3 Determine the evaluation mode and design of evaluation scheme for

peer review3.3.4 Modify evaluation scheme as required3.3.5 Implement required changes following results of evaluation

3.4Research and development3.4.1 Determine the priorities for research and development3.4.2 Set criteria for evaluation of success of research and development-

improvements in 3.1-3.33.4.3 Modify or conduct new R&D based on evaluation results

3.5Staff training and development3.5.1 Determine the priorities for staff training and development3.5.2 Set criteria for evaluation of success of staff training and development-

improvements in 3.1-3.33.5.3 Implement revised training programme depending on evaluation results

3.6Communication3.6.1 Do it – with transparency and comprehensibility

4. Two Dimensions of Evaluation 4.1 Introduction

4.1.1 The methods available-verification and user-based4.1.2 The importance of balance

4.2Verification4.2.1 Consistency with statistical theory4.2.2 Free of human interpretation (for objective methods)

4.3User-based assessment4.3.1 True reflection of user perception4.3.2 Subject to human perception

4.4Combined Approach4.4.1 Based on what is relevant to users

34

4.4.2 Matching perceived performance with technical verification results 4.4.3 No single score or method is sufficient4.4.4 Determine priorities for actions

5. Verification5.1Introduction

5.1.1 Overall purpose

5.1.2 Definition of and characteristics of accuracy and skill

5.1.3 Definition of and characteristics of objective and subjective evaluation

5.2Guiding Principles

5.2.1 Principles Related to Why To Verify

5.2.1.1 We Must Know The Quality of the Products5.2.1.2 We Need Information to Aid Decision Making5.2.1.3 We Need Appropriate Information for Reporting to Users and

Other Stakeholders

5.2.2 Principles Related to How To Verify

5.2.2.1 There Should Be An Overall Plan

5.2.2.2 Measures Must be Relevant to the Users

5.2.2.3 Keep It Simple

5.2.2.4 Use Consistent Elements, Locations, Methods and Scores

35

5.2.3 Principles Related to What to Do with Results

5.2.3.1 Use Them

5.2.3.2 Do Not Misuse Them

5.3Performance Measures

5.3.1 Continuous weather variables

5.3.1.1 Applies to temperature, wind speed, wind-chill, humidity

5.3.1.1 Accuracy measures

Bias, MAE, RMSE

5.3.1.2 Skill measures

1-MAE/MAE (of climatology or persistence) Reduction of variance

5.3.2 Categorical

5.3.2.1 Two Category

5.3.2.1.1Applies to

Yes/No precip. Yes/No severe weather events Rain versus snow

5.3.2.1.2Accuracy and skill measures

5.3.2.2 Multi-category

5.3.3 Probabilistic

5.3.3.1 Comments on decision-making models, and characteristics of these scores etc.

5.3.3.2 Applies to

POP Precip. phase

36

Etc.

5.3.3.3 Accuracy Measures

Brier skill score See references

5.3.3.4 Multi-category Probabilities

5.3.3.4.1Ordinal

5.3.3.4.2Cardinal

5.3.4 Timing

5.3.4.1 Phase error for an event

Start of precip End of precip Phase change Start of severe event End of severe event (danger over)

5.3.4.2 Lead time for an event

5.3.5 Spatial errors

Event happened but forecast to be in the wrong place How wrong is it if it is the neighbouring county? Threat scores

6. User-based assessment

37

6.1Introduction

6.1.1 Characteristics

6.1.1.1 Subjective

6.1.1.2 Perception as Reality

6.1.1.3 Dimensions: Requirements, Expectations, Understanding, Importance, Satisfaction, Utility, etc.

6.1.1.4 Economic value assessment

6.2Guiding Principles for Methodology

6.2.1 Overall multi-year user-based assessment plan (need for)

6.2.1.1 Cover both product lines and delivery mechanisms

6.2.1.2 Multi-year strategy to user-based assessment

6.2.1.3 Consistent questions over years

6.2.2 Requirement to make strategic/tactical decisions as the driver

6.2.2.1 Decisions on continuance or modification of programs

6.2.2.2 Decisions on reporting on performance commitments

6.2.2.3 Decisions on deployment of technology (e.g. level of automation) and resources

6.2.3 Need to know why it should be done

6.2.3.1 To check perceptions against expectations

6.2.3.2 To track trends

6.2.3.3 To seek feedback to improve existing services

6.2.3.4 To determine requirement for new or different services

38

6.2.3.5 To assess perceived effectiveness of overall programme

6.2.3.6 To identify areas where actions can be taken

6.2.3.6.1Give a few examples

6.2.4 Credibility and Transparency

6.2.4.1 Fewer well planned surveys, focus groups, etc. , rather than a large mixture of disconnected ones

6.2.4.2 Consistency of approach to track trends

6.2.4.3 Balanced set of scores giving a comprehensive picture

6.2.4.4 Statistical significance issues

6.2.4.4.1Size of sample

6.2.4.5 Collaboration with other relevant authorities is desirable

6.2.4.5.1Health promotion –National survey on sun awareness and protective behaviour (Canada), etc

6.2.4.5.2Transportation – road icing

6.2.4.5.3Recreation – mountain safety authorities, etc.

6.2.4.5.4Other levels of government

6.2.5 Principles of User-based Assessment Design

6.2.5.1 Preferably independently administered

6.2.5.1.1Perceived credibility

6.2.5.1.2Perceived statistical validity

6.2.5.1.2.1 Sample size6.2.5.1.2.2 Geographical and geopolitical representation

39

6.2.5.1.3May be a formal requirement for performance pledge / charter or of quality assurance system

6.2.5.2 Use of professional Expertise

6.2.5.2.1Other government department (required approvals?)

6.2.5.2.2University expertise

6.2.5.2.3Accredited consultants

6.2.5.3 Lack of professional advice or availability of an independent capacity is no excuse to not doing it

6.2.5.4 Use some “best practice” examples

6.2.5.5 Dry run or pilot test the assessment instrument

6.2.5.6 Information storage

6.2.5.6.1Use of a database system designed for statistical analysis

6.2.5.6.2Non-electronic storage

6.2.6 Communication of Information

6.2.6.1 Accessibility within the NMS

6.2.6.2 Clear interpretation reports prepared for internal and external consumption

6.2.6.3 Archive, publish, use as appropriate for promotion (and education)

40

6.2.6.4 Communication of results to

6.2.6.4.1staff,

6.2.6.4.2management

6.2.6.4.3public,

6.2.6.4.4central agencies, and

6.2.6.4.56.2.6.4.5 others

6.3Methods

6.3.1 Formal structured surveys

6.3.1.1 Large survey every 4 or 5 years – comprehensive

6.3.1.1.1Reference for an example of a comprehensive survey

6.3.1.1.1.1 Canada (Goldfarb survey)

6.3.1.2 More frequent tracking surveys

6.3.1.2.1Reference – survey by Hong Kong, China

6.3.1.2.2Maybe tacked onto omnibus survey

6.3.1.3 Subject area surveys

6.3.1.3.1Key issues

6.3.1.3.1.1 E.G. Climate change

6.3.1.3.2Product lines

6.3.1.3.2.1 Parameters (wind-chill)

6.3.1.3.2.2 Understanding of terminology

6.3.1.3.2.3 Relative importance of products or weather elements

41

6.3.1.3.3Delivery systems

6.3.1.3.3.1 Which are being used (e.g., the Internet, weatheradio, telephone, pager, mobile, digital radio)

6.3.1.3.3.2 Which could be used

6.3.1.3.4 Information sought

6.3.1.3.4.1 Accuracy perception, requirement, trend

6.3.1.3.4.2 Satisfaction perception, requirement, trend

6.3.1.3.4.3 Utility perception, requirement, trend

6.3.1.3.4.4 Understandability perception, requirement, trend

6.3.1.3.5Perception of overall service

6.3.1.3.6Economic value estimate

6.3.1.3.6.1 Production based methods vs. demand based methods

6.3.1.3.6.2 Current value

6.3.1.3.6.3 Value if accuracy increased

6.3.1.4 Questionnaire design

6.3.1.4.1Scales (e.g. of satisfaction)

6.3.1.4.2Multiple choice

6.3.1.4.3Open versus closed questions (define terms)

6.3.1.4.4Avoidance of leading questions

6.3.1.4.5Probing for more information

6.3.1.4.6 Geographical and geopolitical representation

42

6.3.2 Formal service audits

6.3.2.1 Independent auditing of the NMS and its services by a third-party (e.g., government audit agency or consulting company)

6.3.2.2 May be part of an overall quality management system

6.3.2.3 Can be seen as an opportunity to learn and improve, and to justify requirement for resources

6.3.3 Focus groups

6.3.3.1 Description of focus group techniques

6.3.3.2 Limitation of focus to a few particular issues

6.3.3.3 Development of a focus group survey type of instrument

6.3.3.4 Utility of a facilitator vs. doing it yourself

6.3.3.5 Methods of recording of what has happened

6.3.3.6 Avoidance of interruptions or interference in the conduct of the focus group(e.g., to clarify a misunderstanding)

6.3.4 Monitoring public opinion

6.3.4.1 Press clippings

6.3.4.2 Newsgroups

6.3.4.3 Media monitoring services (transcripts)

6.3.5 Direct feedback and response (complaints, compliments, suggestions)

6.3.5.1 Specific to dissemination systems (telephone, Web, fax, etc.)

6.3.5.2 Letters to NMS or Minister

6.3.5.3 Email

43

6.3.6 Consultation

6.3.6.1 Visiting user associations

6.3.6.2 Conventions

6.3.6.3 User meetings

6.3.6.4 Visiting client sites

6.3.6.5 Hosting visits

6.3.6.5.1Workshops

6.3.6.5.2Particular clients or client groups

6.3.7 Post-Event Review and Debrief

6.3.7.1 Forecasting System

6.3.7.1.1Used-based assessment

6.3.7.2 Overall Service Delivery System Including Coordination with Other Agencies

6.3.7.2.1Review delivery, coordination (inter-agency

6.3.7.2.2communication), impacts

6.3.7.2.3Surveys of affected area

6.3.7.2.4Joint debriefing with other agencies

6.3.7.2.5Consultations

6.3.7.2.6Document, learn, improve

6.3.7.2.7Service-User relationship building

6.3.8 Collection of Anecdotal Information

Collect stories of lives saved, damage avoided, through effective warnings etc.

44

7. Conclusions7.1Review of why and how to carry out assessment programme7.2Guidance on an “entry-level” programme

45

EXAMPLE SPECIFICATIONS FOR WEATHER GRAPHICS SYSTEMS

SWAZILAND TV WEATHER PRESENTATION SYSTEM

This is an example of a system which could be used in a developing country with limited resources

Guidelines on Design & Contentof a TV weather presentation using PowerPoint

(A) PRE-REQUIREMENTS

(i) Hardware (Min. Specs.)

Pentium 100 PC, 2GB HDD, 16 MB RAM

(ii) Software

Microsoft Office Suite (With PowerPoint)

Standard GIS package e.g. Surfer

Collection of applicable weather Icons/symbols e.g. in Clipart of Microsoft

Office.

(iii) Content (Country Specific)

Forecast info

warnings, watches, outlooks etc.

Informational products e.g. current weather etc.

Other products

(iv) Other (Optional)

Satellite Imagery

46

Image editing software e.g. Kodak Imaging in Windows 95/98

Digital weather charts & related products (importable into PowerPoint)

(B) PRODUCT DEVELOPMENT PROCEDURE

1. Create background map of country/region of interest using the GIS software

and adjust size, colour appropriately

2. Open PowerPoint for new presentation

3. Drag & drop map into presentation

4. Drag & drop (overlay) weather symbols at appropriate positions on map

according to forecast info in (iii).

5. Repeat steps 3 & 4 for all desired products, creating several slides.

6. Drag & drop (or copy & paste) satellite images or other forms of images,

charts etc. into presentation.

7. Create or import tables of city/regional forecasts etc.

8. Edit, rearrange slides for smooth flow of presentation and for animation

sequences.

9. Save presentation.

10. Rehearsal of script to be read over presentation may be necessary to adjust

timing.

11. Presentation can now be transferred to the TV studio either on floppies, or by

email, ftp, etc. (May need to be zipped for floppies & compression)

12. On TV studio end, presentation is played on a PC linked to the transmission

system & forecaster provides the simultaneous audio input.

47

AN EXAMPLE SPECIFICATION FOR IN-HOUSE TELEVISION WEATHER GRAPHICS PRODUCTION

Hong Kong Observatory

This is an example of a system which could be used in a medium to large NMS with developed infrastructure and human resources trained to

provide the required support

1. FUNCTIONAL REQUIREMENTS

1.1 The system is required to process graphical images for press conferences and

television weather programmes.

1.2 The system shall be a turnkey system comprising computer software, computer

hardware, which shall perform the following functions:

(a) acquire, store and process meteorological data, including pressure, temperature,

rainfall, wind direction/speed, humidity, numerical model data, radar data, satellite

cloud data and satellite derived products in pre-defined formats from computer

systems of NMSs.

(b) render the topography of selected areas 2-and 3-dimensional terrain.

(c) render meteorological data and cloud data into 2- and 3-dimensional images and

merge with the 2-and 3-dimensional terrain in (b);

(d) allow manual placement of weather system symbols, including cold/warm fronts,

tropical cyclones, high and low pressure systems and isopleths, onto the 2- and 3-

dimensional terrain in (b);

(e) save 2- and 3-dimensional graphics or perspectives created in (c) and (d) as still

graphics;

(f) generate and save 2- and 3- dimensional animation segments of fixed perspectives

as well as in cockpit views from an aircraft flying into/over the weather system;

(g) accept graphical images from NMSs’ computer systems for display as still graphics

and animation;

(h) The system shall display the chroma-keyed images on video monitors, record the

48

images on tape, and transmit the images in real time to

(i) television stations via video circuits.

2. WORKLOAD REQUIREMENTS

2.1 Retrieval of meteorological data and satellite cloud data, according to a pre-set

schedule from NMS's computer systems via Network. System should be able to

handle the volume of meteorological data and graphics to be transferred for each

presentation through the Network - e.g. 40 Mbytes.

2.2 Preparation of 2- and 3-dimensional weather graphics and animation in 1.2 (b) to (f) for

the preparation. This process would involve retrieval of meteorological and cloud data

from hard disk, generation of topographic images for selected areas, overlaying of

weather images interactively, and storage of prepared images on the proposed system

for play back at a later time. A typical presentation includes five still images and four

10-second animation segments at a minimum rate of about 15 frames per second.

2.3 Playback of stored still images and animation segments automatically or upon user

command, and chroma-key the video images of weather presenters from existing

video camera onto weather graphics and animation, then output the final images to

video output channels at standard video refresh rates, all in real-time. Anticipated

presentation frequency is up to x presentations per day. Preparation time for each

presentation shall be less than 1 hour.

2.4 The proposed system shall operate round the clock for routine retrieval of

meteorological data from NMSs’ computer system.

3. SOFTWARE REQUIREMENTS

3.1 Operating System for the TV Computer Weather Graphics System

The operating system shall be UNIX or NT.

3.2 Application Software

3.2.1 Weather Visualization and Display Software

The weather visualization and display software shall have the following functional

modules:

49

a. Graphics preparation module;

b. Animation creation module;

c. Graphics and animation playback module.

3.2.1.1 Graphics Preparation Module

3.2.1.1.1 Terrain Selection

3.2.1.1.1.1 This module shall include a worldwide digital terrain database based on low orbit satellite imageries.

3.2.1.1.1.2 The resolution of the terrain database shall be at least 5 kilometres worldwide, at least 1 kilometre for regional areas, and at least 80 metres for local area.

3.2.1.1.1.3 This module shall allow the selection of terrain sector interactively with a mouse or other pointing devices. For easy conversion to video format, terrain shall be rendered in 768x512 pixel (i.e. PAL size) windows.

3.2.1.1.1.4 3-dimensional terrain shall be rendered in such a way that the terrain appears to be viewed from selected latitude, longitude and elevation. The field of view from these locations shall also be user selectable.

3.2.1.1.1.5 Perspectives, as defined by terrain coverage and perspective settings in 3.2.1.1.1.3 and 3.2.1.1.1.4, shall be saveable and recallable for later use.

3.2.1.1.1.6 This module shall include in its terrain database the lakes, rivers and international political borders for display as selected line data on the 2- and 3-dimensional terrain.

3.2.1.1.2 Cloud Imageries Rendering

3.2.1.1.2.1 The software shall accept and store infrared (IR) and visible (VIS) MTSAT

cloud data and render the data onto the 2 and 3-dimensional terrain selected

in 3.2.1.1.1 in at least 64 colours or gray shades.

3.2.1.1.2.2 The resolution of rendered cloud images shall be up to one kilometre and

50

shall be user selectable.

3.2.1.1.2.3 There shall be facilities to select the minimum value of which IR clouds will be

treated as genuine cloud and everything below that value shall not be

displayed.

3.2.1.1.2.4 There shall be facilities to adjust the vertical stretch of the 3-dimensional cloud

images to exaggerate or flatten the features of clouds. The apparent height of

the cloud base above the terrain shall be independently adjustable.

3.2.1.1.2.5 3-dimensional cloud images shall be rendered in such a way that they will

match the perspectives of terrain setting in 3.2.1.1.1.4.

3.2.1.1.2.6 The map projection of the terrain shall be designed to match the map

projection of the satellite cloud imageries.

3.2.1.1.3 Other Graphics Objects

3.2.1.1.3.1 This module shall allow the creation and placement of the following symbols on 2- and 3-dimensional terrain described in 3.2.1.1.1 :a. Cold fronts

b. Warm fronts

c. Stationary fronts

d. Occluded fronts

e. High pressure systems

f. Low pressure systems

g. Troughs of low pressure

h. Tropical cyclones

i. Isobars

j. Arrows

k. Isopleths

3.2.1.1.3.2 This module shall allow the placement of smooth-sided polygons for representation of temperature bands and rainfall bands. There shall be functions to fill polygons with user selectable semi-transparent or solid colours.

3.2.1.1.3.3 This module shall allow the polygons described in 3.2.1.1.3.2 to be re-shaped via rotation, proportional and non-proportional scaling, and to be edited by selecting and moving original input points defining the

51

objects.

3.2.1.1.3.4 This module shall also allow the placement of text strings, both English and local language, on the 2- and 3-dimensional terrain described in 3.2.1.1.1. Fonts style, size and colour of the text shall be user selectable.

3.2.1.1.4 Import and Display of Data and Images from Other Computer System

3.2.1.1.4.1 Have specified procedures with which the following meteorological data (including but not limited to Global Telecommunication System (GTS) data, automatic weather station data, radar data, satellite data, satellite derived products and numerical model output) can be imported from NMS's computers via Network :

i. Temperatures, to a precision of 1 degree Celsius, at predefined

locations;

ii. Surface pressures, to a precision of 1 hecto Pascal, at predefined

locations;

iii. Relative humidities, to a precision of 1 percent, at predefined locations;

iv. Rainfall, to a precision of 1 millimetre, at predefined locations;

v. Wind speeds, to a precision of 5 kilometres per hour, at predefined

locations;

vi. Wind directions, to a precision of 10 degrees, at predefined locations.

vii. Numerical model outputs.

viii. Satellite cloud imageries

ix. Satellite derived products

x. Radar data

3.2.1.1.4.2 There shall also be facilities to enter the data described in 3.2.1.1.4.1 manually within the proposed system.

3.2.1.1.4.3 There shall be facilities to automatically display at predefined locations the imported data described in 3.2.1.1.4.1 and 3.2.1.1.4.2 on the terrain

52

selected in 3.2.1.1.1. Wind directions and wind speeds shall preferably be displayed as wind barbs.

3.2.1.1.4.4 There shall be facilities to import raster and vector graphics from NMSs’ computers via the Network. The System shall be able to convert the imported graphics and display them alone or overlay onto the terrain. There shall also be facilities to edit the imported raster graphics files.

3.2.1.1.5 Capture of Still Graphics

3.2.1.1.5.1 This module shall allow any 2- and 3-dimensional graphics created to be saved and used in future as still graphics by the animation creation module.

3.2.1.2 Animation Creation Module

3.2.1.2.1 This module shall allow creation of animation as well as real-time rendering of animation without the necessity of saving the animation for latter use.

3.2.1.2.2 This module shall create the following types of animation from 2- and 3- dimensional perspectives of terrain and weather systems:

3.2.1.2.2.1 Fixed Perspective Animation

3.1.1.1.2.1.1 This type of animation shall be created so that the viewer appears to be fixed at a selected latitude, longitude, elevation and field of view with weather systems moving below.

3.1.1.1.2.1.2 Each animation shall be defined by a starting time, and ending time (or a time interval relative to the starting time), weather systems and either the number of frames or imagery time increment.

3.1.1.1.2.1.3 This module shall allow definitions of fixed perspective animation to be saved and loaded as desired. After loading previously saved definitions, the module shall allow modifications.

53

3.1.1.1.2.2 Simulated Cockpit-View Animation

3.2.1.2.2.2.1 This type of animation shall be created so that the viewer appears to be travelling on a plane on a selected flight path looking at weather systems below or around.

3.2.1.2.2.2.2 The flight path shall be defined by selecting the starting and ending locations and several points in between on the terrain. The module shall automatically fit a spline curve to these points to generate a smooth flight path.

3.2.1.2.2.2.3 Each animation shall be defined by a starting time, and ending time (or a time interval relative to the starting time) weather systems and the number of frames between the starting and ending locations. If the ending time is equal to the starting time, weather objects below shall remain stationary during the entire animation sequence.

3.2.1.2.2.2.4 This module shall allow definitions of the cockpit-view animation to be saved and loaded as desired. After loading previously saved definitions, the module shall allow modifications.

3.2.1.2.2.3 Multi-Segment Animation

3.2.1.2.2.3.1 This type of animation shall consist of a combination of fixed perspectives and cockpit-view animation segments.

3.2.1.2.2.3.2 Each animation segment shall be user defined by a 2- or 3-dimensional starting perspective, ending perspective, speed of animation and the weather system to be displayed. This module shall calculate the interpolating frames between these views automatically to create the animation segment.

3.2.1.2.2.3.3 Each animation segment shall also include user defined header and trailer segment times that can be placed between segments for pauses during multi-segment animation.

54

3.2.1.2.2.3.4 This module shall allow the definitions made for each multi-segment animation to be saved and loaded as desired. After loading previously saved definitions, the module shall allow modifications.

3.2.1.3 Graphics and Animation Playback Module

This module is used to assemble and edit previously prepared still graphics and animation for playback during programme recording.

3.2.1.3.1 This module shall display lists of previously saved still graphics and animation

and allow users to select and load these graphics in the desired order from

hard disk to random access memory.

3.2.1.3.2 This module shall allow the following parameters of each loaded graphics and

animation to be set :

a. The number of frames per second for each animation;

b. The duration of pauses between still graphics or animation;

c. The type of transition when switching to the next still graphics of

animation.

3.2.1.3.3 This module shall allow users to preview each frame of graphics and

animation loaded and to remove any individual frames when desired.

3.2.1.3.4 The playback of graphics and animation shall have a choice between

automatic and manual. In automatic playback mode, the module shall

continuously play the selected graphics and animation until a key or a

handheld remote control device is pressed. In manual playback mode, the

module shall show the still graphics or animation just once, and shall advance

to the next loaded still graphics or animation when a key or a handheld remote

control device is pressed.

3.2.1.3.5 This module shall be able to continuously display a set of standard colour bars

for colour calibration purpose.

3.2.1.3.6 After all frames had been loaded and the user had finished editing the frames,

55

the module shall be able to playback the frames as video signal with all

controls as specified in 3.1.3.3.4.

3.3 Supporting Software

3.3.1 An ANSI C compiler shall be provided for compilation of customization and interface programs that may be written by NMSs.

3.3.2 A text editor shall be provided for program editing and data input.

3.3.3 A local language module shall be provided for interfacing with the system and creating, editing and printing the local language text.

4. Hardware requirements

4.1 Hardware Features

4.1.1 Computing Workstation

One computing workstation shall be provided for generating and displaying TV

graphics and send graphics to television monitors. TV graphics shall be able to be

remotely displayed on other workstations via network. In order to meet the

functional requirements and workload requirements in Section 1 and 2, the

following computing hardware requirement is needed:

4.1.1.1 Processor and Graphics Subsystem Performance

4.1.1.1.1 The main processor of the computing workstation shall operate at SPEC 95 FP

benchmark index higher than 20.

4.1.1.1.2 The graphics subsystem of the computing workstation shall be optimized for 3-

dimensional polygon geometry manipulation. The following features are

required :

i. 24-bit colour planes for simultaneous display of up to 16.7 million colours on

screen.

56

ii. Dedicated graphics processors that supports 24-bit hardware Z-buffer capability

for hidden line and hidden surface removal. Minimum 3-dimensional graphics

performance benchmarks are 1 million 3-dimensional vectors per second and

400,000 triangles per second, using OPEN GL graphics library.

iii. Colour monitor of at least 480 (21”) diagonal, operating in non-interlaced mode

with vertical refresh rate of at least 70 Hz at a minimum resolution of

1280x1024 pixels.

4.1.1.2 Video Subsystem

4.1.1.2.1The workstations shall have a video subsystem that can output component analogue video in both RGB and Y/R-Y/B-Y formats at 8 bits per component.

4.1.1.2.2The workstation video subsystem shall also have a composite video output for monitoring of video output by source monitors.

There shall be facility to convert graphics images to composite video from PAL-sized window.

4.1.1.3 Physical Memory Capacity

The workstations shall have sufficient (at least 1 GB) dynamic random access

memory (DRAM) to run the operating system, networking software, and other utility

programs, plus an amount of memory that allows the loading of at least 300 frames of 24-bit

PAL size images for animation in the Graphics and Animation Playback Module of the

weather visualization and display software.

4.1.1.4 Hard disk Storage

The workstations shall have hard disk drive capacity that can store all software,

plus an additional 10 GB capacity for storing of cloud and meteorological data.

4.1.1.5 Tape drive

The workstations shall include a digital tape drive of at least 4 gigabyte storage

capacity for hard disk backup.

57

4.1.1.6 Networking

The workstations shall operates over IEEE 802.3 10BaseT Ethernet.

4.1.1.7 Input and Pointing Devices

The workstations shall have keyboard and mouse as input and pointing devices.

4.1.1.8 Attachment of Peripheral Devices

The workstations shall have at least one external SCSI-2 connector for direct attachment of peripheral devices, including external hard disks and CD-ROM.

58

AN EXAMPLE OF NEWSPAPER PRESENTATION SYSTEM

Australian Bureau of Meteorology

Computer Requirements for Weather Graphic Presentations to Newspapers

HARDWAREApple Macintosh - OS8.5

- G3 processor

- 256Mb RAM

- (2) 6GB internal HardDrives

- CD ROM

- Modem

- Scanner (recommended)

- Laser Printer (recommended)

MAJOR SOFTWAREAdobe - Illustrator

- Photoshop

- Streamline

Quark - Quark Express

Microsoft - Office

UTILITY SOFTWAREE-mail program (e.g. Eudora)

Web Browser (e.g. Netscape)

FTP program (e.g. Fetch)

AntiVirus (e.g. Virex)

HardDrive Repair (e.g. Norton Utilities)

File Compression/Expansion (e.g. Stuffit Deluxe)

TRAINING REQUIREMENTSIt is essential for an operator to be familiar with the Apple operating system.

Training will be required in the use of the Adobe products, particularly Illustrator and

PhotoShop. Training would also be needed for basic Quark Express operation.

If technical school training is not viable within your country, many good books are available,

59

as are training videos (from MacAcadamy).

It may be possible for training to be provided by the Australian Bureau of Meteorology’s

National Media Graphics Unit (NMGU).

An estimate of three months would be needed to train an operator and set up a weather

page.

60