NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring,...

27
NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information Officer NOAA’s National Weather Service APSDEU-7 Meeting Sep 22-23, 2006

Transcript of NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring,...

Page 1: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

NOAA’sNWS Telecommunication Gateway

RTH Washington

NOAA’sNWS Telecommunication Gateway

RTH Washington

Fred Branski, Chief, Performance Monitoring,

Support & Data Management Branch

Office of the Chief Information Officer

NOAA’s National Weather Service

APSDEU-7 Meeting

Sep 22-23, 2006

Fred Branski, Chief, Performance Monitoring,

Support & Data Management Branch

Office of the Chief Information Officer

NOAA’s National Weather Service

APSDEU-7 Meeting

Sep 22-23, 2006

Page 2: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

NWSTG Functional OverviewNWSTG Functional Overview

The NWSTG is

the central communication facility of the NWS;

the primary acquisition and distribution center for NWS data and products;

the primary acquisition and distribution center for international data and products to meet WMO, ICAO and bi-laterally agreed US requirements;

A major data exchange hub for NOAA and other agency data and products.

The NWSTG is

the central communication facility of the NWS;

the primary acquisition and distribution center for NWS data and products;

the primary acquisition and distribution center for international data and products to meet WMO, ICAO and bi-laterally agreed US requirements;

A major data exchange hub for NOAA and other agency data and products.

Page 3: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

NWSTG Functional OverviewNWSTG Functional Overview

The NWSTG includes

WMO Regional Telecommunication Hub (RTH) Washington

ICAO OPMET Databank (KWBCYMYX)

the ASOS Operations and Monitoring Center (AOMC)

• Operational oversight of U.S. federal automated surface observing systems

the AWIPS Network Control Facility (NCF)

• AWIPS is the main NWS’ system which supports the NWS forecast and warning mission requirement

• The NCF is the central communications hub and technical support center for AWIPS

The NWSTG includes

WMO Regional Telecommunication Hub (RTH) Washington

ICAO OPMET Databank (KWBCYMYX)

the ASOS Operations and Monitoring Center (AOMC)

• Operational oversight of U.S. federal automated surface observing systems

the AWIPS Network Control Facility (NCF)

• AWIPS is the main NWS’ system which supports the NWS forecast and warning mission requirement

• The NCF is the central communications hub and technical support center for AWIPS

Page 4: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Data Input to the RTHData Input to the RTH

IP / Sockets / Frame Relay

X.25

Asynchronous

Dial up

FTP – http://weather.gov/tg/ftpingest.html

Email – http://weather.gov/tg/emailingest.html

Web - http://weather.gov/tg/bullguid.html

IP / Sockets / Frame Relay

X.25

Asynchronous

Dial up

FTP – http://weather.gov/tg/ftpingest.html

Email – http://weather.gov/tg/emailingest.html

Web - http://weather.gov/tg/bullguid.html

Page 5: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Dissemination Systems Dissemination Systems

GTS

ISCS

EMWIN

Internet

GMDSS

NWS Telecom. Gateway*

GTS

ISCS

EMWIN

Internet

GMDSS

NWS Telecom. Gateway*

NWWS

NWR

LDAD

Family Of Services (FOS)

Interagency Connections

SBN/NOAAPORT

AWIPS*

* Although not dissemination systems these are systems that are critical to the process

NWWS

NWR

LDAD

Family Of Services (FOS)

Interagency Connections

SBN/NOAAPORT

AWIPS*

* Although not dissemination systems these are systems that are critical to the process

International National

Page 6: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Dissemination and Distribution

NWSTG

FOS

SBN/NOAAPORT• GOES •NCEP Product Suite

NWWS(10 sec)

WAN

NESDIS

Internet-BasedDissemination

EMWIN(> 1 min)

Telecommunications Operations Center

Satellite Legend:EMWIN

NOAAPORT

NWWS

Commercial Satellite

GOES

NWRWSR-88D

Field Offices

NCEP

DataServers

NCF

Media &Other

Customers

Public

SpecializedCustomers

Other

Agencies

LDAD

Designated Local

Customers

•Commercial Weather Services•Research Institutions•FAA, etc.

ISCS

GTS EMWIN

Private line Dissemination

• Observations

Imagery

WMO

ICAO

Page 7: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Page 8: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Major InitiativesMajor Initiatives

Replacement Telecommunications Gateway

Backup Telecommunications Gateway

NOAANet – National MPLS network

WIS development planning

Code migration

Improved Monitoring

RMTN upgrade

Replacement Telecommunications Gateway

Backup Telecommunications Gateway

NOAANet – National MPLS network

WIS development planning

Code migration

Improved Monitoring

RMTN upgrade

Page 9: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Replacement NWSTG (RTH)Replacement NWSTG (RTH)

Full functional replacement of existing capabilities

Expanded capacity and capability

Transition to new technology

– Message queuing (MQ) for internal transport

– Network centric systems interconnectivity

– Relational database central processing engine

– NAS/SAN storage solutions

Highly scaleable architecture

Hardware refresh

Full functional replacement of existing capabilities

Expanded capacity and capability

Transition to new technology

– Message queuing (MQ) for internal transport

– Network centric systems interconnectivity

– Relational database central processing engine

– NAS/SAN storage solutions

Highly scaleable architecture

Hardware refresh

Page 10: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Geographically separatedbackup system in northernVirginia

Replacement / BackupTG Description / Data Handling

Projection

Replacement / BackupTG Description / Data Handling

Projection

Worldwide users

• WMO/ICAO• Family of

services• Govt. agencies• Internet users• Foreign

countries• Emergency mgrs

NWS users• Nat’l Centers for Environ. Prediction• NWS Regional Offices• Domestic/int’l observation & forecast offices• AWIPS

NWS Telecom Gateway• Located in Silver Spring• New message switching syst.allows future upgrades• x 2 upgradeability• Much improved response time • Redundancy ensuresuninterrupted service• Full configuration management

120GB/461500 GB

85GB/38250 GB

90GB/46900 GB

950GB/383500 GB

Daily Throughput/# of circuits

Legacy over 5 year projection for replacement

Daily total message flow:

Legacy - 1.245TB

RTG/BTG – 6.15TB (2011)

Measurements/Projections based on May 2006 WMO message flow

Page 11: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

RTG Performance Measures:RTG Performance Measures:

Requirement FOC Actual Variance Threshold FY06 FY06

FY07

Message (Watch&Warning)

Avg. Transit Time (seconds) 10 6 0 0

Message (Routine&Model)

Avg. Transit Time (seconds) 60 7 -53 0

Avg. Message Traffic

(send/receive) (daily) 1.2TB 1.2 TB 0 0

Requirement FOC Actual Variance Threshold FY06 FY06

FY07

Message (Watch&Warning)

Avg. Transit Time (seconds) 10 6 0 0

Message (Routine&Model)

Avg. Transit Time (seconds) 60 7 -53 0

Avg. Message Traffic

(send/receive) (daily) 1.2TB 1.2 TB 0 0

Page 12: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

For Watches and Warnings:For Watches and Warnings:

Avg time (seconds) to queue to outbound FEP: 6.16

Max time (seconds) to queue to outbound FEP: 182 (3.03 minutes)

Avg time (seconds) to send from outbound FEP: 37.77

Max time (seconds) to send from outbound FEP: 3838 (63.96 minutes)

Avg time (seconds) to queue to outbound FEP: 6.16

Max time (seconds) to queue to outbound FEP: 182 (3.03 minutes)

Avg time (seconds) to send from outbound FEP: 37.77

Max time (seconds) to send from outbound FEP: 3838 (63.96 minutes)

Note: Not all connections are moved to the RTG infrastructure. Those still moving through legacy systems have the longest delays. We still see occasional spikes in the RTG processing stream which we are investigating with IBM to determine the cause and resolve.

Page 13: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

For all other data (except Watches and Warnings):For all other data (except Watches and Warnings):

Avg time (seconds) to queue to outbound FEP: 6.97

Max time (seconds) to queue to outbound FEP: 236 (3.93 minutes)

Avg time (seconds) to send from outbound FEP: 17.13

Max time (seconds) to send from outbound FEP: 4039 (67.32 minutes)

Avg time (seconds) to queue to outbound FEP: 6.97

Max time (seconds) to queue to outbound FEP: 236 (3.93 minutes)

Avg time (seconds) to send from outbound FEP: 17.13

Max time (seconds) to send from outbound FEP: 4039 (67.32 minutes)

Note: Not all connections are moved to the RTG infrastructure. Those still moving through legacy systems have the longest delays. We still see occasional spikes in the RTG processing stream which we are investigating with IBM to determine the cause and resolve.

Page 14: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

For Model data:For Model data:

Avg time (seconds) to queue to outbound FEP: 10.25

Max time (seconds) to queue to outbound FEP: 189 (3.15 minutes)

Avg time (seconds) to send from outbound FEP: 62.71

Max time (seconds) to send from outbound FEP: 1910 (31.83 minutes)

Avg time (seconds) to queue to outbound FEP: 10.25

Max time (seconds) to queue to outbound FEP: 189 (3.15 minutes)

Avg time (seconds) to send from outbound FEP: 62.71

Max time (seconds) to send from outbound FEP: 1910 (31.83 minutes)

Note: Not all connections are moved to the RTG infrastructure. Those still moving through legacy systems have the longest delays. We still see occasional spikes in the RTG processing stream which we are investigating with IBM to determine the cause and resolve.

Page 15: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Government Networking Requirements Government Networking Requirements

• IP-based networking solution

− Any-to-any connectivity

− High degree of bandwidth scalability

− Optimum redundancy and survivability

− IP convergence (i.e., voice, video and data over IP)

− High-end performance

• Network security remains paramount, particularly in light of today’s socio-political threats

• Segmentation from the public Internet

• Minimizes risk of security or privacy breaches

Page 16: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

NOAANet BackboneSprint Peerless IP Network Map

NOAANet BackboneSprint Peerless IP Network Map

Internet Transport Node

OC48

ChicagoChicago

AnaheimAnaheim

San JoseSan Jose Pennsauken, NJPennsauken, NJ

Kansas CityKansas City

StocktonStockton CheyenneCheyenne

FortWorthFort

Worth

New YorkNew York

TacomaTacoma

AtlantaAtlanta

Relay, MDRelay, MD

DCDC

Page 17: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

NOAANet StatusNOAANet Status

NOAANet Transition:

– Internal underway, NWS regions, NCF, NESDIS soon

– External – begin December 01, 2006

– Initially two Access Points

• One within the RTG facility but external to the infrastructure

• One at Parsippany New York – GTS, AFTN / FAA / Hawaii / Micronesia, Others???

• Possibly Atlanta, Chicago, Tacoma, ???

NOAANet Transition:

– Internal underway, NWS regions, NCF, NESDIS soon

– External – begin December 01, 2006

– Initially two Access Points

• One within the RTG facility but external to the infrastructure

• One at Parsippany New York – GTS, AFTN / FAA / Hawaii / Micronesia, Others???

• Possibly Atlanta, Chicago, Tacoma, ???

Page 18: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Status for RTG/BTG NOAANet Projects

Status for RTG/BTG NOAANet Projects

RTG IOC - June 19, 2006

RTG FOC – 31 September 2006

NOAANet OC-3 connection to BTG – June 2006, OC-12 – 01 October 2006

BTG IOC / OC-12 – 4Q 2006

NOAANet Transition:

– Internal underway, NWS regions, NCF, NESDIS soon

– External – begin December 01, 2006

BTG IOC (4Q 2006)

All 3 projects end – May 31, 2006

RTG IOC - June 19, 2006

RTG FOC – 31 September 2006

NOAANet OC-3 connection to BTG – June 2006, OC-12 – 01 October 2006

BTG IOC / OC-12 – 4Q 2006

NOAANet Transition:

– Internal underway, NWS regions, NCF, NESDIS soon

– External – begin December 01, 2006

BTG IOC (4Q 2006)

All 3 projects end – May 31, 2006

Page 19: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Other Major InitiativesOther Major Initiatives

WIS development planning

– TOC undertaking planning of VGISC development and US WIS plan

– Basis provide by RTH upgrade and MPLS rollout

– Will coordinate with Region IV to develop regional plan

Code migration

– Workstations throughout the regional capable of processing TDCF

– Capability for Upper Air translation exists within RTH.

– Extension of translation capability is main enabling method outside of native processing

Improved Monitoring

– New initiative to be further developed within the RTH and Region.

– Part of Phase two of RTH upgrade.

WIS development planning

– TOC undertaking planning of VGISC development and US WIS plan

– Basis provide by RTH upgrade and MPLS rollout

– Will coordinate with Region IV to develop regional plan

Code migration

– Workstations throughout the regional capable of processing TDCF

– Capability for Upper Air translation exists within RTH.

– Extension of translation capability is main enabling method outside of native processing

Improved Monitoring

– New initiative to be further developed within the RTH and Region.

– Part of Phase two of RTH upgrade.

Page 20: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Other Major Initiatives Cont.Other Major Initiatives Cont.

RMTN upgrade

ISCS follow on planning beginning

EMWIN expansion

– Third Border Initiative funding two pilot projects

– Plan to implement 10 to 15 additional EMWIN site within Region IV - Caribbean, Central American area

Enhanced extra regional connections

– Region III

– Russia

RMTN upgrade

ISCS follow on planning beginning

EMWIN expansion

– Third Border Initiative funding two pilot projects

– Plan to implement 10 to 15 additional EMWIN site within Region IV - Caribbean, Central American area

Enhanced extra regional connections

– Region III

– Russia

Page 21: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Major ConcernMajor Concern

Existing GTS Frame relay contract ends December 2007

BT may be willing to extend for 1 year

What will be its replacement ???

MPLS ???

Existing GTS Frame relay contract ends December 2007

BT may be willing to extend for 1 year

What will be its replacement ???

MPLS ???

Page 22: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Backup slidesBackup slides

Page 23: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Backup NWSTGBackup NWSTG

Page 24: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

IssuesIssues Data Explosion

– Increased resolution of observations and models

– Increased frequency of observations and models

– Increased number of sensors

– Improved sensing technology

– New spatial and temporal requirements

– Graphics, imagery, and video

– Thousands of small products

Bandwidth

– Technology selection

– Estimation of capacity growth

– Transmission of ‘information’ versus ‘raw data’

Data Explosion

– Increased resolution of observations and models

– Increased frequency of observations and models

– Increased number of sensors

– Improved sensing technology

– New spatial and temporal requirements

– Graphics, imagery, and video

– Thousands of small products

Bandwidth

– Technology selection

– Estimation of capacity growth

– Transmission of ‘information’ versus ‘raw data’

Page 25: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Challenges and Opportunities

Challenges and Opportunities

Demand for Data and Prediction Services Has Dramatically Increased

– Climate Services: Drought / El Niño/La Niña

– Seismic data for Tsunami Warning Systems

– Non traditional data sets

– Mesonet Data

– Extra-disciplinary (other sciences) data sets

International Data Policy: Open and Unrestricted Use of Weather, Climate and Ocean Data

Inter/Intra Regional Cooperation

Global Earth Observing System of Systems (GEOSS)

WMO Information System (WIS)

WMO Code Migration

Technology Infusion: Keeping Up With Advances in Science and Technology

Demand for Data and Prediction Services Has Dramatically Increased

– Climate Services: Drought / El Niño/La Niña

– Seismic data for Tsunami Warning Systems

– Non traditional data sets

– Mesonet Data

– Extra-disciplinary (other sciences) data sets

International Data Policy: Open and Unrestricted Use of Weather, Climate and Ocean Data

Inter/Intra Regional Cooperation

Global Earth Observing System of Systems (GEOSS)

WMO Information System (WIS)

WMO Code Migration

Technology Infusion: Keeping Up With Advances in Science and Technology

Page 26: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

New TechnologiesNew Technologies

Geographic Information Systems (GIS)

Digital Video Broadcast

Optical Networks

Multi Protocol Label Switching (MPLS)

Wireless

Public-Key Infrastructure (PKI)

New Data Formats

– Table driven – Binary & XML

Data discovery based exchange

Geographic Information Systems (GIS)

Digital Video Broadcast

Optical Networks

Multi Protocol Label Switching (MPLS)

Wireless

Public-Key Infrastructure (PKI)

New Data Formats

– Table driven – Binary & XML

Data discovery based exchange

Page 27: NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information.

“Taking the pulse of the planet”“Taking the pulse of the planet”

Your Data and Product AdvocatesFred Branski - Chief, Performance Monitoring, Analysis, Support & Data Management Branch

Data Management [email protected] (301) 713-0864 ext 146Walter Smith - Team Leader, Data [email protected] (301) 713-0864 ext 139Julie Hayes – Customer Relationship Manager [email protected] (301) 713-0864 ext 120Richard Robinson - Data Manager [email protected] (301) 713-0864 ext 179Cynthia Cromwell – Data Manager [email protected] (301) 713-0864 ext 143

KWBC Communication Control Center (CCC) - Tech ControlPoint of contact 24 hours every [email protected]: (301) 713-0902 Fax: (301) 587-1773