NPOESS Data Exploitation (NDE) Status Update
description
Transcript of NPOESS Data Exploitation (NDE) Status Update
Air Force Weather AgencyFly - Fight - Win
NPOESS Data Exploitation (NDE)
Status Update
WG-CSAB Oct 2008John Zapotocny
Approved for Public Release Distribution Unlimited
F l y - F i g h t - W i n
Overview
Risk Reduction Strategy Early centrals interface Use current advanced sensor data Collaboration via JCSDA
Infrastructure Enhancements MetSat ingest and data storage redesign Weather Data Analysis (WDA) program
Data Processing and Applications Global high resolution cloud analysis Regional high-res cloud forecasts
F l y - F i g h t - W i n 3
IDPS Early Centrals Interface Supports testing for AFWA internal applications Improves the quality of the delivered IDPS by identifying issues
early-on IDPS development/test resources on-site to support AFWA’s
software development process IDPS software installed on AFWA equipment AFWA staff training completed (Nov 07)
Independent testing by AFWA on-going Canned test data (~2TB) transferred from replicated IDPS Datasets are roughly 100x legacy volume
Risk Reduction StrategyEarly Centrals Interface
F l y - F i g h t - W i n 4
JCSDA is AFWA’s primary vehicle for data assimilation capability development in preparation for NPOESS 6 AFWA-funded projects directly related to NPP/NPOESS
Impact assessment of AIRS (CrIS proxy) in WRF MODIS (VIIRS proxy) skin temperatures in Land Information System (LIS) Integration of CRTM (will support NPP sensors) into LIS Impacts of AMSU cloud-cleared, AMSU and AIRs cloudy radiances Integrate MODIS/METOP cloud optical properties into WWMCA Impact of VIIRS cloudy/precipitating radiances on WRF using GSI
AFWA migrating to GSI data assimilation engine for WRF More effectively leverages community development NCAR energized – provides transition path and synergy
More on-site presence at WWB through Visiting Scientist program Currently 1 position increases to 3 for FY09
Risk Reduction StrategyCollaboration via JCSDA
F l y - F i g h t - W i n 5
MODIS NPOESS data in HDF 5 format, MODIS data comes in HDF EOS
format (precursor to HDF 5) and is a good proxy Currently ingesting MODIS data via DREN (RDT&E only) Continuing challenges with data feed from NESDIS - only partial
data receipt via DATMS-U
METOP MetOp on orbit and planned to fill third constellation
requirement during NPOESS era AFWA receiving 1km resolution AVHRR imagery data which is
very valuable especially for snow cover products Primary issues is 120+ min latency of MetOp data as this does
not meet AFWA timeliness requirements for global cloud analysis
Risk Reduction StrategyUse of Current Advanced Sensor Data
F l y - F i g h t - W i n
Infrastructure EnhancementsIngest and Data Storage
AFWA has redesigned ingest sub-system for NPOESS era
Data placed directly on SAN landing zone prior to processing to allow virus scanning before promoting to a trusted location for product generation and dissemination
Redesign enables ingest of MODIS and METOP data from DATMS-U network emulating NPOESS IDPS connection
Systems Engineering, Management, and Sustainment (SEMS) team worked with IDPS staff to design an efficient and secure connection between the IDPS and AFWA SAN Initial connectivity pending Certification & Accreditation
approval (ECD Dec 2008) Connectivity required to support NPP system tests planned for
Dec-Jan timeframe and early Spring 2009
F l y - F i g h t - W i n 7
DMZ
Landing
Zone
AFWA CentralStorage
WPMDS
Meteosat-8GOES-E/W
POES, DMSPMTSATMODIS data
MSG Dell front end
boxes
Sun V40zFront end
boxes
Shared
Data
Environment
DATMS-U
KenCastSatellite feeds
Meteosat-7Metop-A
NOAA-18 “blind”
CentralAPPSServer
Emulates IDPS
Emulates NPOESSSecurity Architecture
Infrastructure EnhancementsIngest and Data Storage
F l y - F i g h t - W i n
Infrastructure EnhancementsWeather Data Analysis Program
AFWA’s Weather Data Analysis (WDA) program will ingest, store, and disseminate NPOESS/NPP data Technical challenges
Massive volume of time critical data, integration with existing WDA capabilities, relay of NPP data to Navy Centrals
Requirements to “slice & dice” incoming science data sets, sampling for spatial resolution, and AOI extraction to meet users requests
AFWA’s internal applications will migrate to HDF5 format usage and adjust to the granule based data of NPOESS/NPP
Vendor not yet on contract – becoming critical issue
F l y - F i g h t - W i n 9
6km global cloud analysis MODIS polar orbiting satellite data coverage limits timeliness
of cloud observations
DCF statistical model technique limits risk exposure to non-timely cloud observations
MODIS data latency is 2-5 hours from observation
Direct readout using Mark-Ivb offer possible faster delivery supporting near real-time regional cloud analyis
Land surface backgrounds (e.g. snow/ice and highly reflective desert conditions) negatively affect products
Need to continue updating AFWA land surface characterization capabilities
Data Processing & ApplicationsHigh Resolution Global Cloud Analysis
F l y - F i g h t - W i n
LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html
Data Processing & ApplicationsHigh Resolution Global Cloud Analysis
F l y - F i g h t - W i n 11
https://weather.afwa.af.mil/cgi-bin/aneph_data.cgi
Data Processing & ApplicationsHigh Resolution Regional Cloud Forecasts
F l y - F i g h t - W i n 12
LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html
Data Processing & ApplicationsHigh Resolution Regional Cloud Forecasts
F l y - F i g h t - W i n
Summary
AFWA working aggressively to prepare for NPP/NPOESS Several Infrastructure, data processing, and application
projects underway and planned Leveraging collaborative development via JCSDA for
NPOESS model data assimilation AFWA will play important role in VIIRS Calibration &
Validation (CalVal)
Goal: Achieve initial operational capability (IOC) for NPP-based processing by end of CalVal period
13
F l y - F i g h t - W i n 14
Questions?