Post on 12-Apr-2017
Scripps VisitAl KellieDirector SCDFebruary 1, 2001
OutlineStorage servicesResearch data setsData Access & analysis servicesComputing servicesObservational services (ATD)Over arching rational for leveraging NCAR
Storage ServicesCapacity to 1.8 PBytes (5-silos)301 vs 231 vs 163 TBytesNet growth rate of 5.0 TB/month
8.91 vs 7.26 vs 5.56 Mfiles5,250,000 requests serviced.260 TBytes moved.14 Files lost since 198425 TBytes/month (user read/write)25 TBytes internal transfer per monthMSS WEB enabled maintenance tools.
Current Storage -FTP Model
Future - NFS Model
Mass Storage Services
SCD - SERVICES for SCIENCE
Future MSS Services
File Services
WEB
Data Download
Data Ordering
Remote
MSS Clients
Local
Compute
VisLab
DataProc
WEB Enabled
MSS Services
Archive
Archive
Research Data Sts35 year old collection & stewardshipOcean, Atmosphere, operational analysis and re-analysis all data secured on SCD MSS530 distinct data sets, 14.5 TB, 158K files20% server available16.6 TBytes data sets accessed (1999) up from 5.6TB(1995) 7502 CDROMS of NCEP/NCAR, 46% to US users, rest to 43 different countries
TBytes of Data Provided From the SCD Research Data Archives
Data ManagementStewardship of ocean data is done by a meteorological & oceanographic staffEach dataset is maintained in a standardized system
Metadata, identification of files, software, etc are secure under a change control systemEach dataset has a web page that is automatically generated, and is always current.Information interface WEB/ professional consultation (match data with research requirements)
Staff specialist for each datasetUser guides to different categories of dataWeb search tools
Data AccessRemote users
Data discovery is through a web interfaceData packages provided upon requestStaged to disk for network transfer, e.g. FTPA variety of magnetic tapes and CD-ROMSNCAR facility users
Directly accessible to all computing platformsFile location, metadata, documentation, software, and some data are available online through a web interface All users
Receive consulting from staff specialist as needed
Example of ocean data users guide
Example of remote access to ocean model dataMICOM, Miami Isopycnic Coordinate Ocean Model
Web order interfaceAutomatic processes to stage the data from the MSS and create variable, temporal, and spatial subsetsData selected is staged to a server for FTP pickup
Six year mean 5m T
Data AnalysisLarge Unix systems directly connected to the MSS and dedicated to data analysisSoftware, NCAR Command Language with NCAR Graphics
Ingests many standard formats (netCDF, HDF, GrIB) and any others by user designMany built in computation features, e.g. interpolations, divergences, vorticity, etcMany grid transformations, e.g. gaussian to lat./lon, etcFEATURE: We control the design and do so to support the scientific needsMany software libraries to support optimized computationsInterfaces to visualization facility and support
Community Data PortalPurpose:
Build an infrastructure using different methods for data exploration and deliveryWeb-based retrieval and interactive analysis for MSS collectionsData sharing for multi-institution cooperative studiesBrowse, select, compare, download data sets, & specify data subsets using graphical, text entry, choice of output formatComponents:
User interface, Live Access Server (LAS) Middleware, Ferret, NCL, GrADSFile service, local, or DODSStatus:
Working pilot project datasets and testing the middleware
LAS and Ferret developed by NOAAGrADS developed by Center for Ocean-Land-Atmosphere Studies (COLA)DODS (Distributed Oceanographic Data System) developed by URI
Pilot Data Access/Vis ServerMassiveDataSimulation & RetrospectiveData Collections
FerretNCLOther EnginesDODSCSM, PCM, DSS, MM5, WRF, MICOM, CMIWG
Example Data Analysis
Live Access Server + NCL (Grib Data)
Interface and Reanalysis 2 Sea Level Pressure
Visual Output
NCAR Scientific Computing Division July 2000Copyright 2000 University Corporation for Atmospheric Research
Enabling Distributed and Collaborative Data Access, Analysis, and VisualizationAnalysis &VisualizationServers (dataproc)EnterpriseWeb ServersAccessGridACACIA, ReAnalysis,And COLA Pilot ProjectsNext Generation Visualization LabCommunityData PortalThe Earth SystemGrid ProjectNCAR Scientific Computing DivisionUser
Computational servicesSustained Gflops at NCAR
Chart3
0.251
0.251
0.251
0.251
0.251
0.251
0.251
0.251
0.251
0.251
0.251
0.251
0.251
0.251
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
0.99
2.39
2.2
2.2
2.2
2.2
4.177
4.177
4.177
4.177
4.177
9.529
10.029
11.229
11.229
11.229
12.811
19.851
19.851
19.851
19.851
32.431
32.431
32.577
32.577
67.84
67.84
Sheet1
StartEndEquipmentHost nameSustained GFLOPsSustained GFLOPs (est/real)Peak GFLOPs(Estimated) Efficiency
6/1/626/1/65??CDC 3600-0.0002est'd0.001315%
6/1/656/1/78??CDC 6600 S/N 7-0.0015est'd0.010015%
6/1/655/1/83?CDC 7600 S/N 12-0.0050est'd0.036414%
7/1/779/1/86CRI Cray 1A S/N 3-0.026est'd0.16016%
5/1/835/1/90CRI Cray 1A S/N 14-0.026est'd0.16016%
10/1/865/1/90CRI Cray X-MP/4-0.225est'd0.94124%
6/1/909/1/94CRI Cray Y-MP/2castle0.190est'd0.65629%
6/1/906/1/97CRI Cray Y-MP/8shavano0.800est'd2.66730%
6/1/9412/1/96CRI Cray Y-MP/8Iantero0.800est'd2.66730%
7/1/943/1/97CRI Cray T3D/64-0.600est'd9.5956%
10/1/956/30/00CRI Cray J90/20aztec1.117measured4.00028%
10/1/956/30/00CRI Cray J90/16paiute0.860measured3.20027%
1/1/9711/30/99CRI Cray C90/16antero4.654measured15.61030%
3/1/976/1/99CRI Cray T3D/128-1.100est'd19.1906%
1/1/971/1/01CRI Cray J90se/24ouray1.498measured4.80031%
5/1/975/1/99HP SPP-2000/64sioux2.000est'd46.0804%
3/1/981/1/01CRI Cray J90se/24chipeta1.582measured4.80033%
6/1/981/1/01SGI Origin2000/128ute7.040est'd64.00011%
7/1/994/13/00IBM SP/32 (24) WH-Ibabyblue1.344est'd25.6005%
7/1/995/13/00IBM SP/288 (128) WH-Iblackforest14.336est'd230.4006%
11/1/991/1/01Compaq ES40/32prospect4.800est'd32.00015%
4/13/001/1/01IBM SP/64 (24) WH-IIbabyblue4.320est'd96.0005%
5/13/001/1/01IBM SP/604 (135) WH-IIblackforest48.600est'd906.0005%
Sheet3
DateCDC3600CDC6600CDC7600CRI Cray 1A S/N 3CRI Cray 1A S/N 14CRI Cray X-MP S/N 217CRI Cray-YMP/2CRI Cray YMP/8 (shavano)CRI Cray YMP/8I (antero)CRI Cray T3D/64CRI Cray J90/20 (aztec)CRI Cray J90/16 (paiute)CRI Cray C90/16 (antero)CRI Cray T3D/128CRI Cray J90se/24 (ouray)HP SPP-2000/64 (sioux)CRI Cray J90se/24 (chipeta)SGI Origin2000/128 (ute)IBM SP/32 (babyblue)IBM SP/288 (blackforest)Compaq ES40/32 (prospect)Fudge-itSum Peak GFLOPs on Floor
1/1/770.0000.0100.0360.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.046
4/1/770.0000.0100.0360.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.046
7/1/770.0000.0100.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.206
10/1/770.0000.0100.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.206
1/1/780.0000.0100.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.206
4/1/780.0000.0100.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.206
7/1/780.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
10/1/780.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
1/1/790.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
4/1/790.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
7/1/790.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
10/1/790.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
1/1/800.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
4/1/800.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
7/1/800.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
10/1/800.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
1/1/810.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
4/1/810.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
7/1/810.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
10/1/810.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
1/1/820.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
4/1/820.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
7/1/820.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
10/1/820.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
1/1/830.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
4/1/830.0000.0000.0360.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.196
7/1/830.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
10/1/830.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
1/1/840.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
4/1/840.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
7/1/840.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
10/1/840.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
1/1/850.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
4/1/850.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
7/1/850.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
10/1/850.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
1/1/860.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
4/1/860.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
7/1/860.0000.0000.0000.1600.1600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.320
10/1/860.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
1/1/870.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
4/1/870.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
7/1/870.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
10/1/870.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
1/1/880.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
4/1/880.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
7/1/880.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
10/1/880.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
1/1/890.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
4/1/890.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
7/1/890.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
10/1/890.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
1/1/900.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
4/1/900.0000.0000.0000.0000.1600.9410.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.101
7/1/900.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
10/1/900.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
1/1/910.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
4/1/910.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
7/1/910.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
10/1/910.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
1/1/920.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
4/1/920.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
7/1/920.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
10/1/920.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
1/1/930.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
4/1/930.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
7/1/930.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
10/1/930.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
1/1/940.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
4/1/940.0000.0000.0000.0000.0000.0000.6562.6670.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0003.322
7/1/940.0000.0000.0000.0000.0000.0000.6562.6672.6679.5950.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00015.584
10/1/940.0000.0000.0000.0000.0000.0000.0002.6672.6679.5950.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00014.929
1/1/950.0000.0000.0000.0000.0000.0000.0002.6672.6679.5950.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00014.929
4/1/950.0000.0000.0000.0000.0000.0000.0002.6672.6679.5950.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00014.929
7/1/950.0000.0000.0000.0000.0000.0000.0002.6672.6679.5950.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00014.929
10/1/950.0000.0000.0000.0000.0000.0000.0002.6672.6679.5954.0003.2000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00022.129
1/1/960.0000.0000.0000.0000.0000.0000.0002.6672.6679.5954.0003.2000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00022.129
4/1/960.0000.0000.0000.0000.0000.0000.0002.6672.6679.5954.0003.2000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00022.129
7/1/960.0000.0000.0000.0000.0000.0000.0002.6672.6679.5954.0003.2000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00022.129
10/1/960.0000.0000.0000.0000.0000.0000.0002.6672.6679.5954.0003.2000.0000.0000.0000.0000.0000.0000.0000.0000.0000.00022.129
1/1/970.0000.0000.0000.0000.0000.0000.0002.6670.0009.5954.0003.20015.6100.0004.8000.0000.0000.0000.0000.0000.0000.00039.872
4/1/970.0000.0000.0000.0000.0000.0000.0002.6670.0000.0004.0003.20015.61019.1904.8000.0000.0000.0000.0000.0000.0000.00049.467
7/1/970.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.61019.1904.80046.0800.0000.0000.0000.0000.0000.00092.880
10/1/970.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.61019.1904.80046.0800.0000.0000.0000.0000.0000.00092.880
1/1/980.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.61019.1904.80046.0800.0000.0000.0000.0000.0000.00092.880
4/1/980.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.61019.1904.80046.0804.8000.0000.0000.0000.0000.00097.680
7/1/980.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.61019.1904.80046.0804.80064.0000.0000.0000.0000.000161.680
10/1/980.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.61019.1904.80046.0804.80064.0000.0000.0000.0000.000161.680
1/1/990.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.61019.1904.80046.0804.80064.0000.0000.0000.0000.000161.680
4/1/990.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.61019.1904.80046.0804.80064.0000.0000.0000.0000.000161.680
7/1/990.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.6100.0004.8000.0004.80064.00025.600230.4000.0000.000352.410
10/1/990.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.20015.6100.0004.8000.0004.80064.00025.600230.4000.0000.000352.410
1/1/000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.2000.0000.0004.8000.0004.80064.00025.600230.40032.0000.000368.800
4/1/000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.0003.2000.0000.0004.8000.0004.80064.00025.600230.40032.0000.000368.800
7/1/000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.8000.0004.80064.000230.400906.00032.0000.0001242.000
10/1/000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.8000.0004.80064.000230.400906.00032.0000.0001242.000
Sheet3
Sheet2
DateCDC3600CDC6600CDC7600CRI Cray 1A S/N 3CRI Cray 1A S/N 14CRI Cray X-MP S/N 217CRI Cray-YMP/2CRI Cray YMP/8 (shavano)CRI Cray YMP/8I (antero)CRI Cray T3D/64CRI Cray J90/20 (aztec)CRI Cray J90/16 (paiute)CRI Cray C90/16 (antero)CRI Cray T3D/128CRI Cray J90se/24 (ouray)HP SPP-2000/64 (sioux)CRI Cray J90se/24 (chipeta)SGI Origin2000/128 (ute)IBM SP/32 (babyblue)IBM SP/280 (blackforest)Compaq ES40/32 (prospect)Fudge-itSum Sustained GFLOPs on Floor
1/1/770.0000.0020.0050.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.007
4/1/770.0000.0020.0050.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.007
7/1/770.0000.0020.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.033
10/1/770.0000.0020.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.033
1/1/780.0000.0020.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.033
4/1/780.0000.0020.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.033
7/1/780.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
10/1/780.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
1/1/790.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
4/1/790.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
7/1/790.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
10/1/790.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
1/1/800.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
4/1/800.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
7/1/800.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
10/1/800.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
1/1/810.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
4/1/810.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
7/1/810.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
10/1/810.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
1/1/820.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
4/1/820.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
7/1/820.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
10/1/820.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
1/1/830.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
4/1/830.0000.0000.0050.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.031
7/1/830.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
10/1/830.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
1/1/840.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
4/1/840.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
7/1/840.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
10/1/840.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
1/1/850.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
4/1/850.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
7/1/850.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
10/1/850.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
1/1/860.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
4/1/860.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
7/1/860.0000.0000.0000.0260.0260.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.052
10/1/860.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
1/1/870.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
4/1/870.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
7/1/870.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
10/1/870.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
1/1/880.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
4/1/880.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
7/1/880.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
10/1/880.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
1/1/890.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
4/1/890.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
7/1/890.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
10/1/890.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
1/1/900.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
4/1/900.0000.0000.0000.0000.0260.2250.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.251
7/1/900.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
10/1/900.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
1/1/910.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
4/1/910.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
7/1/910.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
10/1/910.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
1/1/920.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
4/1/920.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
7/1/920.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
10/1/920.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
1/1/930.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
4/1/930.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
7/1/930.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
10/1/930.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
1/1/940.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
4/1/940.0000.0000.0000.0000.0000.0000.1900.8000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.990
7/1/940.0000.0000.0000.0000.0000.0000.1900.8000.8000.6000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0002.390
10/1/940.0000.0000.0000.0000.0000.0000.0000.8000.8000.6000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0002.200
1/1/950.0000.0000.0000.0000.0000.0000.0000.8000.8000.6000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0002.200
4/1/950.0000.0000.0000.0000.0000.0000.0000.8000.8000.6000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0002.200
7/1/950.0000.0000.0000.0000.0000.0000.0000.8000.8000.6000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0002.200
10/1/950.0000.0000.0000.0000.0000.0000.0000.8000.8000.6001.1170.8600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.177
1/1/960.0000.0000.0000.0000.0000.0000.0000.8000.8000.6001.1170.8600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.177
4/1/960.0000.0000.0000.0000.0000.0000.0000.8000.8000.6001.1170.8600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.177
7/1/960.0000.0000.0000.0000.0000.0000.0000.8000.8000.6001.1170.8600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.177
10/1/960.0000.0000.0000.0000.0000.0000.0000.8000.8000.6001.1170.8600.0000.0000.0000.0000.0000.0000.0000.0000.0000.0004.177
1/1/970.0000.0000.0000.0000.0000.0000.0000.8000.0000.6001.1170.8604.6540.0001.4980.0000.0000.0000.0000.0000.0000.0009.529
4/1/970.0000.0000.0000.0000.0000.0000.0000.8000.0000.0001.1170.8604.6541.1001.4980.0000.0000.0000.0000.0000.0000.00010.029
7/1/970.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6541.1001.4982.0000.0000.0000.0000.0000.0000.00011.229
10/1/970.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6541.1001.4982.0000.0000.0000.0000.0000.0000.00011.229
1/1/980.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6541.1001.4982.0000.0000.0000.0000.0000.0000.00011.229
4/1/980.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6541.1001.4982.0001.5820.0000.0000.0000.0000.00012.811
7/1/980.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6541.1001.4982.0001.5827.0400.0000.0000.0000.00019.851
10/1/980.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6541.1001.4982.0001.5827.0400.0000.0000.0000.00019.851
1/1/990.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6541.1001.4982.0001.5827.0400.0000.0000.0000.00019.851
4/1/990.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6541.1001.4982.0001.5827.0400.0000.0000.0000.00019.851
7/1/990.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6540.0001.4980.0001.5827.0401.34414.3360.0000.00032.431
10/1/990.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8604.6540.0001.4980.0001.5827.0401.34414.3360.0000.00032.431
1/1/000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8600.0000.0001.4980.0001.5827.0401.34414.3364.8000.00032.577
4/1/000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.1170.8600.0000.0001.4980.0001.5827.0401.34414.3364.8000.00032.577
7/1/000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.4980.0001.5827.0404.32048.6004.8000.00067.840
10/1/000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0000.0001.4980.0001.5827.0404.32048.6004.8000.00067.840
Sheet2
Sum Sustained GFLOPs on Floor
Sustained GFLOPs Capacity at NCAR
Utilization
TheoreticalPeakCalculatedPeakActualSustained%UtilizationIBM SP/6681,002.052.932.7663.1%
Compaq ES40/3232.04.81.5131.6%Origin2000/12864.07.045.1769.9%Cray J90se/244.801.491.3691.4%Cray J90se/244.801.581.3791.1%
Experience in Service to Research Operates two distinct research computationl facilities.Climate simulationsUniversity community Governance of SCD resources in the hands of the users - two external allocation committees.Computing leverages a common infrastructure for access, networking, data storage & analysis, research data sets, and support services including software development, and consulting.
Climate Simulation Laboratory (CSL)The CSL is a national, multi-agency, special-use, computing facility for climate system modeling for the U.S. Global Change Research Program (USGCRP). Priority projects that require very large amounts of computer time. CSL resources are available to U.S. individual researchers with a preference for research teams regardless of sponsorship. An inter-agency panel selects the projects that use the CSL. Chair Jim Kinter (COLA)
Community FacilityThe Community Facility is used primarily by university-based NSF grantees and NCAR Scientists. Community resources are allocated evenly between NCAR and the university community. NCAR resources are allocated by the NCAR Director to the various NCAR divisions. University resources are allocated by the SCD Advisory Panel. Open to areas of atmospheric and related sciences. Chair Bert Semtner.
Pie chart from Greg McResearch Areas Supported by SCD
3.psd
Research Areas Supported by SCD
Chart5
0.211
0.0472
0.1781
0.1058
0.0924
0.1119
0.2536
Other includes:Basic Fluid Dyanmics (1.50%)Cloud Physics (3.22%)
All Use of SCD Computing by Area of Scientific Interestthrough September 2000 for Fiscal Year 2000
Climate25.36%
Astrophysics21.10%
Other4.72%
Weather Prediction17.81%
Upper Atmosphere10.58%
Oceanography9.24%
Miscellaneous11.19%
Sheet1
Astrophysics21%
Other5%
Weather Prediction18%
Upper Atmosphere11%
Oceanography9%
Miscellaneous11%
Climate25%
Sheet1
Sheet2
Astrophysics21.10%
Other4.72%
Weather Prediction17.81%
Upper Atmosphere10.58%
Oceanography9.24%
Miscellaneous11.19%
Climate25.36%
Sheet2
0
0
0
0
0
0
0
Other includes:Basic Fluid Dyanmics (1.50%)Cloud Physics (3.22%)
All Use of SCD Computing by Area of Scientific Interestthrough September 2000 for Fiscal Year 2000
Miscellaneous11.19%
Oceanography9.24%
Upper Atmosphere10.58%
Weather Prediction17.81%
Other4.72%
Astrophysics21.10%
Climate25.36%
Sheet3
Computational Services
SCD - SERVICES for SCIENCE
Chart1
100
180
320
570
1020
GFLOPs
Sustained GFLOPs
Required Sustained GFLOPs from this RFP
Sheet1
YearGFLOPsRFP2000 GFLOPs (just a guess now)
20000
2001100
2002180
2003320
2004570
20051020
Sheet1
GFLOPs
Sustained GFLOPs
Required Sustained GFLOPs from this RFP
Sheet2
Sheet3
RISC FFT Performance
17.bin
Spectral Toolkit (STK)Highly optimized spectral transform frameworkFor Scalar microprocessor parallel architecturesMultidimensional real & complex FFT May 2001Spherical Harmonic Transform Sept 01Spectral Element tools Dec 01Design portable, scalable, enabling on virtually any type of computer, limited only by available computer resourcesOptimization details in the frameworkWritten in C, with additional object-based functionality in C++
Recent Accomplishments!From 20 to >70 Gflops sustained400% increase in allocations>100 university projectsIncreased grad student & post docs 250%Small data access accounts to Univ faculty at no chargeDemonstrated >25% efficiency on RISCCommunity Data Portal infrastructure
Other NCAR Resources:AtmosphericTechnologyDivision
ATD wind profiler on the Japanese vessel R/V Mirai; ATD automated balloon launcher on a Canadian ice breaker.
ATD Systems & Services:Shipboard meteorological instrumentationSurface meteorological & flux sensorsStabilized, clutter-mitigated wind profilersGPS Radiosonde systemsDigitization of standard ship radarsHigh-level design & fabrication capabilitiesRemote 3-D design supportAll materials & alloysSurface treatment & corrosion controlFlow modeling & structural analysis
ATD Systems & Services:Airborne delivery of ocean sensor systemsStandard AXBT, AXCTD, SonobuoysSpecial buoy or drifter packagesAirborne remote sensingAerosolsSSTIce extent, ageColorAirborne platforms for user instrumentsSurface salinity (JPL)
ATD Systems & Services:Available to any NSF-supported researcherAvailable at NSF-approved rates to any researcher
ATD systems loading on the NOAA vessel R/V Discoverer
Why engage NCAR?Battle-tested for about > 40 yrsProven itself in demanding Research environmentHigh quality servicesHighly reliableWidely accessible, with high availabilityScalable, delivers high performanceCost-effective
Why engage NCAR?Experienced in supporting researchMaximize investmentEvery 1$ spent in compute equipment requires 2-3$ in supportGovernance of allocation policies managed by the user specific groupsSMPs add-on easily & partition exclusivelyWorkshop & instrumentation capabilities are unique
A Computing CenterA Computing Center is not just a flop-shop, must offer more Convenient AccessibilityManageability of User resourcesUsability overall user experience of the Center
Willed FutureUser Perception of NCAR
PEOPLEVISUAL ANALYSISARCHIVE DATAREAL-TIME DATASIMULATIONS SERVICESUSER
MiddlewareWeb Tools
The EndIn the final analysis, any successful facility means offering users what they value...