2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in...
-
Upload
marjory-melton -
Category
Documents
-
view
217 -
download
4
Transcript of 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in...
![Page 1: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/1.jpg)
2014 ESIP Summer MeetingJuly 8–11, 2014 | Frisco, Colorado
Advancing Scientific Data Support in
ArcGIS
Nawajish Noman
![Page 2: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/2.jpg)
• ArcGIS and Scientific Data
• Ingest and aggregation
• Visualization and Analysis
• Service, Ready-to-Use Maps, Web Applications
• Extending Analytical Capabilities using Python
• OPeNDAP and Future Direction
Outline
![Page 3: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/3.jpg)
ArcGIS
Online Content
and Services
Desktop Web Device
Server
ArcGIS Platform
![Page 4: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/4.jpg)
Scientific Data
• Stored in netCDF, GRIB, and HDF formats
• Multidimensional
• Ocean data
Sea temperature, salinity, ocean current
• Weather data
Temperature, humidity, wind
• Land
Soil moisture, NDVI, land cover
![Page 5: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/5.jpg)
ArcGIS
direct ingest
data management
visualizationanalysis
share
Scientific Data in ArcGIS - Vision
![Page 6: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/6.jpg)
•Directly reads netCDF file using o Make NetCDF Raster Layero Make NetCDF Feature Layero Make NetCDF Table View
•Directly reads HDF and GRIB data as raster
Ingesting Scientific data in ArcGIS
![Page 7: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/7.jpg)
What about Aggregation?
• Create a seamless multi-dimensional cube fromo files representing different regionso files representing different time steps/slices
![Page 8: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/8.jpg)
• Supports netCDF, HDF and GRIBo Spatial Aggregationo Temporal Aggregation o On-the-fly analysis
• Accessible as Map Service
• Accessible as Image Service
• Supports direct ingest
• Eliminates data conversion
• Eliminates data processing
• Improves workflow performance
• Integrates with service oriented architecture
Scientific data support in Mosaic Dataset
![Page 9: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/9.jpg)
Multidimensional Mosaic Datasets
• Raster Types for netCDF, HDF & GRIB
• Define variables when adding Rasters
• Each Row is a 2D Raster with variables and dimension values
• Define on-the-fly processing
• Serve as Multidimensionalo Image Serviceo Map Serviceo WMS
Aggregate (mosaic) spatial, time, and vertical dimensions
![Page 10: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/10.jpg)
Behaves the same as any layer or table • Display
o Same display tools for raster and feature layers will work on multi-dimensional netCDF raster and netCDF feature layers.
• Graphingo Driven by the table just like any other chart.
• Animationo Multi-dimensional data can be animated through time dimension
• Analysis Toolso Will work just like any other raster layer, feature layer, or table. (e.g.
create buffers around netCDF points, reproject rasters, query tables, etc.)
Using Scientific Data in ArcGIS
![Page 11: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/11.jpg)
Multidimensional Mosaic Dataset - Visualization
• Visualize temporal change of a variable
• Visualize a variable at any vertical dimension
• Visualize flow direction and magnitude variables
![Page 12: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/12.jpg)
• New Vector Field renderer for raster o Supports U-V and Magnitude-directiono Dynamic thinningo On-the-fly vector calculation
• Eliminates raster to feature conversion
• Eliminates data processing
• Improves workflow performance
Visualization of Raster as Vectors
![Page 13: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/13.jpg)
• Several hundreds analytical tools available for raster, features, and table
• Temporal Modelingo Looping and iteration in ModelBuilder and Python
Spatial and Temporal Analysis
![Page 14: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/14.jpg)
Modeling with Raster function template (RFT)
• A scientific model = a raster function template
• Windchill = 35.74 + 0.6215T - 35.75(V^0.16) + 0.4275T(V^0.16)
• RFTo Created using o Contains Query, GroupName, Variables
o Set Mosaic dataset propertieso Used during adding raster data
![Page 15: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/15.jpg)
• Map Service (supports WMS)o Makes maps available to the web.
• Image Service (supports WMS)o Provides access to raster data through a web service.
• Geoprocessing Serviceo Exposes the analytic capability of ArcGIS to the web.
• Map Packageo To share complete map documents and the data referenced by the
layer it contains.
• Geoprocessing Packageo To share your geoprocessing workflow.
Sharing / WMS Support (for multi-dimensions)
![Page 16: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/16.jpg)
Publishing a WMS on ArcGIS Server
• Enable WMS capabilities on Service Editor or Manager
![Page 17: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/17.jpg)
Multi-dimensional data support in WMS
• getCapabilities
o Supports time, elevation and other dimensions (e.g. depth)
• getMap
o Returns map for any dimension value
&DIM_<dimensionName>=<value>&
o Supports CURRENT for time dimension
&TIME=CURRENT&
• getFeatureInfo
o Returns information about feature for any dimension value
![Page 18: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/18.jpg)
Multi-dimensional WMS in ArcMap
• Supports WMS layer like any other layer
• Animates a time enabled WMS layer using time-slider
• Slices for any dimension value are accessible with ArcObjectsPublic Sub UpdateWMSServiceLayerDimensionValue() 'UID for wms service layer type Dim pUid As New uid pUid = "{27ABB9EC-7A26-4cf8-8BD4-70EC1D274E17}"
Dim pWMSMapLayer2 As IWMSMapLayer2 'calling a function to find the layer from active dataframe Set pWMSMapLayer2 = GetLayer(pUid, "myWMSLayer")
'setting values to dimensions Dim pDimNameValues As IPropertySet Set pDimNameValues = New PropertySet pDimNameValues.SetProperty "Depth", "500" 'dimension#1 pDimNameValues.SetProperty "T1", "500" 'dimension#2 Set pWMSMapLayer2.DimensionValues = pDimNameValues 'calling a function to redraw the layer RefreshActiveDataFrameEnd Sub
![Page 19: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/19.jpg)
WMS in Dapple Earth Explorer
![Page 20: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/20.jpg)
Multi-dimensional WMS in a Web Application
http://dtc-sci01.esri.com/MultiDimWMSViewer/
Depth
Time
![Page 21: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/21.jpg)
ArcGIS Online
• Curated, authoritative content provided by Esrio Ready To Useo Highly scalableo Global to National
• Authoritative content provided by the communityo Hosted in your ArcGIS Online Organization accounto Hosted on your hardware and shared to ArcGIS Online
> 100 Tb of data> 150 millions maps per day
![Page 22: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/22.jpg)
Ready-to-Use Maps
http://www.arcgis.com/features/maps/index.html
![Page 23: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/23.jpg)
Ready-To-Use Analysis Services
• Esri hosted analysis on Esri hosted datao Simplify job of GIS Professionalso Can be used in models and scripts
just like any other toolo Extend spatial analysis to a
much broader audienceo Available in Desktop or as REST service
Best practices published to the Resource Center
![Page 24: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/24.jpg)
• GLDAS Noah Land Surface Model Outputs
o Evapotranspirationo Soil Moistureo Snow Packo Other
Ready-to-Use Scientific Data Maps
![Page 25: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/25.jpg)
Web Application
![Page 26: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/26.jpg)
Web Application
![Page 27: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/27.jpg)
• netCDF4-python and SciPy are included in 10.3/Pro
Supplemental tools
• OPeNDAP to NetCDF
• Make NetCDF Regular Point Layer
• Make NetCDF Station Point Layer
• Make NetCDF Trajectory Point Layer
• Describe Multidimensional Dataset
• Get Variable Statistics
• Get Variable Statistics Over Dimension
• Multidimensional Zonal Statistics
• Multidimensional Zonal Statistics As Table
http://blogs.esri.com/esri/arcgis/2013/05/24/introducing-the-multidimension-supplemental-tools-2/
Python and Geoprocessing Tools
![Page 28: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/28.jpg)
Create Space-Time Cube & Emerging Hot Spot Analysis
![Page 29: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/29.jpg)
Creating your own tool
![Page 30: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/30.jpg)
OPeNDAP to NetCDF
![Page 31: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/31.jpg)
• Ingest OPeNDAP Service
• Output dynamic multidimensional raster
• Support Sub-setting
Next: Make OPeNDAP Layer
![Page 32: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/32.jpg)
Tell the story of your scientific data – Create Story Maps
http://dtc-sci01.esri.com/DeadZoneStoryMap/
![Page 33: 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.](https://reader038.fdocuments.us/reader038/viewer/2022110207/56649d365503460f94a0dacc/html5/thumbnails/33.jpg)