ArcGIS Hydro Data Model Design principles for the data model Data model components Time series Arc...

ArcGIS Hydro Data Model

• Design principles for the data model

• Data model components

• Time series

• Arc Hydro tools

GIS in Water Resources Consortium

Bringing together these two communities by using a common geospatial data model

http://www.crwr.utexas.edu/giswr

GISWater

Resources

CRWR

Trends During 1990’s• Standardized GIS data sets were produced for

hydrology • Internet became a major conduit for data

distribution• Most US hydrologic models had GIS interfaces

constructed for them• Microsoft COM protocol became a standard (Word,

Powerpoint, Excel, Visual Basic for Applications)• ESRI adopted COM for ArcGIS

Trends during 2000’s

• Relational databases (Access, Oracle,…) will be the standard for data storage

• Geospatial and temporal data for hydrology will be more formally synthesized

• Use of component technologies will blur the line between applications (hydrology-hydraulics-water quality)

• Increasing use of real-time applications

• More use of terrain surfaces e.g. LIDAR

ArcGIS Data Models

• Facilitate a process with the user community• Capture the essential, common data model for each

discipline• Build a database design template that works well with

ArcGIS• Build on experience, not a standards exercise• Share the model on ArcOnlinehttp://arconline.esri.com/arconline/datamodels.cfm

Essential Data Model

Organization AOrganization B

Organization D

Organization C

SomethingSomethingin commonin common

The data model for a business organization tends not to change greatly over time unless the business organization changes the fundamental way that it does business

Model Definition

• Develop a data model to support Hydrology and Hydrography

• Link the vector and raster worlds• Understand producer and consumer needs• Exercise with real data to validate the model • Use a geometric network for faster tracing

and data quality validation

Evolution of the Model

• Hands-on experience was key to evolution

• We have somehow struggled through the process and found new ways of managing Hydro Data– Consistent structure

– Varying detail

– Multi-purpose

– Common tools and techniques (Patterns)

• You will hear interest and excitement about this in the presentations today

Acknowledgements

• CRWR – ESRI team

• BYU, CDM, DHI, Dodson, EPA, HEC, LCRA, NHD, TNRCC, TWDB, USGS

• Many individuals in academia, government and industry

Many people and organizations have contributed to the development of Arc Hydro. We thank you!!


Hydrography Hydrology


Flow

Time

Time Series

Hydrography

Network

Channel

Drainage

HydroFeatures

Data Model Based on Inventory

NHD Points

Gages

NHD Areas

NHD Lines

Dams

Bridges

Make an inventory of all features of a given type in the region

What is it?Where is it?

Data Model Based on BehaviorFollow a drop of water from where it falls on the land, to the stream, and all the way to the ocean.

Integrating Data Inventory using a Behavioral Model

Relationships betweenobjects linked by tracing pathof water movement

Types of Classes

ESRI ArcObject classes (colored grey) are genericobject classes provided with the ArcGIS software.All ArcGIS Hydro classes inherit from one of theseclasses (Object, Feature, Network Feature).

An Abstract class (Class Name in italics) is a classwhich stores common attributes shared by theclasses inheriting from it. It does not have objects ofits own.

An Object class (colored white) is a classrepresented as a Table in which each object has anObjectID and Attributes.

ArcGIS Hydro Data Modelhttp://www.crwr.utexas.edu/giswr

Hydrography Channel

How to readthis diagram

Inheritance

Association 1..* Multiplicity

ESRI ArcObject Class

1

Abstract Class

Subtype

Attributes

Feature Class

Attributes

Time Series

Flow

Time

Flow

GIS in Water ResourcesConsortium

CRWRCRWRCRWR

Network

DrainagePoint

JunctionID

DrainageArea

AreaSqKmJunctionIDNextDownID

1Drainage

DrainageFeature

DrainID

Catchment BasinWatershed

DrainageLine

ComplexEdgeFeature

HydroJunction

SimpleJunctionFeature

HydroIDHydroCodeNextDownIDLengthDownDrainAreaFTypeEnabledAncillaryRole

EdgeType

1

Flowline

Shoreline

HydroEdge

HydroIDHydroCodeReachCodeNameLengthKmLengthDownFlowDirFTypeEdgeTypeEnabled

HydroPointEvent

Measure

HydroLineEvent

FMeasureTMeasureOffset

TimeSeries

Object

FeatureIDTSTypeTSDateTimeTSValue

HydroEvent

ReachCode

Object

CrossSection

CSCodeJunctionIDCSOriginProfileM

Object

ChannelFeature

ReachCodeRiverCode

CrossSectionPoint

CSCodeCrossMElevation

1

1..*

1

Types of Classes

A Feature class (colored blue) is an object classthat has spatial coordinates (Point, Line Area).

A Network Feature class (colored blue) is afeature class that has connectivity betweenJunctions (points) and Edges (lines).

A Coded Value Domain is an attribute combininga numerical code with a text label. It is used forType attributes.

A Class Subtype (blue and white pattern ) is aseparate class defined by a Coded Value Domaintype attribute.

Types of Relationships

Inheritance (indicated by a triangle) means that theclasses below inherit the properties and methods ofthe classes above them in the class hierarchy.

Association (indicated by a blue line) links objects intwo classes using common values of key attributefields stored in both classes.

Multiplicity specifies how many objects can beassociated with another object in an Association.

1 One and only one.

1..* From one to any positive integer.

Attributes of Hydro Features

HydroID is an integer identifier for hydro featureswhich is unique within the geodatabase

HydroCode is a string identifier for hydro featureswhich is their permanent public identifier

JunctionID is the HydroID of an associatedHydroJunction. This junction is the outlet location forDrainage Areas and Waterbodies

FeatureID is the HydroID of an associated hydrofeature.

NextDownID is the HydroID of the next downstreamfeature in this class

Feature

1Structure

MonitoringPoint

WaterWithdrawal

Bridge

Dam UserPoint

WaterDischarge

HydroResponseUnit

AreaSqKm

HydroPoint

JunctionID

HydroLine HydroArea

Waterbody

AreaSqKmJunctionID

FTypeProfOrigin

ProfileLine

Components

All features in the model are Hydro Features.

Hydrography features are the blue lines on maps,and point features from tabular data inventories

Drainage features define the drainage areas of thelandscape.

Network features describe the connectivity of waterflow through the landscape

Channel features provide a 3-dimensional view ofchannel shape.

Time Series store time varying data about the waterproperties of any feature

Feature Class

Attributes

Object Class

Attributes

Hydrography

FTypeName

HydroFeature

HydroIDHydroCode

HydroFeature

HydroIDHydroCode

HydroFeature

HydroIDHydroCode

HydroFeature

HydroIDHydroCode

SchematicNode

FeatureID

SchematicLink

FromNodeToNode

http://arconline.esri.com/arconline/datamodels/water.cfm

Arc Hydro Implementation

Geodatabase

Feature Dataset

Feature Class

Geometric Network

Object Class

Relationship

Workspace

Arc Hydro Design Principles• Classification

– Partitioning, typing, and naming of classes

• Attribution– Feature description, including time series

• Association– Relating features using key attributes

• Navigation– Following water movement from feature to

feature

Classification• Partitioning

– Like features are grouped into components (Network, Drainage, …)

• Typing – Object, Feature, Network feature

• Naming– Common names if possible, defined by a

glossary

Classification Hierarchy1. Text descriptor e.g.

FType2. Coded Value Domain

e.g. FDir3. Subtypes – separate

classes with same attributes e.g. HydroEdge

4. Subclasses - separate classes with different attributes e.g. HydroPoint

• FType = “Stream/River”

• 1 = “WithDigitized”, 2 =“AgainstDigitized”,..

• EdgeType = 1 for Flowline, = 2 for Shoreline

• Dam, Bridge, Monitoring Point, …

Light

Heavy

Two-Way Classification:FTypes of Subtypes

• EdgeType = 1 FlowLine

• FType =– “Stream/River”

– “Canal/Ditch”

– “Pipeline”

– “Connector”

– “Waterbody FlowLine”

• EdgeType = 2 Shoreline

• FType =– “Bankline”

– “Shoreline”

– “Coastline”

Attribution• Minimal attribution in the model

– Assume user will add more

• Attribute Names are all 10 characters or less so they are not truncated when exported to Shapefiles

• Standard conventions– ID is a long integer

– Code is a string

Hydro Features

• Every Arc Hydro feature is a Hydro Feature with a HydroID and HydroCode

• HydroID = Class Number + ObjectID e.g. 12000013 is object 13 in class 12 (unique within a geodatabase)

• HydroCode = HydroID + Geodatabase name e.g. Mybasin12000013 (unique within a set of geodatabases)

Association

• An association is established using key fields in two separate tables – Can build relationship if necessary

• Hydro Assocation – HydroID of one class is an attribute of another class– JunctionID (Drainage Outlets)

– FeatureID (Time Series)

– NextDownID (Downstream feature)

Navigation• Navigation means tracing the movement

of water downstream or upstream– Dendritic Navigation – using NextDownID

within a single feature class– Network Navigation – using Network

Analyst tracing tools on Hydro Network– Schematic Navigation – using

SchematicLink and SchematicNodes to connect features in several classes

National Hydro Data Programshttp://www.crwr.utexas.edu/giswr/nhdconf/nationalhydro.html

National Elevation Dataset (NED)

National Hydrography Dataset(NHD)

Watershed Boundary DatasetElevation Derivatives for

National Applications (EDNA)

How do we combine these data?

Digital ElevationModels

Watersheds Streams Waterbodies

An integrated raster-vector

database

AB

? ?

Where Does the Raindrop Go?

Dale Honeycutt’s concept, May 2000

AB

Water Flows from an Area to a Line

Problems with this: • Areas and lines are not always consistent with one another. • Sometimes many lines within one area.

AB

How to Connect Areas to the Hydro Network?

Outlet Points

Areas connectto lines at points

Regardless of where the drop falls in the area, its runoff is on the network at the outlet point

Area to Stream Outlet Connectivity

ArcHydro and ArcFM Water

• ArcFM Water– Water

Infrastructure

– Water distribution

– Wastewater collection

– Storm sewers

• Arc Hydro– Natural water

system

– Catchments drain to storm sewer inlets

– Storm sewers discharge to streams

Area to Sewer InletConnectivity

Schema

• A schema is the structure or design of a database.

• A schema specifies the feature and object classes -- including their attributes and relationships -- of the geodatabase.

Repository

• A repository is database that contains the schema information needed to create a geodatabase from a UML model created using a CASE tool.




• Time series

• Arc Hydro tools

Types of Classes

ESRI ArcObject classes (colored grey) are genericobject classes provided with the ArcGIS software.All ArcGIS Hydro classes inherit from one of theseclasses (Object, Feature, Network Feature).

An Abstract class (Class Name in italics) is a classwhich stores common attributes shared by theclasses inheriting from it. It does not have objects ofits own.

An Object class (colored white) is a classrepresented as a Table in which each object has anObjectID and Attributes.

ArcGIS Hydro Data Modelhttp://www.crwr.utexas.edu/giswr

Hydrography Channel

How to readthis diagram

Inheritance

Association 1..* Multiplicity

ESRI ArcObject Class

1

Abstract Class

Subtype

Attributes

Feature Class

Attributes

Time Series

Flow

Time

Flow

GIS in Water ResourcesConsortium

CRWRCRWRCRWR

Network

DrainagePoint

JunctionID

DrainageArea


1Drainage

DrainageFeature

DrainID


DrainageLine

ComplexEdgeFeature

HydroJunction



EdgeType

1

Flowline

Shoreline

HydroEdge


HydroPointEvent

Measure

HydroLineEvent


TimeSeries

Object

FeatureIDTSTypeTSDateTimeTSValue

HydroEvent

ReachCode

Object

CrossSection


Object

ChannelFeature

ReachCodeRiverCode

CrossSectionPoint


1

1..*

1

Types of Classes

A Feature class (colored blue) is an object classthat has spatial coordinates (Point, Line Area).

A Network Feature class (colored blue) is afeature class that has connectivity betweenJunctions (points) and Edges (lines).

A Coded Value Domain is an attribute combininga numerical code with a text label. It is used forType attributes.

A Class Subtype (blue and white pattern ) is aseparate class defined by a Coded Value Domaintype attribute.

Types of Relationships

Inheritance (indicated by a triangle) means that theclasses below inherit the properties and methods ofthe classes above them in the class hierarchy.

Association (indicated by a blue line) links objects intwo classes using common values of key attributefields stored in both classes.

Multiplicity specifies how many objects can beassociated with another object in an Association.

1 One and only one.

1..* From one to any positive integer.

Attributes of Hydro Features

HydroID is an integer identifier for hydro featureswhich is unique within the geodatabase

HydroCode is a string identifier for hydro featureswhich is their permanent public identifier

JunctionID is the HydroID of an associatedHydroJunction. This junction is the outlet location forDrainage Areas and Waterbodies

FeatureID is the HydroID of an associated hydrofeature.

NextDownID is the HydroID of the next downstreamfeature in this class

Feature

1Structure

MonitoringPoint

WaterWithdrawal

Bridge

Dam UserPoint

WaterDischarge

HydroResponseUnit

AreaSqKm

HydroPoint

JunctionID

HydroLine HydroArea

Waterbody

AreaSqKmJunctionID

FTypeProfOrigin

ProfileLine

Components

All features in the model are Hydro Features.

Hydrography features are the blue lines on maps,and point features from tabular data inventories

Drainage features define the drainage areas of thelandscape.

Network features describe the connectivity of waterflow through the landscape

Channel features provide a 3-dimensional view ofchannel shape.

Time Series store time varying data about the waterproperties of any feature

Feature Class

Attributes

Object Class

Attributes

Hydrography

FTypeName

HydroFeature

HydroIDHydroCode

HydroFeature

HydroIDHydroCode

HydroFeature

HydroIDHydroCode

HydroFeature

HydroIDHydroCode

SchematicNode

FeatureID

SchematicLink

FromNodeToNode

http://arconline.esri.com/arconline/datamodels/water.cfm

Arc Hydro Implementation

Geodatabase

Feature Dataset

Feature Class

Geometric Network

Object Class

Relationship

Workspace

GIS in Water Resources ConsortiumArcGIS Hydro Data Model

CRWRCRWRCRWR

NetworkComplexEdgeFeature

HydroJunction



EdgeType

Flowline

Shoreline

HydroEdge


HydroPointEvent

Measure

HydroLineEvent


HydroEvent

ReachCode

Object

HydroFeature

HydroIDHydroCode

SchematicNode

FeatureID

SchematicLink

FromNodeToNode

Example - Holland


CRWRCRWRCRWR

Hydrography Feature

Structure

MonitoringPoint

WaterWithdrawal

Bridge

Dam UserPoint

WaterDischarge

HydroResponseUnit

AreaSqKm

HydroPoint

JunctionID

HydroLine HydroArea

Waterbody

AreaSqKmJunctionID

Hydrography

FTypeName

HydroFeature

HydroIDHydroCode

River networksfor 8-digit HUC watersheds


CRWRCRWRCRWR

Hydrography Feature

Structure

MonitoringPoint

WaterWithdrawal

Bridge

Dam UserPoint

WaterDischarge

HydroResponseUnit

AreaSqKm

HydroPoint

JunctionID

HydroLine HydroArea

Waterbody

AreaSqKmJunctionID

Hydrography

FTypeName

HydroFeature

HydroIDHydroCode


CRWRCRWRCRWR

Drainage

DrainagePoint

JunctionID

DrainageArea


DrainageFeature

DrainID


DrainageLine

HydroFeature

HydroIDHydroCode

Watersheds of the US

2-digit water resource regions 8-digit HUC watersheds

Watershed Hierarchy

8 HUC

4

2

6

EDNA

1012

Available In Progress

Digit #

Watershed Boundary Dataset

• National Program by USGS and USDA (NRCS)

• Boundaries for 10- and 12- digit watersheds

• First cut is by automated delineation from NED

• Hand checked and edited

10-digit watersheds

• National program by USGS and NWS

• 5000 cell threshold on a 30m DEM (~ 8 km2 average drainage area)

• ~ 1 million catchments for US when completed

• Includes grid derived products e.g. topmodel index

Elevation Derivatives for National Applications (EDNA

Area to Area Connectivity: SchematicLinks built using

NextDownID


CRWRCRWRCRWR

Channel

CrossSection


Object

ChannelFeature

ReachCodeRiverCode

CrossSectionPoint


1

1..*

FTypeProfOrigin

ProfileLine

HydroFeature

HydroIDHydroCode

&&

&&&&&&&&&& &&&&&

&&

&&

&&&&

àÞ

&&&&&&&&&&&&

&&

&

#*#*#*#*

#*#*#*

#*#*#*

#*#*#*#*#*#*#*#* #*#*#*

#*#*#*

#*

#*#*

#*#*#*

#*

#*#*#*

#*#*#*#*

#*

#* #*

#*#*#*#*#* #*#*

#*

#*

#*

#*#*

#*

#*#*#* #* #* #*#*

#*#*

DrainageDrainageLine

& DrainagePoint

Watershed

HydrographyHydroLine

àÞ MonitoringPoint

& Structure

Waterbody

Network

HydroJunction

HydroEdge

SchematicLink

#* SchematicNode

Channel

<all other values>

FType

LeftBank

RightBank

Thalweg

CrossSection

Pecan Bayou: Flood Hydrology and Hydraulics Studyby David Anderson (CRWR)

David Anderson, 2000

Pecan Bayou: Data Development Process

TerrainModel

CRWR-PrePro

HEC-HMS

HEC-GeoRAS

HEC-RAS

FloodplainTerrain Model

Hydrology& Hydraulics

3-D Polyline Z Measure (m) and Elevation (z)

Values on Cross Sections

Channel Geometry using Arc Scene

Build a TriangulatedIrregular Network

(TIN)

Begin with ContoursExtract ProfileLines

and CrossSections

Demo




• Time series

• Arc Hydro tools

Time Series Objectives

• Store Metadata about each collection of time series values– What is measured– What units are used

• Display and store Time Series Views– Rainfall for Gage 1001010– All data between years 2000 and 2001

Time Series Classes

TimeSeries Attributes

• FeatureID – ID of spatial feature

• TSTypeID – Identifies TS properties

• TSDateTime - Timestamp

• TSValue - Value

• TSDesc – Property of particular record

TimeSeries ExampleFeatureID TSTypeID TSDateTime TSValue TSDesc

3000001 1 4/3/1976 13:00 697.33000001 1 4/3/1976 19:00 697.33000001 1 4/3/1976 23:48 697.43000001 1 4/4/1976 4:07 697.61000001 2 4/3/1976 13:00 32.31000001 2 4/3/1976 19:00 35.72000001 4 9/1/2001 0.52000001 4 9/2/2001 12000001 4 9/3/2001 1.12000001 4 9/4/2001 1.31000002 2 4/3/1976 13:00 108.91000002 2 4/3/1976 19:00 108.91000002 2 4/4/1976 1:00 115.7 IT1000002 2 4/4/1976 7:00 125.2

TSTypeInfo Attributes

• TSTypeID – Identifies a set of TS properties• Variable – What is being measured or recorded• Units – The units that the data values are in• IsRegular – Values spaced at regular or irregular

time intervals• TSInterval – Time interval between values (if

regular)• DataType – The type of time series data• Origin – Values recorded or generated

More on DateType

• Inst-Value

• Inst-Cumulative

• Step-Cumulative

• Step-Average

• Step-Maximum

• Step-Minimum

TSTypeInfo ExampleTSTypeID Variable Units IsRegular TSInterval DataType Origin

1 Stage ft - MSL FALSE Inst-Value Recorded2 Streamflow cfs TRUE 6Hour Inst-Value Recorded4 Rainfall in TRUE 6Hour Inst-Cumulative Recorded

FeatureID TSTypeID TSDateTime TSValue Descriptor3000001 1 4/3/1976 13:00 697.33000001 1 4/3/1976 19:00 697.33000001 1 4/3/1976 23:48 697.43000001 1 4/4/1976 4:07 697.61000001 2 4/3/1976 13:00 32.31000001 2 4/3/1976 19:00 35.72000001 4 9/1/2001 0.52000001 4 9/2/2001 12000001 4 9/3/2001 1.12000001 4 9/4/2001 1.31000002 2 4/3/1976 13:00 108.91000002 2 4/3/1976 19:00 108.91000002 2 4/4/1976 1:00 115.7 IT1000002 2 4/4/1976 7:00 125.2

Time Series Views

• Use Query Builder in ArcGIS– Save

– Load

• Provides Selective Views of Entire TS Table• Requires no extra functionality

Connecting to Time Series

HydroID

CrossSectionHydroPoint

DrainagePoint Junction

TimeSeries

Time

Flow

FeatureID of time seriesis HydroID of feature thetime series describes

FeatureID

National Water Information System (NWIS)http://water.usgs.gov

Web access to USGS water resources data in real time




• Time series

• Arc Hydro tools

Arc Hydro Tools

• Code development being done jointly by ESRI and CRWR

• Uses a standardized application framework for VB tools in ArcGIS

• Fills in standard attributes in Arc Hydro data model

• Will be published on GISWR web page and freely available

Application Framework

• Tool for developers

• Eases routine ArcGIS programming tasks

• Provides standard look and feel to applications

Anatomy of Code

Streamlining Routine Tasks

Vs.

User-Interface Capabilities

• Handles Basic Input/Output

• Reduces development time by up to 50%

• Provides a standard look and feel across different applications

Tool Updates

• “Repaired” NWIS tool (released)

• Improved accuracy of NextDownstream Tool (development)

• Added “Shortest Path to Sink” algorithm to LengthDownstream tool (development)

• Exercise on ArcHydroLite being presented in class next week.

Overview

• Introduction

• Conceptual Framework

• Subtyping of Time series

• Properties of Time series class

• Applications

Arc Hydro NWIS Application

• Custom Tool Retrieves NWIS Data

• Time Series Table Built Automatically

• Operates Within ArcMap GUI

Demo


Flow

Time

Time Series

Hydrography

Network

Channel

Drainage

HydroFeatures

Open Architecture for Water Modeling

ProcessEngines

Interface 4Custom Designed

Interface 1ArcGIS

Interface 2Excel

Interface 3Hydrologic Model

Temporal DataGeospatial data

ArcGIS Interface to ModelLibHydro:An HEC-1subroutinelibrary convertedto a .dll

Interface written using VBA for ArcGIS

Excel Interface to Model

Interfaceconstructedusing VBA forExcel

Hydrologic Model

Hydrologic modelconstructed using with a Visual Basicinterface callsArcObjects toaccess Arc Hydrodata

Custom Interface e.g. Basins

Custom Interface(for several hydrologic models)

TIWSSTexas Integrated Water Simulation System

Arc Hydro

Geospatial and Temporal Data

HEC ModelsFlooding & Water Management

ModflowGroundwater

SWATWater Quality

WRAPWater Availability

ArcGIS Hydro Data Model Design principles for the data model Data model components Time series Arc...

Documents

Transcript of ArcGIS Hydro Data Model Design principles for the data model Data model components Time series Arc...