GIS Enterprise ArchitectureGIS Enterprise Architecture

Danny Luong

Division of Technology Services

Enterprise GIS Manager November 19, 2009

California Department of Water Resources

22

Enterprise GIS Technology & Trends:Enterprise GIS Technology & Trends:

Server Virtualization w/ Blade Technology & Benefits (VMWare Server Virtualization w/ Blade Technology & Benefits (VMWare ESX)ESX)

VDI (Virtual Desktop Infrastructure) VDI (Virtual Desktop Infrastructure)

Clustering (Hardware, EMC SAN Storage, memory, etc) as Clustering (Hardware, EMC SAN Storage, memory, etc) as neededneeded

Service Oriented Architecture (SOA) & Identity ManagementService Oriented Architecture (SOA) & Identity Management

Active Directory/LDAP/Virtual Directory user authenticationActive Directory/LDAP/Virtual Directory user authentication

VMWare High-Availability/Fault-Tolerant VMWare High-Availability/Fault-Tolerant

Load Balancing Load Balancing

Client Web Interface (Flex, Silver Light, Java Script APIs) orClient Web Interface (Flex, Silver Light, Java Script APIs) or Web ADF (Java or .NET)Web ADF (Java or .NET)

3 Day Design Workshop / User Requirements:3 Day Design Workshop / User Requirements:

We anticipate approximately:We anticipate approximately:

• 100 internal users accessing our ArcGIS Server, Image 100 internal users accessing our ArcGIS Server, Image Server, SDE/Oracle 11g using ArcGIS Desktop 9.3, Third Server, SDE/Oracle 11g using ArcGIS Desktop 9.3, Third party (Microstation, Autocad, etc)party (Microstation, Autocad, etc)

• 50 external users using Mobile devices (Trimble Unit) & 50 external users using Mobile devices (Trimble Unit) & Customized Web InterfaceCustomized Web Interface

• 10 external users authenticating to internal network10 external users authenticating to internal network

• Estimated Growth in 2010 and 2011Estimated Growth in 2010 and 2011– Desktop (25%) and Web (40%)Desktop (25%) and Web (40%)

33

Geodatabase Design StrategyGeodatabase Design Strategy

• Versioning? Versioning? YesYes

• Vector? Vector? YesYes

• Raster? Raster? Yes, including Image ServiceYes, including Image Service

• Multiple or Single Geodatabase(s)? Multiple or Single Geodatabase(s)? 1 Instance 9 Multiple1 Instance 9 Multiple GeodatabasesGeodatabases

• Replication Strategy? Replication Strategy? YesYes

44

Storage RequirementsStorage Requirements

• Analysis Needed on How Much for GISAnalysis Needed on How Much for GIS Storage/Mirror/Backup/Offline Storage/Mirror/Backup/Offline

• Analysis Needed on How Much StorageAnalysis Needed on How Much Storage Needed for Vector and Raster Storage Needed for Vector and Raster Storage

• What Type of Storage System is Available?What Type of Storage System is Available?– SANSAN– Direct AttachDirect Attach– NASNAS

55

ArcSDEArcSDE Direct Connect Direct Connect VS Application ConnectVS Application Connect

• Direct Connect Provides Best PerformanceDirect Connect Provides Best Performance

• Works with Active DirectoryWorks with Active Directory

• ArcSDE Application Server Has Had No Development ArcSDE Application Server Has Had No Development Since Version 9.2Since Version 9.2

• Direct Connect is ESRI DirectionDirect Connect is ESRI Direction

• Allows Re-using of Current ArcSDE ServersAllows Re-using of Current ArcSDE Servers

66

User WorkflowsUser Workflows(Information Products)(Information Products)

• Users Types (Desktop and Web or Mobile)Users Types (Desktop and Web or Mobile)

• User WorkflowsUser Workflows

• Simple MappingSimple Mapping

• EditingEditing

• GeocodingGeocoding

• GeoprocessingGeoprocessing

• Batch Processes (Done off-hours, Nightly)Batch Processes (Done off-hours, Nightly)

• Interfaces to Other Applications/DatabasesInterfaces to Other Applications/Databases

• Geodatabase ReplicationGeodatabase Replication

• VersioningVersioning

• EDN, Production, Publishing, TestingEDN, Production, Publishing, Testing77

Consuming ServicesConsuming Services

• Map ServiceMap Service– MSDMSD

• GeocodeGeocode• Geodata ServiceGeodata Service

– Simple EditingSimple Editing

• Geoprocessing ServiceGeoprocessing Service– TasksTasks

• Globe ServiceGlobe Service• Imager ServiceImager Service• KML ServiceKML Service• OGC ServicesOGC Services• Caching ServicesCaching Services

88

Expanding Deployment OptionsExpanding Deployment OptionsOGC Standards via ArcGIS 9.3.1OGC Standards via ArcGIS 9.3.1

• Web Feature Service (WFS)Web Feature Service (WFS)– Provide feature dataProvide feature data

• Manipulation/analysis of data on clientManipulation/analysis of data on client

• Web Feature Service Transaction (WFS-T)Web Feature Service Transaction (WFS-T)– Simple transaction updates Simple transaction updates

• Session-less redliningSession-less redlining

• Web Mapping Service (WMS)Web Mapping Service (WMS)– Provide an ImageProvide an Image

• Different styles can be requested via SLDDifferent styles can be requested via SLD

• Web Coverage Service (WCS)Web Coverage Service (WCS)– Provide CoverageProvide Coverage

• Can be consumed for analysis by GeoprocessingCan be consumed for analysis by Geoprocessing

• Keyhole Markup Language (KML)Keyhole Markup Language (KML)– Google Earth/Maps compatibilityGoogle Earth/Maps compatibility

• Catalogue Service – Web (CS-W)Catalogue Service – Web (CS-W)– MetadataMetadata

UC2008 Technical WorkshopUC2008 Technical Workshop 99

ESRI Performance Tools:ESRI Performance Tools:

Capacity Planning Tool & MXDPerfStatCapacity Planning Tool & MXDPerfStat

1010

Template

Why is Enterprise System Architecture Why is Enterprise System Architecture design Important?design Important?Performance ChainPerformance Chain

1111

Reduce Cost

System Architecture Design

Improve Productivity

Balanced System Design

Servers Network DBMS Geodatabase

Storage Clients ArcSDE Application

Hardware Infrastructure

Framework for Productive Operations

Database Design User Workflow

Performance, Scalability, Flexibility, Reusable, interoperable

Expanding Deployment OptionsExpanding Deployment OptionsAPI’s - Enabling Mashup SupportAPI’s - Enabling Mashup Support

UC2008 Technical WorkshopUC2008 Technical Workshop 1212

VDI Deployment PatternsVDI Deployment PatternsEnterprise - CentralizedEnterprise - Centralized

J8338J8338

NorthernRegion

User

Data Center

Application Data

VDI

Oracle/ArcSDE

Thin/Thick Client Connections

Central Region

User

Thin /Thick Client Connections

South Central Region

User

Thin/Thick ClientConnections

Southern Region

User

Thin/Thick ClientConnections

WHY CONSOLIDATE?•Reduced hardware cost•Reduced administration cost•Lower implementation risk•Reduce infrastructure needed in DC (power, cooling, BK, etc)•Improved data access•Improved security•Reduced network traffic• “Greener datacenter”

WHY CONSOLIDATE?•Reduced hardware cost•Reduced administration cost•Lower implementation risk•Reduce infrastructure needed in DC (power, cooling, BK, etc)•Improved data access•Improved security•Reduced network traffic• “Greener datacenter”

Application Pattern

GIS Services

Data Sources

Desktop Web Mobile

Silverlight Flex

Rest

Map Service

MSD MXD

Map Cache

Dynamic BlendedCached

Java ADF .NET ADF

Soap

ImagesPGDB FGDB DB2 PostgresSQLOracle InformixMS Access

Data Types

User

JavaScript

Example One GIS Service (Map Only) x 16 Services

ESRI Servers 9.3.1 (VMWare, Blade System)ESRI Servers 9.3.1 (VMWare, Blade System)

1515

ArcGIS Server:- Make: Dell- Model: 2950- Type of CPU: Intel Xeon CPU E5440@3.0GHz – 4 Core- Disk (RAID, SAN, etc): local storage- OS with exact version & service pack: Windows Server 2003 R2 Enterprise Edition with SP2- Network adapter(s) & speed: Broadcom BCM5708C netXtreme II – 1 Gbps SDE Server:- Make: Dell- Model: 2950- Type of CPU: Intel Xeon CPU E5440@3.0GHz – 4 Core- Disk (RAID, SAN, etc): local storage- OS with exact version & service pack: Windows Server 2003 R2 Enterprise Edition with SP2- Network adapter(s) & speed: Broadcom BCM5708C netXtreme II – 1 Gbps

ESRI Servers 9.3.1 (VMWare, Blade System)ESRI Servers 9.3.1 (VMWare, Blade System)

1616

Image Server:- Make: Dell- Model: 2950- Type of CPU: Intel Xeon CPU E5440@3.0GHz – 4 Core- Disk (RAID, SAN, etc):  local storage and SAN- OS with exact version & service pack: Windows Server 2003 R2 Enterprise Edition with SP2-  Network adapter(s) & speed: Broadcom BCM5708C netXtreme II – 1 Gbps Database Server:- Make: Dell- Model: 2950- Type of CPU: Intel Xeon CPU E5440@3.0Ghz – 4 Core- Disk (RAID, SAN, etc): local Storage and SAN- OS with exact version & service pack: Redhat Enterprise Edition 5.3- Network adapter(s) & speed: Broadcom BCM5708C netXtreme II – 1 Gbps- Database: Oracle 11g

Database RecommendationsDatabase Recommendations

• 1 Oracle 11g Instance1 Oracle 11g Instance• 7 User Geodatabases7 User Geodatabases• High-Availability/Fault-ToleranceHigh-Availability/Fault-Tolerance

– PublicationPublication– ProductionProduction

• Inherit Characteristics of Existing GeodatabasesInherit Characteristics of Existing Geodatabases• ESRI Provide Oracle Configuration RecommendationsESRI Provide Oracle Configuration Recommendations• Geodatabase Requirements (Tablespaces, etc)Geodatabase Requirements (Tablespaces, etc)

– Come from Existing ImplementationsCome from Existing Implementations

• ESRI Provide Tools for Oracle Performance TuningESRI Provide Tools for Oracle Performance Tuning

1717

Network RecommendationsNetwork Recommendations

• Remote Desktop UsersRemote Desktop Users– WTSWTS– VDIVDI– CitrixCitrix

• Test and MonitorTest and Monitor– Define Real Network ImpactDefine Real Network Impact

• DS3 ImplementationDS3 Implementation

1818

Storage RecommendationsStorage Recommendations

• Utilize 2 SANs Storage SpecificationsUtilize 2 SANs Storage Specifications– Production (2 TB)Production (2 TB)– Publication (11 TB)Publication (11 TB)– RAID 1/0 & 5 MirroringRAID 1/0 & 5 Mirroring

• Geodatabase ReplicationGeodatabase Replication– Changes to Oracle Geodatabases Moved from Production to PublicationChanges to Oracle Geodatabases Moved from Production to Publication

• Image Service ReplicationImage Service Replication– Move initial imager to SAN (UNC Path)Move initial imager to SAN (UNC Path)– Changes to Service Overviews and ImageryChanges to Service Overviews and Imagery– Done very infrequentlyDone very infrequently

1919

Security RecommendationsSecurity Recommendations

• Firewall Protected Boundary Around Publication Firewall Protected Boundary Around Publication EnvironmentEnvironment– All Publication Access Within Boundary (Read-only)All Publication Access Within Boundary (Read-only)– Reverse ProxyReverse Proxy

• Active Directory & LDAP integrationActive Directory & LDAP integration– Application EnablingApplication Enabling

• Single Sign OnSingle Sign On

2020

Show Visio Architecture Show Visio Architecture Diagram (Final)Diagram (Final)

2121

Summary Summary • Benefits for Enterprise GIS Architecture Benefits for Enterprise GIS Architecture

– Meets the state CIO enterprise architecture initiativeMeets the state CIO enterprise architecture initiative

– Improve overall performance (network, servers, desktops, load Improve overall performance (network, servers, desktops, load balance). balance).

– Multi-users & accommodate remote users via thin client connection Multi-users & accommodate remote users via thin client connection and tighter securityand tighter security

– Promote data sharing internal & external (as services)Promote data sharing internal & external (as services)

– Lower TCO of servers, software, licenses due to consolidationLower TCO of servers, software, licenses due to consolidation

– Scalability & Flexibility (Hardware, software, storage, clustering, Scalability & Flexibility (Hardware, software, storage, clustering, adding future projects, user access)adding future projects, user access)

2222

Questions?Questions?

Thank you!Thank you!

dluong@water.ca.govdluong@water.ca.gov

916-654-6433916-654-6433

2323