ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance...

40
ArcGIS Enterprise: Performance and Scalability Best Practices Darren Baird, PE, Esri [email protected]

Transcript of ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance...

Page 1: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

ArcGIS Enterprise:

Performance and Scalability

Best PracticesDarren Baird, PE, Esri

[email protected]

Page 2: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

What is ArcGIS Enterprise

Page 3: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

What’s Included with ArcGIS Enterprise

• ArcGIS Server – the core web services component for making maps and performing

analysis

• Portal for ArcGIS – allows you to share maps, applications, and other geographic

information with other people in your organization

- Identity Management

• ArcGIS Data Store – lets you configure data storage for hosting and federated servers

used with your deployment

- ArcGIS Managed PostgreSQL Database

• ArcGIS Web Adaptor – allows you to integrate your ArcGIS Server and Portal for ArcGIS

with your existing web server and your organization’s security mechanisms

- Windows – IIS and Java

- Linux – Java

Page 4: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Base ArcGIS Enterprise Deployment

Page 5: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

ArcGIS Server Architecture Options

Page 6: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Silos, Sites, and Clusters

Silo Siterecommended

Configuration Stores Configuration Store(shared)

ClusterTo be deprecated

Configuration Store(shared)

Cluster A Cluster B

Sit

e

Sit

e

Page 7: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Site Design ConsiderationMulti-node, high number of services

• Ensure Required Infrastructure Resources

- Network Stability

- NAS Stability for ArcGIS Server and Portal config stores

- RAM

- CPU

• Try to Avoid during Working Hours

- Publishing High Number of Services

- Adding/Removing Nodes

• Distribute Recycle Times

Page 8: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Site Management Consideration

• Identify unused services and reduce min (to 0 if possible)

• Tune slow services

• Provide best practices to the publishers

• Monitor resources

- RAM and committed memory

- CPU

- Network latency

Page 9: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Publication Best Practices

Page 10: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Server Pattern Web GIS

Page 11: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Publication Strategies

Portal

Active Wells

Proposed Wells

Wells by Status

GeoServices

Wells

Geodata

Wells

Page 12: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Hosting Server

• Scalable Solution

- Publish thousands of services

Page 13: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Processes, Tools, Value

Page 14: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Tuning Definitions

• Performance – Speed, in other words, response time (seconds)

• Scalability – Ability to increase output and maintain acceptable performance

• Capacity – maps per second (users x maps per second)

• Bottleneck – Something that limits performance and capacity

Page 15: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Tuning Methodology

• Profile each tier starting at the top

Page 16: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Tuning Methodology – Case Study 1Profile each tier starting at the top

• You can use tools like fiddler to narrow down the problem URL

Page 17: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Tuning Methodology – Case Study 1

• Look at statistics of problem service

Page 18: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Tuning Methodology – Case Study 1

• If ArcMap MXD, use MXDPerfStat, shows call to DB is slow

• If ArcGIS Pro, PerfTools is available – search for “ArcGIS Pro Perftools” in a search engine

Page 19: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Tuning Methodology – Case Study 1https://oracle-base.com/articles/misc/sql-trace-10046-trcsess-and-tkprof#trace_example

• Run query using Oracle Trace for example

Page 20: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Tuning Methodology – Case Study 2

• In this case the number of feature vertices was the problem

• Compare to FGDB performance

Page 21: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System Tools

Page 22: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System Tools Framework

Tool

Patterns

Discipline

Page 23: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Process and Tools

Page 24: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Relationship between System Tools

Page 25: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System Testing

Page 26: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Testing Objectives

• Meet service-level agreements (SLAs)

• Bottlenecks analysis

• Capacity planning

• Benchmarking different alternatives

Page 27: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Testing Process

Application

GIS Services

Infrastructure

Hardware and Software

Page 28: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System Test for the WebGIS Test Automation

• ArcGIS Services

- Mapping

- Feature

- OGC

- Geocoding

- Image

- Network

- Geoprocessing

- Tile Cache

• Application Testing

• Search on ArcGIS.com

- owner:EnterpriseImp

Page 29: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System Design

Page 30: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System DesignProvide Sufficient Hardware Resources

• GIS Systems are bound by

- CPU

- Memory – when there are a large number of services

- Disk – Image service, synchronization (Collector causes lots of I/O)

- Network – low bandwidth deployment

- Poorly configured virtualization

- Can result in 30% higher performance degradation

Page 31: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System Design

• Manual calculations not feasible

Page 32: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System DesignerSolution Architect Design Methodology

• Gathering Requirements

• Designing

• Capacity Planning

- CPU

- Network

- Memory

• Reporting

• Search on ArcGIS.com

- owner:EnterpriseImp

Page 33: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

System Monitor

Page 34: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Monitoring Enterprise GISChallenges

• Multiple Administrators

• Multiple disparate monitoring/diagnostic tools

• Data collected in reactive fashion, not proactive – on demand and for a limited time

• Correlation of data with different timestamp is difficult

• ArcGIS Administrators do not have access to all tools, data, and reports

• Challenging to quickly identify the root cause and take appropriate measures

Page 35: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

MotivationGrowing Complexity of ArcGIS Enterprise

• Certificates

• Load Balancer

• Firewall

• ArcGIS Web Adaptor

• Portal for ArcGIS

• Storage

• ArcGIS Server

• ArcGIS Data Store

• Databases

Page 36: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

ArcGIS Monitor

• Search for “ArcGIS Monitor”

Page 37: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

ArcGIS Monitor

Demo

Page 38: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Print Your Certificate of AttendancePrint stations located in the 140 Concourse

Tuesday Wednesday12:30 pm – 6:30 pm GIS Solutions Expo Hall B

5:00 pm – 6:30 pm GIS Solutions Expo SocialHall B

10:30 am – 5:15 pm GIS Solutions Expo Hall B

6:30 pm – 9:00 pm Networking ReceptionSmithsonian National Portrait Gallery

Page 39: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase

Download the Esri Events

app and find your eventSelect the session

you attended

Scroll down to find the

feedback section

Complete answers

and select “Submit”

Please Take Our Survey in the Esri Events App

Page 40: ArcGIS Enterprise: Performance and Scalability Best Practices · Tuning Definitions •Performance –Speed, in other words, response time (seconds) •Scalability –Ability to increase