ArcGIS GeoEvent Processor for Server

Jayson Hagen & Bryan Franey

ArcGIS GeoEvent Processor for Server

• Real-time GIS Overview

• Working with real-time data

• Performing continuous processing and analysis

Agenda

GIS data

Credit: iStockphoto/chris_lemmens

• GIS data typically represents state at a specific moment in time: “historic”, “current”, or “future”.

Real-time GIS data • Real-time GIS data is a continuous stream of events flowing from

sensors where each event represents the latest state of the sensor. - Emergency Response - Utility Networks and Warehouses - Environmental

Web Desktop Runtime

Mobile

Applications

Features Challenge #1

Police Person

Ambulance

Police Car

110

Storm Wind

Temperature

Earthquake Wild Fire

Network Sensor Warehouse Item

Analyzing real-time GIS data • Are my field personnel working within the designated project area?

Web Desktop Runtime

Mobile

Applications Features Equipment

Alert

Challenge #2

Continuous Analysis

Outside Boundary

Analyzing real-time GIS data • Tell customer when their delivery truck is 15 minutes away.

Continuous Analysis

Web Desktop Runtime

Mobile

Applications Features Delivery Vehicle

Notification Enter Customer Area

Challenge #3

ArcGIS GeoEvent Processor for Server • Receives real-time streaming data • Performs continuous processing and analysis • Sends updates and alerts to those who need it where they need it

Continuous Processing and Analysis

Connectors

im

ws://

Alerts Alerts

Web Desktop Runtime

Mobile

Applications Features FeaturesArcGIS Server

GeoEvent Processor

Connectors

Real-Time Data

ArcGIS supports real-time GIS

Real-time data

ArcGIS Online /Portal for ArcGIS al for A

Operations Dashboard Collector

ArcGIS Server

GeoEvent Processor

Twitter monitoring

Demonstration

Demo

Real-time data

You can add your own connectors.

ArcGIS for Server

GeoEvent Processor

Receive NMEA

Receive Sierra Wireless

Receive Tweets

Receive Instagram

Receive Trimble

Receive GPX

NMEA

GPX Receive Vessels

Receive Geomessages

Receive Air Traffic Control

Receive Cursor-on-Target

Receive VMF

CoT

VMF

Message Geo

Watch a folder for new Files

Receive RSS

Receive from a Socket

Receive from a Web Socket

Receive on a REST Endpoint

Poll an ArcGIS Server

Poll an external website

ws://

http://

http://

Watch a folder for new Files

Receive RSS

Receive from a Socket

Receive from a Web Socket

Receive on a REST Endpoint

ws://

http:// Receive on a REST Endpointhttp://

Receive from a Socket

Receive from a Web Socket ws://

Receiving real-time data Input Connectors • You can easily integrate real-time data with ArcGIS by using a

connector that meets your needs.

im

ws://

Web Desktop Runtime

Mobile ArcGIS for Server

GeoEvent Processor

Real-time data

You can add your

own connectors

Send to RabbitMQ

Send to ActiveMQ

Send to HornetQ

Write to Hadoop

Write to MongoDB

Send a Tweet

Send to CESIUM

Send an Instant Message

Send an email

Update a Feature

Add a Feature

Send a Text Message

Publish to REST Endpoint

Send to a Web Socket

Send to a Socket

Write to a File

im

ws://

Sending real-time data Output Connectors • You can easily send resulting streams to those who need it where

they need it using a connector.

Publish to REST Endpoint

Send an Instant Message

Send an email

Update a Feature

Add a Feature

Send a Text Message

im

Send an email

Update a Feature

Add a Feature

Continuous processing and analysis GeoEvent Services

Web Desktop Runtime

Mobile

im

ws://

• A GeoEvent Service configures the flow of geoevents, - the Filtering and GeoEvent Processing steps to perform,- what input(s) to apply them to, - and what outputs(s) to send the results to.

ArcGIS for Server

GeoEvent Processor

Real-time data

Twitter Input Add Tweet Feature Geolocated Filter

Write Tweets to Hadoop

Twitter Monitor (GeoEvent Service)

Performing continuous processing and analysis

Continuous processing and analysis Processors • Calculate new fields on a geoevent: GeoTagger, Field Calculator • Modify a geoevent: Field Enricher, Field Reducer • Derive a new geoevent: Field Mapper, Incident Detector

GeoEvent Service

GeoTagger

Field Calculator

Field Enricher

Field Reducer

Field Mapper

Incident Detector

Input 1 Output 1

ArcGIS Server with GeoEvent Processor

Continuous processing and analysis Derive a new geoevent • An Incident Detector processor

- creates an incident upon an opening condition being met,- maintains state for the duration of the incident, - closes the incident based on a closing condition or expiration.

GeoEvent Service

Incident Detector

91 90 92 65 68 90 91 90 92 81 73 68 66

Close Incident

81

Open Incident

90 noiseDecibel >= 90

Opening Condition

Input 1 Output 1

Real-time data

Sending real-time data to features Using local feature services

ArcGIS for Server

feature layers

GeoEvent Processor

Filters Processors

Inpu

ts

Out

puts

GeoEvent Services

Update a Feature

Add a Feature

Operations Dashboard for ArcGIS

ArcGIS Online / Portal

operation view

web map

Your Dashboards

Your Applications

Web APIs JavaScript

Flex

Silverlight/WPF

Mobile GIS iOS

Android

Windows Phone

Runtimes Windows Store

Java

Mac OS X

Qt

Real-time data

Sending real-time data to features Using remote feature services

Your Applications

Web APIs JavaScript

Flex

Silverlight/WPF

Mobile GIS iOS

Android

Windows Phone

Runtimes Windows Store

Java

Mac OS X

Qt

ArcGIS Online / Portal

operation view

web map

ArcGIS for Server feature layers

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inpu

ts

Out

puts

GeoEvent Services

Update a Feature

Add a Feature

Operations Dashboard for ArcGIS

Your Dashboards

Real-time data

Sending real-time data to features Using ArcGIS Online feature services

Your Applications

ArcGIS Online / Portal

operation view

web map

feature layers

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inpu

ts

Out

puts

GeoEvent Services

Update a Feature

Add a Feature

Web APIs JavaScript

Flex

Silverlight/WPF

Mobile GIS iOS

Android

Windows Phone

Operations Dashboard for ArcGIS

Your Dashboards

Runtimes Windows Store

Java

Mac OS X

Qt

Real-time data

Sending real-time data to big data stores Write to a Hadoop Distributed File System (HDFS) Write to a MongoDB Document Store

• GIS Tools for Hadoop - http://github.com/Esri/gis-tools-for-hadoop

ArcGIS for Desktop Geoprocessing

GIS Tools for Hadoop

2013/03/06/10/vehicles-2013-03-06-10.json 2013/03/06/10/vehicles 2013 03 06 10.jsonj2013/03/06/11/vehicles-2013-03-06-11.json 2013/03/06/11/vehicles 2013 03 06 11.jsonjso2013/03/06/12/vehicles-2013-03-06-12.json 2013/03/06/12/vehicles 2013 03 06 12.jsonj2013/03/06/13/vehicles-2013-03-06-13.json

2013/03/06/10/vehicles-2013-03-06-10.tsv 2013/03/06/10/vehicles 2013 03 06 10.tsv2013/03/06/11/vehicles-2013-03-06-11.tsv 2013/03/06/11/vehicles 2013 03 06 11.tsv2013/03/06/12/vehicles-2013-03-06-12.tsv 2013/03/06/12/vehicles 2013 03 06 12.tsv2013/03/06/13/vehicles-2013-03-06-13.tsv

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inpu

ts

Out

puts

GeoEvent Services

Write to Hadoop

Write to MongoDB

Demo

GeoEvent Processor – An Introduction Summary

• ArcGIS is a dynamic platform that enables real-time visualization, continuous analysis, and understanding of our world.

• GeoEvent Processor allows you to: - be alerted when interesting events occur - react and make smarter decisions faster - to know what is happening, as it happens

• Product Page - http://pro.arcgis.com/share/geoevent-processor

• Questions

Thanks

• Jayson Hagen jhagen@esri.com

• Bryan Franey bfraney@esri.com