Big Data and GIS - Transportation Research...

34
Big Data and GIS …… Visualization and Analysis Unleashed

Transcript of Big Data and GIS - Transportation Research...

Page 1: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Big Data and GIS

……

Visualization and Analysis Unleashed

Page 2: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Big Data and GIS

We Don’t Need Big Data… …..We Need Big Understanding

……

Visualization and Analysis Unleashed

Page 3: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

We Are Increasingly Measuring Everything And Making This Data Widely Available,

Page 4: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Connected Consumer; Collecting Insight

Smart – Connected Devices are Becoming Pervasive

Page 5: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Data is being Connected and Integrated Into Everything We Do

Page 6: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

50b connected

devices

5 gadgets

per person

By 2020 The Internet of All Things Will Emerge as a New Framework

. . . . Creating Very Large Real Time Data Sets About Everything. . . ……Volume, Velocity and Variety

Page 7: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Location Intelligence Will Be Essential Providing the Content and Context for Understanding

Page 8: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

• Sensor Networks

• Software and Hardware Processing Environments

- - Hadoop, Spark…., Cloud and Grid Computing…. - - Supporting large amounts and types of data

Powerful Applications and Systems

Big Data and GIS Applications Are Already Emerging

Supporting a Wide range of Transportation Systems

Page 9: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Continuous Processing and Analysis

• Big Data

• Stream Processing

• Geo-Fencing

JMS

Streams Messages

Rules

Real Time GIS Ship Tracking

Page 10: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Ship Tracking

Containership Tanker

Bulk Carrier General Cargo Refrigerated Cargo Ro-Ro

Passenger

James J. Corbett,

GIS Helps Us Understand Patterns and Relationships

Page 11: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Real Time Transit Accessibility

GIS Helps Us Understand Patterns and Relationships

Page 12: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Web Visualization of Geodesign Proposals

Rochester NY Master Plan Center-City Master Plan 3D was critical Lots of civic engagement

Page 13: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Smart System Concepts Are Emerging . . . . Including Management of Transportation Networks

Source: IBM

Page 14: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

SHRP 2 Naturalistic Driving Study

• 5.4 million Trips • 3.6 Billion GPS points

GIS Helps Us Understand Manage and Link the Data

Page 15: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Big Data and GIS Are Driving Big Systems

Connected Vehicles

Car Insurance

Toll Collection Systems

Parking Fees and Management

Intelligent Operations Center

Adaptive Signal Control Systems

Page 16: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

spreadsheets

web services

business systems

big data collections

images / video

sensor networks social media

analytics

spatial data

Cloud Computing Infrastructure Provides A New Platform . . . for Big Data and GIS

Page 17: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Uplan is a Leading Model Leveraging the Web GIS Pattern in the Cloud

http://uplan.maps.arcgis.com/home/

Page 18: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

The AASHTO Innovation Initiative Putting Web GIS (modeled after UPlan ) in every State

Page 19: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Enabling a Flexible and Agile Approach

Databases Distributed Services

Web GIS Is a New Architecture Making Data Sharing and Access Easier

Page 20: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Both Internally and on the Open Web

Analysis and Models

Imagery

Real-Time

Enterprise Data

Big Data Social Media

Maps

Web GIS Integrates All Types of Information Organizing and Sharing Your Work

Page 21: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Two Approaches For Big Data and GIS Integration Adding Fundamental Geo-processing and Spatial Analytics

“Spatialized” Big Data

Web GIS Integration

Page 22: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Mashup

Visual Overlay

Modeling

Spatial Analysis

Web GIS Integrates Contents Dynamically Combining and Analyzing Information

Helping to Discover and Understand Relationships . . .

Page 23: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Web GIS Creates ……an Interconnected Platform

Bringing Together Data, Technology, and People . . . . . . Creating a Framework for Solving Complex Problems

Apps

Desktop

Web GIS

Community Content

Server

Page 24: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Web GIS Integrates Organizations and People

Breaking Down the Barriers

Sharing Information . . . . . . Supporting Collaborative Approaches

Creating New Relationships

Page 25: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range
Page 26: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Two Final Examples

HPMS

State DOT “Data Lake”

Page 27: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Geospatial Systems Are Helping Us Understand

. . . Helping Us Make Better Decisions

Data

Information

Knowledge

Understanding

Mapping

Integration

Sharing and Collaboration

Page 28: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range
Page 29: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Urban Observatory

Page 30: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Urban Observatory Urban Footprint

Page 31: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Urban Observatory Population Density

Page 32: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Urban Observatory Road Speed

Page 33: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Urban Observatory Real Time Traffic

Page 34: Big Data and GIS - Transportation Research Boardonlinepubs.trb.org/onlinepubs/excomm/15-01-Dangermond.pdf · Big Data and GIS Applications Are Already Emerging Supporting a Wide range

Urban Observatory Open Space