Open Geo-Data and Open Geo-Software

National Assoc. of CountiesGIS Subcommittee Agenda July 16, 2011

Presented by Bibiana McHughIT Manager of Spatial TechnologiesTriMet

City of Portland resolution directs city government to open data and encourage adoption of open source solutions in technology procurement

open

dat

a

Just look at the numbers:

7 Other nations establishing open data16 States now offering data sites9 Cities in America with open data236 New applications 253 Data contacts in Federal Agencies305,709 Datasets available on Data.gov

open

dat

a

40 apps developed by third parties using TriMet’s open data PDX Bus sends @ 100k requests/day for next arrival info

open

dat

a

proprietary software

open source software

risk

low entry cost, shared costs

broad user & developer base

(many eyes)

fosters innovation and competition

risk

traditional business model, well understood

aligns with procurement

processes

more control

Understand and weigh your risks and advantagesNot all proprietary is the same, and not all oss is the same

open

sour

ce so

ftwar

e

open

sour

ce so

ftwar

e

Free Hybrid Car!

= $$$

Open Source Software is NOT FREEhardware requirements, training, implementation, customizations, upgrades, additional feature development, support, maintenance, etc.

open

sour

ce so

ftwar

e

Analyzed alternatives for internet mappingCompared open source alternatives with proprietary

open

sour

ce so

ftwar

e

TriMet Interactive System Map/Trip Planner maps.trimet.orgAll open source technologies including GeoServer, OpenLayers, PostGIS

open

sour

ce so

ftwar

e

TriMet Interactive System Map/Trip Planner maps.trimet.orgReal-Time Vehicle locations , Measure Distance Tool

open

sour

ce so

ftwar

e

Internal applications using same open source platformMobility map, Real-Time Vehicle Mapper, Stops and Amenities Application, Accident & Incident Application, Transit Mapper

open

sour

ce so

ftwar

e

Single-Mode Trip Planners

trip

pla

nnin

g

Multi-Mode Trip Planners

trip

pla

nnin

g

2009 Portland, OR

1. trimet trip planner2. oregon unemployment claim3. 95.5 the game4. multnomah county jail5. onpoint credit union6. mypcc7. pcc.edu8. pdx.edu9. workinginoregon.org10. blazers edge

2010 Portland, OR

trip

pla

nnin

g

Metro Regional Travel Options Grant July 1, 2009 – July 1, 2011

Project Tasks Estimated Completion Data Actual Completion Date

Project Management Plan September 2009 September 2009

Software development and implementation of working prototype

January 2011 February 2010

Evaluation Studies May 2011 July 2010 – June 2011Final Reports June 2011 June 2011

the

Ope

n Tr

ip P

lann

er (O

TP)

Project Kick-Off Workshop July 2009

the

Ope

n Tr

ip P

lann

er (O

TP)

OpenTripPlanner.org

the

Ope

n Tr

ip P

lann

er (O

TP)

Open Source Development Method

the

Ope

n Tr

ip P

lann

er (O

TP)

Open Architecture

ClientApplication

GeocodingService

Web ServicesAPI

AddressNormalizer

ServiceEtc.Routing

Service

Data API

Shapefiles Oracle OSMOpenStreetMap

RegionalDataPostGIS

Adapter Adapter Adapter Adapter Adapter

the

Ope

n Tr

ip P

lann

er (O

TP)

Street Data

OSM

USGS National Elevation Dataset

NED

Transit Data

GTFS

OTP uses open source datasets (GTFS, NED, and OSM) to build a routable graph

the

Ope

n Tr

ip P

lann

er (O

TP)

Progress in Year 1 (July 2009 – July 2010)Worldwide interest and participation

The demos are designed for demonstration purposes and are intended to be used as a tool for the developers for testing purposes for both the algorithm and the underlying data.

the

Ope

n Tr

ip P

lann

er (O

TP)

Progress in Year 1Support and maintenance options

the

Ope

n Tr

ip P

lann

er (O

TP)

Progress in Year 2 July 2010 – July 2011

Demos Released:5. Granada, Spain July 20106. Pune, India October 20107. Smartrip Transport for Dublin Journey Planner January 20118. Ottawa Canada Green Trip Planner January 20119. Tampa, Florida May 201110. Gipuzkoa Transit Android App May 201111. TeleAviv, Israel

Translations into: French, Gaelic, Hungarian, Italian, Marathi, Polish, Spanish, Hebrew

Code DevelopmentCode quality and extensibility improvements Improved wheelchair accessibility graph reloading Speed improvements (~10x) Memory usage improvements (~0.5) Code documentation Intermediate stops in API Better extensibility Visualization improvements Making bikes on transit optional Kept up-to-date with changing technology (upgraded Spring) Edge notes Nominatim geocoder support Cleaner max walk distance support Support for certain common GTFS failure modes Workarounds for OSM data issues (pedestrian islands) Support loading OSM from Protocol Buffers format & bz2 xml OSM future proofing OSM permission bug fixes Traffic circles / roundabouts Much improved transfer support (min transfer times; transfers now routed on walking network) Support for multiple route names on the same stop pattern (typically night buses) Dozens of miscellaneous bug fixes Gvsig visualization Documentation for graph builder Better names for some OSM ways Better slope visualization Slope override for bridges Some integration with OneBusAway Preferred/dispreferred/banned routesTranslations from English into the following seven languages: French, Gaelic, Hungarian, Italian, Marathi, Polish, Spanish

the

Ope

n Tr

ip P

lann

er (O

TP)

Street Map Data Options Why OSM? Investment in community product for shared benefits

Jurisdictional Data

• regional or local coverage

• not designed for routing

Commercial Products

• seamless worldwide coverage

• includes routing attributes

• costly annual license fees

OSM

• seamless worldwide coverage

• includes routing attributes

• collaboration with community

the

Ope

n Tr

ip P

lann

er (O

TP)

Jurisdictional Format

OSM RoutableFormat

Ope

n St

reet

Map

(OSM

)

Shapefile OSM

Point, Line or Polygon File Everything in one data model, more similar to geodatabase

Point Node

Line Way

Polygon Closed Way (beg xy = end xy) or Relation

Attribute Tag

Layer file (point, line or poly) Relation (can include nodes and ways)

Edit Session Change Set

Copy of shapefile for editing Sandbox copy of OSM data for playing

Tools for Editing: ESRI ArcMap Tools for Editing: ESRI ArcMap, JOSM, Potlatch, Merkaartor, MapZen, Quantum GIS, Osmosis

Topology Tools Validation Tools (JOSM)

ESRI – OSM Glossary

Phase I – Feb 18, 2011 thru Aug 18, 2011 Improve geometry

Add additional linework: missing streets, trails, bicycle lanes , pedestrian paths, major waterways Add/correct attribution Verify directionality and add turn restrictions for bicycle routing

Not Included Addresses Loc_Ids (except where an OSM way was edited, the RLIS local ID was added as a backwards reference)

Ope

n St

reet

Map

(OSM

)

Address Geocoding

SE Main St 1 99 101 199 201 0 98 100 198 200

SE

Wat

er S

t. SE

1st

SE 2

nd S

t.Address geocoding (via GIS)on theoretical address ranges in centerline file

Address search engine (Solr) on address points

in database

Returns via GIS/geocoder approximate XY coordinates based on interpolation of theoretical address ranges -- high maintenance for approximations-- requires breaking of segments

Returns via web service accurate XY coordinates based on database records compiled from

tax lots, landmarks, intersections, etc. ++ improves with usage++ access to current data w/out basemap import

55 SE Main St.

SE

Wat

er S

t.

SE 1

st

SE Main St

55 SE Main St.

Ope

n St

reet

Map

(OSM

)

Address Geocoding

Address Search Engines force the user to enter/determine accurate spelling, address, etc. O

pen

Stre

et M

ap (O

SM)

Priority Phase II - Aug 18, 2011 thru Dec 16, 2011 Status

7 Physical Turn Restrictions – for peds, vehicles, buses, bikes Requires QC

8Legal Turn Restrictions – for peds, vehicles, buses, bikesData from VisSum and PDX sign inventory

Exploration in 3 test areas (not Clark)

9Speed LimitsData from restrictions – legal for vehicles, buses & bikesData from VisSum

Exploration in 3 test areas (not Clark)

10 Impedances (speed bumps, roundabouts) Acquire during QC process

11 QC Process for Phase II Data Improvements Begins September 2011

Phase II StatusGoal – to support vehicular and bus routing for TriMet Operations (and future phase of OTP)

Ope

n St

reet

Map

(OSM

)

Attributes to be verified:o Legal turn restrictions for cars,

bicycles, buseso Speed limits (ranges)o Street nameso Street directionality/one-wayso Other impedences (speed

bumps, roundabouts, etc.)

QC Process

Ope

n St

reet

Map

(OSM

)

OTP Project Tasks

Task 1Project Management Plan work with stakeholders to identify and prioritizerequirements and that can be delivered within the two-year timeframe and budget

September 2011

Task 2 Application Development of Features prioritized at July 2011 Workshop January 2011

Task 3 Evaluation Study May 2011

Task 4 Final Reports June 2011

Metro Regional Travel Options Grant July 1, 2011 – July 1, 2013

the

Ope

n Tr

ip P

lann

er (O

TP)

On the Horizon

OTP Phase II Kick-off WorkshopJuly 2011

OTP TriMet Public Beta Release October 2011

OSM Data Improvements and further collaboration with community and jurisdictions for on-going maintenance

OSM QC Process

the

Ope

n Tr

ip P

lann

er (O

TP)

OTP Interface Preview – Fall Beta Release

the

Ope

n Tr

ip P

lann

er (O

TP)

PCC Sylvania

to Gabriel S

kate Park

Beaverto

n HS to Ced

ar Hills

Crossing

Lewis &

Clark Colle

ge to

Pioneer Square

SW Ed

gewood/H

untington to O

regon Zo

o

Centra

l Librar

y to SW

Virginia/

Nevada

SW Lu

radel/ 25th to

Barbur S

afeway

OHSU to SW

10th/Stark

SW 1st/

Ankeny to PSU

Smith Center

SW M

oody/Gain

es to Ja

panese

Garden

Taylor/C

arson to

PCC Sylvania

135

2519 17

9

23

6

19

4540

17

38 34 34 32

19 15

57

83

x x

34 3445

34

2115

8086

OTP Bike-to-Transit Google Transit ATIS

OTP produced a significantly faster trip in all but one case

Min

utes

Planned Trips