Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and...

21
Route Data Cleanup for Roads and Highways Kyle Gonterwitz KDOT June 13, 2018 Kevin Sigwart 1Spatial June 13, 2018 with Stuff I thought was impossible Until I learned 1Spatial and got help from experts

Transcript of Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and...

Page 1: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Route Data Cleanupfor Roads and HighwaysKyle Gonterwitz KDOTJune 13, 2018

Kevin Sigwart1SpatialJune 13, 2018

with

Stuff I thought was impossible Until I learned 1Spatial and got help from experts

Page 2: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Problem Statement

KDOT needed to quickly validate road centerlines from NG911 with conflated route-defining attributes, and enhance

the centerlines for Route Migration for migration to Roads and Highways with minimal route errors.

Page 3: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

High Level Workflow

Goalposts moveAiming for 100%

Page 4: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Create new routes using projected shape length measures for Roads

and Highways

KDOT SourcesKDOT source 1:

w\ Measures (M) - Project StationingTemporality for temporal events

KDOT Source 2:w\ Measures (M) - Map or driven

distances

KDOT source 3:Measure Attributes (not M) - Driven

distances or shape lengths

Stat

e Hi

ghw

ays

3456

7

UR

U

R + ramps

Conflate KDOT sources

to NG911 Road

Centerline Geometry

Roads and Highways

ClassUrbanRural

All Single Carriageway Polylines & Route Defining Attributes

Dual Carriageway (No M’s)No Route defining attributesAddress Location Attributes

No temporality (current state)Overlapping Segments

105 Sources (not edge matched)Topology Rules

Alias Tables

Next Gen 911

Workflow

Page 5: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Technology Used

Page 6: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

• Edit in ArcGIS Pro• 1Integrate for ArcGIS

• Validate• Pinpoints Issue Locations• Automate fixups

• Shared Pro Packages on ArcGIS Online

• Facilitated Editing & Validation

• Consistent Cartography & Labeling

Editing and Reviewing

Page 7: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Automation• Python Development

• Calibrate & Update Route Measures

• Flip Lines• Update Datasets• Package and Share Docs

https://github.com/KDOTGIS/pydot/tree/master/KhubCode25

Editing and Reviewing

Page 8: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

1Integrate for ArcGIS Demonstration

• Validation• Rules Based Validation• Pin-Point Exact

Locations • Enhancement

• Automate Cleanup• Integration

• Validate Multiple Sources

• Snap Sources Together

Editing and Reviewing

Page 9: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for All Source Routes*

Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 34,190 27,616 38,717 22,969 1,363

Duplicate Calibration Points – Same measures 56 20 2 - -

Detect Non-Monotonic Routes 11,561 27,452 6,643 2,473 887

Branches 503 628 460 172 179

Barbells 1 1 2 1 1

Complex Self-Intersections 1351 201 144 37 44

Duplicate Vertex 2,809 1,117 1,031 227 253

* Round 4 and 5 networks did not include local, ghost, or zombie roads

Page 10: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for All Source Routes*

Validation Check 1 2 3 4* 5*Invalid Geometry 3 3 3 - -

Multipart Line 4,755 3,242 2,499 865 841

Dangles 1,486 243 256 44 37

Orphan 137 123 107 6 7

Alpha Routes 5 8 8 2 1

Single Self Intersection – 4 approaches 445 16 29 4 17

Single Self Intersections – 5 approaches - 1 - - -

* Round 4 and 5 networks did not include local, ghost, or zombie roads

Page 11: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for All Source Routes*

Validation Check 1 2 3 4* 5*Infinity 5 - 1 - -

Cutbacks 246 146 204 40 39

Evaluate Polyline Length 26 13 33 2 2

Polyline or Path Closes on Self 2,535 794 892 151 179

Loops 389 180 200 9 9

Lollipops 101 80 187 1 1

TOTAL 60,604 61,884 51,418 27,003 3,860

* Round 4 and 5 networks did not include local, ghost, or zombie roads

Page 12: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for All Source Routes*

* Round 4 and 5 networks did not include local, ghost, or zombie roads

Page 13: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for State Highway System

Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 11,116 11584 1838 1866 0

Duplicate Calibration Points – Same measures 2 0 0 0 0

Detect Non-Monotonic Routes 684 540 468 324 142

Branches 60 60 56 13 47

Barbells 0 0 0 0 0

Complex Self-Intersections 68 29 23 1 13

Duplicate Vertex 142 97 91 15 74

Page 14: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for State Highway System

Validation Check 1 2 3 4* 5*Invalid Geometry 0 0 0 0 0

Multipart Line 327 249 279 190 213

Dangles 155 18 16 6 4

Orphan 0 0 0 0 0

Alpha Routes 0 0 1 1 0

Single Self Intersection – 4 approaches 13 6 10 0 14

Single Self Intersections – 5 approaches 0 0 0 0 0

Page 15: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for State Highway System

Validation Check 1 2 3 4 5Infinity 0 0 0 0 0

Cutbacks 7 4 4 0 0

Evaluate Polyline Length 4 2 1 0 0

Polyline or Path Closes on Self 108 67 63 10 54

Loops 0 0 1 0 0

Lollipops 1 2 0 0 0

TOTAL 12,687 12,658 2,851 2,426 561

Page 16: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for All Source Routes*

Page 17: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for Non-State HWAY –non local

Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 13,219 13,809 33,142 21,103 1,363

Duplicate Calibration Points – Same measures 32 14 0 0 0

Detect Non-Monotonic Routes 2733 3913 3784 2149 745

Branches 296 407 281 159 132

Barbells 0 0 1 1 1

Complex Self-Intersections 266 123 78 36 31

Duplicate Vertex 730 560 391 212 179

Page 18: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Validation Check 1 2 3 4* 5*Invalid Geometry 3 0 3 0 0

Multipart Line 1191 982 921 675 628

Dangles 356 79 82 38 33

Orphan 4 2 1 6 7

Alpha Routes 2 2 2 1 1

Single Self Intersection – 4 approaches 48 9 18 4 3

Single Self Intersections – 5 approaches 0 1 0 0 0

Results for Non-State HWAY –non local

Page 19: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Validation Check 1 2 3 4 5Infinity 0 0 0 0 0

Cutbacks 57 39 39 40 39

Evaluate Polyline Length 2 0 7 2 2

Polyline or Path Closes on Self 574 347 246 141 125

Loops 10 9 10 9 9

Lollipops 8 4 1 1 1

TOTAL 19,531 20,300 39,007 24,577 3,299

Results for Non-State HWAY –non local

Page 20: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.

Results for Non-State HWAY –non local

Page 21: Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018.