www.mtri.org

Colin N. Brooks, Michigan Tech Research Institute (MTRI)Dr. Tim Colling, P.E., Michigan Tech Center for Technology and Training (CTT)

Christopher Roussi, MTRIRichard Dobson (MTRI)

Valerie Lefler, Integrated Global Dimensions (IGD)Caesar Singh, P.E., US Department of Transportation Office of the Assistant Secretary for

Research and Technology (OST-R)www.mtri.org/unpaved

Characterization of Unpaved Road Conditions through the Use of Remote Sensing

RITARS-11-H-MTU1 Technical Advisory Committee

Project Update – March 24, 2015

Agenda

8:30 - 9:00 am: Sign-in time and continental breakfast

9:00 - 9:30 am: Project Progress Overview - Colin Brooks, MTRI, Principal Investigator

9:30 – 10:00 am: Description of 2013 and 2014 data collections – Rick Dobson, MTRI

10:00 – 10:30 am: Distress data algorithms, results, & improvements – Chris Roussi, MTRI, Associate PI

10:30 - 11:00 am: Decision support system integration with GIS – Dr. Tim Colling, P.E., CTT, Associate PI

11:00 – 11:30 am: Outreach & Demonstration Discussion for 2015 and 2016 – Colin Brooks, MTRI & Valerie Lefler, MPA, Integrated Global Dimensions

11:30am – 12:00 pm: Discussion time for information shared in the morning.

12:00 - 1:00 pm: Lunch (including additional discussion time)

1:00 – 2:00 pm: Remote control hexacopter demonstration in the field (weather permitting)

2:00 – 3:00 pm: Discussion of next steps for outreach, demonstrations, and implementation.

2

Characterization of Unpaved Road Conditions through the Use of Remote Sensing

Goal of the Project: Extend available Commercial Remote Sensing & Spatial Information (CRS&SI) tools to enhance & develop an unpaved road assessment system by developing a sensor for, & demonstrating the utility of remote sensing platform(s) for unpaved road assessment.

– Commercially viable in that it can measure inventory and distress data at a rate and cost competitive with traditional methods

– Rapid ID & characterization of unpaved roads – Inventory level with meaningful metrics– Develop a sensor for, & demonstrate the utility of remote sensing platform(s) for

unpaved road assessment– Platform could be a typical manned fixed-wing aircraft, UAV, or both; depends on relative

strengths & weaknesses in meeting user community requirements– Simplify mission planning, control of sensor system, & data processing fitting for a

commercial entity or large transportation agency– Demonstrate prototype system(s) to stakeholders for potential implementation

developed through best engineering practices– Develop a decision support system to aid the user in resource management and

planning

3

www.mtri.org

Ann Arbor, MI

March 24, 2015

Technical Advisory Committee Project Progress Review

Current Technical Status of the Project

Original DeliverablesStatus by Task: Completed

Task 1: Requirements Definition– “Requirements for Remote Sensing Assessments of Unpaved Road Conditions” Report (Deliverable 1-A). Completed 10/31/2011.

Task 2: State of the Practice Assessment– “State-of-the-Practice of Unpaved Road Condition Assessment” Report (Deliverable 2-A). Completed 11/30/2011.

Task 3: Phenomenology– “Remote Sensing the Phenomena of Unpaved Road Conditions” Report (Deliverable 3-A). Completed 3/15/2012.

Task 4: Sensor Selection– “Candidate and Recommended Remote Sensors for Unpaved Road Condition Assessment” Report (Deliverable 4-A). Completed 5/24/2012.

Task 5: Platform Selection– “Candidate and Recommended Remote Sensing Platforms for Unpaved Road Condition Assessment” Report (Deliverable 5-A). Completed

6/30/2012.

Task 6: Algorithm and Software Development– A demonstration of mission planning system (Deliverable 6-A). Completed 5/31/2012.– A demonstration of how collected data could be utilized with the RoadSoft GIS Decision Support System (Deliverable 6-B). Completed

7/27/2012.– “Software and Algorithms to Support Unpaved Road Assessment by Remote Sensing” Report (Deliverable 6-C). Completed 10/31/2012.

Task 7: Integration, Testing, and Demonstration– “Plans for Field Deployment of Recommended Systems for Remote Sensing of Unpaved Road Conditions” Report (Deliverable 7-A).

Completed 5/30/2013.– “Performance Evaluation of Recommended Remote Sensing Systems in Unpaved Road Type Condition Characterization” (Deliverable 7-B).

Completed 11/26/2013.

Task 8: Reporting and Technical Advisory Committee– Quarterly status and progress reports (Deliverable 8-A) (Q1-Q12).– TAC meetings held 12/9/2011, 5/2/2013– Final Report (Deliverable 8-B) – Submitted 9/30/14; revised version resubmitted 12/5/14. Ready to post.

5

2014 major accomplishments, by task

Task 7 (Integration, Testing, and Demonstration):– Gave a well-received system outreach demonstration in Sioux Falls, SD in

June, 2014 (6/26/14)– Online webinar released & watched by stakeholders– New “user friendly” implementation-focused website released; existing

research website updated– New outreach articles published: 4 popular press articles, one newspaper,

two Michigan Tech articles– Michigan XML results integrated into RoadSoft GIS DSS– New relationship with Woolpert, Inc. established focused on 3rd party

implementation (company on forefront of domestic commercial UAV usage – one of first FAA commercial exemptions, Dec. 2014)

6

2014 major accomplishments, by task

Task 8 (Reporting & TAC): – Five conference & meeting presentations + USDOT Innovation Series

talk Nov. ‘14• Mid-Continent Transportation Research Forum (Madison, WI, Aug. ’14 – WisDOT

interest); ASPRS 2014 spring conference (Louisville, KY, March ‘14); Southeast Michigan GIS Users Group (Novi, MI, Feb. ‘14); TRB (Jan. ’14, Jan. ‘15)

• C.Singh presentation to 35th ACRS in Burma

– Three peer-reviewed papers submitted; one accepted for publication so far:

• Dobson, R. J., Colling, T., Brooks, C., Roussi, C., Watkins, M. K., & Dean, D. (2014). Collecting Decision Support System Data Through Remote Sensing of Unpaved Roads. TRANSPORTATION RESEARCH RECORD, Vol. 2433: 108-115.

– Final Report (Deliverable 8-B) submitted, revised, accepted, & published to website - at www.mtri.org/unpaved under “Tasks and Deliverables”

7

June technical demo in Sioux Falls, SD

Successful demonstration to South Dakota DOT & local transportation agencies in Sioux Falls, June 26, 2014– 36 attendees, 15 groups (state & local agencies) – SDDOT,

SDLTAP, 3 local counties, Nebraska LTAP, ND LTAP– Overview, live field demo, quick data processing, round table

discussion– Feedback:

• Definite improvement over “windshield surveys”• A practical system – “see tremendous use”• Strong interest in accessing as a third-party service

– Other interests expressed: Haul road inventories, road geometry evaluations, encroachment issues, natural disaster documentation

Partnered with outreach specialist (Valerie Lefler, Integrated Global Dimensions - IGD) – organized June demonstration workshop– www.unpavedroadsremotesensing.com

2014 outreach examples

9

Civil Engineering magazine, April 2014

The Urban Transportation Monitor, Feb. 2014 ARTBA Transportation Builder, Mar/Apr. 2014

www.unpavedroadsremotesensing.com outreach website http://goo.gl/0eTjeq outreach webinar - 142 attendees

Michigan Tech press release, Feb. 20142287 views

Unpaved Roads Outreach & Implementation Extension Summary

5 Tasks, 8 Deliverables

October 1, 2014 – September 30, 2016 Period of Performance

$283,079 new federal funding supplement (“Phase II”)– $283,079 equal amount of cost share

Focus on Outreach and Commercial Implementation

New Outreach & Implementation Phase: Additional Project Activities

Update and maintain www.mtri.org/unpaved project website with focus on professional outreach materials.

Organize and meet with the Technical Advisory Committee for input on moving Unsurfaced Roads Condition Assessment System (URCAS) to full commercial implementation and providing advice on related project direction.

Provide a state of the practice for available UAVs and systems that could be used for URCAS

Prepare the URCAS remote sensing system (RSPS) project to be moved towards an operational commercial-ready product.– Investigate additional assessment functionality for transportation agencies such as road

geometry evaluations.

Develop and provide professional outreach for implementation to a nationwide audience.

Work closely with the private sector to commercialize URCAS for day-to-day operation in light of new FAA regulations to likely to take effect in 2016.

11

New Outreach & Implementation Phase: Additional Project Activities

Demonstrate how URCAS is able to fulfill needs for system deficiency detection and damage prevention to transportation agencies for unpaved roads.

Meet with Technical Advisory Committee for reviewing project progress and solicit input and guidance for remainder of the project.

Extend GIS Decision Support System Tools to nationwide asset management tool for unpaved roads.

Demonstrate and integrate unpaved road assessment methods with multiple transportation agency partners in multiple states, including field demonstrations and appropriate presentations.

Report on project's progress, Technical Advisory Committee input, and obstacles and accomplishments in a series of quarterly reports to the project sponsor.

Create and submit a Final Report summarizing the project deliverables, demonstrations, outreach, and commercialization activities.

12

Additional Tasks

Task 5: Review and Update System Requirements

Task 6: Adapting Remote Sensing Processing System into Commercial Readiness with GIS Extension

Task 8: Field Demonstrations with State and Local Transportation Agencies, Reporting and Technical Advisory Committee, and Updated Final Report

Task 9: Extended Professional Outreach

Task 10: Commercialization of URCAS for Day-to-Day Usage

13

Task 5: Review and Update System Requirements

Outputs– Review of requirements

• Describe relevance of new inventory-focused unpaved roads rating method developing by Tim Colling

– Review of new platforms– Review of latest sensors

Deliverables– Deliverable 5-B: report “Review and Update on URCAS

Requirements, Sensors, and Platforms” • Report submitted to USDOT on Feb. 13th, 2015

14

Deliverable 5-B: “Review and Update of URCAS Requirements, Sensors, and Platforms”

15

Bergen Helicopter (original platform)– Total flight time: 16 minutes (not including 2

minute reserve); flight time for a 200 meter section ~ 4 minutes.

– Flown at 2 m/s at 25 and 30 meters– 50mm prime lens– ~$17k with GPS/IMU

Cessna 172 and 152 Aircraft– Average air speed: 65 knots (~ 75 mph)– Flown at altitudes of 500 and 1000 feet– 105 mm prime lens (2012), 70-200mm zoom

(2013)

Bergen Hexacopter (current platform)– Total flight time: up to 30 minutes with small

payloads– Weight: 4kg unloaded; Maximum Payload: 5kg– Includes autopilot system, stabilized mount that

is independent of platform movement, and first person viewer system (altitude, speed, battery life, etc.)

– ~$5700 with GPS navigation

Overview of Deliverable 5-B: “Review and Update on URCAS Requirements, Sensors,

and Platforms”

Sensor requirements unchanged – >24 MP sensor, 50mm f/1.4 lens, shutter speed1:250/sec or faster, image

capture at 2fps or faster

Nikon D800 initially selected– still recommended for resolution, cost effective, wide range of lenses available– Sony Alpha 7R weighs less (improved range), less expensive, meets other

requirements

16

Airframe Recommendations

17

Airframe recommendations• Multirotor systems recommended

– Bergen Hexacopter still meets requirements

– Other airframes in selected 6 and 8 rotor configurations also meet requirements

– details in Figure 7-1 and Table 7-1 of Project Deliverable 5-B

Airframe Recommendations

18

Task 6: Adapting Remote Sensing Processing System (RSPS) into Commercial Readiness with GIS Extension

Outputs– Software improvements (6-E), inc. a detailed list of the

steps being taken to make the RSPS ready for commercial utilization

• Data conditioning improvements• Script modifications• Algorithm refinement (improve washboarding, rut

detections; potholes & crown sufficiency already work well)

• Evaluation of potential new features / geometries, such as road intersection geometry

– Software outreach (6-D): • Outreach for the use of geospatial XML distress data in

GIS software to multiple transportation agencies. (T.Colling – CTT)

• A description of what steps were taken with GIS software to extend their capabilities to a nationwide audience when combined with URCAS.

19

Example of useful road geometry data

Task 6: Adapting Remote Sensing Processing System (RSPS) into Commercial Readiness with GIS Extension

Deliverables– Deliverable 6-E: report "Adaption of URCAS

Remote Sensing Processing System Software to Include Additional Features and for Commercial Readiness"

– Deliverable 6-D: report "Extension of GIS Decision Support System Tools to a Nationwide Assessment Tool for Unpaved Roads"

20

Unpaved roads data from URCASwithin Roadsoft GIS DSS

Current Remote Sensing Processing System (RSPS) image analysis methodology software flow& overall modular components of URCAS

21

RSPS flow

Modular components of URCAS

Task 8: Field Demonstrations with State and Local Transportation Agencies, Reporting and Technical Advisory

Committee, and Updated Final Report

Outputs– Exposure to multiple transportation agencies of the capabilities of URCAS for

unpaved road asset management.– URCAS results collected and demonstrated for at least three planned states

plus potentially the location of the 2015 or 2016 Low Volume Roads Conference.

• 2015 potential: Kansas, South Dakota (+ local Michigan testing)• 2016 potential: Louisiana, TBD

– Summary of discussions with transportation agencies on how a deployed version of URCAS can help with their system deficiency detection and damage prevention needs.

– Quarterly reports– Regular and clear reporting to the sponsor and stakeholder community– One or more meetings with the Technical Advisory Committee, based on

recommendations of the Program Manager.– Updated project websites (research results focused and client-focused versions)

• www.mtri.org• www.unpavedroadsremotesensing.com

– Draft final report for sponsor review– Final report that addresses sponsors comments

22

Task 8: Field Demonstrations with State and Local Transportation Agencies, Reporting and Technical Advisory

Committee, and Updated Final Report

Deliverables– Deliverable 8-A: report "Quarterly Status and

Progress Reports Including TAC Input" (eight quarterly reports)

– Deliverable 8-C: report "Transportation Agency Field Demonstration Report"

– Deliverable 8-D: report "Updated Final Report"

23

Task 9: Extended Professional Outreach

Outputs– Generation of promotional material such as flyers,

demonstration videos, HTML email announcements and updates, implementation blog and two new webinars.

– Generation of outreach documents such as a business intelligence report, creative brief, technical briefs, executive summary and SlideShare content.

– Organizing field demonstrations for transportation agencies.

• 4 demonstrations (plus Michigan)– Working with Valerie Lefler, Integrated Global

Dimensions (IGD), Outreach Specialist

Deliverables– Deliverable 9-A: report "Professional Outreach for

Implementation to a Nationwide Audience Report"

24

Task 10: Commercialization of URCAS for Day-to-Day Usage

Outputs– Inclusion of private sector inputs on the best practices for third-

party commercialization of URCAS– Working with Woolpert, Inc. of Dayton, Ohio

• Provide expertise on commercialization potential form a business perspective

• Expertise in commercial UAV deployment

Deliverables– Deliverable 10-A: report “Commercialization Report on

URCAS for Day-to-Day Operations”

25

New Acronym & Taglines

Current acronym: URCAS - Unpaved Road Condition Assessment System

New acronyms under consideration:• RSAT – Road Safety Assessment Tool• AURA – Aerial Unpaved Road Assessment• ATTEST – Aerial TransporTation Assessment Tool

• Your input – which one do you like?

• Let’s talk about this more during the Outreach & Demonstration discussion (with Valerie Lefler, IGD, 11 am)

26

New Acronym & Taglines

Tag Line Options:• Rapid Road Safety Assessment Tool

• Effective Rural Road Safety Assessment & Management

• Affordable, Effective, Efficient Road Management

27

2014-2015 Technical and Deliverable Milestone Schedule

Technical and Deliverable Milestone Due Date

Update project website with TAC input; sponsor notified 12/15/2014

Meet with Technical Advisory Committee (3rd meeting); publishing of meeting minutes to website once available 3/24/2015

Submit "Review and Update on URCAS Requirements, Sensors, and Platforms" (Deliverable 5-B) 2/13/2015

Submit 12th Quarterly Status Report (Deliverable 8-A) 1/15/2015

Submit "Adaptation of URCAS Remote Sensing Processing System Software to Include Additional Features and for Commercial Readiness" (Deliverable 6-E)

4/15/2015(asking for

6/15/15)

Submit 13th Quarterly Status Report (Deliverable 8-A) 4/15/2015

Submit 14th Quarterly Status Report (Deliverable 8-A): • Describe progress in developing professional outreach materials in this Quarterly

Status Report7/15/2015

Submit 15th Quarterly Status Report (Deliverable 8-A): • Describe progress in working with private sector on URCAS commercialization • Describe progress in demonstrating URCAS for system deficiency and damage

prevention

10/15/2015

Meet with Technical Advisory Committee (4th meeting); publishing of meeting minutes to website once available 12/15/2015

28

2016 Technical and Deliverable Milestone Schedule

Technical and Deliverable Milestone Due DateSubmit “Extension of GIS Decision Support System Tools to a Nationwide Assessment Tool for Unpaved Roads” (Deliverable 6-D) 1/15/2016

Submit 16th Quarterly Status Report (Deliverable 8-A) 1/15/2016

Submit "Commercialization Report on URCAS for Day-to-Day Operations" (Deliverable 10-A) 4/15/2016

Submit 17th Quarterly Status Report (Deliverable 8-A) 4/15/2016

Include description of system deficiency/damage prevention activity description as part of Deliverable 6-A 7/15/2016

Submit "Transportation Agency Field Demonstration Report" (Deliverable 11-A) 7/15/2016

Submit 18th Quarterly Status Report (Deliverable 8-A) 7/15/2016

Submit Draft of "Final Report" (Deliverable 8-A) 7/15/2016

Submit "Professional Outreach for Implementation to a Nationwide Audience Report" (Deliverable 9-A) 9/30/2016

Submit final version of “Final Report” (Deliverable 8-C) 9/30/2016

29

Administrative Issues – Implementation in light of changing FAA regulations

FAA regulations on UAS operations for private entities are being updated. – The FAA document 14 CFR Part 91 (

http://www.faa.gov/about/initiatives/uas/reg/media/frnotice_uas.pdf) specifically excludes individuals or companies flying model aircraft for business (commercial) purposes.

– For public entities (such as the USDOT), the process of operating a UAS involves obtaining a Certificate of Authorization (COA) for a particular mission. Each mission must have its own COA, which effectively prevents the current use of UASs for arbitrary assessment. Thus, under current FAA guidelines, there had been no way to deploy an unmanned system for this purpose.

– However, some agencies with COAs have been able to get them reapproved within relatively short time periods (< 1 month).

30

Administrative Issues – Implementation in light of changing FAA regulations

This is changing – ex: four companies received exemptions in Dec. 2014 to operate UAVs commercially in parts of the lower 48 (previously commercial usage had been restricted to northern Alaska, and some movie companies) – including a fixed-wing UAV from our Woolpert partner covering 1/3 of Ohio in rural areas

New proposed regulations for small UAVs released February 2015, now in 60-day comment period

Commercial UAV regulations by late 2015 / early 2016

More exemptions for private firms likely under FAA Sec. 333

31

Changing FAA regulations – 2015 and beyond

Section 333 exemption – Commercial operation with limitations– Line of sight– Daylight hours– Under 55 lbs– Airworthiness certificate

potentially required for aircraft– Observer required– Operator must hold valid

Commercial Pilot certificate– https://www.faa.gov/uas/legislativ

e_programs/section_333/

32

Changing FAA regulations – 2015 and beyond

PROPOSED regulations for small UAVs (likely effective 2016/2017)– Line of sight– Daylight operation – No airworthiness certificate required– Max airspeed 100 mph (87 kts)– Under 55 lbs– Max operating altitude 500’ agl– New FAA issued UAS Operator Certificate (no requirement for

a pilot’s license) “$300” cost

Additional sets of regulations – larger UAVs

33

34

Contact InfoColin Brooks cnbrooks@mtu.edu

Desk: 734-913-6858, Mobile: 734-604-4196Michigan Tech Research Institute, MTRI

3600 Green Court, Suite 100Ann Arbor, MI 48105

www.mtri.org Tim Colling, Ph.D., P.E. tkcollin@mtu.edu

Chris Roussi croussi@mtu.edu Rick Dobson rjdobson@mtu.edu

Valerie Lefler valerie.d.lefler@gmail.com

www.mtri.org/unpaved

DISCLAIMER: The views, opinions, findings and conclusions reflected in this presentation are the responsibility of the authors only and do not represent the official policy or position of the USDOT/OST-R, or any State or other entity.