Light Vehicle Extended Pilot Test...Extended Pilot Test (EPT) Objectives • Demonstrate FOT...
Transcript of Light Vehicle Extended Pilot Test...Extended Pilot Test (EPT) Objectives • Demonstrate FOT...
11
Light Vehicle Extended Pilot Test
Dave LeBlancMary Lynn Buonarosa
Adam BlankespoorUMTRI
Extended Pilot Test (EPT) Objectives
• Demonstrate FOT readiness through a full dress rehearsal.– 12 drivers from the general public– 4 FOT vehicles equipped with IVBSS– Experimental process exercised
• Success criteria:– Is driver acceptance positive?– Does IVBSS perform as expected? Is it robust?– Is data collection reliable?– Is the experimental process ready for the FOT?
2
Light Vehicle Field Operational Test & Extended Pilot Test
Platform Test Drivers / usage period Travel distance
Light vehicle
FOT 108 drivers @ 6 wksplus 10 drivers @ 6 additional wks
Baseline ( 2 weeks )IVBSS enabled (4 weeks)
272,000 Miles*436,000 Km
Extendedpilot
12 drivers @ 4 weeks
IVBSS enabled only (4 weeks)
12,600 Miles20,200 Km
* Prediction based on previous FOTs
Drivers for both tests: •Evenly split by gender•Evenly split by age groups (20-30, 40-50, 60-70 years)
Driver Recruitment & Orientation
• Recruitment with licensing agency database– Southeast Michigan resident with 2 yrs driving, no
egregious violations, and self-reported mileage at least 75% of average NPTS for the age/gender group.
• Pre-drive information and training:– Informed consent form – Questionnaires: demographic background,driver
behavior questionnaire (DBQ), driver style questionnaire (DSQ)
– Video overview of IVBSS– Hands-on demonstration, including static demo of driver
interfaces, and on-road test driveFebruary 10, 2009 IVBSS 11th Quarterly Briefing 4
Post-Drive Instruments
• Written Questionnaire– General Impression of IVBSS– Combinatorial Effects of the Warnings– Forward Crash Warning (FCW)– Lateral Drift Warning (LDW)– Lane Change/Merge Warning (LCM)– Overall IVBSS Warning Acceptance– Displays and Controls– Training and Ease of Learning
• Verbal questions• Video-assisted review of the driver’s alerts
IVBSS Data Acquisition System
Data sources: CAN buses – IVBSS, OEM J1939 (heavy truck) 5 cameras with video capture &
compression 6 or 7 radars Onboard map match (LV)UMTRI Data acquisition system: Two CPU system Automotive-grade hard disks Second GPS Vehicle motion IMU Microphone………ETC! GPRS/Edge cellular modem DAS power management system
77
Travel During EPT
Total distance traveled: 12,629 miles.99.7% of distance traveled was capturedby DAS.
Video
8
99
Alerts by Warning Functionality
Note: 45% of alerts involve no audible alerts, only haptic seat vibration.
(All alerts are followed by text on the OEM center-stack display.)
FCW/audible9%
CSW/audible6%
LDW‐unoccupied/
haptic45%
LDW‐occupied/audible22%
LCM/audible18%
Alert Experience Varies by Driver
38%
6% 31%
4%
21%
Driver 20113%
11%
51%
2%
23%
Driver 2028%
12%
61%
15%3%
Driver 203
17%
36%
37%
6%4%
Driver 204
14%
31% 48%
< 1%6%Driver 205
7%
21%
49%
4%
18%
Driver 206
20%
14%
50%
2%
14%Driver 207
41%
20%
29%
3%6%
Driver 208
16%
30% 51%
3%< 1%Driver 209
22%
9%
52%
11%6%
Driver 210
21%
34%
27%
4%
14%Driver 211
6%6%
44%
< 1%
44%
Driver 212
LDW-unoccupiedLDW-occupiedLCMFCWCSW
1111
Alerts Per 100 Mi (161 Km)
Individual drivers Mean
0.0
2.5
5.0
7.5
10.0
12.5
15.0
17.5
Overall Alert Rate by Individual Drivers
121225 < V < 35 35 < V < 55 V > 55
0
10
20
30
40
50
60
70
80
90
100LDW Lane Tracking Availability Results
Per
cent
age
of T
ime
Ava
ilabl
e
LeftBothRight
Host speed (mph)
LDW AvailabilityNote: Testing in Winter
13
Subjective Results: Overview
Questionnaire topic MeanHelpful 6.3Attention‐getting 6.6Not annoying 6.1Not distracting 5.7Will increase driving safety 6.3
14
Questionnaire: Sample of Response Distribution
0
2
4
6
8
10
1 2 3 4 5 6 7
Res
pons
e Fr
eque
ncy
Overall, how satisfied were you with the integrated system?
Mean = 6.4 St. Dev = 0.8
VeryDissatified
VerySatisfied
15
Sanity Check: Comparing IVBSS to RDCW FOT
Using Van der Laan Ratings
0
0.5
1
1.5
2
0 0.5 1 1.5 2
Satis
fact
ion
Usefulness
RDCW
IVBSS
Very useful,very satisfied
Neutral
• IVBSS extended pilot test results : 11 subjects feedback.• RDCW FOT results: 78 drivers.
LV pilot
Safety impacts & driver performance - Examples
• Examine:– Driving pattern changes:
• Involvement in scenarios, e.g., approaches to decelerating lead vehicles
• Changes in pre-conflict and conflict distributions, e.g., headway times, forward conflict distributions, lane change metrics, curve-taking
– Driver response to events– Unintended consequences
• Estimates of potential safety benefits - Volpe
Example - Forward conflict –analysis steps*
17
-1.5
-0.8
Dec
el-to
-avo
id (m
/sec
^2)
Time to collision(sec)0 0
Region defining candidateconflict episodes
0.5
continues
10
0
5
10
15
20
25
4 4.5 5 5.5 6 6.5 7 7.5 8 8.5 9 9.5 10
Driver's mean enhanced TTC at brake onset (sec)
Num
ber o
f driv
ers
Week 1
Weeks 3, 4
* ACAS FOT [USDOT HS 809 901]
1818
LV Extended Pilot Test Conclusions
• Driver acceptance of IVBSS is high. • IVBSS performed well, but modest changes and
calibration changes would reduce potential nuisance alerts in specific scenarios.
• IVBSS was robust in the field. • Data collection & management is ready, with
adjustments.• Recruitment, subject handling, and subjective data
instruments is ready, with adjustments.