P54 Presentation at 2007 ITU Fully Networked Car Workshop
24
Geneva, 7-9 March 2007 Using Speech to Interact with In-Car Devices in the Project54 System Andrew Kun University of New Hampshire
-
Upload
andrew-kun -
Category
Technology
-
view
894 -
download
1
description
These are the slides from the presentation I gave at the 2007 ITU Fully Networked Car Workshop in Geneva, Switzerland.
Transcript of P54 Presentation at 2007 ITU Fully Networked Car Workshop
Geneva, 7-9 March 2007
Using Speech to Interact with In-Car Devices in the Project54 System
Andrew KunUniversity of New Hampshire
The Fully Networked Car Geneva, 7-9 March 2007
2Outline
o Introductiono Speech user interface testingo Driving simulator studieso Conclusion
The Fully Networked Car Geneva, 7-9 March 2007
3What is the problem?
The Fully Networked Car Geneva, 7-9 March 2007
4The system in the car
The Fully Networked Car Geneva, 7-9 March 2007
5Speech user interface
o Command and control interfaceo Microsoft speech recognition (SR) engineo Microsoft text-to-speech (TTS) engineo Directional microphoneo Push-to-talk (PTT) buttono Grammars
The Fully Networked Car Geneva, 7-9 March 2007
6Outline
o Introduction
o Speech user interface (SUI) testing
o Driving simulator studieso Conclusion
The Fully Networked Car Geneva, 7-9 March 2007
7Testing
o Officer volunteers: 27o Corpus: just under 50,000 utteranceso Utterances: while PTT is pressed
The Fully Networked Car Geneva, 7-9 March 2007
8Speech user interface (SUI) performance
o Recognized: 85 %o Unrecognized: 4 %o Misrecognized: 11 %
The Fully Networked Car Geneva, 7-9 March 2007
9Reasons for imperfect recognition
o SR engine error: 37 %o User error: 63 %
The Fully Networked Car Geneva, 7-9 March 2007
10SR engine error example
o Utterance: 0 3 2 1 8 5o → Recognized 0 3 2 1 0 5 7 1o → Recognized OK
The Fully Networked Car Geneva, 7-9 March 2007
11User errors
o Utterance not in any grammar: 54 %o Utterance in another grammar: 34 %o PTT (“Patrol screen” ): 12 %
The Fully Networked Car Geneva, 7-9 March 2007
12Outline
o Introductiono Speech user interface testing
o Driving simulator studieso Conclusion
The Fully Networked Car Geneva, 7-9 March 2007
13Driving simulator
The Fully Networked Car Geneva, 7-9 March 2007
14Driving simulator studies
o Multi-threaded dialogueso SUI and driving
The Fully Networked Car Geneva, 7-9 March 2007
15Multi-threaded dialogues
o National Science Foundation granto Goal: interact with multiple real-time
devices using speecho Manual-visual task!o Human-human to human-computer
interaction
The Fully Networked Car Geneva, 7-9 March 2007
16SUI and driving – police radio
The Fully Networked Car Geneva, 7-9 March 2007
17SUI and driving
o Two experiments (8 subjects) :• Baseline + radio• Baseline + SUI
o Record:• Lane position• Velocity• Steering wheel angle
The Fully Networked Car Geneva, 7-9 March 2007
18Lane position – radio
The Fully Networked Car Geneva, 7-9 March 2007
19Lane position – SUI
The Fully Networked Car Geneva, 7-9 March 2007
20Outline
o Introductiono Speech user interface testingo Driving simulator studies
o Conclusion
The Fully Networked Car Geneva, 7-9 March 2007
21Status
o February 2007: ≈900 cars on the road in USA(New Hampshire, Massachusetts, California, Maryland)
o Industry participation
The Fully Networked Car Geneva, 7-9 March 2007
22Research and development directions
o SUI and drivingo SUI performance improvements (SR
training, …)o SUI performance relation to driving task
difficulty, recognizer accuracyo Intelligent interaction (multi-threaded
dialogues, natural language processing, …)
o Non-speech work (handhelds, telematics, …)
o Standards
The Fully Networked Car Geneva, 7-9 March 2007
23Acknowledgement
o US Department of Justiceo National Science Foundation
The Fully Networked Car Geneva, 7-9 March 2007
24www.project54.unh.edu
