research about dialogue and dialogue systems and the department of linguistics
description
Transcript of research about dialogue and dialogue systems and the department of linguistics
research about dialogue and dialogue systems and the department of linguistics
• goal:– develop theories about human dialogue
which can be used when building dialogue systems
– explore the use of dialogue systems as interfaces to applications and services
• Some projects– TRINDI: Task-Oriented and Instructional Dialogue– SIRIDUS: Specification, Interaction and
Reconfiguration in Dialogue Understanding Systems– D´Homme: Dialogues in the Home Environment
From menu to dialogue
Staffan LarssonInstitutionen för lingvistik
Göteborgs Universitet
Background
• Many applications and services have menu-based interfaces– mobile phone– video– computer– automatic cinema ticket booking via phone
• But menus have certain disadvantages• Dialogue systems provide more user-
friendly interfaces
Overview
• GoDiS: a dialogue system• Meny vs. dialogue• Menu components• Dialogue plans• Converting menus to dialogue plans• Examples
GoDiS: a dialogue system
• dialogue manager – implemented using the information
state approach– based on a theory about dialogue
based on ”Questions Under Discussion” and dialogue plans
– allows flexible dialogue
GoDiS architecture
• modules:– speech recogniser– language interpreter
– dialogue manager– language generator– speech synthesis
• Information state• resources
– lexicon, database, domain knowledge
inputinter-pret
Information State
lexicon
control
update selectgene-rate
output
data-base
domain
Typical human-computer dialogin a travel agency
S: Hello, how can I help you?U: I want price information pleaseS: Where do you want to go?U: ParisS: How do you want to travel?U: A flight pleaseS: When do you want to travelU: AprilS: what class did you have in mind?…S: The price is $123
Typical human-human dialogue
S(alesman), C(ustomer)S: hiC: flights to ParisS: when do you want to travel?C: April, as cheap as possible...
Flexible dialogue with GoDiS in the travel agency domain
• answering question which have not yet been asked, but which are relevant to some task– S: when do you want to travel?– U: in April, as cheap as possible
• providing information without specified task– S: hello– U: flights to Paris
Menus vs. dialogue:Drawbacks of menus
• User must follow predesigned menu structure
• this structure may be complicated and difficult to learn
• menus allow only one activity at a time
Menu vs. dialogue:Advantages of flexible dialogue
• provide information in any order• provide information without pre-
specifying the task • doing several things at once• not necessary to learn menu
structure
Menu components
• multiple-choice list– the user selects one of several prespecified
choices
• dialogue window– user types requested information
• tickbox– user ticks box (or not)
• system message– information from system; user clicks ”OK”
Sample menu from a Noka 3210
• search phonebook– dialogue window to type in name
• Name: _______
– message showing the number• Kalle 031 12 34 56
– tickbox: whether to call this person• Call
– if a call is made, a message:• Calling 031 12 34 56
Dialogue plans
• dialogue plans are partial specifications of how the system should act in a dialogue– action sequences, conditions etc
• Actions:– find the answer to a question– answer a question– inform – search database– domain-specific actions, e.g. phone up
number
Questions
• yes/no-question– ” Do you want to call NN?”
• wh-question: who, what, which....– ”Who do you want to search for?”
• alternative-question– ”Do you want to search, add to, erase
from or change the phonebook?”
Converting from menu to dialogue plan
Menu Planmulti-choice list alternative
question
tickbox yes/no-question
dialogue window wh-question
message inform
the menu again
• search phonebook– dialogue window to type in name– message showing the number– tickbox: whether to call this person– if a call is made, a message
corresponding plan
1 question: what name? 2 search database for NUMBER matching
the name3 answer: the number is (NUMBER)4 ask: do you want to call?5 if yes then
call up number:NUMBERinform: calling NAMN
another plan: assign ringing tone
1 ask: what name? 2 ask: which ringing tone?3 assign the ringing tone to the name4 inform: the ringing tone for (NAME) is no
(RINGING TONE)
Example 1: standard menu navigation
• U:Go to the phonebook• S: Phonebook. Do you want to search, add, or
remove an entry, or assign a ringing tone? • U: Assign ringing tone• S: What name?• U: John• S: Which ringin tone?• U: Bossanova• S: The ringing tone for John is now Bossanova.
Example 2: providing information which has not
been asked for• U: Assign ringing tone• S: What name?• U: Bossanova for John• S: The ringing tone for John is now
Bossanova.
Example 3: provide information without
assigning task(I)
• U: Bossanova for John• S: The ringing tone for John is now
Bossanova.
Example 4: provide information without assigning task (II)
• U: 5 o’clock• S: Do you want to set the clock or
the alarm clock? • U: alarm clock• S: the alarm clock is now set to 5
Example 5 (video): system requests missing information• U: record from 19:30 to 20:00
today• S: What channel?• U: Seven• S: OK, I will record channel 7 from
19:30 to 20:00 today.
Demo
• GoDiS has been adapted to several domains, including– travel agency– mobile phone interface (course project)– interface to intellegent house– cinema ticket booking (MA thesis)– internet search (MA thesis)– telephone receptionist
• We will give a demo of the mobile phone interface
demo
• GoDiS i resebyrådomänen• 14.30-15.00• F317
Dialogplaner
• handling: A
• handlingssekvens: A1,A2,..., An
• villkorssatser: – if_then(P,C)
• P är ett villkor• Om P är uppfyllt, gör C