TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99...
-
Upload
jamal-reddan -
Category
Documents
-
view
213 -
download
0
Transcript of TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99...
![Page 1: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/1.jpg)
26-8-99
TUDelftKnowledge Based Systems Group
Zuidplantsoen 42628 BZ Delft, The Netherlands
Dialogue Controlin the Alparon System
Niels Andeweg
![Page 2: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/2.jpg)
Dialogue Control in the Alparon System 2 TUDelft
Information Technology and Systems
Knowledge Based Systems– Artificial Intelligence
Alparon– multi-media– automatic speech processing– dialogue management
![Page 3: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/3.jpg)
Dialogue Control in the Alparon System 3 TUDelft
Assignment design dialogue control for the Alparon
system implement prototypes of the components
for dialogue control
![Page 4: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/4.jpg)
Dialogue Control in the Alparon System 4 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
![Page 5: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/5.jpg)
Dialogue Control in the Alparon System 5 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
![Page 6: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/6.jpg)
Dialogue Control in the Alparon System 6 TUDelft
ASP system
dialogue manager
application
speech recognition
speechgeneration
natural languagecomponent
meaning extraction
response generation
![Page 7: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/7.jpg)
Dialogue Control in the Alparon System 7 TUDelft
Dialogue managementWhy dialogue management? spread out user requirements discourse phenomena
Tasks: provide context problem solving response generation
![Page 8: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/8.jpg)
Dialogue Control in the Alparon System 8 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
![Page 9: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/9.jpg)
Dialogue Control in the Alparon System 9 TUDelft
Alparon system information retrieval and transaction
services natural language speech interface mixed-initiative focus on dialogue management strategies in human-human dialogues
![Page 10: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/10.jpg)
Dialogue Control in the Alparon System 10 TUDelft
Alparon model
Text tospeech
Parser CoderSpeech
recognition
Textgeneration
Dialoguemanager
Userinterface
bytelephone
Languageatmosphere
![Page 11: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/11.jpg)
Dialogue Control in the Alparon System 11 TUDelft
Alparon DM
Task coordinator
Blackboard system
Discourse manager
Databasemanager
Rest of theASP system
Dialogue manager
![Page 12: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/12.jpg)
Dialogue Control in the Alparon System 12 TUDelft
Discourse Manager
Task coordinator
Disambi-guation
Contextupdating
Referencehandling
QueryResponsegeneration
Dialogueact
generation
Discourse Manager
![Page 13: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/13.jpg)
Dialogue Control in the Alparon System 13 TUDelft
Blackboard system
Task coordinator
Blackboard system
Informationboard
Statusboard
HistoryBoard
Controlboard
Presentationboard
![Page 14: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/14.jpg)
Dialogue Control in the Alparon System 14 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
![Page 15: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/15.jpg)
Dialogue Control in the Alparon System 15 TUDelft
Dialogue controlTasks structure dialogue generate responses
Two kinds of information
‘What time does the train to Amsterdam leave?’
![Page 16: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/16.jpg)
Dialogue Control in the Alparon System 16 TUDelft
Approach task-oriented dialogues plan-based goal structure
– level of abstraction– task & dialogue goals
determine departure station
verify departure station– dynamic
![Page 17: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/17.jpg)
Dialogue Control in the Alparon System 17 TUDelft
Achievement operations
– deductions– default behaviour
interaction– ‘Departure at 8:30.’– ‘What is your departure station?’
strategy
![Page 18: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/18.jpg)
Dialogue Control in the Alparon System 18 TUDelft
Implementation framework rulesets
Two steps– determine consequences of user’s turn
dialogue updating module– generate response
response generation module
Java
![Page 19: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/19.jpg)
Dialogue Control in the Alparon System 19 TUDelft
Dialogue updating moduleProcess effects of user’s turn new information conflicts choices reaction
![Page 20: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/20.jpg)
Dialogue Control in the Alparon System 20 TUDelft
Response generation moduleGenerate a system response actions candidates combine
![Page 21: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/21.jpg)
Dialogue Control in the Alparon System 21 TUDelft
Control boardStore information for dialogue control goalstack conflicts choices response
![Page 22: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/22.jpg)
Dialogue Control in the Alparon System 22 TUDelft
Strategy 1 decomposition
achievementslot Time contains departure time
slot DeparturePlace is verified
communicated
operationscity(Delft) station(Delft)
date = today
CdetermineNeed…..
AdetermineDep, AdetermineArr
…..AdetermineTime, AdetermineDate
![Page 23: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/23.jpg)
Dialogue Control in the Alparon System 23 TUDelft
Strategy 2 reactions
reconfirmation of departure place reconfirm(DepPlace)
start dialogue ChelpUser
actionsAverify(time) [VerifyExplicit(time), VerifyImplicit(time)]
Adetermine(DepPlace) [Ask(DepPlace), Ask(Where), Encourage)]
combinations– VerifyImplicit(*): {Ask(*)}
![Page 24: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/24.jpg)
Dialogue Control in the Alparon System 24 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
![Page 25: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/25.jpg)
Dialogue Control in the Alparon System 25 TUDelft
Train timetable information travelplan for train connections mixed-initiative information needed
– departure station– arrival station– departure or arrival time– date
![Page 26: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/26.jpg)
Dialogue Control in the Alparon System 26 TUDelft
Phases greeting determination of user’s need query presentation further needs goodbye
![Page 27: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/27.jpg)
Dialogue Control in the Alparon System 27 TUDelft
Example actionsAdetermine(DepPlace): [Ask(DepPlace),
Ask(Place), Encourage]
Adetermine(ArrPlace): [Ask(ArrPlace), Ask(Place), Encourage]
Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]
Adetermine(Date): [Ask(date), Ask(When)]
Averify(*): [VerifyExplicit(*), VerifyImplicit(*)]
![Page 28: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/28.jpg)
Dialogue Control in the Alparon System 31 TUDelft
Example dialogue 4U4: I want to go to Den
Haag central station.
Gs: Cclose
CfurtherNeeds
Cpresent
Cquery
Adetermine(Time)
Res: Ask(When)
S4: When do you want to travel?
Achoice(*): communicated
Adetermine(ArrPlace):
ArrPlace is station & ArrPlace has user
Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]
![Page 29: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/29.jpg)
Dialogue Control in the Alparon System 32 TUDelft
Example dialogue 5U5: …???…
Gs: Cclose
CfurtherNeeds
Cpresent
Cquery
Adetermine(Time)
Res: Ask(Time)
S5: At what time do you want to travel?
Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]
![Page 30: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/30.jpg)
Dialogue Control in the Alparon System 33 TUDelft
Example dialogue 6U6: I want to arrive at half
past nine.
Gs: Cclose
CfurtherNeeds
ApresentPart(3)
ApresentPart(2)
ApresentPart(1)
Res: PresentPart(1)
S6: OK. Departure at 7:35 in Baarn to Utrecht.
Adetermine(Time):
Time is ArrTime(*)
Cquery: [[Aquery]]
Aquery:
true : send(QM, query, empty body, queryDone)
Cpresent: [[ApresentPart(*)]]
ApresentPart(*): [PresentPart(*)]
![Page 31: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/31.jpg)
Dialogue Control in the Alparon System 40 TUDelft
Contents Automatic speech processing (ASP) Alparon system Dialogue control Train timetable information system Conclusions
![Page 32: TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg.](https://reader035.fdocuments.us/reader035/viewer/2022081518/551a740c55034643688b51cf/html5/thumbnails/32.jpg)
Dialogue Control in the Alparon System 41 TUDelft
Conclusions two modules and a blackboard generic framework with rulesets mixed-initiative reactions adequate rulesets testing with complete system