Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE...

Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain

Dan Bohus, Alex Rudnicky

MITRE Workshop on Dialog Management,Boston, October 2003

10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…

Overall Architecture

ParsingPHOENIX/HELIOS

Dialog Manag.RAVENCLAW

Back-end(perl)

Language Gen.ROSETTA

RecognitionSPHINX

SynthesisFESTIVAL


Overall Architecture (internals)



Back-end(perl)


HUB

FESTIVALSERVER

RecognitionSPHINX

SynthesisFESTIVAL

Galaxy





Back-end(perl)


RecognitionSPHINX

SynthesisFESTIVAL





Back-end(perl)


Text I/OTTYServer

RecognitionSPHINX

SynthesisFESTIVAL


Developed Resources



Back-end(perl)


Text I/OTTYServer

Grammar

Templates

RavenClawDialogTask

Specification

Back-end(perl)


Development Time



Back-end(perl)


Text I/OTTYServer

Grammar

Templates

RavenClawDialogTask

Specification

Back-end(perl)

RC Fixes 2h15, 11%

RavenClaw 4h, 19%

Design 4h, 18%

Setup 1h10, 5%

Grammar3h45, 18%

Backend3h20, 16%

Templates 2h45, 13%

Total: 21:15h


RavenClaw Architecture

Captures all domain-specific dialog (task) logic with a hierarchical description

The authoring effort is focused entirely here

Dialog Task (Specification)

Domain-independent Dialog Engine

Manages dialog by executing the dialog task specification

Provides domain-independent conversational strategies



Dialog Stack

Madeleine

E:LoadSymptoms GeneralFeel

R:HowAreYou? I:Glad I:Sorry

Diagnose

Fever Travel

R:AskFever E:MeasureTemp I:InformFever

I:Welcome

Expectation Agenda

general_feeling

chart

have_fever

diagnostic



Dialog Stack

Madeleine

Madeleine



Diagnose

Fever Travel


I:Welcome

Expectation Agenda

general_feeling

chart

have_fever

diagnostic



Dialog Stack

Madeleine

Welcome

Madeleine



Diagnose

Fever Travel


I:Welcome

Expectation Agenda

general_feeling

chart

have_fever

diagnostic



Dialog Stack

Madeleine

Hi, this is Madeleine, the automated…

Madeleine



Diagnose

Fever Travel


I:Welcome

Expectation Agenda

general_feeling

chart

have_fever

diagnostic



Dialog Stack

Madeleine


Madeleine



Diagnose

Fever Travel


I:Welcome

LoadSymptoms

R:Headache R: R: R:

Expectation Agenda

general_feeling

chart

have_fever

diagnostic

headache



Dialog Stack

Madeleine


Madeleine



Diagnose

Fever Travel


I:Welcome

R:Headache R: R: R:

Expectation Agenda

general_feeling

chart

have_fever

diagnostic

headache



Dialog Stack

Madeleine


Madeleine



Diagnose

Fever Travel


I:Welcome

R:Headache R: R: R:

GeneralFeel

Expectation Agenda

general_feeling

chart

have_fever

diagnostic

headache



Dialog Stack

Madeleine


Madeleine



Diagnose

Fever Travel


I:Welcome

R:Headache R: R: R:

GeneralFeel

How are you feeling today?

general_feeling

chart

have_fever

diagnostic

HowAreYou

Expectation Agenda

general_feeling: [good], [bad], [soso]

general_feeling: [good], [bad], [soso] [good], [bad], [soso]

general_feeling: [good], [bad], [soso] [good], [bad], [soso]have_fever: [fever]. ![yes], ![no] ![yes], ![no]headache: [headache], ![yes], ![no] ![yes], ![no]cough: [cough], ![yes], ![no] ![yes], ![no]……

GeneralFeel

I:Glad I:Sorry

Not so good, I think I have a fever[soso](not so good)[fever](I think I have a fever)

headache

GeneralFeel


Illustrated Features

Dynamic generation of dialog task structure Symptoms loaded from backend, appropriate

structures to “talk about them” created on-the-fly New symptoms – no DM changes

Dynamic dialog control policy The order in which symptoms are addressed is

controlled by the backend

Conversational skills


Dynamic Dialog Control …

Dialog Stack

Madeleine

Hi, this is Madeleine, the automated…How are you today?Not so good, I think I have a headacheSorry to hear you’re not feeling so good,Tell me more about your symptoms…Do you have abdominal pain?

Madeleine



Diagnose

Fever Travel


I:Welcome

R:Headache R: R: R:

Diagnose

Expectation Agenda

general_feeling

chart

have_fever

diagnostic

headache

Backend Decision Tree


Illustrated Features

Dynamic generation of dialog task structure Symptoms loaded from backend, appropriate

structures to “talk about them” created on-the-fly New symptoms – no DM changes

Dynamic dialog control policy The order in which symptoms are addressed is

controlled by the backend

Conversational skills


Conversational Skills

Corresponding agencies added automatically to the dialog task tree Help What Can I Say? Repeat Suspend / Resume Start Over Timeout handling (not illustrated)

Still need all the language generation prompts and grammar, but some of those are develop-once, too


Conclusion

Highlights Set task posed no challenges to the framework

Easy to implement Dynamic dialog structure and control Automatic use of domain-independent

conversational skills

Lowlights? Toolkit perspective: how easy would it be for

someone else to build it? Asynchronous behaviors? (timing) Couple of bugs / fixes (or is that a highlight?) …


Demo

Run


RavenClaw Grounding

Madeleine



Diagnose

Fever Travel


I:Welcome

R:Headache R: R: R:

general_feeling

chart

have_fever

diagnostic

headache

Grounding EngineStateIndicators

Strategies


Other RavenClaw systems

LARRI – Language Assistant for Retrieval of Repair Information

RoomLine – Conference room reservation within SCS

Let’s Go! (BusLine) – Bus schedule information in Pittsburgh

TeamTalk – Command and control for a team of robots

Eureka – Dialog interface to a clustered web search engine (Vivisimo)

Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE...

Documents

Transcript of Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE...