Speech Graffiti Tutorial

MovieLine version

Fall 03

What is Speech Graffiti?SPEECH GRAFFITI is a special way of speaking that makes it faster for you to exchange information with a computer that understands your speech. Speech Graffiti is easy to learn This tutorial will teach you how

This tutorial uses a movie information system as an example, and afterwards you should be able to use any Speech Graffiti application. Let's get started!

PhrasesWith Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time Titanic is playing at the Manor theater on Tuesday….

On a form, you'd have to fill in this information:

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

movie is Titanic, theater is the Manor, day is Tuesday

PhrasesWith Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time Titanic is playing at the Manor theater on Tuesday….

On a form, you'd have to fill in this information:

See the pattern?

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

movie is Titanic, theater is the Manor, day is Tuesday

PhrasesWith Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time Titanic is playing at the Manor theater on Tuesday….

On a form, you'd have to fill in this information:

See the pattern? You always give the type of thing you're talking about…

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

movie is Titanic, theater is the manor, day is Tuesday

PhrasesWith Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time Titanic is playing at the Manor theater on Tuesday….

On a form, you'd have to fill in this information:

See the pattern? You always give the type of thing you're talking about…

then say is…

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

movie is Titanic, theater is the manor, day is Tuesday

PhrasesWith Speech Graffiti, you provide information to the system as if you were filling in a form.

Say you're wondering what time Titanic is playing at the Manor theater on Tuesday….

On a form, you'd have to fill in this information:

See the pattern? You always give the type of thing you're talking about… then say is… then state the value you want to specify for that field.

With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information

The phrases always sound like this:

movie is Titanic, theater is the manor, day is Tuesday

Other applicationsAs you just learned, input might look like this in a movie application movie is Titanic, theater is the Manor, day is Tuesday

But Speech Graffiti works with many different applications

For instance, in a flight information system, you might say airline is USAirways, flight number is

28, departure city is Los Angeles

So you can see that although the vocabulary is different, the structure

is the same

ConfirmationThe Speech Graffiti system will always confirm what it thought it heard you say

movie is Titanic

Titanic

theater is the Manor, date is Tuesday

the Cinemagic Manor theater, Tuesday

If anything goes wrong, you can start over by saying start over

start over

Practice: phrases

How would you make Speech Graffiti phrases with the following information?

1. Showcase East theater

2. on Sunday

3. comedies

Practice: phrases

How would you make Speech Graffiti phrases with the following information?

1. Showcase East theater

2. on Sunday

3. comedies

theater is Showcase East

Practice: phrases

How would you make Speech Graffiti phrases with the following information?

1. Showcase East theater

2. on Sunday

3. comedies

theater is Showcase East

day is Sunday

Practice: phrases

How would you make Speech Graffiti phrases with the following information?

1. Showcase East theater

2. on Sunday

3. comedies

theater is Showcase East

day is Sunday

genre is comedy

If things go wrong

If the system doesn’t understand a phrase, it won’t confirm it, and it will also play this sound to alert you that it missed something.  Then you can simply repeat the missing phrase, like this:   

theater is Showcase East, genre is thriller

theater is Showcase East 

Showcase Cinemas Pittsburgh East

...thriller!

!

after 7 pm

Sometimes the system confirms the wrong information If this happens, you can erase your whole last utterance by saying scratch that, and then re-entering the erased info:

If things go wrong

theater is the Manor, show

time is after 7pm

scratch that scratched

Cinemagic Manor Theater, after 10 pm

theater is the Manor

Cinemagic Manor Theater

show time is after 7pm

Regent Square theater

If you ever find yourself wondering what information the system has successfully understood and retained from your query, you can just ask where was I?

Where was I?

movie is TitanicTitanic

where was I?

movie is Titanic, show time is before 10 pm

theater is Regent Square

theater is Regent Square, show

time is before 10 pm …before 10 pm!

ReviewSo now you know how to give information in Speech Graffiti phrases… theater is the Manor

How to recover from problems start over scratch that

How to find out what the system has stored where was I?

But you don't want to just give info to the system – you want to get info from it That's the next thing you'll learn…

To get information, ask a what?-question

Asking questions

theater is the Manor, movie is Titanic

Cinemagic Manor Theater, Titanic

what are the show times? 

3 show times: 5:25pm, 8:10pm, 11:30pm

To get information, ask a what?-question

Asking questions

So you just say…

theater is the Manor, movie is Titanic

Cinemagic Manor Theater, Titanic

what are the show times? 

3 show times: 5:25pm, 8:10pm, 11:30pm

To get information, ask a what?-question

Asking questions

So you just say… what are (or what is)…

theater is the Manor, movie is Titanic

Cinemagic Manor Theater, Titanic

what are the show times? 

3 show times: 5:25pm, 8:10pm, 11:30pm

To get information, ask a what?-question

Asking questions

So you just say… what are (or what is) and then the thing you want to know about

theater is the Manor, movie is Titanic

Cinemagic Manor Theater, Titanic

what are the show times? 

3 show times: 5:25pm, 8:10pm, 11:30pm

To get information, ask a what?-question

Asking questions

So you just say… what are (or what is) and then the thing you want to know about

As another example, you could ask what is the rating?

theater is the Manor, movie is Titanic

Cinemagic Manor Theater, Titanic

what are the show times? 

3 show times: 5:25pm, 8:10pm, 11:30pm

Other applications

As with specifying phrases, when you ask questions in other Speech Graffiti systems, the vocabulary is different but the structure is the same airline is United,

flight number is 1123,

arrival city is Las Vegas,

what is the arrival time?

more

For general Speech Graffiti help, just say helpSpeech Graffiti can also let you know what kinds of things you can talk about in the system you're using just say options

Getting help

options

show times are after 10 pm, genre options 

you can specify or ask about title, theater, show time …

comedy, drama, or you can ask, what is the genre?

genre can be action, adventure,animation …

The Speech Graffiti system plays this sound that you saw in the last slide when it is telling you about a long list

Whenever you hear this sound, you can say more to hear the next chunk of the listWhen you're browsing a list, you can also navigate through the list by saying next – gives you the next single item previous – gives you the previous chunk first – goes back to the first item in the list last – skips ahead to the last item in the list repeat

Lists…

Practice: questions & helpHow would do the following in Speech Graffiti?

1. find out which movies are playing at the Manor theater

2. find out all the neighborhoods you can ask about

3. hear the next chunk of a list

Practice: questions & helpHow would do the following in Speech Graffiti?

1. find out which movies are playing at the Manor theater

2. find out all the neighborhoods you can ask about

3. hear the next chunk of a list

theater is the Manor, what are the movies?

Practice: questions & helpHow would do the following in Speech Graffiti?

1. find out which movies are playing at the Manor theater

2. find out all the neighborhoods you can ask about

3. hear the next chunk of a list

theater is the Manor, what are the movies?

neighborhood options

Practice: questions & helpHow would do the following in Speech Graffiti?

1. find out which movies are playing at the Manor theater

2. find out all the neighborhoods you can ask about

3. hear the next chunk of a list

theater is the Manor, what are the movies?

neighborhood options

more

ReviewIn Speech Graffiti, you provide information in phrases & ask what-questions to get info theater is the Manor, what are the movies?

start over and scratch that help you recover from errors

where was I? lets you know what the system knows

means the system didn’t understand something you said, and means there are more items in a list

!…

HintsWhen you’re using a new application for the first time, say options to learn what you can talk about with that system

Talk to the system in a normal voice

Speech Graffiti remembers what you enter until you say start over see example on next slide

where was I?

theater is Cinemagic Manor theater, what is show time?, title is Titanic

Titanic, 5 show times, 1:25pm, 3:50pm, 7:10pm …

where was I?

theater is Cinemagic Manor theater, what is show time?

theater is the Manor, what are the show

times?

title is Titanic, go ahead

Cinemagic Manor theater, 58 show times: 11:50am, noon, 12:05pm …

If the system already has a question stored, saying go ahead will re-ask that question

OK – that's all there is to know about Speech Graffiti! Have fun!

Ready?