Speech Graffiti Tutorial

1
Speech Graffiti Tutorial

• FlightLine version
• Fall 03

2
What is Speech Graffiti?

• SPEECH GRAFFITI is a special way of speaking that
  makes it faster for you to exchange information
  with a computer that understands your speech.
• Speech Graffiti is easy to learn
• This tutorial will teach you how
• This tutorial uses a flight information system as
  an example, and afterwards you should be able to
  use any Speech Graffiti application.
• Let's get started!

3
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time USAirways
  flight 28 leaves Los Angeles.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• airline is USAirways, flight number is 28,
  departure city is Los Angeles

4
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time USAirways
  flight 28 leaves Los Angeles.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• airline is USAirways, flight number is 28,
  departure city is Los Angeles

• See the pattern?

5
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time USAirways
  flight 28 leaves Los Angeles.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• airline is USAirways, flight number is 28,
  departure city is Los Angeles

• See the pattern?
• You always give the type of thing you're talking
  about

6
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time USAirways
  flight 28 leaves Los Angeles.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• airline is USAirways, flight number is 28,
  departure city is Los Angeles

• See the pattern?
• You always give the type of thing you're talking
  about
• then say is

7
Phrases

• With Speech Graffiti, you provide information to
  the system as if you were filling in a form.
• Say you're wondering what time USAirways
  flight 28 leaves Los Angeles.
• On a form, you'd have to fill in this
  information

• With Speech Graffiti, you speak this information
  in PHRASES just as if you were filling out a
  form one phrase for each piece of information
• The phrases always sound like this
• airline is USAirways, flight number is 28,
  departure city is Los Angeles

• See the pattern?
• You always give the type of thing you're talking
  about
• then say is
• then state the value you want to specify for that
  field.

8
Other applications

• As you just learned, input might look like this
  in a flight application
• airline is USAirways, flight number is 28,
  departure city is Los Angeles
• But Speech Graffiti works with many different
  applications
• For instance, in a movie info system, you might
  say
• movie is Titanic,
  theater is
  the Manor,
  day is Tuesday
• So you can see that although the vocabulary is
  different, the structure is the same

9
If things go wrong

• If the system doesnt understand a phrase, it
  wont confirm it, and it will also play this
  sound to alert you that it missed something.  
• Then you can simply repeat the missing phrase,
  like this   

airline is USAir, flight number is 630
airline is USAir 
USAirways
10
If things go wrong

• Sometimes the system confirms the wrong
  information
• If this happens, you can erase your whole last
  utterance by saying scratch that, and then
  re-entering the erased info

airline is Northwest, flight number is 1059
to Atlanta, flight 1059
scratch that 
scratched
airline is Northwest
Northwest
flight number is 1059
flight 1059
11
Where was I?

• If you ever find yourself wondering what
  information the system has successfully
  understood and retained from your query, you can
  just ask where was I?

departure city is Pittsburgh
from Pittsburgh
airline is Delta, arrival airport is Detroit
where was I?
departure city is Pittsburgh, arrival city is
Detroit
airline is Delta
Delta
12
Review

• So now you know how to give information in Speech
  Graffiti phrases
• airline is United
• How to recover from problems
• start over
• scratch that
• How to find out what the system has stored
• where was I?
• But you don't want to just give info to the
  system you want to get info from it
• That's the next thing you'll learn

13
Asking questions

• To get information, ask a what?-question

airline is United, flight number is 1123
United, flight 1123
arrival city is Las Vegas, what is the arrival
time? 
to Las Vegas, arriving at 629pm
14
Asking questions

• To get information, ask a what?-question

• So you just say

15
Asking questions

• To get information, ask a what?-question

• So you just say
• what is (or what are)

16
Asking questions

• To get information, ask a what?-question

• So you just say
• what are (or what is)
• and then the thing you want to know about

17
Asking questions

• To get information, ask a what?-question

• So you just say
• what is (or what are)
• and then the thing you want to know about
• As another example, you could ask what is the
  departure gate?

18
Other applications

• As with specifying phrases, when you ask
  questions in other Speech Graffiti systems, the
  vocabulary is different but the structure is the
  same
• theater is the Manor,
  movie is Titanic,
  what are the
  show times?

19
Getting help

• For general Speech Graffiti help, just say help
• Speech Graffiti can also let you know what kinds
  of things you can talk about in the system you're
  using
• just say options

options
airline is Delta, departure airport
options 
more
Los Angeles, Pittsburgh, or you can ask, what is
the departure airport?
20
Lists

• The Speech Graffiti system plays this sound that
  you saw in the last slide when it is telling you
  about a long list
• Whenever you hear this sound, you can say more to
  hear the next chunk of the list
• When you're browsing a list, you can also
  navigate through the list by saying
• next gives you the next single item
• previous gives you the previous chunk
• first goes back to the first item in the list
• last skips ahead to the last item in the list
• repeat

21
Practice questions help

• How would do the following in Speech Graffiti?
• 1. find out which airlines are flying to Las
  Vegas
• 2. find out all the airlines you can ask about
• 3. hear the next chunk of a list

22
Practice questions help

• How would do the following in Speech Graffiti?
• 1. find out which airlines are flying to Las
  Vegas
• 2. find out all the airlines you can ask about
• 3. hear the next chunk of a list

• arrival city is Las Vegas, what are the airlines?

23
Practice questions help

• How would do the following in Speech Graffiti?
• 1. find out which airlines are flying to Las
  Vegas
• 2. find out all the airlines you can ask about
• 3. hear the next chunk of a list

• arrival city is Las Vegas, what are the airlines?
• airline options

24
Practice questions help

• How would do the following in Speech Graffiti?
• 1. find out which airlines are flying to Las
  Vegas
• 2. find out all the airlines you can ask about
• 3. hear the next chunk of a list

• arrival city is Las Vegas, what are the airlines?
• airline options
• more

25
Review

• In Speech Graffiti, you provide information in
  phrases ask what-questions to get info
• flight number is 102, what is the departure gate?
• start over and scratch that help you recover from
  errors
• where was I? lets you know what the system knows
• means the system didnt understand
  something you said, and means there are
  more items in a list

26
Hints

• When youre using a new application for the first
  time, say options to learn what you can talk
  about with that system
• Talk to the system in a normal voice
• Speech Graffiti remembers what you enter until
  you say start over
• see example on next slide

27
If the system already has a question stored,
saying go ahead will re-ask that question
departure airport is Denver, what are the
departure times?
where was I?
departure airport is Denver, what is departure
time?
airline is USAir, go ahead
where was I?
departure airport is Denver, what is departure
time?, airline is USAirways
28
Go ahead, part 2

• In some applications, saying go ahead will give
  you all the information for the items you provide
• Instead of asking what is the airline, what is
  the flight number, what is the departure time,
  etc.

departure city is Pittsburgh, arrival city is
Houston
from Pittsburgh, to Houston Intercontinental
connection is none, go ahead
more
29
Ready?

• OK that's all there is to know about Speech
  Graffiti! Have fun!