Speech Graffiti Tutorial - PowerPoint PPT Presentation

Loading...

PPT – Speech Graffiti Tutorial PowerPoint presentation | free to download - id: 13b27-ZDg0M



Loading


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation
Title:

Speech Graffiti Tutorial

Description:

SPEECH GRAFFITI is a special way of speaking that makes it faster for you to ... With Speech Graffiti, you speak this information in PHRASES just as if you were ... – PowerPoint PPT presentation

Number of Views:134
Avg rating:3.0/5.0
Slides: 29
Provided by: SCS6
Learn more at: http://www.cs.cmu.edu
Category:

less

Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: Speech Graffiti Tutorial


1
Speech Graffiti Tutorial
  • FlightLine version
  • Fall 03

2
What is Speech Graffiti?
  • SPEECH GRAFFITI is a special way of speaking that
    makes it faster for you to exchange information
    with a computer that understands your speech.
  • Speech Graffiti is easy to learn
  • This tutorial will teach you how
  • This tutorial uses a flight information system as
    an example, and afterwards you should be able to
    use any Speech Graffiti application.
  • Let's get started!

3
Phrases
  • With Speech Graffiti, you provide information to
    the system as if you were filling in a form.
  • Say you're wondering what time USAirways
    flight 28 leaves Los Angeles….
  • On a form, you'd have to fill in this
    information
  • With Speech Graffiti, you speak this information
    in PHRASES just as if you were filling out a
    form one phrase for each piece of information
  • The phrases always sound like this
  • airline is USAirways, flight number is 28,
    departure city is Los Angeles

4
Phrases
  • With Speech Graffiti, you provide information to
    the system as if you were filling in a form.
  • Say you're wondering what time USAirways
    flight 28 leaves Los Angeles….
  • On a form, you'd have to fill in this
    information
  • With Speech Graffiti, you speak this information
    in PHRASES just as if you were filling out a
    form one phrase for each piece of information
  • The phrases always sound like this
  • airline is USAirways, flight number is 28,
    departure city is Los Angeles
  • See the pattern?

5
Phrases
  • With Speech Graffiti, you provide information to
    the system as if you were filling in a form.
  • Say you're wondering what time USAirways
    flight 28 leaves Los Angeles….
  • On a form, you'd have to fill in this
    information
  • With Speech Graffiti, you speak this information
    in PHRASES just as if you were filling out a
    form one phrase for each piece of information
  • The phrases always sound like this
  • airline is USAirways, flight number is 28,
    departure city is Los Angeles
  • See the pattern?
  • You always give the type of thing you're talking
    about…

6
Phrases
  • With Speech Graffiti, you provide information to
    the system as if you were filling in a form.
  • Say you're wondering what time USAirways
    flight 28 leaves Los Angeles….
  • On a form, you'd have to fill in this
    information
  • With Speech Graffiti, you speak this information
    in PHRASES just as if you were filling out a
    form one phrase for each piece of information
  • The phrases always sound like this
  • airline is USAirways, flight number is 28,
    departure city is Los Angeles
  • See the pattern?
  • You always give the type of thing you're talking
    about…
  • then say is…

7
Phrases
  • With Speech Graffiti, you provide information to
    the system as if you were filling in a form.
  • Say you're wondering what time USAirways
    flight 28 leaves Los Angeles….
  • On a form, you'd have to fill in this
    information
  • With Speech Graffiti, you speak this information
    in PHRASES just as if you were filling out a
    form one phrase for each piece of information
  • The phrases always sound like this
  • airline is USAirways, flight number is 28,
    departure city is Los Angeles
  • See the pattern?
  • You always give the type of thing you're talking
    about…
  • then say is…
  • then state the value you want to specify for that
    field.

8
Other applications
  • As you just learned, input might look like this
    in a flight application
  • airline is USAirways, flight number is 28,
    departure city is Los Angeles
  • But Speech Graffiti works with many different
    applications
  • For instance, in a movie info system, you might
    say
  • movie is Titanic,
    theater is
    the Manor,
    day is Tuesday
  • So you can see that although the vocabulary is
    different, the structure is the same

9
If things go wrong
  • If the system doesnt understand a phrase, it
    wont confirm it, and it will also play this
    sound to alert you that it missed something.  
  • Then you can simply repeat the missing phrase,
    like this   

airline is USAir, flight number is 630
airline is USAir 
USAirways
10
If things go wrong
  • Sometimes the system confirms the wrong
    information
  • If this happens, you can erase your whole last
    utterance by saying scratch that, and then
    re-entering the erased info

airline is Northwest, flight number is 1059
to Atlanta, flight 1059
scratch that 
scratched
airline is Northwest
Northwest
flight number is 1059
flight 1059
11
Where was I?
  • If you ever find yourself wondering what
    information the system has successfully
    understood and retained from your query, you can
    just ask where was I?

departure city is Pittsburgh
from Pittsburgh
airline is Delta, arrival airport is Detroit
where was I?
departure city is Pittsburgh, arrival city is
Detroit
airline is Delta
Delta
12
Review
  • So now you know how to give information in Speech
    Graffiti phrases…
  • airline is United
  • How to recover from problems
  • start over
  • scratch that
  • How to find out what the system has stored
  • where was I?
  • But you don't want to just give info to the
    system you want to get info from it
  • That's the next thing you'll learn…

13
Asking questions
  • To get information, ask a what?-question

airline is United, flight number is 1123
United, flight 1123
arrival city is Las Vegas, what is the arrival
time? 
to Las Vegas, arriving at 629pm
14
Asking questions
  • To get information, ask a what?-question
  • So you just say…

15
Asking questions
  • To get information, ask a what?-question
  • So you just say…
  • what is (or what are)…

16
Asking questions
  • To get information, ask a what?-question
  • So you just say…
  • what are (or what is)
  • and then the thing you want to know about

17
Asking questions
  • To get information, ask a what?-question
  • So you just say…
  • what is (or what are)
  • and then the thing you want to know about
  • As another example, you could ask what is the
    departure gate?

18
Other applications
  • As with specifying phrases, when you ask
    questions in other Speech Graffiti systems, the
    vocabulary is different but the structure is the
    same
  • theater is the Manor,
    movie is Titanic,
    what are the
    show times?

19
Getting help
  • For general Speech Graffiti help, just say help
  • Speech Graffiti can also let you know what kinds
    of things you can talk about in the system you're
    using
  • just say options

options
airline is Delta, departure airport
options 
more
Los Angeles, Pittsburgh, or you can ask, what is
the departure airport?
20
Lists
  • The Speech Graffiti system plays this sound that
    you saw in the last slide when it is telling you
    about a long list
  • Whenever you hear this sound, you can say more to
    hear the next chunk of the list
  • When you're browsing a list, you can also
    navigate through the list by saying
  • next gives you the next single item
  • previous gives you the previous chunk
  • first goes back to the first item in the list
  • last skips ahead to the last item in the list
  • repeat

21
Practice questions help
  • How would do the following in Speech Graffiti?
  • 1. find out which airlines are flying to Las
    Vegas
  • 2. find out all the airlines you can ask about
  • 3. hear the next chunk of a list

22
Practice questions help
  • How would do the following in Speech Graffiti?
  • 1. find out which airlines are flying to Las
    Vegas
  • 2. find out all the airlines you can ask about
  • 3. hear the next chunk of a list
  • arrival city is Las Vegas, what are the airlines?

23
Practice questions help
  • How would do the following in Speech Graffiti?
  • 1. find out which airlines are flying to Las
    Vegas
  • 2. find out all the airlines you can ask about
  • 3. hear the next chunk of a list
  • arrival city is Las Vegas, what are the airlines?
  • airline options

24
Practice questions help
  • How would do the following in Speech Graffiti?
  • 1. find out which airlines are flying to Las
    Vegas
  • 2. find out all the airlines you can ask about
  • 3. hear the next chunk of a list
  • arrival city is Las Vegas, what are the airlines?
  • airline options
  • more

25
Review
  • In Speech Graffiti, you provide information in
    phrases ask what-questions to get info
  • flight number is 102, what is the departure gate?
  • start over and scratch that help you recover from
    errors
  • where was I? lets you know what the system knows
  • means the system didnt understand
    something you said, and means there are
    more items in a list

26
Hints
  • When youre using a new application for the first
    time, say options to learn what you can talk
    about with that system
  • Talk to the system in a normal voice
  • Speech Graffiti remembers what you enter until
    you say start over
  • see example on next slide

27
If the system already has a question stored,
saying go ahead will re-ask that question
departure airport is Denver, what are the
departure times?
where was I?
departure airport is Denver, what is departure
time?
airline is USAir, go ahead
where was I?
departure airport is Denver, what is departure
time?, airline is USAirways
28
Go ahead, part 2
  • In some applications, saying go ahead will give
    you all the information for the items you provide
  • Instead of asking what is the airline, what is
    the flight number, what is the departure time,
    etc.

departure city is Pittsburgh, arrival city is
Houston
from Pittsburgh, to Houston Intercontinental
connection is none, go ahead
more
29
Ready?
  • OK that's all there is to know about Speech
    Graffiti! Have fun!
About PowerShow.com