Voice Recognition For more information, visit www.SpeakingSolutions.com

1
Voice RecognitionFor more information,
visitwww.SpeakingSolutions.com
2
Ride the Wave of Change
3
USA TodayJune 22, 1999

• Important Technologies of the Last 100 years
• Typewriter
• Word Processor (Office)
• Internet
• . and Speech Technologies

4
The Holy Grail of Computer Input
1950s
1960s
1970s
5
Speech Recognition Arrives Finally!

• Summer of 1997
• Pentium II 266 MMX computing power
• Cost of RAM fell
• Software finally starts to work

6
Speech Recognition Arrives Finally!

• Result
• Voice-type 110 - 160 wpm
• 45 Minute Training Period
• _at_ 95-98 accuracy
• With 3 weeks of practice
• TOTAL 3,000 Computer 150 Software

7
Speech Recognition Arrives Finally!

• Summer of 2000
• Pentium III 500 with SIMD Extensions
• Lowering costs allowed 128MB RAM
• Software really improves
• Headsets really improve (USB)

8
Speech Recognition Arrives Finally!

• Result
• Voice-type 110 - 160 wpm
• 10 Minute Training Period
• _at_ 95-98 accuracy
• With a few hours of practice
• TOTAL 850 Computer 150 Software

9
The New Educational Model
Text User Interface TUI
Graphical User Interface GUI
Speech User Interface SUI
10
The New Educational Model
Handwriting User Interface HUI
11
Speech RecognitionWhy Teach Speech?For
more information, visitwww.SpeakingSolutions.com
12
Why Teach Speech?

• Increase Productivity
• 110-160 wpm _at_ 95 and above
• Improve Writing, Reading, Speaking
• 152 students per semester
• Twice the work
• Much higher quality
• Injury Prevention
• Wrist Rescue!!!

13
Why Teach Speech?

• Big Learning Gains
• NOT 18 weeks / Its 18 days
• NOT 35 wpm / 140 wpm
• 4X the Gain in 1/5 Time
• 95 - 98 accuracy
• Easier to maintain

14
Speech RecognitionWhats the Future of
Speech?For more information,
visitwww.SpeakingSolutions.com
15
Breaking Down Barriers

• Peter Cochrane -- Head of BT Labs June 99
• What are the hot emerging technologies of the
  next two years?
• AI merging with speech technology. Speech will
  appear in numerous devices.
• Over 80 of the people in most countries are
  limited in their participation with computers by
  the QWERTY keyboard and the mouse. A speech
  interface will open computers up to everyone.

16

• Bill Gates -- Microsoft Corporation
• The technology will combine speech recognition
  and natural language understanding, so that the
  computer can determine your intent
• Your TV and PC will include a camera so they can
  recognize gestures and facial expressions. They
  will be able to tell if you are talking to the
  device or someone elseand determine your
  emotional reaction.

17

• Bill Gates -- Continued . . .
• Computers that see, listen, and learn will
  extend technology into many new areas where the
  keyboard or mouse interface make interaction
  impractical.
• Business _at_ the Speed of Thought, 1999
• youll operate your PC by talking to it
  everything I described is already possible.

18

• Bill Gates -- Continued . . .
• Im a great believer in voice-recognition
  software the state of the art is advancing, and
  . . . you may want to talk to your computer as
  much as you type-or more. January 12, 1999

19
"When you get the small form factor device, the
idea of having speech recognition, fits right
into that because it's not as easy to type on a
small device. Bill Gates, July 3, 2000 (US News
and World Report) "The day is coming when every
object big enough to hold a chip actually has
one. We'd better be able to talk to these objects
because very few of them will have room for a
keyboard. M. Mitchell Waldrop, January, 2001
(Technology Review )
20

• Bill Gates -- Continued
• "The kind of devices we'll be working against,
  the user interface ... will be fundamentally
  different than it is today. People will look back
  and say,
• 'Wow! Why did I buy a PC that was big and I
  couldn't take it to a meeting and I couldn't talk
  to it? What was that all about?'"
• July 3, 2000 (US News and World Report)

21
Form Factors Microsoft Office XP
22

• Bill Gates Microsoft.NET XP
• If Gates's vision becomes a reality,
• .NET XP will incorporate just about every neat
  new technology Microsoft's research arm is
  exploring, including speech recognition, natural
  language processing, and handwriting
  recognition.
• July 3, 2000 (US News and World Report)

23

• Installation
• Language bar
• Multiple Users

24

• Collapsed
• Expanded
• Minimized

25

• Enrollment training
• Language bar
• Voice Commands

26

• Dictation OR Commands
• Dictation Speech Accuracy
• Selecting, Editing Formatting
• Error Correction

27
The Scope ofRapid Change

• This will be in everything before long. (IBM
  Employee, 1997)
• The Technology Always Wins like a ratchet that
  only turns one way.
• Size and form factors of computers are changing.
  Tablet computers with touch screens or stylus
  combined with speech will make keyboards
  optional. Palm-sized speech computers will be
  popular.

28
The Scope ofRapid Change
Machine Translation (MT)
29
Reaching Critical Mass

• Its out of control. (IBM Employee, 2000)
• 1 million copies of ViaVoice sold in 1997.
• 50,000 copies per week for Macintosh in December
  1999
• Internet and telephony integration
• Wireless Web services and Voice Portals
• Medical is moving toward it

30
Software Today!
IBM ViaVoice 8
LH Dragon NaturallySpeaking 5
Microsoft Office XP Speech Recognition
IBM ViaVoice for Mac 2.0.3
31
Software Tomorrow
IBM ViaVoice
LH Dragon NaturallySpeaking
Microsoft Office XP Speech Recognition
32
Speech InstructionHow will we do it? Business
Education!For more information,
visitwww.SpeakingSolutions.com
33
Reaching Critical Mass
How do you . . . Train 250,000 computer
education instructors, 8 million teachers and
support staff, and 70 million students in speech
recognition in less than eight years? (Speaking
Solutions, 2000) Train the Trainers in Business
Education
34
Jump-start the Training

• Train 15 Business Education Trainers Per State
• 12-16 hour workshops
• Beginner Basics
• Instructor Methods
• Intermediate and Advanced Techniques . . .
• Lernout Hauspie,Plantronics, South-Western
  Educational Publishing, Speaking Solutions
• www.SpeakingSolutions.com

35
Last Millennium
36
Washington
North Dakota
Michigan
Colorado
Nebraska
Indiana
Utah
Virginia
Missouri
Arizona
316 Trainers of Trainers in 11 States
Mississippi
37
Montana
Minnesota
Oregon
Vermont
Idaho
Massachusetts
Iowa
Pennsylvania
Nevada
Ohio
Illinois
Colorado
California
Kansas
Kentucky
North Carolina
Tennessee
Oklahoma
South Carolina
Alabama
Texas
1,000 Trainers in 35 States by Fall 2001!
Florida
38
Growth Projections
39
Growth Projections
40
Speech RecognitionInjury Prevention Wrist
Rescue Recovery ChallengeFor more
information, visitwww.SpeakingSolutions.com
41
Wrist Rescue Recovery

• Wait For the Note
• "The reason this is late is because I have
  refused to sign it. It is no fault of Carlos. I
  am not signing away my right to hold the school
  responsible if he gets carpal tunnel."

42
Evidence Mounts

• "A survey published last fall of Harvard
  University undergraduates showed that 40 percent
  reported symptoms of RSI.
•     In a 1999 survey, 170 sixth-graders at an
  Andover, Mass., middle school complained of neck
  pain (35 percent), lower backaches (20 percent),
  sore wrists (17 percent), sore shoulders (17
  percent) and sore elbows (10 percent).
• Lini S. Kadaba, KNIGHT RIDDER NEWS SERVICE, Feb.
  11, 2001)

43

• One in four PC users will eventually be impacted
  by carpal tunnel or repetitive stress injuries.
  ZDTV June 99
• Afflicts 1.8 - 5 million new cases in the USA
  each year, 21 million or more afflicted.
• Age is dropping
• 3 to 1 higher in women than men.
• New OSHA studies 600,000 lost work days each
  year in the USA. Keyboard related injuries are a
  major portion and growing
• 18-45 Billion in lost productivity and injury
  claims. Prevention can save over billions.
  (55,000 per)

44

• Carpal Tunnel Syndrome
• Is Keyboarding Bad for Your Health?
• Dr. Thomas W. OrmeAmerican Council on Science
  and Health
• If Charles Dickens were alive today he might
  compare the modern computer workstation to the
  19th century loom. . . office workers are
  slumped over their keyboards and peer at computer
  monitors. . . their work is often repetitive and
  dehumanizing. And many say it is making them
  sick.
• Common worker complaints include pain in the hand
  and loss of hand function, both of which workers
  blame on repeated injuries from continuous
  typing.

45

• What Is CTS?
• Dr. Thomas W. OrmeAmerican Council on Science
  and Health
• Carpal tunnel syndrome might also be called
  "tennis elbow of the hand." It is an inflammatory
  disorder that affects the carpal -- or wrist --
  part of a specific nerve. Repetitive stress,
  physical trauma, certain diseases or specific
  hereditary conditions can inflame the sheaths
  that surround wrist tendons. With the swelling of
  small blood vessels, pressure increases on the
  nerve and disrupts its function. The result is
  numbness, pain and a loss of manual dexterity.
  CTS treatment usually consists of rest, splinting
  the wrist and anti-inflammatory drugs. Severe
  cases require surgery to relieve the pressure.

46

• Are Keyboard Mouse Hazards to your Children?
• Michael Rutter
• Christa McAuliffe Fellow
• Are your children at risk?
• Millions are. Currently, 21 million Americans
  suffer from some form of repetitive stress injury
  (RSI) including carpal tunnel syndrome. What is
  especially troubling to health officials,
  however, is the ever-increasing injuries among
  children and teens.
• The culprit isnt lurking among the shadows.
  Its likely sitting in plain sight. Dont look
  further than the trusty keyboard and mouse on the
  nearest PC.

47

• Are Keyboard Mouse Hazards to your Children?
• Michael Rutter
• Christa McAuliffe Fellow
• For the record, one in four adult computer users
  will suffer from some form of RSI. With
  children, since young bodies are still growing,
  the number is greater. And the problem isnt
  gender friendly since females are three times as
  likely as males to have problems. Apparently,
  there is a down side to technology.

48

• Kid Wrists at Risk
• Susan Gregory Thomas
• U.S. News and World Report, July 5, 1999
• The tragedy of repetitive stress injury is being
  discussed more and more by the popular press. The
  July 5, 1999 issue of U.S. News and World Report
  chronicles the difficulties of Bryan Christian.
  Brian began playing with computers at age 5. By
  age 14 he began showing signs of RSI. He entered
  Virginia Tech, and at age 18 found that he could
  no longer type without excruciating pain. He
  eventually dropped out of the Computer Science
  Department at Virginia Tech. Bryan is quoted
  saying

49

• Kid Wrists at Risk
• Susan Gregory Thomas
• U.S. News and World Report, July 5, 1999
• "No one could believe that someone as young as
  I could develop repetitive stress injuries,"
  says Christian. "Now, because of them, I can't do
  what I've wanted to do my whole life."
• The article goes onto explain that the age bar
  for the onset of RSI is lowering because kids are
  starting on computers at much earlier ages. The
  article does a great job talking about the role
  ergonomic furniture can play in helping young
  people prevent the onslaught of RSI.

50

• Balancing Muscle Groups
• A Solution to Repetitive Stress Injuries
• C. Ted Ostrem
• Physical Therapy Products Journal, Mar/Apr 1997
• Take an average typist who works a six hour day.
  If he or she types 60 words per minutes, thats
  18,000 keystrokes each hour, which requires about
  eight ounces of pressure with each keystroke.
• At the end of the day, that typists fingertips
  have pressed the equivalent of 54,000 pounds.
  Thats 27 tons in one day. Do that day after
  day, year after year, and not surprisingly,
  problems arise.

51
Typewriter vs. Keyboard

• Typewriter not as bad
• Built in mechanical rests to insert and adjust
  paper
• Wrists were always off the table
• Not everybody typed
• No Mouse
• Trained Professionals

52

• Farrer Middle School (1999-2001 School Years)
• Cindy Age 14 (Piano, typed 75wpm)
• Mandy Age 11 (Violin, typed 35wpm) Pain for 3
  hours after 10 minute warm ups
• Alice Age 12 (Violin, Family History)
• Michelle, Heather Amy Age 13 (RSI as a result
  of Typing and Clicking)
• Carlos Age 12 (Family History)
• Jacob and Mike 13 (Wrist Injuries)
• Six more with symptoms (play video games?)

53

• Business Education Teachers
• Virginia 6 of 18, multiple surgeries
• Arizona 25 mostly women
• Mississippi 20 all women
• Washington 20 all women
• ERGONOMICS, WHILE ESSENTIAL, CANT EXTINGUISH THE
  FUSE!!!

54
Legal Implications

• Digital Equipment Corp. case 1996
• Three Women won 6,000,000
• HR departments are going crazy looking for
  alternatives.
• Every 1 in prevention saves 4
• OSHA Hearings (10 years)
• Bush Factor

55
The New Educational Model
30 TUI
20 GUI
50 SUI
56
Wrist Rescue Recovery

• Take up the challenge!
• If every Business Educator will identify three
  students who are at risk for CTS or RSI the
  epidemic ends.
• Start your speech recognition exploratory program
  and focus on these at-risk students
• We can rescue 100,000 wrists per year!

57
Wrist Rescue Recovery

• NO MORE EXTENDED TIMINGS!
• 10 Min Never
• 5 Min Never
• 3 Min Very Rare
• 1 Min Infrequent
• 30 Second - Standard
• REDUCE INTENSIVE KEYBOARDING PRACTICE TIME TO
  10-15 MINUTES PER DAY NEVER MORE!
• REST HANDS AFTER EVERY 3 5 MINUTES
• ACCURACY ONLY SPEED DOESNT MATTER!

58
Legal Implications

• Develop Procedures For RSI Students
• Stop typing immediately and permanently
• Visit Doctor
• ADA
• IEP
• Availability of speech computer
• Home ergonomics and speech software
• Information campaign

59
SpeakingSolutions.Com

• The Five Goals
• Reduce keystrokes and mouse clicks among healthy
  computer users by 50 in 5 years while improving
  their overall productivity.
• Reduce keystrokes and mouse clicks among WMSD
  sufferers by 95 in 5 years while improving their
  productivity.

60
SpeakingSolutions.Com

• The Five Goals Continued . . .
• Encourage continuous speech recognition (CSR)
  instruction into every K -12 school and college
  by 2005.
• Establish CSR Trainer of Trainers programs in
  every state and province.
• Assist corporate Human Resource departments as
  they implement much needed CSR training
  on-the-job.

61
SpeakingSolutions.Com
Mission Statement Speaking Solutions is committed
to greatly reducing work-related cumulative
trauma disorders (such as carpal tunnel syndrome
and repetitive strain injuries) caused by the
keyboard and the mouse while increasing
productivity through the use of continuous speech
recognition (CSR or Voice-Typing) software
solutions.
62
Health Resourcesspeakingsolutions.com

• Links Discussing RSI and CTS Injuries
• Middle School RSI Problems and Prevention
• We Have an Epidemic on our Hands
• Are Keyboard Mouse Hazards to your Children?
• Kids Wrists at Risk
• The RSI Generation
• Helping Kids Avoid RSI
• American Occupational Therapy Association

63
What Stage Are You In?

1. The Inquiry Stage
2. The Exploratory Stage
3. The Course Stage
4. The Tool Stage

64
Inquiry StageHardware

• Windows Minimum
• Windows Optimal
• Macintosh

65
Inquiry StageMicrophones

• Plantronics
• Andrea
• Telex

66
Inquiry StageOther Issues

• Speech over a Network
• Physical Facilities
• Background Noise
• Thinking Ahead

67
LH and NaturalLanguage Technology

• NLT is a portfolio of techniques, algorithms and
  processes that enables users to control
  electronic devices easily and accurately by
  speaking to them in natural language patterns.
  It is also the foundation for natural language
  understanding, the next generation of speech and
  language technology, which LH believes will
  allow machines to not only recognize speech, but
  to understand it. (Press Release, 2000)

68
The Complex Miracle of Speech Recognition (SUI)

• SUI Speech User Interface
• SAPI Speech Application Programming Interface
• ASR Automatic Speech Recognition
• NLT Natural Language Technology
• TTS Text-to-speech
• MT Machine Translation
• SIMD Streaming Instruction Multiple Data
  Extensions

69
The Big Three
IBM ViaVoice Millennium
LH VoiceXpress Version 5
LH Dragon NaturallySpeaking Version 5
70
What Do YouNeed to Know?

• Instructor Feelings
• The better you type, the more frustrating at
  first
• Same 10-15 hours to learn the basics
• Extend your practice by 10 hours for every 10 wpm
  you type
• Hands off the keyboard and mouse!!!