Abstract Writing Workshop

1
Informal PUIs No Recognition Required
James Landay Jason Hong Scott Klemmer James
Lin Mark Newman
2
WIMPy User Interfaces

• Windows, Icons, Menus, Pointer
• Hitting limitations of this kind of interface
• WIMP designed for limited audience
• Full use of eyes
• Literate
• Full use of hands
• WIMP designed for limited situations
• Fixed location (often offices)
• Sitting down
• Single person

3
Perceptual User Interfaces

• PUIs leverage our innate perceptual, motor, and
  cognitive abilities
• Speech recognition, computer vision,
  sketching, handwriting
• Sketching is one part of this bigger push
• PUIs more useful for different audiences and
  wider range of situations
• Mobile workers or Home
• Speech gt Hands-free
• Location Tracking gt Physical motion

4
PUIs and Recognition

• Key question
• When should perceptual input be recognized?
• Immediate recognition can interfere with
  creativity and communications

5
Communication and Creativity

• Informal visual representation
• communicates unfinished
• encourages creativity
• faster to create
• higher level comments

• Formal visual representation
• communicates finished
• inhibits creativity (detailed)
• slower to create
• lower-level comments

6
Informal User Interfaces

• Historic bias towards formal user interfaces
• Computation over creativity and communication
• Structured input to simplify computation
• Position
• Recognition interferes with creativity and
  communication due to errors and perception
• Recognition should be minimized or deferred
  for these kinds of apps

7
Informal User Interfaces

• Sketching
• Speech
• Handwriting

8
Informal User Interfaces

• Sketching
• Speech
• Handwriting

9
Slide
Landay (1996)
10
Slide
Gross and Do (UIST96)
11
Slide
Lin, Newman, Hong, Landay (CHI2000)
12
DENIM Video
13
Informal User Interfaces

• Sketching
• Speech
• Handwriting

14
Slide
Stifelman, Arons, Schmandt (CHI2001)
15
SUEDE Informal Prototyping for Speech-based UIs

• Supports design practice
• example scripts
• Wizard of Oz
• error simulation
• iterative design
• Informal user interface
• no speech recognition or synthesis
• need not be programming expert
• fast fluid design

16
Slide
Klemmer et al (UIST2000)
17
SUEDE Video
18
Informal User Interfaces

• Sketching
• Speech
• Handwriting

19
NotePals Informal Handwriting Capture
Davis et al (CHI99)
20
NotePals Informal Handwriting Capture
21
Takeaway Ideas

• Perceptual user interfaces useful for more
  audiences and more places
• Informal User Interfaces valuable for PUIs
• Minimize or defer recognition
• Creative or communications-oriented tasks
• Informal User Interfaces can be applied to a
  range of perceptual input
• Sketching
• Speech
• Handwriting

22
Informal PUIs No Recognition Required
James Landay Jason Hong Scott Klemmer James
Lin Mark Newman
23
Backup Slides
24
Backup Slides
Igarashi, Edwards, LaMarca, and Mynatt (AVI2000)