Gestural%20and%20Bimanual%20Input

1
Gestural and Bimanual Input

• Doantam Phan
• CS 376 Discussion

2
Marking Menus

• Pen-based radial menu that allows users to select
  options based on direction of movement
• Easy for novices and beginners
• Faster to perform

3
Long Term Study

• Two users one expert, one novice annotated
  conversation data over a month
• How else might the study have been done?
• How do marking menus compare to context menus
  with keyboard shortcuts?
• Was there a non-marking menu way to accomplish
  the tasks (hotkeys)?

4
Menus in the real world

• Many things are still linear menus barriers to
  adoption?
• Pie Menus (in Denim, the Sims)
• Alias Wavefront
• Others?

5
T3 Prototype

• (Old) Tablets, Two-Hands, Toolglass
• Allow independent movement of toolglass and
  cursor
• How would you make these features self-revealing?
• They say training covers all

6
StudioPaint

• Dropped Rotation-aware widgets
• Is this an issue?
• Better Sweeping
• Have mix of GUI and new input styles
• Would users be interested in adopting T3 as it
  was or as it is in StudioPaint?

7
T3 Today

• Tablet PCs are now in (not Wacom)
• Is two handed input that important for drawing
  apps?
• Is there bimanual interaction with a Tablet PC?
• Maybe give it a sensor that measures orientation
  and attitude?

8
Real-World Interface Props

• Use passive props to allow expert users
  (neurosurgeons) to manipulate a familiar object
  which controls a computer representation
• As opposed to abstract gestures on virtual objects

9
Extending Props

• Props clutter the real world?
• Can you be precise with props?
• What are props good for? Only for interacting
  with a 3D model?
• Can you make generic props (one sphere, one cube,
  one plane, one line) and remap per application?
• What about props versus haptics? Is it the
  difference between passive and active?

10
Future Gestures

• Minority Report - Video manipulation
• John Underkoffler (Media Lab)
• A consistent language for gestures seems to exist
  in the clip (copy, zoom, frame)
• Johnny Mnemonic Navigation on the internet

11
Gestures versus Props

• When are gestures used?
• When speaking I once caught a fish
• Hard to specify precise quantities
• Most of the time our gestures arent under our
  exact control. So when would it be useful?
• Gesture versus direct manipulation?

12
Brainstorming

• Choose gestures, props, bimanual input (or all of
  them!)
• What is a good use for them that isnt one of the
  papers we read?