Mousing%20Around

1
Mousing Around

• Michael Feldman, MD, PhD
• feldmanm_at_mail.med.upenn.edu

2
Goal

• Is there a better UI than mouse for WSI ?

3
Microscope

• Retain ergonomics of microscope
• Small motions that move mountains of data
• Other hand is useful?
• Focusing
• Changing magnification
• Fast
• 400 slides per day in 10 hr day
• Eyes on diagnosis field

4
Challenge

• WSI systems today ? microscope
• Limitations to full clinical use WSI
• Total system throughput too slow
• One component is UI
• Validation image quality
• Workflow challenges
• IT integration
• Storage
• Streaming pixels

5
Multitouch screen

• DLP display
• Interface - Frustrated Total Internal Reflection
  (FTIR)
• Software
• Aperio image library
• Interface code (C)
• Tracking code (C)

6
Multi-touch Technology

• Users can directly interact with objects through
  touch and simple gestures.
• Gestures can be used to pan and scale an image.
• This creates a highly intuitive and interactive
  image environment.

7
Multi-touch Application Framework
Tracking Component
Application Component
Interface Component
(x1,y1) (x2,y2) (x3,y3)
(X,Y) (L,W) (Zoom)
Image Libraries
8
Testing

• Create basic platform
• Test (not rigorous)
• Image quality
• UI
• How does it feel
• Ergonomics
• Simple Gestures Pan, zoom, tap box, locate
  small, load work
• Show movies

9
Results

• Image quality biggest limitation DLP
• At 40-50 inches, DLP is too low resolution
• UI a lot to like
• Using both your hands feels correct
• Gestures easy to get used to
• Sensitivity not there yet in our models
• No haptic feedback
• No variable ratio viewing yet

10
Next Steps

• Other touch interfaces
• One or two touch pads (conductive technology)
• Gaming haptics
• Display
• Look into HD DLP but likely still not adequte
• One or two large LCDs
• Software
• More gestures will be needed
• Variable ratio movement
• More fluid touch sensitivity

11
Team

• Drexel
• Dr. Youngmoo E. Kim
• Matthew Prockup
• Aperio
• Ole Eichorn
• Pathologists
• Mike Feldman Penn
• Alex Judkins CHOP