Pocket Projectors All-in-one Solution for Mobility, Augmentation, Communication

1
Pocket ProjectorsAll-in-one Solution for
Mobility, Augmentation, Communication

• Ramesh Raskar
• Senior Research Scientist
• Mitsubishi Electric Research Labs, Cambridge, MA

2
Pocket ProjectorsAll-in-one Solution for
Mobility, Augmentation, Communication

• Ramesh Raskar
• Mitsubishi Electric Research Labs (MERL)
• Cambridge, MA, USA

3
Ultimate Personal Display ?
Mitsubishi Electric Pocket Projector DLP based
with R, G, B LEDs Instant on, Battery-pack
Available Now
4

• DLP 0.55 Chip
• LED life gt10,000 hours
• SVGA 800 x 600
• 250 LUX in brightness
• Inputs VGA, RCA S Video
• Battery 2.5 hours
• Actual Size 4.85W x 1.85H x 3.82H
• Weight 1 pound (450g)

5
(No Transcript)
6
Small Projector
Big Projections
Estimated Possible Partner Device for Attachment Projected 2005 Sales Projected 2006 Sales
Portable DVD Players 1,545,000 1,845,000
Digital Camera 20,161,000 21,893,000
Gaming Systems 60,000,000 64,200,000
Others (ie. RVs, PDAs, etc.) (Very rough estimate only) 50,000,000 55,000,000
Rough Base Totals 131,706,000 142,938,000
Estimates and Projections Quoted from Various
Sources
7

• Average Consumer Electronic Adoption Rate
• 0.34 during the first year of product
  introduction
• 0.84 during the second year
• 1.54 during the third year

Possible Partner Device for Attachment Projected 2005 Sales Projected 2006 Sales
Rough Base Totals 131,706,000 142,938,000
Conservative Early Adopter Estimate 0.034 0.084
Possible Sales in Units 44,780 120,067
8

• Problems
• Brightness LEDs and Optics
• Price 699
• Applications ?

9
Brightness and Power

• More LEDs for illumination
• Heat Better thermal designs
• Cost LEDs are expensive !
• Size Complex optics for multi-LEDs
• White boost
• Equivalent to transparent part of color wheel
• All 3 R,G,B LEDs on at the same time
• Blacks
• LED Dimming
• Limits
• Difficult to match lamp based, AC powered
  projectors
• Need to think about other applications

10
ApplicationsUnderstanding Projector Pros and
Cons

• Large image with small device
• Image overlay on real object
• Ideal for augmentation
• Superposition of images
• Higher resolution, brightness

• Issues
• Ambient bright light
• Screens Affected by display surface reflectance

11
New Opportunities

• Aware Projectors
• Decoupled display size

12
New Opportunities

• Aware Projectors
• Decoupled display size
• Image Overlay on Real Objects
• Decoupled device
• Non-planar surfaces

13
New Opportunities

• Aware Projectors
• Decoupled display size
• Image Overlay on Real Objects
• Decoupled device
• Non-planar surfaces
• Machine Projection
• Projector for non-display apps

14
New Opportunities

• Aware Projectors
• Decoupled display size
• Image Overlay on Real Objects
• Decoupled device
• Non-planar surfaces
• Machine Projection
• Projector for non-display apps

15
Decoupled Image Size

• Small group presentations
• Pocket monitor
• PDA, Digital Camera, Mobile phones, Video iPods
• Gaming displays
• Portable home theater
• Camping entertainment
• In-Car entertainment
• Compact Tiled Displays (VideoWall)

16
Pocket Projector Developments
Pocket Projector 2004-05
iLamps 2002
RFIG Lamps 2003-04
17
Stabilized Desktop-like Interaction
Sensor support What components are needed ?
18
(No Transcript)
19
Desktop-like Interaction

• Mouse Simulation
• Cursor follows handheld projector motion
• Pre-warped image remains stable

20
Image Quasi-Stabilization
Eliminate hand jitter using inertial
sensorscamera
21
Absolute Stabilization
Image stays registered with world features
22
New Opportunities

• Aware Projectors
• Decoupled display size
• Image Overlay on Real Objects
• Decoupled device
• Non-planar surfaces
• Machine Projection
• Projector for non-display apps

23
Changing Texture and Virtual Lighting
Raskar, Welch, Low, Bandyopadhyay, Shader
Lamps (2000)
24
(No Transcript)
25
Image Overlay on Objects
Raskar, vanBaar, Beardsley et al, Siggraph 2003
26
New Opportunities

• Aware Projectors
• Decoupled display size
• Image Overlay on Real Objects
• Decoupled device
• Non-planar surfaces
• Machine Projection
• Projector for non-display apps

27
Machine Projection

• Images consumed not by humans but by other
  machines
• Project images to assist machine computation
• Unique compared to other display technologies

Optical Communication Optical Etching Visual
coding Robot Guidance
Machines consume images
Machines Produce images
28
Maskless Lithography
OpticalResists
DLP Micro-mirror array Fast parallel operation on
optical resists
29
Optical Networking Gear
Parallel Switching and Routing at 100KHz Fixed
diffraction grating Optical switches
30
Optical Communication
Glorified Remote Control Glorified Laser
Pointer
Pocket Projector
31
R F I
G
R F I D
(Radio Frequency Id Geometry)
Photosensing Wireless Tags
Find tag location using Pocket Projector
Interactive stabilized projection
Many geometric ops
Siggraph 2004
32
Conventional Passive RFID
33
Using Projector to Interact with Tagged Books in
a Library
With RFID, get list of books in RF range
With Precise Location Data Find which books are
out of sorted order !
34
Prototype Tag
RF tag photosensor
35
Support for handheld projection RF Reader
36
RFIG Finding Tag Location and Image Overlay
Siggraph 2004
37
Directions for PocketProjector

• Personal display
• Shrinking portable devices that carry more data
• Opportunity to switch between personal and public
• Modular
• Low cost mass market product
• Will become building block
• Platforms TV, Stereoscopic, Advertising,
  VideoWalls etc
• Process Tiling, Jittering, Superposition,
  Steering

38
Mitsubishi Pocket Projector

• Mobility
• Limited Brightness but new Applications
• All-in-one
• Display large with small device size
• Augment image overlay on real objects
• Communicate with tagged world (RFID, Sensors)
• Collaborate using shared projection

raskar_at_MERL.com
39
Mitsubishi PocketProjectorLED-Based DLP
Projector
40

• END