Spatial Augmented Reality Oliver Bimber University of Weimar Ramesh Raskar Mitsubishi Electric Research Labs

1
Spatial Augmented RealityOliver
Bimber University of WeimarRamesh
Raskar Mitsubishi Electric Research Labs
Course Page http//Spatial-AR.com
2
Welcome

• AR Display Approaches
• Traditional, Goggle-bound, Alternative
• Spatial Augmentation
• Projectors, Non-planar, Mobile objects, Change
  appearance, Interaction
• Exploiting Optical Elements
• Mirrors, Beam splitters, Holograms
• Applications
• Prototypes in Art, Research and Industry

3
A Non-traditional Approach

• Painting with Light
• Bandyopadhyay, Raskar, Fuchs 2001

4
Goals

• Understand advantages of Spatial AR
• Discuss issues in traditional AR approaches
• Explore alternative AR methods
• Graphics, Vision, Optics techniques
• Learn math of rendering and calibration
• See new applications in art and industry
• What we will not cover
• Fundamentals of AR and VR

5
Speaker
Oliver Bimber is a Junior Professor for Augmented
Reality at the Bauhaus University Weimar,
Germany. He serves on the editorial board of
the IEEE Computer magazine (graphics and
multimedia editor). Bimber invented several AR
displays, such as the Virtual Showcase,
Interactive Holograms and Augmented Paintings. He
published in several journals, such as IEEE
Computer, IEEE CGA, Presence, Computers and
Graphics, and at many graphics, AR and VR
conferences. Bimber is member of IEEE,
Eurographics, ACM and ACM Siggraph. He has
exhibited in the Emerging Technology Laboratory
of Siggraph02 and was a speaker in the
Siggraph02 course Building Interactive
Workspaces. Together with Ramesh Raskar, Bimber
organized the proposed course at Eurographics
2003 and 2004
6
Speaker
Ramesh Raskar is a Senior Research Scientist at
MERL-Cambridge Research. His research interests
include projector-based graphics, projective
geometry and non-photorealistic rendering. During
his doctoral research at U. of North Carolina at
Chapel Hill, he developed a framework for
projector based 3D graphics, which can simplify
the constraints on conventional immersive
displays, and enable new projector-assisted
applications. He has published several articles
on immersive projector-based displays, spatially
augmented reality and has introduced Shader
Lamps, a new approach for projector-based
augmentation. His technical papers have appeared
in SIGGRAPH, EuroGraphics, IEEE VR, IEEE
Visualization, CVPR and many other graphics and
vision conferences. He was a course organizer and
speaker for Siggraph 2002, 2003 and 2004. He is a
member of the ACM and IEEE. http//www.merl.com/pe
ople/raskar/raskar.html
7
Book Spatial Augmented Reality, Bimber and
Raskar Book Signing today at 2pm-3pm A.K.Peters,
Exhibition Booth Coupons available at the course
8
Opportunities

• Think beyond goggle-bound AR
• Learn techniques using projectors, flat displays
  and optics
• Explore more realistic augmented environments
• Learn how to build your own spatial AR displays
  (only covered in tutorial notes).
• Learn how to extend your own software framework
  to support spatial AR displays
• Get an impression on applicability

9
Schedule
830 Overview 840 Todays AR Display
Approaches (Bimber) 920 New Directions in
Augmentation (Raskar) 1015 Break 1030
Augmentation using Optical Elements (Bimber) 1115
Prototypes (Bimber and Raskar) 1205
Discussion
Course Page http//Spatial-AR.com
10
ShaderLamps
Virtual Reflectance
Virtual Illumination
Interaction
Virtual Motion
11
(No Transcript)
12
Virtual Showcase
13
R F I
G
R F I D
(Radio Frequency Id Geometry)
Photosensing Wireless Tags
Find tag location using handheld Projector
Interactive stabilized projection
Many geometric ops
14
Survey

• How many of you are users of VR system ?
• How many of you are users of AR system ?
• How many of you are involved in AR
  design/development ?
• How many do active programming ?
• What type of AR do you use HMD ? Handheld ?
  Projector ?
• Field of work Academics? Industry ? Research ?
  Art ?

15
Part 2 Introduction to Current Approaches for
AR (Bimber)
16
Spatial Augmented Reality
y
Course Page http//Spatial-AR.com
830 Overview 840 Todays AR Display
Approaches (Bimber) 920 New Directions
in Augmentation (Raskar) 1015
Break 1030 Augmentation w/ Optical Elements
(Bimber) 1115 Prototypes (Both) 1205
Discussion

• Panel The Ultimate Display What Will It Be?,
  Thursday, 830 - 1015 am, Room 515B
• IEEE Computer Special Issue on Future Display
  Technology, August , www.computer.org/computer
• ETech HMPDs, Projector-Based AR, Fog Screen

Book Signing today 2pm-3pmA.K.Peters,
Exhibition Booth 1110 Coupons available at the
course