Editing Real World Scenes: Augmented Reality with Image-Based Rendering

1
Editing Real World Scenes Augmented Reality
with Image-Based Rendering Dana Cobzas, Keith
Yerex and Martin Jagersand Computing Science,
University of Alberta, Canada

• Augmented Reality with camera-captured real-world
  objects and scenes
• Image-Based Modeling of object and scene using
  Structure-From-Motion and Dynamic Textures
• Interactive alignment by specifying Scene AR
  object transform

SCENE VIDEO
AUGMENTED VIDEO
Tracking scene model
SFM
CURRENT VIEW Motion Ps
OBJECT MODEL Structure S Texture B
ALIGNED MODEL Structure HS Texture B
SCENE MODEL Structure Ss,Ps
Texture coeff ys
OBJECT RENDERING
Overlay
OBJECT-SCENE ALIGNMENT