Bringing Photographs to Life With View Morphing

1
Bringing Photographs to LifeWith View Morphing

• Steve Seitz
• University of WisconsinMadison

2
Images Are Static

• Photographs Lack
• Movement scene is frozen in time
• Depth image is two-dimensional
• Can we animate the scene via the image?

3
ObjectiveScene Interaction Via Photos

• Scene Viewing
• Move virtual camera, view real scene
• Scene Interaction
• Move objects cut and paste
• Change objects paint, sculpt
• Animate the scene make things walk, talk

4
Adding Movement

Original Image
Expression Change
5
Adding Depth

Original Image
Perspective Change
6
Talk Outline

• Adding Motion and Depth
• View Morphing
• Applications
• Visualization, photo correction, special effects
• Interacting With the Scene
• Scene editing via photographs

7
Photograph
Photograph
8
Virtual Camera
Morphed View
9

• 1. Prewarp
• align views

10

• 1. Prewarp
• align views
• 2. Morph
• move camera

11

• 1. Prewarp
• align views
• 2. Morph
• move camera
• 3. Postwarp
• point camera

12
Features of View Morphing

• Provides
• A mobile virtual camera
• Better image morphs
• Requires no prior knowledge
• No 3D shape information
• No camera information
• No training on other images

13
Applications Visualization

• User-controlled Virtual Camera
• Telepresence visit a remote scene
• Web commerce product viewing over Internet
• Viewing historical sites
• Animating paintings

14
Applications Photo Correction

• Image Postprocessing
• Alter image perspective in the lab
• Image Databases
• Normalize images for better indexing
• Simplify face recognition tasks

15
Original Photographs
Corrected Photographs
16
Applications Better Image Transitions

• Avoid bending and shearing distortions
• Shapes do not need to be aligned

Image Morph
View Morph
17
The Next StepInteracting With the Scene

• Scene Editing Via Photographs
• Move objects cut and paste
• Change objects paint, warp

Scene
Photo
Painted Photo
Propagation
18
Original Photo
Original Photo
19
Painted Photo
Cut Photo
Original Photo
Original Photo
20
Painted Photo
Cut Photo
Original Photo
New Views of Modified Scene
21
Conclusions

• Photographs Come Alive
• Motion, depth added by View Morphing
• User-Scene Interaction Via Photos
• Still images interactive movies
• What kinds of scene changes are possible?
• Which modes of interaction are natural?