Visual Chatter in the Real World

1
Visual Chatter in the Real World

• Shree K. Nayar

Computer Science Columbia University
With Guru Krishnan, Michael Grossberg, Ramesh
Raskar Eurographics Rendering Symposium June
2006, Nicosia, Cyprus Support ONR
2
Direct and Global Illumination
surface
source
P
camera
3
Related Work
4
Fast Separation of Direct and Global Images

• Create Novel Images of the Scene

• Enhance Brightness Based Vision Methods

• New Insights into Material Properties

5
Compute Direct and Global Images of a Scene
from Two Captured Images
6
Direct and Global Components Interreflections
surface
source
i
camera
7
High Frequency Illumination Pattern
surface
source
camera
8
High Frequency Illumination Pattern
surface
source
camera
fraction of activated source elements
9
Separation from Two Images
direct
global
10
Minimum Illumination Frequency
11
Other Global Effects Subsurface Scattering
translucent surface
source
camera
12
Other Global Effects Volumetric Scattering
participating medium
surface
source
camera
13
(No Transcript)
14
(No Transcript)
15
Verification
F
G
C
A
D
B
E
A Diffuse Interreflection (Board) B Specular
Interreflection (Nut) C Subsurface Scattering
(Marble) D Subsurface Scattering (Wax) E
Translucency (Frosted Glass) F Volumetric
Scattering (Dilute Milk) G Shadow (Fruit on
Board)
16
Verification Results
A
B
1
G
E
0.8
F
0.6
0.4
D
marble
0.2
C
p
0
5
3
7
9
11
15
19
23
27
31
35
39
43
47
Checker Size
17
(No Transcript)
18
V-Grooves Diffuse Interreflections
concave
convex
Psychophysics Gilchrist 79, Bloj et al. 04
19
Mirror Ball Failure Case
20
Real World Examples Can You Guess the Images?
21
Eggs Diffuse Interreflections
22
Wooden Blocks Specular Interreflections
23
Novel Images
24
(No Transcript)
25
Photometric Stereo The Pseudo Shape
Actual Shape
Nayar et al., 1991
26
Photometric Stereo using Direct Images
Bowl
Shape
27
Variants of Separation Method
28
Building Corner
3D from Shadows Bouguet and Perona 99
Stick
Shadow
29
Building Corner
30
Shower Curtain Diffuser
Shadow
31
Shower Curtain Diffuser
32
(No Transcript)
33
Kitchen Sink Volumetric Scattering
Volumetric Scattering Chandrasekar 50, Ishimaru
78
34
Novel Image
35
Peppers Subsurface Scattering
36
Novel Images
37
Real or Fake ?
38
Tea Rose Leaf
Leaf Anatomy Purves et al. 03
39
Translucent Rubber Balls
40
Marble When BSSRDF becomes BRDF
Scene
Global
Direct
Subsurface Measurements Jensen et al. 01,
Goesele et al. 04
41
Hand
Skin Hanrahan and Krueger 93, Uchida 96, Haro
01, Jensen et al. 01, Igarashi et al. 05, Weyrich
et al. 05
42
Hands
43
Separation from a Single Image
44
Face
Direct
Global
Sum
45
Skin Tone Control
Skin Color and Lipids Tsumura et al. 03
46
Blonde Hair
Hair Scattering Stamm et al. 77, Bustard and
Smith 91, Lu et al. 00 Marschner et al. 03
47
Hair Bidirectional Texture Function
Hair
Direct
Global
48
Pebbles 3D Texture
49
Pebbles Bidirectional Texture Function
Pebbles
Direct
Global
50
Pink Carnation
Spectral Bleeding Funt et al. 91
51
(No Transcript)
52
Summary

• Fast and Simple Separation Method

• No Prior Knowledge of Material Properties

• Wide Variety of Global Effects

53
















www.cs.columbia.edu/CAVE