16421: Vision Sensors

1
16421 Vision Sensors

• Lecture 1 Introduction
• Instructor S. Narasimhan
• Wean 5310, T-R 130pm 300pm

2
A Brief History of Images
1558
Camera Obscura, Gemma Frisius, 1558
3
A Brief History of Images
1558
1568
Lens Based Camera Obscura, 1568
4
A Brief History of Images
1558
1568
1816
The first negative (not original) Not
fixedquickly vanished
Joseph Nicéphore Niépce (1765-1833)
5
A Brief History of Images
1558
1568
1816
1826
The first permanent photograph (8 hour exposure),
Niepce
6
A Brief History of Images
1558
1568
1816
1826
1837
Still Life, Louis Jaques Mande Daguerre, 1837
7
A Brief History of Images
Daguerreotype Panorama (wiki)
8
A Brief History of Images
1558
1568
1816
1826
1837
1841
William Henry Fox Talbot , negative to positive
photographic process
9
A Brief History of Images
1558
1568
1816
1826
1837
1841
1861
tartan ribbon, James Clerk Maxwell, additive
color photograph
10
A Brief History of Images
1558
1568
1816
1826
1837
1841
1861
1868
Louis Ducos du Hauron, subtractive color
photograph
11
A Brief History of Images
1558
1568
1816
1826
1837
1841
1861
1868
1878
The Horse in Motion, Muybridge, fast motion using
24 cameras.
12
A Brief History of Images
1558
1568
1816
1826
1837
1841
1861
1868
1878
13
A Brief History of Images
1558
1568
1816
1826
1837
1841
1861
1868
1878
1925
The Leica, the 35mm format in still photography.
The photographic film is cut into strips
35 millimeters wide.
14
A Brief History of Images
1558
1568
1816
1826
1837
1841
1861
1868
1878
1925
Poloroid instant image camera
Edwin H. Land
1948
15
howstuffworks
wiki
Cross-section view of SLR system1 - Front-mount
Lens (4 element Tessar design)2 - Reflex Mirror
at 45 degree angle3 - Focal Plane Shutter4 - 35
mm Film or Sensor5 - Focusing Screen6 -
Condenser Lens7 - Optical Glass Pentaprism (or
Pentamirror)8 - Eyepiece (can have diopter
correction ability)
16
A Brief History of Images
1558
1568
1816
1826
1837
1841
1861
Silicon Image Detector, 1973
1868
1878
1925
1948
1973
17
A Brief History of Images
1558
1568
1816
1826
1837
1841
1861
1868
1878
1925
Digital Cameras
1948
1973
1995
18
Canon.com
19
Eastbourne, England
Edinburgh, Scotland
Kirriemuir, Scotland
1836, Dumfries, Scotland
20
Aberwystweth, Wales
Knighton, Wales
21
Giant Camera, San Francisco, California
Discovery Park, Safford, Arizona
22
George Eastman House, Rochester, New York
23
(No Transcript)
24
Paleo-Camera theory Small random holes in
Paleolithic hide tents coincidentally and
occasionally created camera obscuras, which
projected moving images inside the dwelling
spaces, triggering profound spiritual,
philosophical, and aesthetic advances
http//www.paleo-camera.com/index.htm
25
Charles Schwartz Private Camera Obscura, New York
City The camera is housed in a specially designed
room that is also an office and workroom. It is
covered with copper for lightness and when the
camera obscura is in use blackout shutters cover
the windows. The optics are housed in a copper
turret on the roof and project through a hole in
the ceiling onto a 42 inch round white table. At
the side of the table is a bank of buttons that
control the shutters, the tilt of the mirror and
rotation of the turret. We learned that it is
equipped with an 8-inch lens with a 12 1/2 foot
focal length and a 12-inch mirror and brings in a
15-degree slice of the world outside. Sharp focus
if possible from infinity to 400 feet. The optics
were designed and built by George Keene of
California. Jack was familiar with George Keene's
work from an article in Sky and Telescope.
26
Topics Covered
27
Camera Obscura
Contemporary artist Madison Cawein rented studio
space in an old factory building where many of
the windows were boarded up or painted over. A
random small hole in one of those windows turned
one room into a camera obscura.
28
Optical Elements in an Imaging System
29
Large Format (View) Camera
30
Camera Calibration
31
Lens Distortions
32
Sensing Color
3 CCD
Bayer pattern
Foveon X3TM
33
The Problem of Dynamic Range

• Dynamic Range Range of brightness values
  measurable with a camera

(Hood 1986)

• Todays Cameras Limited Dynamic Range

High Exposure Image
Low Exposure Image

• We need 5-10 million values to store all
  brightnesses around us.
• But, typical 8-bit cameras provide only 256
  values!!

34
High Dynamic Range Imaging
(Mitsunaga)
(Debevec)
35
Light Field Cameras - Lens Arrays
Contax medium format camera
Kodak 16-megapixel sensor
4000 4000 pixels 292 292 lenses 14
14 pixels per lens
36
Refocusing using Lens Arrays
37
Refocusing using Lens Arrays
38
Refocusing using Lens Arrays
39
Controlling Each Pixel
LCD Camera
Jitter Camera
DMD Camera
40
Optical Beam Splitting
3 CCD Camera
41
Optical Beam Splitting
42
Polarization Photography
Without Polarizer
With Polarizer

• Provides better Color Saturation
• Darkens the sky

43
Polarization Photography Reflections
Reduce Reflections
44
Range Scanning
45
Camera Arrays
46
Large Images
47
Large Images
48
High Speed Cameras
49
Cameras with Lenses and Mirrors
50
OneShot 360 by RemoteReality
(Nayar 97)
4 Megapixel (2000 x 2000) 360 degree still
camera
51
(No Transcript)
52
(No Transcript)
53
(No Transcript)
54
(No Transcript)
55
Cameras with Lenses and Mirrors - Applications
56
Projector-Camera Systems
57
Reactive Displays
58
3D Displays
59
Course Logistics
60
Readings

• No text
• Class Notes (required)
• Supplementary Material (papers, tutorials,
  online)

61
Course Schedule
1/15/2008 Introduction and Course
Fundamentals 1/17/2008 Camera Obscura and
History of Photography 1/22/2008 No
Class 1/24/2008 Optical Elements (filters,
lenses, mirrors) 1/29/2008 Camera Calibration
I 1/31/2008 Camera Calibration II ?
Assignment 1 OUT 2/5/2008 CCD Demosaicing
and Assorted Pixels 2/7/2006 High Dynamic Range
Imaging 2/12/2008 Beam Splitters
I 2/14/2008 Beam Splitters II ? Assignment
2 OUT 2/19/2008 Range Scanners
I 2/21/2008 Range Scanners II ? Demo in
Martials Lab 2/26/2008 Camera Arrays
I 2/28/2008 Camera Arrays II ? Demo in
Tsuhans Lab 3/4/2008 IR, LIDAR and Gated
Sensors 3/6/2008 Midterm 3/11/2008 Spring
Break 3/13/2008 Spring Break
62
Course Schedule
3/18/2008 High Speed Cameras 3/18/2008
Light Fields 3/25/2008 Cameras with
Mirrors ? Assignment 3 OUT 3/27/2008
Omnicamera ? Assignment 4 OUT 4/1/2008
View Caustics and Imaging ? Assignment 5
OUT 4/3/2008 Mosaicing 4/8/2008 Multiperspec
tive Imaging 4/10/2008 Displays I (LCD, LCOS,
Reactive) 4/15/2008 Displays II (3D and
Stereoscopic) 4/17/2008 No Class 4/22/2008 Pr
ojectors (LCD, DMD) 4/24/2008 Projector-Camera
Systems 4/29/2008 Project Discussions 5/1/2008
Review 5/6/2008 Final Exam
63
Prerequisites

• Basic Linear Algebra, Probability, Calculus
  Required
• Basic Data structures/Programming knowledge
• No Prior knowledge of Computer Vision Required
• Basic knowledge of photography

64
Grading

• THREE Assignments 60
• ONE Midterm 15
• ONE Final 25