Toward Affective Interfaces

1
Toward Affective Interfaces

• Rosalind W. Picard
• MIT Media Laboratory

2
Affective Computing
Computing that relates to arises from,
or deliberately influences emotions.
3
TOO MUCH EMOTION wreaks havoc on reasoning

• TOO LITTLE EMOTION wreaks havoc on reasoning

4
(No Transcript)
5
(No Transcript)
6
Emotions modulate physical communication

• Face
• Voice
• Posture
• Gestures, movement, behavior
• Skin conductivity
• Pupillary dilation
• Respiration, heart rate, pulse
• Temperature
• Blood pressure

• Visible
• Less
• Visible

7
Video Scientific American Frontiers
8
(No Transcript)
9
Sandal, slipper, or shoe senses galvanic skin
conductivity (GSR)
10
Personal Area Network (PAN) (Zimmerrman, IBM
Systems J 96 Picard Healey IEEE PT 97)
11
Steve Mann, Wearcam/Wearcomp, 80s - 90s
12
Arousal
Ski victory
Mutilated face
Valence
Cute baby
Cemetery
Flowers
13
Affective WearCam (ISWC 98)
14
Video Affective WearCam
15
(No Transcript)
16
(No Transcript)
17
(No Transcript)
18
Conductors Jacket
EMG sensor net, plus position and orientation
sensing on arm joints torso, respiration,
heart-rate, skin conductivity Marrin and Picard,
ICMC 98
19
(No Transcript)
20
(No Transcript)
21
(No Transcript)
22
Speech pitch contours and spectrograms
Annoyed Sad
Cahn, J. of the American Voice I/O Soc. 90
23
Essa and Pentland, PAMI 97
24
(No Transcript)
25
Confusion Sensing
26
Video Expression Glasses
27
(No Transcript)
28
JK
29

• Goal
• Help relieve user frustration

30

• Goal
• Help relieve user frustration
• Strategy
• Recognize situation as frustrating
• Is user willing to talk about feelings? If so
• Assess practice active listening
• Attempt to show empathy
• it sounds like things could have gone better
• How received? Repair if needed, up to 3x
• Communicate feelings ok, perhaps apologize
• Express sympathy
• good to hear it wasnt terribly frustrating
• Polite social closure

31
(No Transcript)
32
(No Transcript)
33
(No Transcript)
34
(No Transcript)
35
(No Transcript)
36
(No Transcript)
37
(No Transcript)
38
Social/Philosophical Concerns

• Deception, no real feelings
• Human displacement
• Baudrillard-Lascaux cave paintings
• Manipulation vs. support
• Computational prozac
• Wind out of sails

39
Keys?

• No deception
• Validate
• Respect
• Support
• Build awareness
• Foster development

40
Emotional Intelligence

• Recognizing emotions
• Expressing emotions
• Regulating emotions
• Utilizing emotions
• Handling anothers emotions

41
(No Transcript)
42
http//www.media.mit.edu/affect
http//www.media.mit.edu/wearables
http//www.media.mit.edu/picard