An Architecture for Action, Emotion, and Social Behavior

1
An Architecture for Action, Emotion, and Social
Behavior

• Joseph Bates, A. Bryan Loyall and W. Scott Reilly
• Federico Trilnik - ISISTAN

2
Oz Project

• Developing technology for artistically
  interesting simulated worlds
• suspend disbelief
• Oz world
• Simulated physical
• environment
• Set of automated agents
• User interface
• Planer

3
Oz Agents

• Perception
• Reactivity
• Goal-directed behavior
• Emotion
• Social behavior
• Natural language analysis
• Natural language generation

4
Tok Architecture

• Perception
• Reactivity and goal-directed behavior
• Emotion and social relationships
• Language analysis and generation

• Sensory Routines and the Integrated Sense Model
• Hap
• Em
• Gump and Glinda

5
Tok Architecture
6
Tok and Lyotard

• The simulated world
• Interactive fiction physical world
• Object-oriented simulation
• Actions methods
• Modify the world, propagate sense data, and
  succeed or fail
• Objects connected via topological relations
• Agents sense via sense data objects

7
Perception

• Sensory Routines
• Raw sense data
• Objects relationships ? topological graph
• Time notion
• Have I seen food in the kitchen in the last ten
  minutes?
• Tok agents three steps sense, think, act

8
Perception (II)

• Integrated Sense Model
• best guest about the world
• merge sensed data
• different modalities (sound and sight)
• new and past perceptions
• inference
• which of the visible objects are within reach
• longer term, approximate model

9
Action - Hap

• goal-directed, reactive action engine
• based on perception, current goals, emotional
  state, behavioral features, ...
• set of actions ? plans (testable preconditions)
• unchanging plan memory
• goto ltobjectgt gt goto_floor of the current room,
• goto_room of the room containing ltobjectgt,
• goto_object_in_room.

possible plan
goal
10
Hap Active Plan Tree

• current execution state
• alternating layers of active goals and plans
• reactivity and management of multiple top-level
  goals
• context conditions and success tests
• Hap modify APT based on changes in the world

11
Em - Emotions and Social Relationship

• models emotional and social aspects
• goals, actions, objects (attitudes)
• generate emotions

Example
Hap
Em

• Events
• create goal
• goal succeed
• goal fail

• Emotions
• happiness
• sadness

12
Emotions

• goals succeed or fail degree depends on
  importance
• action is approved or disapproved
• moral beliefs and personal standards of
  performance
• positive or negative attitude
• attitude to model social relationship

• happiness and sadness
• pride, shame, reproach, and admiration
• love and hate

13
Behavioral Features

• Behavioral features modulate the activity of Hap
• Adjusted by
• Em to express emotional influences on behavior
• Hap to force a style of action
• Act friendly to get what it wants
• Influence
• Create new top-level goals, affect preconditions,
  success tests, context conditions, style of an
  action perform
• How Hap chooses to achieve its goals

14
Original Lyotard Task
Emotions Emotions Behaviors
hope fear wanting to be pet or brushed
happy sad cleaning self
pride shame wanting to go out/in
admiration reproach eating
gratification remorse wanting to eat
gratitude anger getting object (using human or other tool)
love hate searching for something
Features Features carrying mouse
curious content playing with ball
aggressive ignoring hiding (anger/fear)
friendly proud bite
energetic ...
15
Conclusion

• Tok, an architecture that integrates mechanisms
  for perception, reactivity, goals, emotion, and
  some social knowledge.
• Lyotard exhibits an interesting behavior
• Suspension of disbelief is the criteria for
  success ? broad, shallow agents may be possible