Human Body Movement Analysis Decoding the Movement and Emotion

1
Human Body Movement Analysis Decoding the
Movement and Emotion
A three years research and application
development project

• Yunyu Wang, Professor
• C. C. Lin, Associate Professor
• W. C. Chen, Professor

2
Origin--2003

• The Exchange/Discussion
• People from Animation, Dance, Laban Movement
  Analysis, Computer Science and Sports Science.
• Topics about Movement Quality, Emotion,
  Expression, Skill Analysis, Dance Innovation and
  LMA Application.

3
Project Description

• Period
• Three-year 2006 to 2009
• First year April 1, 2006
• Participants
• Professors 5
• Graduate students 18
• Full time staffs and technicians 5

4
TNUA

• The College of Dance
• Graduate School of Technology and Arts
• Center for Art and Technology
• The E Motion Lab

5
The E Motion Lab
6
Partner Organizations and Institutions

• NCPES (National College of Physical Education and
  Sports)
• ITRI (Industrial Technology Research Institute)
• Academia Sinica (http//www.sinica.edu.tw/as/intro
  /hist_e.html)

7
WHY ?

• In Dance
• In Animation
• In Exercise and Sports
• In health industry

8
(No Transcript)
9
Sub-Project I Motion Database and Metadata
10
Motion Database and Metadata

• Project Leadership and Project integration
• Theory development, movement knowledge analysis
• Movement Data Collection
• Motion Database Schema and Structure
• Metadata

11
(No Transcript)
12
Sub-project IIMotion Synthesis and Detection

• Motion Synthesis and Detection

13
Motion Synthesis and Detection

• A kernel Engine for Laban motion and emotion
  analysis
• Laban motion
• Effort
• Shape
• Body
• Emotion
• Cyclic
• Non-Cyclic

14
Motion Synthesis
Laban mocap
emotional mocap
Emotional Mocap(EM)
Laban Mocap(LM)
Construction of Basis Functions (LM and EM
separately)
Construction of Basis Functions
EM ? Motives LM
Dd
PCA
FT
Dynamic Systems
Movement Primitive Lib. (LM and EM)
Learning Algorithm
Motion compiler
Task Objective
Output Motion
15
Motion Detection/Classification
Laban mocap
emotional mocap
Emotional Mocap
Laban Mocap
Construction of Basis Functions (LM and EMCAP)
Dd
PCA
FT
Neural Net
Movement Primitive Lib. (LM and EM)
Motion Classifier Construction
Motion Classifier Lib.
Unclassified Motion
Unclassified Motion
Motion Detection
Learning Algorithm
16
Example Result PCA elbow up
17
Demo(Mans arm up movement)
Mocap original motion
PCA motion synthesis
18
Sub-project III Industry Applications
19
Application

• in Dance
• Dance engine for Choreography
• Dance analysis
• Dance creation
• Interactive Dance

Sub-3
20
Application

• in movie and animation
• Motion/Emotion Quantity Model and Synthesis
  techniques
• Common Motion Language
• Animation Plug-in
• Game engine

Sub-3
21
Application

• In Exercise and Sports
• Efficient and safe (Basketball shooting and
  Discus throwing)
• Online instruction and learning
• Skill Analysis and diagnosis

Sub-3
22
Application

• In Health industry
• Better Rehab. --Motivating Moves
• Janet Hamburg
  (University of Kansas)
• Fitness Instructor ---My Best Friend
• Online Stretching, exercise monitoring,

Sub-3
23
The End

• In describing movement, we must make a mental
  note of the most important intermediary positions.