Motion Capture Assisted
Animation: Texturing and
Synthesis
SIGGRAPH ’02
Speaker: Alvin
Date:23 August 2004
Outline
Introduction
Framework
Results
Conclusions and Future Work
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
2
Introduction
Create a method that allows an artist
low-level control of the motion
Combine the strengths of keyframe
animation with those of mocap
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
3
Introduction (cont.)
“Sketch” an animation by keyframing
Animate only a few degrees of freedom
Set few keyframes
“Enhance” the result with mocap data
Synthesize missing degrees of freedom
Texture keyframed degrees of freedom
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
4
Keyframing vs. Mocap
Advantages
Disadvantages
Keyframing
•Control
•Intuitive
•Detail hard
•Many DOF
Mocap
•Detail easy
•All DOF
•No control
•Not intuitive
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
5
Keyframe vs. MoCap
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
6
Correlation
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
7
Framework
Choosing Matching Angles
Frequency Analysis
Segmentation
Matching
Path Finding
Joining
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
8
Choosing Matching Angles
Root x trans
Root y trans
Root z trans
Root x rot
Root y rot
Root z rot
Spine1 x
Spine1 y
Spine1 z
Spine2 x
Spine2 y
Spine2 z
Spine3 x
Spine3 y
Spine3 z
Neck x
Neck y
Neck z
Head x
Head y
Head z
Head Aim x
Head Aim y
Head Aim z
Left Clavicle x
Left Clavicle y
Left Clavicle z
Left Shoulder x
Left Shoulder y
Left Shoulder z
Left Elbow x
Left Elbow y
Left Elbow z
Left Wrist x
Left Wrist y
Left Wrist z
Right Clavicle x
Right Clavicle y
Right Clavicle z
Right Shoulder x
Right Shoulder y
Right Shoulder z
Right Elbow x
Right Elbow y
Right Elbow z
Right Wrist x
Right Wrist y
Right Wrist z
Time
Alivn/GAME
Lab./CSIE/NDHU
Left Hip x
Left Hip y
Left Hip z
Left Knee x
Left Knee y
Left Knee z
Left Ankle x
Left Ankle y
Left Ankle z
Left Ball x
Left Ball y
Left Ball z
Right Hip x
Right Hip y
Right Hip z
Right Knee x
Right Knee y
Right Knee z
Right Ankle x
Right Ankle y
Right Ankle z
Right Ball x
Right Ball y
Right Ball z
Time
Motion Capture Assisted Animation:
Texturing and Synthesis
Time
9
Frequency Analysis
Laplacian Pyramid Decomposition
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
10
Segmentation
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
11
Matching
Motion Capture Data
Keyframed
Fragment
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
12
Matching (cont.)
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
13
Matching (cont.)
Hip Angle (Matching Angle)
Spine Angle (For Synthesis)
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
14
Matching and Synthesis
Low frequency hip angle data (a matching angle)
Spine angle data to be synthesized
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
15
Angle in degrees
Path Finding
Time
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
16
Angle in degrees
Joining
Time
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
17
Path Finding
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
18
Joining
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
19
Smoothing
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
20
Smoothing (cont.)
Blend Function
The data s after smoothing is
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
21
Result
Watch the demo movie file.
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
22
Summary of the Method
Sketch +
Mocap
Frequency
Analysis
Matching
Keyframed data
Keyframed Data
Matching Angles
Mocap Data
Mocap Data
Possible Synthetic Data
Path Finding
Joining
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
Enhanced
Animation
23
Conclusions and Future Work
Combine the advantages of both
methods
Allow the user control an initial rough
animation with keyframes
Fill in missing DOFs and detail using the
information in motion capture data
Direct incorporation of hard constraints
Fundamental units of motion
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
24
Evaluation Form
論文簡報部份
完整性介紹(4)
系統性介紹(4)
表達能力(3)
投影片製作(4)
論文審閱部分
瞭解論文內容(4)
結果正確性與完整性 (4)
原創性與重要性(4)
讀後啟發與應用：
The method using the correlative relationship of the joints to synthesis
the other DOFs can be used in my research.
Alivn/GAME
Lab./CSIE/NDHU
Motion Capture Assisted Animation:
Texturing and Synthesis
25