Using GPU Rendering

Using GPU Rendering
- Achieving Animation
Production in Hours
王銓彰
Media Lab, Next Media Animation
October 22, 2010
Objectives
What We Do and Why
Classic Animation Production Pipeline Concept
Next Media Animation Pipeline
What We Have Learned and Will Do with GPU
NVIDIA Confidential
新聞動畫
Animate the “Missing Image” inside the News
Our Objectives
Within Two Hours Finishing One Animation
From Story Board to Broadcasting
At least 20 sets of News Animation per Day
Famous People Must Look Like Themselves
No Quality Sacrificed
Mission Impossible
Regular Animation Pipeline Not Working Now
Some Technical Creativity Needed
NVIDIA Confidential
新聞動畫
We Integrate the Game Development with the
Computer Animation
Utilizing GPU Computing Power to Solve the
Problems
Mission Completed !
NVIDIA Confidential
新聞動畫
You Can See the 蘋果動新聞 at
http://tw.nextmedia.com
http://hk.nextmedia.com
YouTube
壹電視 Next TV
http://www.nexttv.com.tw/
NVIDIA Confidential
Next Media Animation 壹傳媒動畫
From August, 1st, 2007
250 Animation Production Staff
Production Capacity
30 Animations / Day, 30-second Animation Each
100 min. Animation / Week
Major Customers
蘋果日報、壹電視、路透社、BBC 、Turner
Medial Lab
R&D Team in Next Media Animation
NVIDIA Confidential
3D Animation Production Pipeline
Visual
Development
Preproduction
Shot
Production
Delivery
Modeling
Camera track
Match Movie
Sketches
Texture Paint
Animation Layout
Animation
Animation Cleanup
Storyboarding
Pre-lighting
Tech Animation
Lighting
Effects
Rigging
NVIDIA Confidential
Rendering
Composite
3D Animation Production Pipeline
Visual
Development
Preproduction
Shot
Production
Delivery
Modeling
Camera track
Match Movie
Sketches
Texture Paint
Animation Layout
Animation
Animation Cleanup
Storyboarding
Pre-lighting
Tech Animation
Rendering
Composite
Lighting
Effects
Rigging
For 30-sec Animation :
NVIDIA Confidential
?? days
?? Days/hours
?? hours
Our Solution
1st Step
No More CPU Rendering
No Rendering Farm
GPU Rendering
Shaders
Next Gen Game Production Spec.
Keeping in “OK” Quality
Graphics Workstation = Rendering Machine
Final Rendering Quality When Editing
WYSWYG
NVIDIA Confidential
Next Gen. Game Rendering
NVIDIA Confidential
Our Solution
2nd Step
Building Up a high Efficient Motion Capture
Pipeline
50 Vicon Cameras
In-house Motion Retargeting Technique
We Capture 300 Motion Clips Every Day.
10 min. Data Processing Time for Each Motion
Clip before Delivering to Animators
Facial Motion Capture for Facial Expression
Synthesis
NVIDIA Confidential
Facial Mocap Demo
Our Solution
3rd Step
In-house Animation Software
70% Animation Done by Our Own Tools
95% Rendering Work Done by GPU
A 3dsMax Real-time Renderer Plugin
Procedural Animation
Game AI Technologies
Physics Simulation
Integrate PhysX with Our Game Engine
Real-time Renderer + Post-processing
NVIDIA Confidential
AT Demo
Our Solution
4th Step
Graphics Asset Database and Search Engine
3D Models
Characters
Textures
Motion Clips
Animation Templates
Recycling Mechanism
Workflow Management System
NVIDIA Confidential
Our Pipeline
Visual
Development
Preproduction
Models/Characters
in
Database
Storyboarding
Camera track
Real-time 3D
Motion from MoCap
Physics Enigne
Rendering
By Game Engine
Lighting
Effects
(Game Engine)
20 min.
NVIDIA Confidential
Delivery
Game AI
Sketches
For 30-sec Animation :
Shot
Production
20 min.
30 min.
Composite
5 min + 0.5 hour
What We Have Learned
GPU Rendering Is the Most Important Successful
Key for News Animation
GPU Is Not Only for Graphics
Real-time Rendering
Facial Expression Synthesis in Real-time (20fps)
Computer Vision
Physics Simulation
Computational Geometry
GPU Provides Us Super-computing Power
R&D Is Very Important
NVIDIA Confidential
What We Will Do
NVIDIA
CUDA
NVIDIA Confidential
What We Will Do
Setup a Hybrid Programming Environment
GPU + Multi-Core
New Projects
GPU-based Global Illumination Renderer
GPU Rendering Farm
New Hair and Fur Solution
New Skin Deformation with Muscle and Fascia
NVIDIA Confidential
Thanks
Light Stage X @ Next Media Animation, Media Lab
NVIDIA Confidential