301 Avatars in e-Learning: How Human is TOO Human?

Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
301
Avatars in e-Learning:
How Human is TOO Human?
John DiGiantomasso
Breakthrough PerformanceTech
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
OLF 301 - AVATARS
IN E-LEARNING:
HOW HUMAN IS TOO HUMAN?
OR: “CROSSING THE UNCANNY VALLEY”
John DiGiantomasso
Breakthrough PerformanceTech
Hot Link!
[email protected]
Copyright © MMXI Breakthrough PerformanceTech LLC All Rights Reserved
HOW HUMAN IS TOO HUMAN?
• The Problem
• “Non-Humanness”
• Animation Rules versus Robotics
• The Balance Rule
• Website Avatars, eLearning Avatars
• Making Choices
• “COTS” Product Snapshots (With Samples)
• BPT’s Approach (With Results)
• Conclusion
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 1
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
THE PROBLEM
I am going to show you a series of Images…
Think about if they make you feel “Comfortable” or “Creepy”
Copyright © MMXI Breakthrough PerformanceTech LLC All Rights Reserved
POPULAR CARTOON NON-HUMANS
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 2
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
WHAT ABOUT REAL ROBOTS?
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
HOW ABOUT SYNTHETIC HUMAN ROBOTS?
HIROSHI ISHIGURO
ZUO RENTI
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 3
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
IDENTIFICATION OF THE PROBLEM
•
Masahiro Mori
• Early Robotics Work
• Unexpected Fall-Off in Comfort
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
THE UNCANNY VALLEY
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 4
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
ANIMATION RULES VERSUS ROBOTICS
•
The Uncanny Valley Problem Applies to Animation, Too!
• Hollywood Films (Polar Express, Final Fantasy)
• Video Games
• Web Animations
• eLearning Applications
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
ANIMATION MOTION ADDS INTENSITY…
Higher Peaks
Deeper Valley
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 5
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
BUT IT IS MORE THAN JUST A VALLEY…
•
When it comes to Non-Humanness, WHAT is Non-human is Extremely Important
• Surface - Texture and Lighting
• Audio - Character, Inflection, Dialect, Rhythm
• Figure - Geometry of Body, Clothes, Hair
• Expression - Lip Synch, Emotion, and Body Movements
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Expression - Movements
Figure – Geometry and Shape
Audio – Vocal Soundtrack
Surface – Texture and Lighting
ARE YOUR AVATARS SAFE?
•
This is a technique that we use at Breakthrough PerformanceTech to determine if our
avatars are “SAFE” or if they are likely to be “creepy.”
•
Let me explain…
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 6
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
THE “SAFE” SCALE
Expression - Movements
Figure – Geometry and Shape
Audio – Vocal Soundtrack
Surface – Texture and Lighting
Totally Real Human
Totally Non-Human
•
Provide Balance Across ALL Categories;
•
Failing That, Always Try to Trend Upward Towards Human Expression
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
REPLIEE Q2 ROBOT – HIROSHI ISHIGURO
Hot Link!
Video 1
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 7
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
CREEPY GIRL
Hot Link!
Creepy Girl
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
POLAR EXPRESS
Hot Link!
Video 2
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 8
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
WALL-E (AN INTERESTING REVERSAL)
Hot Link!
Video 3
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
HOMER SIMPSON
Hot Link!
Video 4
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 9
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
HOMER SIMPSON – NEW AND IMPROVED!
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
THE REAL SIMPSONS
Hot Link!
Video 5
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 10
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
WEBSITE AVATARS, E-LEARNING AVATARS
Copyright © MMXI Breakthrough PerformanceTech LLC All Rights Reserved
WEBSITE AVATARS, E-LEARNING AVATARS
• Traditionally
• Hosts
• Narrators
• Companions
• “High-Tech Coolness Wow! We’re Modern!” Artifacts
• Emerging
• Practice Partners
• Role Models
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 11
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
WHY THE UNCANNY VALLEY IS IMPORTANT
• Hosts
• Hosts, Companions and Narrators can often be totally ignored
• They are not integral to the learning process
• They are usually stylized, which makes them easy to trivialize
• Practice Partners and Role Models
• In order for a practice partner to be emotionally engaging, it has to be “real”
• If it’s real (or somewhat real) then any creepiness can interfere with learning
•
Decide What you Want the Avatar to Accomplish
• Is there a net advantage in Learning?
• At what point does an avatar become annoying and counter-productive?
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
MAKING CHOICES
•
View – Head Only or Full Body
•
Format – Flash (Interactive with Screen) or Fixed Playback
•
Quality – Screen Size and Frame Rate
• Affects File Size, and therefore Bandwidth Requirements
•
Catalog – A Set List of Avatars and Options, or Provide Your Own
•
Process – Full Control or No Control
• Do You Want to Control Every Movement, or No Movements
• Time, Time and More Time
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 12
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
THE MOST IMPORTANT CHOICE…
Balanced on the Left Side of the Valley
Balanced on the Right Side of the Valley
(Enhance Learner Comfort)
(Enhance Emotional Engagement)
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
SEVEN COMMON TOOLS (IN ALPHABETICAL ORDER!)
• iClone
Expression - Movements
Figure – Geometry and Shape
• CrazyTalk
Audio – Vocal Soundtrack
• CodeBaby
Surface – Texture and Lighting
• AlterEgos
• Noah
• Oddcast (SitePal)
• Poser
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 13
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
VARIED APPROACHES, VARIED RESULTS
•
The Different Tools all have Different Strengths and Weaknesses
•
These Can Either Align Beneficially or Detrimentally with Each Specific Application
•
Most Tools Have “Free Trials” or Demos On-Line, so Be Sure to Explore
•
Brief Overview of Seven Tools (With Samples)
• Use the Hot Links to connect to the sample
• Then, let’s take a poll to see what everybody thinks!
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
ALTEREGOS
•
HTTP://WWW.ALTEREGOS.COM/
Set Catalog of Avatars, but Custom Available
• Fairly Realistic 3D CGI Style Characters
•
Simple Animation Controls
•
Facial Window Only
•
Good Lip Synch – Based on Audio & Text
•
Integrates to Web or PowerPoint
•
SWF, FLV, AVI Output Formats
Hot Link!
Video 6
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 14
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
CODEBABY
•
HTTP://WWW.CODEBABY.COM/
Set Catalog of Avatars
• Stylistic 2D Full-Body Cartoons
•
Full Body Capable
• Good Controls for Expression with Full-Body Gestures
•
Easy User Interface
•
Large Customer Base
•
DevLearn Sponsor!
Hot Link!
Video 7
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
CRAZYTALK
HTTP://WWW.REALLUSION.COM/CRAZYTALK/
•
Facial Window Only, Can Import Any Image as Model
•
Powerful (Yet Simple and Intuitive) User Interface
•
Head Movement, Emotional Expressions
•
Puppeteering
•
Supports Variety of Video Formats
•
Very Fast Renders
• Designed for Non-Animators (kids!)
Hot Link!
Video 8
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 15
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
ICLONE
HTTP://WWW.REALLUSION.COM/ICLONE
•
Facial or Full Body
•
Incredible Ability to Merge Live Video and Animation
•
Powerful (Yet Simple and Intuitive) User Interface
•
Head Movement, Emotional Expressions
•
Puppeteering
•
Supports Variety of Video Formats
•
Very Fast Renders
Hot Link!
Video 9
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
NOAH
•
HTTP://WWW.NOAHX.COM/
Set Catalog of Avatars
• Simple 2D Full-Body Cartoons
•
Motion Controls Emphasize Screen Interaction
•
Full Body or Facial Presentation
•
Add-In Avatar Layer
•
Can be Added to Articulate or Captivate
•
Can be Added to Websites; Well-Suited for Host Duties
Hot Link!
Noah Website
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 16
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
ODDCAST (SITEPAL)
•
HTTP://WWW.ODDCAST.COM/TECH/
User Uploadable Character Images, Plus Cartoon Catalog
• New PhotoFace Technology
•
Facial Window Only
•
Several Different Technologies & Tools
• Character Studio, SitePal, Avatar Framework, etc.
•
Primarily Hosted Web Companions
•
Primarily Flash-Based, video output available
Hot Link!
Video 10
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
POSER
•
HTTP://POSER.SMITHMICRO.COM/POSER.HTML
Huge 3D Character Library
• Lots of 3rd Party Offerings (DAZ, Renderosity, RDNA, PoserWorld, etc.)
•
Full-Body or Facial, with Walkabout
• Scene, Lighting and Camera Options
•
Full Animation Capabilities - Animate Every Joint and Muscle
•
Excellent Rendering of Still Images
•
Incredibly Powerful; Delivers Capabilities Needed by Professional Animators
Hot Link!
Video 11
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 17
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
SEVEN GOOD PRODUCTS (AND MORE)
•
No Single Product is Right for Breakthrough PerformanceTech
•
Close Attention to Objectives and Targets
•
Three Years to Produce “a Commodity”
•
Still Learning, Still Enhancing
•
Technology is Advancing – Every Day
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
BPT’S APPROACH
•
Emotional Engagement Through Role Models and Simulated Conversations
• Commercial, Off-the-Shelf (COTS) Technologies
• Voice Actor Audio
• High-Quality 3D Renderings for Models (Realism)
• Hand-Animation to Perfect Timing of Expression
• Custom, Automatic Avatar Generation via SLICK
• Voice Actor Audio
• Pre-Generated Characters Added to Avatar Catalog
• Specialized Motion Scripts to Balance Emotion and Movement
• Automated Animation
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 18
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
BPT’S APPROACH
•
Emotional Engagement Through Role Models and Simulated Conversations
• Commercial, Off-the-Shelf (COTS) Technologies
• Voice Actor Audio
• High-Quality 3D Renderings for Models (Realism)
• Hand-Animation to Perfect Timing of Expression
• Custom, Automatic Avatar Generation via SLICK
• Voice Actor Audio
• Pre-Generated Characters Added to Avatar Catalog
• Specialized Motion Scripts to Balance Emotion and Movement
• Automated Animation
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
CUSTOM AVATAR ANIMATION
•
Created by BPT’s In-House Animation Team
•
Enhanced Lip Synch
•
Precise Timing and Expression
•
Ground-Up Avatar Creation
• Model Features
• Uniforms / Corporate Clothing
• Nametags and Props
• Actual Scenes as Backgrounds
•
Production Time: 60 to 1
Hot Link!
Video 12
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 19
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
AUTOMATIC AVATAR ANIMATION
•
Produced by End User (No Skills Required)
•
Pick and Choose User Interface
• Pick Avatar Model from Catalog
• Pick Background Scene
• Pick Motion Script (Emotion & Strength)
• Attach Audio File
• Click DONE
•
Total Time, Click to View: Less Than 1 to 1
• BPT Has Integrated Multiple Technologies
Hot Link!
Video 13
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
CONCLUSION
Copyright © MMXI Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 20
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
WHAT HAVE WE LEARNED?
•
Problems of Robotics also Apply to Animation
•
Non-Humans are Great if They Are Clearly Non-Human
•
Almost-Human Can Be OK, as long as you Balance and Trend Up to Expression
•
There are Commercial, Off-the-Shelf Solutions Available
•
Determine Your Purpose, Set Realism Target
•
Pick Appropriate Tool (or Combine Tools!) to Achieve Your Goals
•
But Make Sure Your Output is Balanced and Properly Trended
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
WHAT ABOUT THE TOOLS?
•
AlterEgo –Facial Animation Tool, with 3D Images
•
CodeBaby –Full-Body Animation Tool, Stylized 2D Images with Good Expression
•
CrazyTalk –Facial Animation Tool, Custom Images, with Easy User Interface
•
iClone –Full-Body Animation Tool, Merge Live Video and Animation
•
NOAH – Full-Bodied Animation Tool, 2D Images, Good Screen Interaction
•
Oddcast (SitePal) – Facial Animation of Custom Images
•
Poser – Extensive Control for Ground-Up Avatar Creation
•
The Breakthrough PerformanceTech Selected Approach
• A Combination of COTS Technologies and Custom Developed Software and Data
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 21
Instructional Design Tips and Techniques:
Best Practices
January 20 & 21, 2011
THANK YOU!
•
John DiGiantomasso
Vice President
Breakthrough PerformanceTech
•
424-208-8610
Hot Link!
Hot Link!
[email protected]
www.bptresults.com
Learn How.
Copyright © MMX Breakthrough PerformanceTech LLC All Rights Reserved
Session 301 – Avatars in e-Learning: How Human is TOO Human? –
John DiGiantomasso, Breakthrough PerformanceTech
Page 22