Idea Proposal:
“Tele White Boarding”: method for remotely interacting with
distant colleagues on immersive screens
24 April 2013
Kyung Mun
Background / Premise
•
•
•
•
Large flat-panel displays will be pervasive in work and
home environments
Large high-resolution displays will create an immersive
environment for viewing video – and facilitate an illusion
for a viewer to (want to) grab and touch objects on screen
Natural human interface technologies (e.g., gesture and
voice recognition) will be far advanced in the future
Ultrasonic wave (touch-free) and camera sensors will be
integrated with large display screens for gesture
recognition applications
Slide 2
Problem Statement
•
•
•
In large-screen environments, object images presented on
large displays may seem “touchable” and “controllable”
from the perspective of a viewer
Interactivity with distant colleagues can be limited in
traditional teleconferencing environments – i.e., can’t lively
interact, on a white board setting for example, in an
impromptu fashion
Can high-speed networks and ubiquitous large displays
remove the “distance” barrier and provide real-time
interactivity for future workers?
Slide 3
“Tele White Boarding” Context
Diagram
West Coast
East Coast
Gesture via camera capture
Screen B
Screen A
ned
happe
What
here?
“board”
Upon voice command,
Screen A zooms in on the
remote Whiteboard, and
Screen A projects gesturebased handwriting on top of
the content of the Whiteboard
Video
stream
Whiteboard
ne
happe
What
here?
d
Touch-free gesture
(ultrasonic wave)
“Tele
Whiteboard”
Cloud
Service
screen capture
& forwarding
engine
“white board” screen capture
streamed in near real-time
Slide 4
“Tele White Boarding” Description
•
System is comprised of:
1)
2)
3)
4)
•
camera sensors on large displays
large displays with touch-free gesture recognition capabilities
digital “white board” as a common collaborative screen (on either
end of remote sites)
“Tele whiteboard” cloud service
“Tele whiteboard” cloud service provides:
•)
voice recognition (e.g., “board”, “zoom”, “pan”, “capture”, “archive”)
•)
gesture recognition
•)
screen capture of gesture overlay and forward to remote screen
•)
interactive session capture/archival/retrieval and remote access
Slide 5
Customer Experience
Gesture-based
handwriting on large
screen is shown in the
distant “white board”
hello
hello
Slide 6