The University of the Arts, Philadelphia
Department of Art Education & Art Therapy
Touch, the oldest of all senses, is the foundation of our existence.
Slavko Milekic, M.D., Ph.D.
Tangible Virtualities
“Not only our geometry and our physics, but our whole
conception of what exists outside us, is based upon the sense
of touch.”
Bertrand Russell
synonyms:
1 a : capable of being perceived especially
by the sense of touch : PALPABLE
b : substantially real : MATERIAL
tangible => PERCEPTIBLE
2 : capable of being precisely identified or
realized by the mind <her grief was
tangible>
Merriam-Webster Dictionary, on-line version
1
synonyms:
synonyms:
tangible => PERCEPTIBLE
tangible => PERCEPTIBLE
which in turn, has the following synonyms:
which in turn, has the following synonyms:
SENSIBLE,
SENSIBLE,
PALPABLE,
synonyms:
synonyms:
tangible => PERCEPTIBLE
tangible => PERCEPTIBLE
which in turn, has the following synonyms:
which in turn, has the following synonyms:
SENSIBLE,
PALPABLE,
TANGIBLE,
SENSIBLE,
PALPABLE,
TANGIBLE,
APPRECIABLE,
2
synonyms:
basic assumption:
tangible => PERCEPTIBLE
which in turn, has the following synonyms:
SENSIBLE,
PALPABLE,
TANGIBLE,
APPRECIABLE,
PONDERABLE
association of virtual and abstract information with
multimodal sensory experiences creates a new layer of
knowledge and action spaces that are more natural and
efficient for humans
basic assumption:
association of virtual and abstract information with
multimodal sensory experiences creates a new layer of
knowledge and action spaces that are more natural and
efficient for humans
these in-between domains, where interactions with
virtual data produce tangible sensations, I dubbed
tangialities.
3
in the context of tangialities, cognitive enhancements are the
consequence of changing the nature of the task
(a)
4 * 2 = 8 or,
8/2 =4
8
4
most often a change is in shift from relying on formal,
abstract operations as a means of gaining knowledge, to direct
manipulation of data (properties) with instantaneously
observable results.
(a)
(b)
?
?
are the dimensions
of the smaller cube exactly the half
?
of the larger one?
4 * 2 = 8 or,
8/2 =4
8
4
(b)
?
?
?
Getting the result using abstract operation (a) or direct
manipulation (b). Note that for the direct manipulation
solution it is not necessary to know the actual dimensions
of objects in order to arrive to the correct conclusion.
direct manipulation => tangiality domain
separation of the hand and the eye……
4
$15.000 solution
$20.000 solution
5
$29 solution
$29 solution
Logitec iFeel mouse
Logitec iFeel mouse
$29 solution
Logitec iFeel mouse
6
Barriers
• success of "drag-and-drop" and "point-and-click" interface
• failure to realize that change or addition of another
interaction device calls for redesign of the GUI
• unlearning established (imposed) conventions
An example of possible use of vibro-tactile device in science
education. The hand represents position of the cursor on the
screen and the user is able not only to see the details of
common herring from the Gulf of Maine but also “feel” its
shape and the texture of scales and fins.
7
Why tangialities
Towards tangialities
• increases ease of use;
Currently, there are two trends in building tangialities:
• use of body (biological) knowledge
• allows grasping and manipulation of complex concepts
without the need for explicit formalization;
• making data (that is, data manipulations) more object like
and thus make their properties available to the senses; and
• reduces cognitive load;
• making objects with desired physical (manipulable)
properties serve as data representations/containers (example
"sensetable")
• reduces the strain of one sense (vision) - single sense
fatigue
• add another dimension to meta data – “how does it feel”
(being able to feel the texture of paintings and other,
otherwise “untouchable” objects)
another way of making information manipulable and
“touchable”:
touch-sensitive screens
8
screen orientation affects possible interactions
digital environments support simultaneous
multi-user interactions
change in orientation allows building of affective space
9
manipulable content
mapping navigational space to experience
10
11
12