Zweig, J., Suzuki, S., Grabowecky, M.

Voices Facilitate Visual Search for Congruent Faces
Jacob
1
Zweig ,
Marcia
1,2
Grabowecky ,
Northwestern University, Department of
Satoru
1,2
Suzuki !
1
Psychology
and Interdepartmental Neuroscience
2) Can voices, that convey no
location information about a target
face, facilitate visual search for
congruent faces?
Training
NIH R01EY021184
Results
No significant differences in accuracy
Visual Search display
appeared synchronously
with the onset of one of
three sounds.!
!
Participants responded by
indicating the quadrant in
which the target face was
present.!
!
Three voices were
counterbalanced across
participants (2 used for
training, 1 for unlearned
voice)!
100%$
Mean Accuracy 1) Can multisensory
correspondences be formed
through brief training?
Evanston, IL!
Accuracy by Voice Condition
90%$
80%$
70%$
60%$
50%$
Congruent Learned
Reversed
3.0#
Response Time by Accuracy
2.5#
2.0#
1.5#
1.0#
0.5#
0.0#
Correct
Response times on congruent learned voice trials were significantly faster
than reversed and novel unlearned voice trials (N=12).
Response Time by Voice Condition
Phase 1
Pre-recorded voice played
simultaneously with face. Participants
were trained with 10 repetitions of 2
faces (20 total views).
Hey, it’s me
Michael!
Phase 2
Participants selected the face that
matched the heard voice until
criterion of 25 consecutive correct
responses was met
Incorrect
Conclusions
Results
Hi my name is
Michael, I’m 22
years old and I
teach Monkeys
sign language.
Unlearned
No evidence of speed-accuracy trade off
Mean Reaction Time (s)
Multisensory correspondences can
enhance the detection, localization, and
response to targets when
correspondences are in agreement
across modalities1,2,3.
2
Program ,
Visual Search
Introduction
3.2$
Correct Mean Reaction Time (s)
*
3.0$
Congruent voices facilitated visual
search for faces.
Crossmodal associations can be
formed through brief training, and
are likely to be strengthened
through repeated spatial and/or
temporal coincidence.
**
2.8$
References
2.6$
1.  Iordanescu, L., Guzman-Martinez, E., Grabowecky, M., & Suzuki,(2008).
Characteristic sounds facilitate visual search. Psychonomic Bulletin &
Review, 15(3), 548–554. 2.4$
2.  Iordanescu, L., Grabowecky, M., Franconeri, S., Theeuwes, J., & Suzuki, S. (2010). Characteristic sounds make you look at target objects more
quickly. Attention, perception & psychophysics, 72(7), 1736–41. 3.  Chen, Y.-C., & Spence, C. (2010). When hearing the bark helps to identify
the dog: semantically-congruent sounds modulate the identification of
masked pictures. Cognition, 114(3), 389–404
2.2$
2.0$
Congruent Learned
Reversed
Unlearned
Overall ANOVA: [F(2,22) = 6.99, p < .01, η2 = 0.39].
Congruent Learned voice trials were 0.19 seconds faster, on average, than Reversed voice trials [t(11) = 4.06, p < .01].
Congruent Learned voice trials were 0.42 seconds faster, on average, than Novel Unlearned voice trials [t(11) = 3.01, p < .05]

Download Report