Writing assignment Jonathan van Leeuwen Seeing Color? Where

Writing assignment
Jonathan van Leeuwen
Seeing Color? Where? Current Standing in Projector and
Associator Grapheme-Color Synesthesia Research.
RM Neuroscience and Cognition
Writing assignment
Jonathan van Leeuwen
Supervisor:
Dr. Paffen, C. L. E.
Second reviewer:
Dr. van der Smagt, M. J.
1 / 35
Writing assignment
Jonathan van Leeuwen
Abstract
Synesthesia is a neurological condition where a perceptual experience of a stimulus triggers a new perceptual
experience, which is not caused in non-synesthetes. For instance, in grapheme-color synesthesia, a black
grapheme “a” can induce the perception that the grapheme is colored “red”. It has been a matter of controversy
whether the synesthetic percept arises due to bottom up processing of the initial stimulus or if the stimulus needs
to be fully processed and subsequently induces the synesthetic percept by top down processing, due to evidence
apparently supporting both views. To explain these diverging findings, a distinction was made between
“projector” and “associator” synesthetes by Dixon, Smilek, & Merikle (2004). The former perceive the induced
color in the outside world, on top of the grapheme, while the latter perceive the color in their minds eye. This
articles reviews research which has addressed whether projectors and associators differ in neurobiology and/or
cognition as well as how differing methods of differentiation between projectors and associators influence
results. Results indicate that there are indeed cognitive and neurobiological differences between projector and
associator grapheme-color synesthetes and that the method used to distinguish between the two may influence
the results of the experiments. Suggestions for increasing reliability and accuracy of projector/associator
differentiation for future research are also discussed.
Keywords: Synesthesia; Projectors; Associators; Grapheme-color synesthesia; Differentiation; Bottom-up
processing; Top-down processing.
Introduction
“I see vague pictures of Bessel functions from Jahnke and Emde’s book, with light tanned j’s,
slightly violet-bluish n’s, and dark brown x’s flying around. And I wonder what the hell it
must look like to the students”. This quote from the Nobel prize winning physicist Richard
Feynman aptly captures the perceptual phenomenon known as synesthesia (Feynman, 1988).
Synesthesia is a neurological condition in which a perceptual or cognitive stimulus triggers a
sensory percept, then the sensory or cognitive processing of this stimulus triggers a new
sensory percept which is not directly caused by the original stimuli. This synesthetic percept
can arise in the same or in a different modality as the inducing stimulus. The stimulus that
causes the synesthetic percept is generally considered the “inducer” and the synesthetic
percept the “concurrent” (Grossenbacher & Lovelace, 2001). Thus, for a grapheme-color
synesthete seeing the letter “a” as “red”, the letter “a” would be considered the inducer and
the perceived color “red” would be the concurrent. Synesthesia was first described in 1812 by
an Austrian physician (Jewanski, Day, & Ward, 2009), however, the scientific community lost
interest in the phenomenon during the mid-twentieth century (Howells, 1944) as it was
explained as normal conditioning between two stimuli by behaviorist. It resurfaced in the late
1990’s (Baron-Cohen, Burt, Smith-Laittan, Harrison, & Bolton, 1996; Baron-Cohen &
Harrison, 1997) and was widely popularized by Ramachandran in 2001 (Ramachandran &
Hubbard, 2001a, 2001b, 2001c). Since the resurgence in the late 1990, it has become an
increasingly hot research topic in cognitive neuroscience and psychology, demonstrated with
a search in Scopus with “synesthesia” showing 64 articles published between 1960 and 1999
2 / 35
Writing assignment
Jonathan van Leeuwen
while the number of published synesthesia articles between 1999 and 2013 is more than 690.
Since synesthesia is thought to be a variation of normal sensory processing, it should therefore
be possible to explain this phenomenon with current cognitive models. Its ability to explain
normal cognition is thus the main driving force behind the increased popularity in synesthesia
research. The increase in new research technologies like electro encephalography (EEG) and
functional magnetic resonance imaging (fMRI) for cognition research has also made
synesthesia a hot topic in cognition and neuroscience research. A Number of different types of
synesthesia have been described, with the more common types being time and space
synesthesia, where synesthetes experience the months as arranged in a particular spatial order
(Brang, Teuscher, Ramachandran, & Coulson, 2010), week days inducing colors (Julia
Simner et al., 2006), sounds inducing colors (Banissy et al., 2012) and graphemes inducing
colors (Brang, Rouw, Ramachandran, & Coulson, 2011; Gheri, Chopping, & Morgan, 2008;
Jürgens & Nikolić, 2012). Grapheme-color synesthetes have been classified as projector and
associator synesthetes (Dixon et al., 2004) as a method of explaining divergent findings in
grapheme-color synesthesia. This review will start by giving a general overview of graphemecolor synesthesia, followed by a review of current neurological and cognitive literature on
projector and associator synesthesia research. How differing methods of differentiating
between projectors and associators causing non-repeatable results or lack of results, as well as
recommendations for future approaches to differentiating projectors and associators will be
given. Finally, this review will look at how the projector and associator differentiation can be
used in non-grapheme-color synesthesia research.
Synesthetic Classification
Certain criteria are used to differentiate between synesthetic percepts and normal associations.
One of the main criteria for a synesthetic percept is that it should be stable over time (BaronCohen et al., 1996; Eagleman, Kagan, Nelson, Sagaram, & Sarma, 2007). For instance, a
hypothetical grapheme-color synesthete with a particular “inducer”-“concurrent” coupling,
will always have the same concurrent for that particular inducer. In other words, if for a
synesthete the letter “a” induced the concurrent color “red”, the letter “a” would always
induce “red” and never “blue” for this hypothetical synesthete (Jamie Ward, 2013).
Synesthetic percepts should also be automatic, but depending on attention and awareness the
strength of the synesthetic experience varies (Mattingley, Payne, & Rich, 2006). The
“inducer” should also always precede the “concurrent”. In grapheme-color synesthesia this
means that the grapheme should always precede the perceived synesthetic color.
3 / 35
Writing assignment
Jonathan van Leeuwen
Traditionally, it was thought that synesthesia was unidirectional, thus that for grapheme-color
synesthetes only the grapheme could induce a color; and a color should not induce a
grapheme percept (Martino & Marks, 2001). However, recent evidence suggest that at least
under some circumstances, synesthesia appears to be bidirectional (Kadosh, Kadosh, &
Henik, 2007; Gebuis, Nijboer, & Van der Smagt, 2009).
Figure 1: Illustration of synesthetic experiences. A: Grapheme-color
synesthesia (letters and numerals with color) (“Synesthesia,” 2013). B:
Time-space synesthesia (Smilek, Callejas, Dixon, & Merikle, 2007)
Determining if someone has synesthesia was previously done by asking the subject
about synesthetic percepts and then label the person as either a synesthete or as a nonsynesthete (Ramachandran & Hubbard, 2001b; Ward, Li, Salih, & Sagiv, 2007).
Subsequently, subjective reports were usually followed up with consistency checks to be sure
the synesthetic percept was stable over time (Dixon et al., 2004; Rouw & Scholte, 2007). In
order to define synesthesia more consistently, Eagleman et al. (2007) developed an online
synesthesia questionnaire battery. This synesthesia battery includes a synesthesia
questionnaire, a color consistency check, a speed congruency check and a number of other
sub-tests (Eagleman et al., 2007). Since the introduction of the questionnaire by Eagleman et
al. (2007), this online tool has become quite popular and is currently the standard method for
determining synesthesia (Gebuis et al., 2009; Hupe, Bordier, & Dojat, 2011; Melero et al.,
2013; van Leeuwen, Petersson, & Hagoort, 2010). Besides the obvious advantage of
increasing the reliability of classifying synesthesia with a standardized test, this online test
also keeps track of all test results derived from synesthetes filling in the questionnaires. It is
therefore possible to do statistics on large groups of synesthetes as well as differentiating
4 / 35
Writing assignment
Jonathan van Leeuwen
between subgroups, making this a powerful tool for synesthesia research now and in the
future (Novich, Cheng, & Eagleman, 2011).
Bottom Up and Top Down Processing
How synesthetic percepts emerge from stimulus processing has been the subject of interest
since the 1990’s. One of the main questions was whether synesthesia was caused by bottom
up or top down processes (Ramachandran & Hubbard, 2001b; Smilek, Dixon, Cudahy, &
Merikle, 2001). If a stimulus is processed from simple to more complex features and/or from
lower to higher cognitive areas, this would be considered bottom up processing. Conversely,
top down processing is when stimulus processing is influenced from higher cognitive areas,
e.g. a Kanizsa triangle where one sees a whole triangle when part of the sides are actually
blocked (Frisby & Clatworthy, 1975). Ramachandran et al. (2001b) used an embedded figures
task, a screen filled with inducing and non-inducing black graphemes in which the inducing
graphemes were then organized such that they formed a figure when combined, and the
participants were asked to determine of the display contained said figure. In this task the
synesthete outperformed controls and Ramachandran et al. (2001b) took this as evidence for
bottom up of processing of synesthetic percepts. Different research groups have also found
experimental evidence supporting the assertion that synesthetic percepts are caused by bottom
up processing (Palmeri, Blake, Marois, Flanery, & Whetsell, 2002; Smilek et al., 2001).
Contrary to these findings is research indicating that synesthetic percepts are influenced and
might even be caused by top down modulation. For instance, Palmeri et al. (2002) had their
synesthete attend to a Navon stimulus (e.g. a “5” made from small “2”’s), while reporting
their synesthetic percept. If attending the global “5”, the synesthete reported to experience the
color percept related to “5” and if the synesthete attended to the small “2”’s, the color percept
relating to 2 was reported. This was taken as evidence for top down modulation affecting
synesthetic percepts. Similar findings showing evidence for top down processing have also
been reported by others (Ramachandran & Hubbard, 2001c; Rich & Mattingley, 2003; Dixon,
Smilek, Duffy, Zanna, & Merikle, 2006).
Cognitive Models of Synesthesia
A number of models have been proposed to explain how synesthetic percepts are formed. The
two most influential ones are the cross activation model (Ramachandran & Hubbard, 2001c)
and the disinhibited feedback model (Grossenbacher & Lovelace, 2001). Other less known,
but promising models, have also been proposed, like the cascade cross tuning model (Brang,
5 / 35
Writing assignment
Jonathan van Leeuwen
Hubbard, Coulson, Huang, & Ramachandran, 2010), the re-entrant feedback model (Smilek et
al., 2001) and the two stage hyper-binding model (Esterman, Verstynen, Ivry, & Robertson,
2006; Hubbard, 2007). Interestingly, some of these models suggest that abnormal brain
connectivity is the underlying cause for synesthesia, while other models maintain that
synesthetes have similar brain connectivity but that the synesthetic percept is caused by
functional differences.
Based on their findings of a pop-out effect in synesthesia, combined with the fact that
the grapheme area is located adjacent to the V4 color area, Ramachandran & Hubbard,
(2001c) argued that the synesthetic experience arises from early cross activation of areas
located spatially near each other in the brain (Ramachandran & Hubbard, 2001a, 2001b,
2001c). Ramachandran & Hubbard (2001c) proposed that synesthesia is caused by a failure of
pruning in the grapheme and V4 color area. Synesthesia has been shown to run in families,
which suggest that there is an underlying genetic cause (Baron-Cohen et al., 1996), which fits
in line with the pruning hypothesis of the cross activation model of synesthesia. Later
neurobiological studies also found increases in white matter in grapheme/color areas for
synesthetes compared to non-synesthetes (Rouw & Scholte, 2007). Their model posits that
when a synesthete sees a synesthesia eliciting grapheme, the grapheme area becomes active,
this area then automatically cross activates the V4 color area via horizontal connections and
the synesthetic experience is created (Ramachandran & Hubbard, 2001c; Hubbard, Brang, &
Ramachandran, 2011). The cross activation model suggests that synesthetes have abnormal
brain connectivity compared to non-synesthetes. While structural differences might explain
some effects of synesthesia, some argue that non-synesthetes can also experience synesthetic
percepts, evidence for this comes primarily from drug studies (Hartman & Hollister, 1963;
Marek & Aghajanian, 1998). If drug induced synesthetic percepts are indeed causally the
same as synesthetic experiences this would indicate that abnormal brain connectivity is not
necessary for explaining synesthesia.
The disinhibited feedback model suggests that synesthetes have less inhibition of
feedback signals, which in turn activate the synesthetic percept (Grossenbacher & Lovelace,
2001). It proposes that feedforward pathways from inducers converge with feedforward
pathways from concurrents in a multimodal cortical area. This multimodal area is then
thought to send feedback down the inducer pathway. In non-synesthetes this feedback only
travels down the inducer pathway and seeing a grapheme does therefore not induce a
synesthetic percept. For synesthetes on the other hand, it is thought that lack of inhibition
causes both the inducer and concurrent pathways to be activated by the feedback mechanism
6 / 35
Writing assignment
Jonathan van Leeuwen
(Figure 2). The activity in the top down activated concurrent pathway is thought to underlie
the synesthetic percept (Grossenbacher & Lovelace, 2001). This model suggests that there is a
functional difference between regular people and synesthetes and not a structural difference as
proposed by the cross activation model (Ramachandran & Hubbard, 2001c). The strength of
this model lies in its ability to explain synesthesia with current known brain mechanism, e.g.
feedforward and feedback mechanisms (Fahrenfort, Scholte, & Lamme, 2007; Lamme &
Roelfsema, 2000; Schmolesky et al., 1998). It does not rely on structural brain abnormality in
synesthetes as a way to explain the synesthetic percepts, but on functional differences
between synesthetes and non-synesthetes. The apparent synesthetic percepts caused by drugs
can be explained with the disinhibited feedback model, as drugs could cause reduced
inhibition and therefore activate a concurrent pathway in non-synesthetes (Marek &
Aghajanian, 1998). The disinhibited feedback model also gets support from research showing
higher order top down influence on synesthetic effects, for instance evidence showing that
synesthetic percepts can change due to attention (Palmeri et al., 2002). Interestingly, evidence
showing that synesthesia is not purely unidirectional but bidirectional also lends support for
the disinhibited feedback model of synesthesia (Gebuis et al., 2009; Kadosh et al., 2007).
Gebuis et al. (2009) used a number and color priming task to investigate bidirectional
synesthesia. They found that both numbers (inducers) as well as color patches (concurrents)
caused interference for detecting colors or numbers, respectively. Using EEG measurements
Gebuis et al. (2009) found that the effects found for bidirectional synesthesia originated in the
parietal lobe, indicating that the synesthetic percept does not arise in early sensory areas but in
higher processing areas. The disinhibited feedback model can explain this with neural activity
originating from the concurrent pathways activating spatial areas in the parietal lobe causing
activity to feedback into the inducer pathway causing bidirectional synesthesia effects.
The cascade cross tuning model is an updated model of the cross activation model
(Brang, Hubbard, et al., 2010; Ramachandran & Hubbard, 2001c). In this model Brang,
Hubbard, et al. (2010) propose that synesthesia is caused during hierarchical grapheme
analysis (Dehaene, Cohen, Sigman, & Vinckier, 2005; Grainger, Rey, & Dufau, 2008).
Hierarchical grapheme analysis posits that graphemes are processed from low complex forms
to higher integrated forms sequentially: simple components (e.g. curves and lines) of a
grapheme are analyzed, then they are combined in a bottom up fashion into the final complex
grapheme representation (Rey, Dufau, Massol, & Grainger, 2009). However, if there is
ambiguity as to what letter is seen, top down activity can influence how these features are put
together and which letter is finally perceived. The cascade cross tuning model therefore
7 / 35
Writing assignment
Jonathan van Leeuwen
argues that low level stimulus features cross activate the V4 color area. It suggests that each
feature then elicits its own associated color. When a grapheme is completely processed the
final synesthetic percepts stabilizes and the synesthete experiences the grapheme as having a
particular color. One prediction this model makes is that partially seen graphemes should
elicit a synesthetic color experience, but that this color does not necessarily have to be the
color associated with the complete grapheme. According to the cascade cross tuning model,
simultaneous incremental grapheme and V4 activity modulated by top down processes cause
the synesthetic percept, while the cross activation model posits that the activity from the
grapheme area to the V4 color area occurs after grapheme processing in a pure bottom up
fashion. Evidence from studies showing that synesthetes with a strong synesthetic color
percept show similar colors for similar graphemes support the cascade cross tuning model
(Brang et al., 2011).
Figure 2: Three of the cognitive models for explaining how synesthetic percepts might arise. (A) The cross
activation model posits structural differences between grapheme areas and color areas that result in grapheme
areas activating color areas. (B) The re-entrant feedback model suggests that higher order conceptual areas
feedback to earlier grapheme areas as well as color areas, thereby influencing the perception of the letter and
causing color percepts. This model does not require structural differences between synesthetes and nonsynesthetes and explains how cognition can influence synesthetic percepts (C) The disinhibited feedback
posits that feedforward information from grapheme areas converge in higher cortical areas, then feedbacks
into color areas due to the lack of feedback inhibition. This model does not require structural differences
between synesthetes and non-synesthetes. Figure originating from (Mulvenna & Walsh, 2006; Hubbard et al.,
2011)
Building on findings that conceptual information about graphemes influences perceived
color, Smilek et al. (2001) proposed the re-entrant feedback model. This model argues that
higher order conceptual areas (e.g. anterior fusiform areas) influence earlier processing areas
like the grapheme areas and color areas in a top down fashion. Evidence for their model
comes from studies showing that ambiguous and/or conceptual information influence digit
detection tasks (Smilek et al., 2001). One example is the conceptual CAT task, were the
perception of the “A” in “CAT” as “A” or “H” influences the perceived color (Ramachandran
& Hubbard, 2001c). Several other studies have also found evidence for top down modulation
8 / 35
Writing assignment
Jonathan van Leeuwen
of the synesthetic percept, supporting the re-entrant feedback model (Rich & Mattingley,
2003; Dixon et al., 2006).
Based on structural results showing that synesthetes also show neurobiological
differences in the parietal lobe (Rouw & Scholte, 2007) as well as trans-cranial magnetic
stimulation studies indicating that the parietal lobe is necessary for grapheme-color binding in
synesthesia (Esterman et al., 2006), the cross activation model was modified to the two stage
hyper-binding model (Esterman et al., 2006; Hubbard, 2007; Robertson, 2003; Rouw &
Scholte, 2007). The two stage hyper-binding model posits that graphemes are first cross
activated in grapheme-color areas but subsequently need to be bound together in parietal areas
for the synesthetic percept to arise. For a schematic overview of the cross activation, reentrant feedback and disinhibited feedback model see Figure 2.
To summarize these models, the cross activation model, the cascade cross tuning model
and the two stage hyper-binding model suggest that there should be increased structural
connectivity between grapheme areas and the color areas. The other models posit that there
should be functional differences in brain areas related to synesthesia, but not necessarily
dependent on structural differences. Some of the models explain apparent bottom up effects,
while others explain top down effects of synesthesia. Most of the models can also be adjusted
in such manner that they could account for both types of processing (see Hubbard et al., 2011
for an example). However, as mentioned, similar experiments have sometimes produces
differing results concerning bottom up and top down processing. The next section will turn to
one proposed explanation for these diverging findings as which is also the main topic of this
review.
Projector and Associator Origin
Dixon et al. (2004) proposed a dichotomy in personal synesthetic experience as a way of
explaining why both bottom up and top down effects are found using similar methods. Color
grapheme synesthetes often describe their synesthetic experience either as seeing the color on
the grapheme itself (Ramachandran & Hubbard, 2001b) or in their minds eye (Dixon et al.,
2004). Dixon et al. (2004) distinguished between these two types of synesthetes and named
the synesthetes that see the color on the paper “projectors” and the synesthetes that see the
color in their minds eye as “associators”. They used subjective reports as a method of
distinguishing between projectors and associators. By using their criteria for projectors and
associators, the quote by Feynman (1988) would classify him as a projector synesthete. Dixon
et al. (2004) gave their associator and projector synesthetes a synesthetic stroop interference
9 / 35
Writing assignment
Jonathan van Leeuwen
task and found that projectors showed larger interference caused by synesthetic color
compared to the veridical color. The associators showed the reverse effect, i.e. larger
interference caused by veridical color compared to the synesthetic color (Dixon et al., 2004).
Based on these results, they suggested that the underlying cause for synesthesia differs
between projectors and associators. It was proposed that cross activation between areas
involved in conceptual representation of numerals and colors might account for associator
type experiences (Ramachandran & Hubbard, 2001c; Smilek & Dixon, 2002; Dixon et al.,
2004). Projector type experiences could be caused by reentrant feedback, caused by an
interaction of feedforward activity from V1 to grapheme areas, then activity might feedback
from grapheme areas into early color specific areas when an inducing grapheme form is
recognized (Dixon et al., 2004; Grossenbacher & Lovelace, 2001). Considering the
differences between projectors and associators, Dixon et al. (2004) stressed the importance of
differentiating between them when doing synesthesia research to increase reliability and
validity of findings.
When Dixon et al. (2004) proposed their view on synesthesia, very little fMRI
research had been done on synesthesia. Currently, fMRI research is flourishing and a number
of fMRI studies have been done to identify the neural underpinnings of synesthesia, including
fMRI research for the projector/associator dichotomy (Hupe et al., 2011; Sperling, Prvulovic,
Linden, Singer, & Stirn, 2006; van Leeuwen et al., 2010; Melero et al., 2013). This review
will consider the current cognitive and neurobiological findings regarding associator and
projector synesthetes and how the current research fits with the explanatory model proposed
by Dixon et al. (2004). It will also take a critical look at how the literature on associators and
projectors has differentiated between these types and how research on this topic may be
improved in the future, for instance by expanding the projector associator distinction to
include other types of synesthesia (besides grapheme-color synesthesia).
Differences Between Projectors and Associators
The synesthete in the experiment by Ramachandran & Hubbard (2001b) was described as
seeing color out in space overlying the real grapheme. Thus for this synesthete the synesthetic
color perception was similar to seeing a colored grapheme. Other synesthetes describe their
perception as a feeling that the grapheme elicits a percept of a color in their mind’s eye
(Dixon, Smilek, Cudahy, & Merikle, 2000). It has since been proposed that synesthetes who
perceive color in the outside world and synesthetes who perceive color in their mind’s eye
have differing neurobiological causes for their synesthetic percept (Dixon et al., 2004). A
10 / 35
Writing assignment
Jonathan van Leeuwen
projector percept might be explained by one neurobiological model while an associator
percept might be explained by another model (Dixon et al., 2004). Since the article by Dixon
et al. (2004) on the difference between projector and associator synesthesia, a number of other
articles have been published that have specifically investigated the differences in cognition
and neurobiology for these two types of grapheme-color synesthesia (see table 1).
Cognitive Differences Between Projectors and Associators
The distinction between projector and associator synesthesia was first made by Dixon et al.
(2004). They divided their group of synesthetes into a group of projector synesthetes which
saw the color as projected onto the viewed grapheme and a group of associator synesthetes
which saw the color in their mind’s eye. Using a stroop grapheme-color task they showed
inducing graphemes in congruent and incongruent synesthetic colors. The results indicated
that projector synesthetes showed increased stroop interference from the synesthetic colors
compared to the veridical colors. Contrary, the associator synesthetes showed increased
interference from veridical colors compared to induced colors. Indicating that synesthetic
experiences can interfere with normal visual processing of graphemes, although this
interference effect appears to be mainly for projector synesthetes and not for associator
synesthetes.
Ward et al. (2007) replicated these behavioral results with a similar stroop task and
again showed that projectors had increased interference from induced colors and that
associators had increased interference from veridical colors. In their experiment, Ward et al.
(2007) showed synesthetes four inducing or non inducing graphemes on a screen, with an
inducing target grapheme which they had to detect in the middle of the other graphemes.
Projectors did not differ significantly from associators at this task. If projectors had a real pop
out effect like Ramachandran & Hubbard (2001a) proposed, it would be expected that
projectors outperformed the associators, at least in the non inducing crowding experiment as
projectors could have used the color to identify the grapheme while associators would be less
able to do so. Having thought of this Ward et al. (2007) had the participants indicate any color
they perceived during this task. Neither the projectors nor the associators saw the colors they
should for the particular graphemes, that is, if color was perceived it did not match the normal
grapheme-color association. Indicating that there was no true pop out effect of synesthetic
color perception for projectors or for associators. Interestingly however, projectors indicated
that they did experience some form of color perception, while associators did not report any
color perception. This would indicate that there is early low level grapheme processing
11 / 35
Writing assignment
Jonathan van Leeuwen
influencing synesthetic percepts for projectors but not for associators. These results fall in line
with the CCT model of synesthesia, at least for projectors (Brang, Hubbard, et al., 2010), as it
would appear that projectors show some form of incremental grapheme-color processing.
Gebuis et al. (2009) tested for bidirectional effects in grapheme-color synesthesia and tested
for differences between projectors and associators. Although they did not find evidence for
bidirectional differences between projector and associator synesthesia, they did find
differences in EEG results when they split their group based on behavioral data, which they
took as evidence for the low/high distinction proposed by Ramachandran & Hubbard (2001c).
However, the participants were not tested with a stroop task to test if the projector/associator
groups showed the characteristic priming effects expected based on the results by Dixon et al.
(2004) and Ward et al. (2007), Gebuis et al. (2009) also used subjective reports to distinguish
between projectors and associators. The lack of significant differences between projectors and
associators found by Gebuis et al. (2009) might be caused by the method of differentiation,
but this will be discussed more in a later section. Brang et al. (2011) did an interesting study
which tested the assumption, based on the CCT model, that similar graphemes elicit similar
colors. They got 52 synesthetes to accurately define the colors they perceived for a number of
graphemes. Subsequently, they calculated a measure of similarity between colors and
graphemes. Similar graphemes did indeed have similar colors, as expected, which indicates a
bottom up effect of synesthetic percepts, which fits nicely with the CCT model of synesthesia.
Brang et al. (2011) also defined their synesthetes on a range from 5 to -5 on a
projector/associator scale, with projectors on the positive end of the scale and associators on
the negative end of the scale. They then correlated the letter/color similarity score for each
synesthete with the projector/associator score of each synesthete and found a significant
positive correlation. The synesthetes scoring high on the projector/associator (projectors)
scale thus show the highest grapheme color similarity, while the lower scoring synesthetes
(associators) show less grapheme color similarity. Saiki, Yoshioka, & Yamamoto (2011) used
a type/token paradigm to test whether associator synesthesia was caused by extreme forms of
normal association between stimuli. A type is a category specific stimulus, e.g. defining a
stimulus as the letter “A” or a color as “red”. Token representations are formed by binding a
type to an episodic memory objects, e.g. the letter “a” is “red”. Normal associations are token
representations, thus if a synesthetic experience is found to be caused by token association it
would indicate that it is an extreme form of normal association. Saiki et al. (2011) presented
inducers above or below a fixation cross followed by color patches that were either at the
correct location (same location as inducing grapheme) or incorrect location (different location
12 / 35
Writing assignment
Jonathan van Leeuwen
than inducing grapheme). They also trained control subjects on color grapheme associations.
Their results indicated that while controls did show token-based responses, associator
synesthetes showed type-based associations between graphemes and colors. This implies that
associator synesthesia is not merely an extreme adaptation of normal associations but appears
to be caused by a different mechanism. Unfortunately they did not include projector
synesthetes. Rich & Karstoft (2013) did an experiment on projector/associator synesthetes.
First they did the projector/associator stroop task to determine if their projector synesthetes
did indeed show increased interference from induced colors compared to the veridical colors.
Secondly they used a variant of the embedded figures search task (Ramachandran & Hubbard,
2001b) to test for pop out effects of synesthesia induced colors. Falling in line with previous
results (Dixon et al., 2004; Ward et al., 2007), they also found that projectors showed
increased interference from induced colors compared to veridical colors, while associators did
not. In their second experiment, they did not find any evidence for a pop out effect compared
to matched controls. However, one of the two projectors did show a non-significant effect for
pop out. Rich & Karstoft (2013) did show that synesthetes were better overall on detecting the
embedded figure, especially when more distracters were used. They concluded that
synesthetes show increased ability for grouping objects, but that they did not show a true pop
out effect.
These results suggest that projectors rely more on bottom up processes than
associators do as projectors show increased interference from induced color, higher similarity
between grapheme shape and induced color and experience color perception under conditions
were associators do not. The results also show that the synesthetic experience is not just
extreme versions of normal object associations. These differences in cognition between
projectors and associators may be caused by associators simply having weaker connections
between grapheme areas and color areas. If these connections were stronger, associators
might become projectors. On the other hand, it might also indicate that the underlying neural
cause for the synesthetic percepts differs more fundamentally between projectors and
associators. With differing underlying neurological causes for projector and associator
synesthetes. These hypotheses will be investigated in the next section which focuses on
neurobiological differences between projectors and associators.
Neurobiological Differences Between Projectors and Associators
The first imaging study to specifically test for neurobiological differences between projector
and associator synesthetes was done by Rouw & Scholte (2007). They used diffusion tensor
13 / 35
Writing assignment
Jonathan van Leeuwen
imaging (DTI) and fMRI to distinguish differences between synesthetes and controls as well
as between projectors and associators. Using a projector/associator questionnaire they scored
synesthetes between 4 and -4, with a high positive number indicating strong projector
synesthetes while a low negative number indicated strong associator synesthetes. During the
fMRI scan, participants watched inducing and non inducing graphemes. Both the projectors
and associators showed increased white matter coherence in the left parietal lobe. A
significant positive correlation was found between white matter coherence in the inferior
temporal lobe and score on the projector/associator questionnaire. This area is next to the
fusiform gyrus, previously implicated in the perception of visual stimuli (Cohen et al., 2000;
Kanwisher, McDermott, & Chun, 1997) and is adjacent to color perception areas (McKeefry
& Zeki, 1997). Rouw & Scholte (2007) also found increased BOLD responses in the right
inferior temporal lobe. However, no differences were found in BOLD response between
projectors and associators. Using a free viewing task and a repetition suppression task, van
Leeuwen et al. (2010) found increased BOLD effects for synesthetes in the left parietal cortex
as well as the right fusiform gyrus. No significant differences were found between projectors
and associators during the free viewing task. The repetition suppression task showed that
synesthetic colors could suppress BOLD responses in the left superior parietal lobule,
however not in areas previously found related to veridical color processing. In the repetition
suppression condition differences were found between associators and projectors, with
associators showing increased activity in the left superior parietal lobule. They argued that
their results support the two stage hyper-binding model by Hubbard (2007) which suggests
that synesthesia activates color areas and that the grapheme percept and color percept are
subsequently bound in the parietal cortex. Based on this, the results by van Leeuwen et al.
(2010) indicate that synesthesia is caused by both bottom up process as well as higher order
binding mechanisms, but associators appear to really more on higher order parietal binding
areas for their synesthetic percepts (van Leeuwen et al., 2010). Continuing their research
between projectors and associators, Rouw & Scholte (2010) used MRI and fMRI to measure
structural and functional grey matter (GM) differences. They used the same method for
defining projectors and associators on a continuous scale as previously described (Rouw &
Scholte, 2007). Overall, an increase of grey matter was found in the parietal cortex for
synesthetes. Synesthetes also showed increased BOLD responses in parietal as well as frontal
areas. Projectors showed increased GM compared to associators in early sensory areas, e.g.
V1 and pre-central gyrus, as well as in the frontal cortex, while associators showed increased
GM in higher order areas involved in memory, e.g. the hippocampus and the parahippocampal
14 / 35
Writing assignment
Jonathan van Leeuwen
gyrus. The functional results showed that projectors did not have significantly increased
BOLD responses compared to associators during free viewing. Associators did show
increased BOLD responses compared to projectors between fusiform areas and hippocampal
areas. Associators also showed increased BOLD in the right parietal cortex compared to
projectors. Taken together, the results by Rouw & Scholte (2010) indicate that projectors rely
more on early sensory regions, while associators show effects in later cognitive areas. This
indicates that projectors and associators use different mechanisms for producing their
synesthetic percepts. It has been demonstrated that grapheme areas, color areas and parietal
areas are activated in synesthetes during the synesthetic percept (Rouw & Scholte, 2010;
Specht, 2012; van Leeuwen et al., 2010). How these areas interact was tested by van Leeuwen
et al. (2011) who used dynamic causal modeling (DCM) to determine temporal onsets of these
areas for projectors and associators. The synesthetes were given a projector/associator score
from 8 to -8, similar to Rouw & Scholte (2007, 2010), with projectors on the positive side and
associators on the negative. By defining regions of interest based on previous research as well
as indicating different activation patters, DCM analysis creates a probability for each of these
predefined models. van Leeuwen et al., (2011) used a letter shape area in the fusiform gyrus,
the V4 color area and the superior parietal lobule as predefined ROI’s on which to base the
DCM analysis. Based on previous research van Leeuwen et al., (2011) hypothesized that the
functional connectivity pattern should either be bottom up activation from grapheme areas to
color areas followed by binding in the parietal lobule, or top down activation due to grapheme
areas activating the parietal lobule which in turn would activate the color area. The
participants had to watch inducing and non-inducing stimuli during the experiment.
Interestingly, they found evidence for both the bottom up and the top down processing model.
Not surprisingly, there was a high correlation between projector/associator score and the
calculated bottom up/top down score. Showing that projectors are more likely to use bottom
up processing with the grapheme area activating the color area then activating the parietal
area. While associators are more likely to show top down processing with the grapheme area
activating the parietal area which in turn activate the color area. These results again imply that
projectors and associators differ substantially in the processing of the synesthetic experience.
Melero et al. (2013) used structural MRI on associator synesthetes and controls to
determine GM and white matter (WM) volume differences between these groups. They found
increased GM for synesthetes in hippocampal areas, the right temporal cortex, the left inferior
parietal sulcus and frontal areas. WM volume increases were found in frontal areas for
synesthetes. These results show that associator synesthetes show differences in areas related
15 / 35
Writing assignment
Jonathan van Leeuwen
to higher cognitive functions and areas related to binding mechanisms. They did not find
differences in the fusiform gyrus, which is the location of the color area. Based on the results
showing that associators use top down process and not bottom up processes these results are
not unexpected.
Evidence from neurobiological studies on projector and associator differences show
that parietal binding and temporal grapheme areas are important for synesthetic percepts.
During free viewing tasks projectors and associators do not appear to show differing BOLD
responses, indicating that the areas they use overlap during sustained synesthetic percepts.
However, structural and temporal measurements show that projectors rely more on early
sensory areas while associators rely more on parietal binding and temporal memory areas.
Indicating that projector synesthesia is more related to bottom up sensory processing while
associator synesthesia is more related to top down cognitive processing. Not all the
neurobiological studies showed differences between projectors and associators, but one which
did not, showed differences between higher and lower synesthetes. The higher/lower
distinction has been used for grapheme-color synesthesia research and it has been suggested
that the projector/associator distinction maps onto this distinction (Dixon et al., 2004). The
next section will therefore look at evidence for the higher/lower distinction and its
relationship with the projector/associator distinction.
Higher and Lower Synesthetes
Another distinction which has been made for grapheme-color synesthesia is the higher/lower
distinction proposed by Ramachandran & Hubbard (2001c). They proposed that higher
synesthetes show more conceptual synesthetic experiences, i.e. a number should elicit the
same color whether it is seen as a numeral or written out as a word. Higher synesthetes are
also thought to have more conceptual synesthesia types, for instance spatial form synesthesia
were days or weeks are arranged spatially. Lower synesthetes on the other hand should not
experience the same induced colors for conceptually similar but physically different stimuli
according to the higher/lower distinction. Ramachandran & Hubbard (2001c) suggested that
lower synesthetes had increased cross activation between grapheme areas and color areas. For
higher synesthetes they suggested that the synesthetic percept was caused by increased cross
activation between the angular gyrus and the superior temporal sulcus. Thus synesthesia
elicited in higher synesthetes is thought to be more conceptually driven while synesthesia for
lower synesthetes is stimulus driven (Ramachandran & Hubbard, 2001c). Hubbard, Arman,
Ramachandran, & Boynton (2005) used a crowding task combined with fMRI to differentiate
16 / 35
Writing assignment
Jonathan van Leeuwen
between higher/lower synesthetes. They found a correlation between V4 activity while
watching graphemes and the ability to detect the grapheme in the crowding experiment. They
thus defined lower synesthetes as those who were the best at detecting the grapheme in the
crowding experiment.
To test whether projector/associator synesthesia was the same as lower/higher
synesthesia, Ward et al. (2007) used the same stroop task as Dixon et al. (2004) used, to
differentiate projectors from associators. Ward et al. (2007) showed that projectors had higher
stroop interference from induced colors while associators showed higher interference from
veridical colors, replicating previous findings (Dixon et al., 2004). They then used a crowding
task based on the one used by Hubbard et al. (2005). Projectors did not outperform associators
on their crowding task, which indicates that the projector/associator distinction is not the same
as the lower/higher distinction. However, it should be noted that projectors did report
experiencing synesthetic color percepts while associators did not. Gebuis et al. (2009) tested
for bidirectional effects of synesthesia in projector/associator synesthetes with a number-color
and color-number task. Their results did not show any significant differences between
projectors and associators. However, based on their behavioral data they could split the
synesthetes into a group with high priming effects and a group with low priming effects. The
group with high priming effects showed EEG effects at parietal areas as well as frontal areas,
the group with low priming effects only showed EEG effects at frontal areas. They interpreted
these findings as lower synesthetes showing lower perceptual effects and higher conceptual
effects, while higher synesthetes only have higher conceptual effects. Their findings thus
supports the idea that the projector/associator distinction is not the same as the lower/higher
distinction. However, it should be noted that Gebuis et al. (2009) differentiated projectors and
associators as a dichotomous group based on questionnaires asking about their perception.
Taken at
face value, experiments testing whether the projector/associator
differentiation maps onto the higher/lower distinction appear to indicate that these two
different classifications are not the same. However, associators and projectors do show
perceptual and neurobiological similarities to the hypothesized higher/lower distinction.
Projectors experience color during fast grapheme search tasks as well as showing
neurobiological effects in early sensory areas while associators do not experience color during
fast grapheme tasks and show neurobiological effects in higher conceptual areas. Considering
that Skelton, Ludwig, & Mohr (2009) showed that merely asking synesthetes about their
17 / 35
Writing assignment
Jonathan van Leeuwen
Table 1: Articles published that specifically test for cognitive and/or neurobiological differences between projector and associator synesthetes.
Participants
Synesthesia
Determination
Subj. rep
P or A
Determination
Subj. rep
Results
Projectors
Higher interference from induced
colors compared to real colors
Results
Associators
Lower interference from
induced colors compared to
real colors
Supported model
Projectors
Re-entrant
feedback
Supported model
Associators
Cross activation
Synesthetic stroop task
18 (18F; 0M)
7 Projectors
11 Associators
Subj. rep &
Consistency check
12 item P & A
questionnaire
DTI and fMRI. Inducing and
non-inducing stimuli
Increased structural connectivity in
the right inferior temporal lobe
compared to associators
R - inferior temporal cortex
L - parietal cortex
Bilateral - frontal cortex
Sub. rep
Synesthetic stroop task &
conscious/unconscious
visual crowding task
Replicated Dixon et al 2004. Color
experience when stimuli was
unconsciously perceived
Questionnaire &
Consistency check
Sub. rep
EEG. Number  Color &
Color  number priming
task
***** “Lower”: Showed parietal
and frontal priming effects
Reduced structural
connectivity in the right
inferior temporal lobe
compared to projectors
Replicated Dixon et al 2004.
No color experience when
stimuli was unconsciously
perceived
***** “Higher”: Showed only
frontal priming effects
Cross activation
(more than
associators)
Cross activation (Less
than projectors)
Rouw & Scholte 2007
14 (10F; 4M)
7 Projectors
7 Associators
Subj. rep &
Consistency check
Cross activation
Disinhibited feedback
Ward, Li, Salih &
Sagiv 2007
14 (13F; 1M)
6 Projectors
8 Associators
Frontal cortex
Parietal cortex
Late and early
processing for
“lower” synesthets
Late processing for
“higher” synesthets
Gebuis, Nijboer, van
der Smagt 2009
21 (19F; 2M)
7 Projectors
6 Associators
8 “MS” Projectors*
Questionnaire &
Consistency check
Subj. rep and
P&A
questionnaire
fMRI. Inducing & noninducing stimuli.
Repetition suppression task
No completely overlapping areas for
veridical and induced color.
Increased activity in the left superior
parietal lobule
No completely overlapping
areas for veridical and induced
color. Increased activity in the
left superior parietal lobule
Ventral occipital areas
L – superior parietal lobule
Integrated model
Integrated model
van Leeuwen,
Petersson & Hagoort
2010
42 (42F; 0M)
16 Projectors
26 Associators
Subj. rep &
Consistency check
(R & S 2007)
***
sMRI & fMRI. Inducing and
non-inducing stimuli
Increased GM in parietal cortex.
Increased activity in areas related
stimuli processing and frontal areas
Increased GM in parietal
cortex. Increased activity in
areas related to memory
L – superior parietal cortex
Frontal cortex
Temporal cortex ****
Early processing
models
Late, integrative
processing models
Rouw & Scholte 2010
52 (Gender)**
16 Projectors
36 Associators
(Eagleman et al.,
2007)
(R & S 2007)
***
Color identification of a
number of similar and
dissimilar graphemes
Positive correlation between
strength of projection and grapheme
color similarity.
Same pattern as projectors, but
lower than projectors
Cascade cross
tuning (Stronger
than associators)
Cascade cross tuning
(weaker than
projectors)
Brang, Rouw,
Ramachandran &
Coulson 2011
19 (17F; 2M)
8 Projectors
5 Associators
6 “MS” Projectors*
Questionnaire &
Consistency check
(R & S 2007)
***
fMRI. Dynamic Causal
Modeling. Viewing
graphemes
Activation pattern:
Grapheme area  V4  Parietal
area
Activation pattern:
Grapheme area  Parietal area
 V4
Early processing
models
Disinhibited feedback
van Leeuwen, den
Ouden & Hagoort 2011
8 (4F; 4M)
0 Projectors
8 Associators
(Eagleman et al.,
2007)
Subj. rep
Graphemes presented above
or below fixation point
followed by a color patch
NA
8 (7F; 1M)
2 Projectors
6 Associators
Questionnaire &
Consistency check
(Edquist 2006)
Synesthetic stroop task &
Modified embedded figure
task
8 (7F; 1M)
0 Projectors
8 Associators
(Eagleman et al.,
2007)
Not reported
sMRI & DTI
12 (11F; 1M)
5 Projectors
7 Associators
Method
Brain areas
NA
NA
NA
Fusiform grapheme area
Superior parietal lobule
V4 color area
Authors
Dixon, Smilek &
Merikle 2004
Color association is type based.
Qualitatively different from
normal associations
NA
NA
Integrated model
(qualitatively different
color associations)
Saiki, Yoshioka &
Yamamoto 2011
Replicated Dixon et al 2004. Overall
no evidence for pop-out.
Better at grouping items.
Replicated Dixon et al 2004.
Better at grouping items
NA
Early/late
processing models
Late processing models
Rich & Karstoft 2013
NA
Increased GM in areas related
to emotional/attention
processing, projecting to
parietal areas
NA
Areas suggest late
integrating processing
models
Melero, Melian, Lago,
Pajares, Tamames, &
Linera 2013
Temporal cortex
Frontal cortex
Parietal cortex
Occipital cortex****
* Mental screen projectors. ** Gender not reported. *** Rouw & Scholte., 2007, P & A questionnaire. **** See relevant article for a complete list of areas. ***** No difference between P & A. Split group into
“lower” and “higher” synesthetes. Sub. Rep (Subjective reports). P & A (Projector & Associator). All studies used grapheme color synesthetes.
18 / 35
Writing assignment
Jonathan van Leeuwen
perception is not very reliable. While van Leeuwen et al. (2011) showed a correlation between
projector/associator strength and functional connectivity results indicating that the
projector/associator distinction should not necessarily be dichotomous. It would therefore
appear that the method of differentiating between projectors and associators might influence
subsequent results, which could explain why Gebuis et al. (2009) failed to find similarities for
projector/associator synesthesia and lower/higher synesthesia. How differentiating between
projectors and associators may influence experimental results is the topic of the next section.
Projector and Associator Differentiation
The early studies on synesthesia used subjective reports combined with consistency checks,
which is considered an indicator of genuine synesthesia (Baron-Cohen, Wyke, & Binnie,
1987), to distinguish between synesthetes and non-synesthetes (Baron-Cohen et al., 1996;
Dixon et al., 2000; Ramachandran & Hubbard, 2001a). One problem with subjective reports is
that they are not standardized and are open for interpretation. This can result in low test-retest
reliability (Edquist, Rich, Brinkman, & Mattingley, 2006). This problem was tackled by
Eagleman et al. (2007), by creating a standardized online synesthesia test battery, which is
currently used to determine synesthesia in a number of studies (Brang, Hubbard, et al., 2010;
Novich et al., 2011). However, many studies still use subjective reports and consistency
checks despite of these advances (Gebuis et al., 2009; Rich & Mattingley, 2010; Rouw &
Scholte, 2007; van Leeuwen et al., 2010). It must be noted that Rouw & Scholte (2007) also
created a questionnaire which often is used, but this questionnaire is not an online aggregating
questionnaire and only tests for grapheme-color synesthesia (Brang et al., 2011; Paffen, van
der Smagt, & Nijboer, 2011). The test-retest reliability of their questionnaire is also not as
high as it could be if it had included illustrations depicting synesthetic experiences (Skelton et
al., 2009).
When Dixon et al. (2004) introduced the projector and associator synesthesia
dichotomy, the normal procedure was to base synesthesia categorization on subjective reports.
They therefore split their groups based on subjective reports of the spatial location of the
synesthetic experience. If the synesthetes reported seeing the induced color on top of the
grapheme they were classified as projectors. If they saw the induced color in their “mind’s
eye” they were classified as associators. Since the introduction of the projector/associator
distinction for grapheme-color synesthetes, researchers have distinguished them using three
different methods: questionnaire for dichotomous grouping, subjective reports and a
questionnaire for grouping on a continuum (Edquist et al., 2006; Gebuis et al., 2009; Rich &
19 / 35
Writing assignment
Jonathan van Leeuwen
Karstoft, 2013; Rouw & Scholte, 2007; Skelton et al., 2009; van Leeuwen, den Ouden, &
Hagoort, 2011).
To examine test-retest reliability for the projector/associator distinction Edquist et al.
(2006) split the synesthetes into associators or projectors based on three questions. The
synesthetes had to describe their perception as: “out there in space”, “in my mind’s eye” or
“neither”. Edquist et al. (2006) found that synesthetes showed low test-retests reliability in
how they described their synesthetic percept. Some synesthetes also reported that their
synesthetic experience could not be classified as projector or associator and answered
“neither”. However, they could be mental screen projectors, which are synesthetes who
perceive the color as if it was projected on a screen in front of them but not on the grapheme
or only in their mind’s eye (Rouw & Scholte, 2007; van Leeuwen et al., 2011). These mental
screen projectors thus differ from both projectors and associators when it comes to the special
location of their synesthetic percept. Based on these results, Edquist et al. (2006) argued that
subjective reports are not a reliable method for distinguishing between projectors and
associators. However, their results might be caused by difficulty in relating these statements
to their perception (Skelton et al., 2009). Skelton et al. (2009) used the descriptive synesthetic
experience questionnaire (DSEQ) to distinguish between projectors and associators. Just like
Edquist et al. (2006), they found low test-retest reliability using purely descriptive statements.
They then made the illustrated synesthetic experience questionnaire (ISEQ) by adding
illustrative pictures to the questions relating to special position of their synesthetic experience.
The ISEQ showed significantly increased test-retest reliability compared to the DSEQ in its
ability to reliably distinguish between projectors and associators (Skelton et al., 2009).
Unfortunately, researchers have yet to adopt the ISEQ for distinguishing between projectors
and associators as no study has yet used the ISEQ. These findings highlight the importance of
standardization of questions and the need for clear unambiguous descriptions of projector and
associator type experiences. It could also explain why one of the synesthetes tested by Edquist
et al. (2006) reported experiencing vivid colors, but could not relate to any of the questions.
Using the same questionnaire as Edquist et al. (2006), Rich & Karstof, (2013) split their
synesthetes into projectors and associators and tested for pop out effects of synesthetic colors.
van Leeuwen et al., (2010) also used an adapted version of the projector associator
questionnaire for splitting their participants into a projector/associator dichotomy (Rouw &
Scholte, 2007).
As mentioned earlier, the use of subjective reports for distinguishing between
projectors and associators was introduced by Dixon et al. (2004). Following in their footsteps,
20 / 35
Writing assignment
Jonathan van Leeuwen
a number of other articles have used subjective reports to distinguish between these two
groups (Gebuis et al., 2009; Saiki et al., 2011; Ward et al., 2007). Thus, based on the
synesthetes’ reports of seeing the color out in space or merely seeing it in their “minds’s eye”,
they were split into projectors and associators. Ward et al. (2007) replicated the findings of
Dixon et al. (2004): they again showed that projectors had increased interference from
induced colors compared to veridical colors. Saiki et al. (2011) also used subjective reports as
the method for differentiating the synesthetes, however they only had self-reported associators
in their group of synesthetes. Using this method of differentiation, Gebuis et al. (2009) were
unable to find differences between projectors and associators. They also split their group
based on low or high stroop interference effects. When split on using behavioral measures,
their two groups did show EEG differences. Interestingly, the groups that were split up based
on the behavioral data contained an equal amount of self reported projectors (Gebuis et al.,
2009) and if the projector/associator distinction is the same as the low/high distinction, which
it appears to be, their findings underscore that subjective reports are not always reliable.
The last method used for differentiating between projectors and associators uses a
slightly
different
approach,
using
questionnaires
to
assign
the
synesthetes
a
projector/associator score on a continuum (Rouw & Scholte, 2007). By using a number of
questions which relate to projector and associator type experiences and having the participant
rate each statement on a likert scale, the summed associator score is subtracted from the
summed projector score and gives each synesthete a projector/associator score. If the score is
positive synesthetes relate their synesthetic experience more with the projector descriptions, if
the score is negative synesthetes relate their synesthetic experience more with the projector
description. Thus instead of splitting the synesthetes into dichotomous groups, this method
treats the projector/associator distinction as a continuum. The strength of this approach lies in
its versatility, it can be used to group synesthetes dichotomously (van Leeuwen et al., 2010)
or group them on a continuum allowing for a correlation approach (Brang et al., 2011; Rouw
& Scholte, 2007, 2010; van Leeuwen et al., 2011). Interestingly, all studies that used a
continuum score and a correlation approach found significant differences between projectors
and associators. van Leeuwen et al. (2011) had a number of self reported mental screen
projectors in their participant group. Using the continuous projector/associator score, self
reported associators showed negative score, self reported projectors showed high positive
scores, while mental screen projectors scored between the other two groups. This again
highlight the importance of correctly distinguishing between synesthetes, as a mental screen
21 / 35
Writing assignment
Jonathan van Leeuwen
projector might be grouped with associators or with projectors if dichotomous grouping based
on subjective reports is used.
As of yet, no study has used a behavioral measure to distinguish between projectors
and associators. This might be due to the fact that the distinction is based on how an
individual synesthete experiences the induced percept. However, as has been demonstrated,
subjective reports of synesthetic experiences are relatively unreliable (Edquist et al., 2006),
although projectors and associators appear to show some reliable behavioral differences
(Dixon et al., 2004; Rich & Karstoft, 2013; Ward et al., 2007). This may result in the
assumption that a participant group consists of only associators or projectors (Saiki et al.,
2011) while they could contain both, and it might also cause the groups to be divided
inaccurately. Another drawback of using subjective reports is that it only allows predefined
distinctions. Contrary, all the studies that have used the method proposed by Rouw & Scholte
(2007) or an adaptation thereof (van Leeuwen et al., 2011), show significant results. By
scoring projector/associator synesthetes on a continuum, synesthetes that experience both
forms or that cannot readily identify with either description can also be included (Edquist et
al., 2006; Ward et al., 2007), thereby increasing the validity of the results. Considering the
behavioral and neurobiological evidence (Brang et al., 2011; Rich & Karstoft, 2013; Rouw &
Scholte, 2007, 2010; van Leeuwen et al., 2011; Ward et al., 2007) it appears that projectors
and associators do indeed differ in how the synesthetic percept arises. Projectors show
evidence that their synesthetic percept is primarily caused by bottom up processing due to
neurobiological differences in early sensory areas (Brang et al., 2011; Rouw & Scholte, 2010;
van Leeuwen et al., 2011). Associators show evidence that their synesthetic percept is
primarily caused by top down processing due to neurobiological differences in later
association and memory areas (Rouw & Scholte, 2010; van Leeuwen et al., 2011). However,
as will be discussed, it appears that projectors and associators do not rely solely on bottom up
or top down processing, respectively, but depends on the projector/associator strength. Using
a continuous score for projectors and associators appears to be able to reflect the relative top
down and bottom up differences between the two groups better than a dichotomous distinction
(van Leeuwen et al., 2011).
Another possibility is that both projectors and associators rely on bottom up and top
down processes. This possibility suggests that two, or more models can explain synesthetic
percepts, i.e. cascade cross tuning for early bottom up processes and disinhibited feedback for
top down processes. Even though both projectors and associators might rely on both models,
the stronger perceptual projector synesthetes might rely mostly on cascade cross tuning while
22 / 35
Writing assignment
Jonathan van Leeuwen
associators rely more on top down processing models like the reentrant feedback model. The
next two studies support this idea. van Leeuwen et al. (2011) showed that the probability of a
synesthete using bottom up processing vs. top down processing was not dichotomous. Not all
projectors were equally likely to fit the bottom up model, but the likelihood of them fitting
one of the models was related to how high they scored on either the projector scale or the
associator scale. This suggest that the groups should not be readily split into dichotomous
groups. Similarly, if projector solely use bottom up processing and associators solely used top
down processing, it would be expected that projectors would show color/letter similarities
while associators would not. Brang et al. (2011) showed that this is not the case: color/letter
similarity did not show dichotomous grouping between projectors and associators, but rather
correlated with individual projector/associator strength. Suggesting that the projector
associator distinction might not be sensitive enough to detect the subtleties in the individual
experiences of synesthesia (but see Jürgens & Nikolić, 2012).
With previous results in mind, it would be preferable to stop using subjective
descriptive reports to distinguish between projectors and associators as it has been shown to
have low test-retest reliability as synesthetes might describe their synesthetic experiences
differently. Using a premade questionnaire to ask about experiences and subsequently
splitting the synesthetes into a dichotomous projector and associator group would be better
than subjective descriptive reports. However a dichotomous distinction removes a lot of
individual variety and does a poor job of accurately representing synesthetic perception as
they are not always classifiable as either projectors or associators. This is rectified by
classifying projectors and associators on a continues scale, as it would reflect individual
synesthetic perception more accurately by taking into account more aspects of how they
perceive their synesthetic percept. A version of the questions used by Rouw & Scholte (2007)
with illustrating pictures, would probably be the most reliable and would provide a valid
method of distinguishing projectors and associators (Brang et al., 2011; Skelton et al., 2009;
van Leeuwen et al., 2011). That these differences map onto the known processes of visual
perception is an important aspect of any model of synesthesia and the next section will
therefore look at visual and attentive processing differences between projectors and
associators.
23 / 35
Writing assignment
Jonathan van Leeuwen
Processing Differences Between Projectors and Associators
Visual Processing
An important aspect of any model that wants to explain visual or perceptual phenomena, is
that it maps onto the structural and functional understanding of the brain. That is, it needs to
have ecological validity. Therefore, in the context of models explaining synesthesia it is
important that it takes into account how the visual system processes information, from the
basic visual constituencies of a stimulus to the eventual conscious percept of a stimulus.
The visual system processes stimuli in two main pathways, the ventral path and the
dorsal path (Lamme & Roelfsema, 2000). One of the interesting aspects of the visual
processing for synesthesia is that different types of synesthetes might not only process
synesthetic inducing stimuli in differing ways (e.g. top down or bottom up processing), but
evidence indicate that they use areas related to different visual pathways (Melero et al., 2013;
Rouw & Scholte, 2007, 2010).
The parietal lobe is important for the synesthetic percept for both projectors and
associators (Hubbard & Ramachandran, 2005; Rich & Mattingley, 2002; Rouw & Scholte,
2007; Specht, 2012; van Leeuwen et al., 2011; van Leeuwen et al., 2010; Ward, 2013). This
area is part of the dorsal pathway for visual processing (Lamme & Roelfsema, 2000; Walsh &
Butler, 1996), which is primarily related to attentive vision (Mesulam, 1999). Interestingly,
van Leeuwen et al., (2011) showed that projectors show activity in color areas before parietal
areas, while associators show the opposite pattern. This might indicate that the synesthetic
experience for projectors starts pre-attentively and then binds to the inducer when processed
in the parietal lobe, as proposed by the two stage hyper-binding model. Contrary, associators
appear to need attention areas before the synesthetic experience starts to arise (van Leeuwen
et al., 2011). Current neurobiological findings indicate that temporal areas are important to the
synesthetic experience for associator synesthetes, but less so for projector synesthetes as
previously described (Melero et al., 2013; Rouw & Scholte, 2010). As the temporal cortex is
part of the ventral visual processing stream, this suggests that associator type experiences
might arise from the ventral pathway. As most of the research looked at relative differences
between projectors and associators, it is difficult to determine if projectors also use the ventral
pathway as the results indicate that associators use these areas more than projectors. However,
this does not preclude the possibility that projectors rely more on these areas then nonsynesthetes when viewing inducing graphemes. Suggesting that the temporal areas might be
important for both projectors and associators.
24 / 35
Writing assignment
Jonathan van Leeuwen
The dorsal stream mainly processes spatial, functional and movement aspects of the
visual stimuli (e.g. location and direction) (Mishkin & Ungerleider, 1982; Lamme &
Roelfsema, 2000) and involves the parietal cortices. It gets most of its information from the
magnocellular visual neurons, which contain information about movement and edges (Walsh
& Butler, 1996). The ventral pathway is primarily involved with object identification and
perception (e.g. what a stimuli is) (Mishkin & Ungerleider, 1982; Lamme & Roelfsema,
2000) and goes to the temporal cortices. Contrary to the dorsal pathway, the ventral pathway
gets most of its information from the parvocellular neurons, which code for fine details (high
spatial resolution) and color (Walsh & Butler, 1996). Interestingly, it appears that the
information transfer in the dorsal pathway is faster than the ventral pathway (Schmolesky et
al., 1998). Thus, this would suggest that associators use both the ventral and dorsal pathway
with predominantly top down processing while projectors primarily use the dorsal pathway
with bottom up processing (Brang et al., 2011; Dixon et al., 2004). This suggests that even
though the phenomenological aspects of associator and projector synesthetes are quite similar,
the underlying causes appear to be spatially, temporally and functionally different. If this is
indeed the case, it has implications for future synesthesia research, as this suggests that
similar experiences might have different neural causes.
Attention and Priming
A point of debate for synesthesia is whether attention is necessary for inducing the synesthetic
percept. Different models make different predictions as to whether attention is needed. In
bottom up models attention might or might not be necessary, while in top down models
attention is needed to induce synesthesia. As with a number of the experimental results
regarding synesthesia discussed earlier, experiments done to test for the contribution of
attention in synesthesia have also found diverging results, with some results indicating that
attention plays a large role (Mattingley et al., 2006; Rich & Mattingley, 2010), while other
results indicate that attention is hardly needed for creation of the synesthetic percept (Brang,
Hubbard, et al., 2010; Ramachandran & Hubbard, 2001c). However, this pattern might again
be explained by splitting the synesthetes into projectors and associators, thereby showing that
attention might indeed be necessary for both projectors and associator synesthetes, but it
appears that projectors need less attention than associators.
As mentioned earlier, a number of experiments have found top down effects for the
induction of synesthesia (Dixon et al., 2006; Palmeri et al., 2002; Smilek et al., 2001). This
suggests that the synesthetic percept can at least be influenced by attention mechanisms.
25 / 35
Writing assignment
Jonathan van Leeuwen
Mattingley, Rich, Yelland, & Bradshaw (2001) used masked inducers to see if unconsciously
perceived inducers caused a synesthetic percept. Their results indicated that unmasked
inducers caused a synesthetic percept while the masked inducers did not. However, masking
disrupts conscious perception and does not influence attention to stimuli, but their results do
imply that conscious perception of the inducer is necessary for synesthetic percepts. In a latter
experiment Mattingley et al. (2006) manipulated attentional load during a letter priming task
by making the participants do a second task which required either high or low attentional
load. Falling in line with their previous findings, higher attentional loads reduced synesthetic
priming effects. Attention as a necessary factor in creating synesthetic percepts was also
found by Rich & Mattingley, (2010). They used a modified attentional blink task and found
that attended inducers created color congruency effects while non-attended inducers did not.
If the synesthetic percept can arise pre-attentively, inducers that are not attended will
still elicit a synesthetic percept and it would suggest that the synesthetic experience originates
from early bottom up sensory processes. Pre-attentive synesthesia would result in a pop out
effect of inducing graphemes when viewing a screen filled with inducing and non-inducing
graphemes as they would be caused automatically by the physical shape of the inducer.
Synesthetic pop out, bottom up effects have been reported (Ramachandran & Hubbard,
2001c) and synesthetic colors can be induced with brief grapheme presentation times (Spruyt,
Koch, Vandromme, Hermans, & Eelen, 2009). However, when their experiment was
subsequently replicated with a more robust methodological approach no real pop out effect
was found (Hubbard et al., 2005; Rich & Karstoft, 2013; Ward, Jonas, Dienes, & Seth, 2009).
These findings are also supported by a study showing that synesthetic inducers did not help in
a chromatic or achromatic grapheme search task, as well as participants only reporting a
synesthetic percept when inducers were attended (Edquist et al., 2006). Alvarez & Robertson
(2013) presented colored inducing graphemes and made participants indicate the color of a
subsequently presented color patch. Using this approach they found that the largest priming
effects occurred for inducers which were colored in the same color as they induced, e.g. a red
inducing grapheme printed in red. These results were taken as evidence that induced colors
use the same underlying substrates as veridical colors. However, most of these experiments
did not take into account the projector/associator distinction and the possibility that these
differing sub types of synesthesia might rely differently on attention mechanisms. For
instance, Ward et al., (2007) found evidence indicating that inducers that were not perceived
did not cause interference, for either projectors or associators. However, projectors did report
experiencing some form of color percept, even when they could not identify the displayed
26 / 35
Writing assignment
Jonathan van Leeuwen
grapheme. Similarly, projectors have higher color/letter similarity than associators, indicating
that they rely more on early sensory areas when creating the concurrent (Brang et al., 2011).
Evidence from fMRI research has also shown that projectors rely more on sensory areas and
that functional time course of inducing the concurrent is different between projectors and
associators (Rouw & Scholte, 2010; van Leeuwen et al., 2011).
The experiments which have used stroop tasks for investigating differences between
projectors and associators all show similar and reliable findings. Projectors show more
interference from induced colors than veridical colors while associators show the reversed
(Dixon et al., 2004; Rich & Karstoft, 2013; Ward et al., 2007). These stroop interference
results again suggest that projectors show more bottom up processing and should therefore be
less reliant on attention for their synesthetic percept. As most of the synesthetes in
experiments that specifically look for projector/associator differences have a larger number of
associator synesthetes (140) compared to projector synesthetes (74), it is likely that most of
the studies which do not distinguish between these groups will have a higher number of
associators. If projectors showed pre-attentive effects in their experiments, these effects would
therefore most likely be averaged out due to the low number of projectors in the study
compared to associators (table 1). Not only are projectors and associators probably mixed in
these experiments, they are underrepresented in general (Brang et al., 2011; Rich & Karstoft,
2013; Rouw & Scholte, 2007; van Leeuwen et al., 2011; van Leeuwen et al., 2010), even to
the point of being absent (Rich & Mattingley, 2010).
Taken together, it appears that attention and priming works differently for projectors
and associators. If the synesthetic percept for projectors is indeed caused by the cascade cross
tuning, it could explain why most experiments show a small or no effects of inducing
synesthetic color and priming when attention is manipulated. Partially seen or unattended
graphemes could therefore elicit different colors than a fully detected or attended grapheme
(Ward et al., 2007). This would explain why experiments fail to find priming effects when
attention is manipulated and/or stimuli is masked.
However, due to lower number of projectors, differing methods of distinguishing
between projectors and associators and the possible effect of cascade cross tuning for
projectors, the exact role of attention for projectors and associators needs further research.
One approach might be to use EEG to test if reentrant feedback is necessary for eliciting
unconscious but detectable neuronal responses to eliciting graphemes (Fahrenfort et al.,
2007). If projectors really need less attention than associators for the synesthetic percept to
arise, it would be expected that synesthesia inducing graphemes show larger occipital/parietal
27 / 35
Writing assignment
Jonathan van Leeuwen
EEG differences with non-inducing graphemes for projectors compared to associators when
reentrant feedback is disrupted.
Projector and Associator Synesthesia in Non-Grapheme-Color Synesthesia.
As has been argued, the projector/associator distinction appears to be able to explain a range
of diverging findings for synesthesia, including cognitive and neurobiological differences.
However, Dixon et al. (2004) proposed this distinction for grapheme color synesthetes, but
did not try to extrapolate this distinction to other forms of synesthesia. Due to this, all current
studies looking at projector/associator differences have only used grapheme-color synesthetes
(table 1). As synesthesia has traditionally been seen as a unitary, though heterogeneous,
condition, the differences between projectors and associators might indicate that multiple
causes may underlie synesthesia. If projector and associator color grapheme synesthetes do
indeed differ in underlying neurological and cognitive causes for their synesthesia, other types
of synesthesia might also have differing underlying causes. Since there has been no research
done with the projector/associator distinction for different types of synesthesia, it is hard to
speculate on how different synesthesia forms might reflect the projectors and associators
distinction, but attempts at speculation, if cautiously, are important for expanding on possible
research areas. For instance, non-sensory type synesthetes, for example space-form
synesthetes, might primarily consist of associator synesthetes as the inducer is caused by a
cognitive concept and not a sensory stimulus. Sensory type synesthetes, for example soundcolor synesthetes or vision touch synesthetes, might comprise of combination as the inducer
might be caused by a cognitive concept or due to a sensory stimulus, as is seen in graphemecolor synesthesia. This would be supported by evidence showing that projectors rely more on
sensory areas while associators rely more on memory areas (Rouw & Scholte, 2010).
Interestingly, sound-color synesthesia does indeed appear to be quite heterogeneous
with regard to how it arises. Some sound-color synesthetes only experience color related to
spoken words (Nunn et al., 2002), while others experience color percepts with all sounds
(Head, 2006; Ward, Huckstep, & Tsakanikos, 2006). It has therefore been suggested that the
speech-color synesthetes rely on linguistic representations of the word, while the pure soundcolor synesthetes rely more on the perceptual properties of the stimuli (Frith & Paulesu, 1997;
Simner, Glover, & Mowat, 2006). Using the projector/associator differentiation, the former
could be labeled as an auditory-color associator, while the later could be labeled an auditorycolor projector. Interestingly, it has been shown that pure auditory-color synesthetes show
qualitatively different early EEG responses to inducing auditory stimuli compared to healthy
28 / 35
Writing assignment
Jonathan van Leeuwen
controls (Goller, Otten, & Ward, 2009). These results of early auditory effects fit nicely with
the cascade cross tuning model and suggest that these synesthetes process their synesthetic
experience in a similar manner as grapheme-color projectors, albeit in a different sensory
area. Interestingly, projector type experiences have also been reported for space-form
synesthesia (Smilek et al., 2007). This might indicate that there are similarities between types
of synesthetes (e.g. grapheme-color, sound-color) who have the same projector or associator
classification, e.g. a grapheme-color projector synesthete might show similarities in cognition
and neurobiology with a sound-color projector. If correct, research on other types of
synesthesia probably also suffers from low reliability as they draw their subjects from
different subject pools, e.g. projectors and associators. The application of the
projector/associator distinction for other types of synesthesia could therefore increase
reliability and validity of future synesthesia research, by making sure that the subjects with
different underlying causes for synesthesia are not grouped together. However, using
subjective reports to distinguish between projector and associator synesthetes is not ideal to
say the least. An adapted version of an illustrated projector/associator questionnaire as well as
an adapted stroop task could be used to differentiate projectors and associators with other
types of synesthesia.
Just as the mechanism for grapheme-color projectors appears to be cascade-cross
tuning in the visual cortex, other sensory projector synesthesia might be caused by cascadecross tuning in the relevant sensory cortex. The relation between different associator
synesthesia forms might be slightly different. As projectors might rely on the relevant sensory
cortex for cascade-cross tuning, associator synesthesia mechanisms appears to be related to
the temporal cortex. This might be the same for all associator synesthesia forms considering it
would be the same high order conceptual mechanism that leads to the association between
two stimuli, for instance hyper-binding. Thus different types of projector synesthetes might
show larger differences in neurobiology, due to the spatial location of the sensory areas, while
different types of associator synesthetes might be more similar, due to the use of memory
areas. This interpretation is purely speculative as no research has yet been done to investigate
projector/associator differences in non-grapheme-color synesthetes. Further research is
needed to determine if this is the case.
Limitations in Projector/Associator Research
Certain limitations and confounding factors have become obvious when reviewing the
projector/associator literature. The first one being the method of differentiating between
29 / 35
Writing assignment
Jonathan van Leeuwen
projectors and associators. Using subjective reports has been shown to be unreliable, while
illustrated questionnaires and continuous scores appear to more adequately describe the
synesthetic percepts. A number of studies used a continuum score for projectors and
associators based on questionnaires and found that most grapheme-color synesthetes fit nicely
on a continuum, even though they might not subjectively subscribe to being either projector or
associator. Combining this continuous approach of defining projectors and associators, but
adding illustrations to the questionnaires to improve test-retest reliability would be the next
step in reliably distinguishing projectors and associators. Another limiting factor is caused by
the assumption that synesthesia was more prevalent in females than males (Barnett et al.,
2008; Rich, Bradshaw, & Mattingley, 2005). This is reflected in the participant inclusion for
synesthesia research. Current research on grapheme-color synesthesia has included 216
synesthetic participants (although some of the same participants were used for multiple
experiments) with 148 being female, 16 being male and 52 being of unreported gender (table
1). However, findings based on more robust methods have found a prevalence ratio of 1:1 for
female and male synesthesia (Banissy, Kadosh, Maus, Walsh, & Ward, 2009; Brang,
Teuscher, et al., 2010; Jamie Ward, 2013). This shows that almost all of the research done
with projector and associator synesthetes has been done with females while males have been
massively underrepresented. Not only is the female/male ratio skewed, but also the
projector/associator ratio is severely skewed. With 140 participants being scored as associator
synesthetes and 74 being scored as projector synesthetes, the discrepancy in total number of
participants is caused by some not being scored as either projector or associator (table 1).
However, no study has yet tried to determine the ratio of projector and associator synesthesia
or if there is a relationship between gender and projector/associator synesthesia. Thus, future
studies on projector/associator synesthesia should try to reflect the natural occurrence rate of
synesthesia and strive for equal female/male ratio inclusion as well as strive for a higher
inclusion rate of projector synesthetes. As well as having skewed participant inclusions, all
current research done on projectors and associators has been done on grapheme-color
synesthetes. Interestingly, it appears that other types of synesthesia can also be differentiated
based on the projector associator distinction. However, as this has not been directly tested as
of yet and future studies would have to determine how and if the projector/associator
distinction can be applied to other types of synesthesia.
30 / 35
Writing assignment
Jonathan van Leeuwen
Concluding Remarks
It is apparent that grapheme-color synesthesia is indeed a very heterogeneous condition, even
more so than supposed by Dixon et al. (2004). With evidence showing that there are indeed
differences in grapheme-color synesthesia between projectors and associators. Not only do
their synesthetic percepts differ, they also show cognitive and neurobiological differences.
Research done on grapheme-color synesthesia which have not differentiated between
subgroups, draw their subjects from two different subject pools, thereby causing diverging
results. The use of the projector/associator differentiation has the possibility of explaining
these diverging findings in grapheme-color synesthesia research, possibly even for other types
of synesthesia. Interestingly, it appears that projectors and associators do not appear to be as
dichotomous as originally thought. The results from experiments using a continuous score for
projectors and associators indicate that projectors and associators are not two completely
separated groups, but fall on a continuum. The continuous scores also manages to include the
third group of grapheme-color synesthesia, mental screen projectors. It therefore appears that
grapheme-color synesthesia is not caused by only bottom up processing, neither by only top
down processing, but rather a combination of the two. Neither do these results indicate that
projectors are solely the cause for bottom up effects and associators solely responsible for top
down effects. Rather, it suggests that both projectors and associators rely on both bottom up
and top down processes. With the importance of bottom up processing appears to correlate
with projector strength while the importance of top down influences appears to correlate with
associator strength. Currently, the cascade cross tuning model appears to be best able to
explain the bottom up effects (Brang et al., 2011; van Leeuwen et al., 2011) while some form
of reentrant feedback could explain the top down effects.
As differing methods of differentiating between projectors and associators reduce
reliability, which therefore causes discrepancies in research results, correctly and reliably
classifying projectors and associators is important. The dichotomous distinction between
projectors does not appear to be adequate, thus classifying projectors and associators on a
continuous scale using an illustrated questionnaire currently has the most promise in capturing
the heterogeneous nature of grapheme-color synesthesia by reliably scoring projectors and
associators (Edquist et al., 2006; Rouw & Scholte, 2007; van Leeuwen et al., 2011).
By switching from a purely observational and behavioral approach, synesthesia
research is now seeing an increase in research determined to detect the underlying
neurological cause for synesthesia. Even though there is still a long way to go for truly
understanding the underlying neurological and cognitive aspects of synesthesia, research on
31 / 35
Writing assignment
Jonathan van Leeuwen
grapheme-color synesthesia has come a long way since the late 90’s early 00’s and
performing synesthesia research as a method of understanding normal cognition has all the
appearance of only becoming more popular in the future.
References:
Alvarez, B. D., & Robertson, L. C. (2013). The interaction of synesthetic and print color and its relation to visual
imagery. Attention, Perception, & Psychophysics, 75(8), 1737–1747. doi:10.3758/s13414-013-0520-3
Banissy, M. J., Kadosh, R. C., Maus, G. W., Walsh, V., & Ward, J. (2009). Prevalence, characteristics and a
neurocognitive model of mirror-touch synaesthesia. Experimental Brain Research, 198(2-3), 261–272.
doi:10.1007/s00221-009-1810-9
Banissy, M. J., Stewart, L., Muggleton, N. G., Griffiths, T. D., Walsh, V. Y., Ward, J., & Kanai, R. (2012).
Grapheme-color and tone-color synesthesia is associated with structural brain changes in visual regions
implicated
in
color,
form,
and
motion.
Cognitive
Neuroscience,
3(1),
29–35.
doi:10.1080/17588928.2011.594499
Barnett, K. J., Finucane, C., Asher, J. E., Bargary, G., Corvin, A. P., Newell, F. N., & Mitchell, K. J. (2008).
Familial patterns and the origins of individual differences in synaesthesia. Cognition, 106(2), 871–893.
doi:10.1016/j.cognition.2007.05.003
Baron-Cohen, S., Burt, L., Smith-Laittan, F., Harrison, J., & Bolton, P. (1996). Synaesthesia: prevalence and
familiality. Perception, 25, 1073–1079.
Baron-Cohen, S., & Harrison, J. E. (1997). Synaesthesia: Classic and contemporary readings (Vol. xiii).
Malden: Blackwell Publishing.
Baron-Cohen, S., Wyke, M. A., & Binnie, C. (1987). Hearing words and seeing colours: an experimental
investigation of a case of synaesthesia. Perception, 16(6), 761–767.
Brang, D., Hubbard, E. M., Coulson, S., Huang, M., & Ramachandran, V. S. (2010). Magnetoencephalography
reveals early activation of V4 in grapheme-color synesthesia. NeuroImage, 53(1), 268–274.
doi:10.1016/j.neuroimage.2010.06.008
Brang, D., Rouw, R., Ramachandran, V. S., & Coulson, S. (2011). Similarly shaped letters evoke similar colors
in
grapheme–color
synesthesia.
Neuropsychologia,
49(5),
1355–1358.
doi:10.1016/j.neuropsychologia.2011.01.002
Brang, D., Teuscher, U., Ramachandran, V. S., & Coulson, S. (2010). Temporal sequences, synesthetic
mappings, and cultural biases: The geography of time. Consciousness and Cognition, 19(1), 311–320.
doi:10.1016/j.concog.2010.01.003
Cohen, L., Dehaene, S., Naccache, L., Lehéricy, S., Dehaene-Lambertz, G., Hénaff, M.-A., & Michel, F. (2000).
The visual word form area Spatial and temporal characterization of an initial stage of reading in normal
subjects and posterior split-brain patients. Brain, 123(2), 291–307. doi:10.1093/brain/123.2.291
Dehaene, S., Cohen, L., Sigman, M., & Vinckier, F. (2005). The neural code for written words: a proposal.
Trends in Cognitive Sciences, 9(7), 335–341. doi:10.1016/j.tics.2005.05.004
Dixon, M. J., Smilek, D., Cudahy, C., & Merikle, P. M. (2000). Five plus two equals yellow. Nature, 406(6794),
365–365.
Dixon, M. J., Smilek, D., Duffy, P. L., Zanna, M. P., & Merikle, P. M. (2006). The role of meaning in graphemecolour synaesthesia. Cortex, 42(2), 243–252.
Dixon, M. J., Smilek, D., & Merikle, P. M. (2004). Not all synaesthetes are created equal: Projector versus
associator synaesthetes. Cognitive, Affective, & Behavioral Neuroscience, 4(3), 335–343.
Eagleman, D. M., Kagan, A. D., Nelson, S. S., Sagaram, D., & Sarma, A. K. (2007). A standardized test battery
for the study of synesthesia. Journal of Neuroscience Methods, 159(1), 139–145.
doi:10.1016/j.jneumeth.2006.07.012
Edquist, J., Rich, A. N., Brinkman, C., & Mattingley, J. B. (2006). Do synaesthetic colours act as unique features
in visual search? Cortex, 42(2), 222–231.
32 / 35
Writing assignment
Jonathan van Leeuwen
Esterman, M., Verstynen, T., Ivry, R. B., & Robertson, L. C. (2006). Coming unbound: disrupting automatic
integration of synesthetic color and graphemes by transcranial magnetic stimulation of the right parietal
lobe. Journal of Cognitive Neuroscience, 18(9), 1570–1576.
Fahrenfort, J. J., Scholte, H. S., & Lamme, V. A. F. (2007). Masking Disrupts Reentrant Processing in Human
Visual Cortex. Journal of Cognitive Neuroscience, 19(9), 1488–1497.
Feynman, R. P. (1988). What Do You Care What Other People Think’ Further Adventures of a Curious
Character. London: Unwin.
Frisby, J. P., & Clatworthy, J. L. (1975). Illusory contours: Curious cases of simultaneous brightness contrast.
Perception, 4, 349–357.
Frith, C. D., & Paulesu, E. (1997). The physiological basis of synaesthesia. Baron-Cohen, Simon [Ed], 123–147.
Gebuis, T., Nijboer, T. C. W., & Van der Smagt, M. J. (2009). Multiple dimensions in bi-directional synesthesia.
European Journal of Neuroscience, 29(8), 1703–1710. doi:10.1111/j.1460-9568.2009.06699.x
Gheri, C., Chopping, S., & Morgan, M. . (2008). Synaesthetic colours do not camouflage form in visual search.
Proceedings of the Royal Society B: Biological Sciences, 275(1636), 841–846.
doi:10.1098/rspb.2007.1457
Goller, A. I., Otten, L. J., & Ward, J. (2009). Seeing sounds and hearing colors: an event-related potential study
of auditory–visual synesthesia. Journal of Cognitive Neuroscience, 21(10), 1869–1881.
Grainger, J., Rey, A., & Dufau, S. (2008). Letter perception: from pixels to pandemonium. Trends in Cognitive
Sciences, 12(10), 381–387. doi:10.1016/j.tics.2008.06.006
Grossenbacher, P. G., & Lovelace, C. T. (2001). Mechanisms of synesthesia: cognitive and physiological
constraints. Trends in Cognitive Sciences, 5(1), 36–41.
Hartman, A. M., & Hollister, L. E. (1963). Effect of mescaline, lysergic acid diethylamide and psilocybin on
color perception. Psychopharmacologia, 4(6), 441–451.
Howells, T. H. (1944). The experimental development of color-tone synesthesia. Journal of Experimental
Psychology, 34(2), 87.
Hubbard, E. M. (2007). Neurophysiology of synesthesia. Current Psychiatry Reports, 9, 193–199.
Hubbard, E. M., Arman, A. C., Ramachandran, V. S., & Boynton, G. M. (2005). Individual Differences among
Grapheme-Color
Synesthetes:
Brain-Behavior
Correlations.
Neuron,
45(6),
975–985.
doi:10.1016/j.neuron.2005.02.008
Hubbard, E. M., Brang, D., & Ramachandran, V. S. (2011). The cross-activation theory at 10. Journal of
Neuropsychology, 5(2), 152–177. doi:10.1111/j.1748-6653.2011.02014.x
Hubbard, E. M., & Ramachandran, V. S. (2005). Neurocognitive Mechanisms of Synesthesia. Neuron, 48(3),
509–520. doi:10.1016/j.neuron.2005.10.012
Hupe, J.-M., Bordier, C., & Dojat, M. (2011). The Neural Bases of Grapheme-Color Synesthesia Are Not
Localized
in
Real
Color-Sensitive
Areas.
Cerebral
Cortex,
22(7),
1622–1633.
doi:10.1093/cercor/bhr236
Jewanski, J., Day, S. A., & Ward, J. (2009). A Colorful Albino: The First Documented Case of Synaesthesia, by
Georg Tobias Ludwig Sachs in 1812. Journal of the History of the Neurosciences, 18(3), 293–303.
doi:10.1080/09647040802431946
Jürgens, U. M., & Nikolić, D. (2012). Ideaesthesia: Conceptual processes assign similar colours to similar
shapes. Translational Neuroscience, 3(1), 22–27. doi:10.2478/s13380-012-0010-4
Kadosh, R. C., Kadosh, K. C., & Henik, A. (2007). The neuronal correlate of bidirectional synesthesia: A
combined event-related potential and functional magnetic resonance imaging study. Journal of
Cognitive Neuroscience, 19(12), 2050–2059.
Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: a module in human extrastriate
cortex specialized for face perception. The Journal of Neuroscience, 17(11), 4302–4311.
Lamme, V. A., & Roelfsema, P. R. (2000). The distinct modes of vision offered by feedforward and recurrent
processing. Trends in Neurosciences, 23(11), 571–579.
Marek, G. J., & Aghajanian, G. K. (1998). Indoleamine and the phenethylamine hallucinogens: mechanisms of
psychotomimetic action. Drug and Alcohol Dependence, 51, 189–198.
Martino, G., & Marks, L. E. (2001). Synesthesia: Strong and Weak. Current Directions in Psychological
Science, 10(2), 61–65. doi:10.1111/1467-8721.00116
33 / 35
Writing assignment
Jonathan van Leeuwen
Mattingley, J. B., Payne, J. M., & Rich, A. N. (2006). Attentional load attenuates synaesthetic priming effects in
grapheme-colour synaesthesia. Cortex, 42(2), 213–221.
Mattingley, J. B., Rich, A. N., Yelland, G., & Bradshaw, J. L. (2001). Unconscious priming eliminates automatic
binding of colour and alphanumeric form in synaesthesia. Nature, 410(6828), 580–582.
doi:10.1038/35069062
McKeefry, D. J., & Zeki, S. (1997). The position and topography of the human colour centre as revealed by
functional magnetic resonance imaging. Brain, 120(12), 2229–2242.
Melero, H., Peña-Melián, Á., Ríos-Lago, M., Pajares, G., Hernández-Tamames, J. A., & Álvarez-Linera, J.
(2013). Grapheme-color synesthetes show peculiarities in their emotional brain: cortical and subcortical
evidence from VBM analysis of 3D-T1 and DTI data. Experimental Brain Research, 227(3), 343–353.
doi:10.1007/s00221-013-3514-4
Mesulam, M.-M. (1999). Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental
representation and attentional targeting of salient extrapersonal events. Philosophical Transactions of
the Royal Society of London. Series B: Biological Sciences, 354(1387), 1325–1346.
Mishkin, M., & Ungerleider, L. G. (1982). Contribution of striate inputs to the visuospatial functions of parietopreoccipital cortex in monkeys. Behavioural Brain Research, 6(1), 57–77.
Mulvenna, C. M., & Walsh, V. (2006). Synaesthesia: supernormal integration? Trends in Cognitive Sciences,
10(8), 350–352.
Novich, S., Cheng, S., & Eagleman, D. M. (2011). Is synaesthesia one condition or many? A large-scale analysis
reveals subgroups: Subtypes of synaesthesia. Journal of Neuropsychology, 5(2), 353–371.
doi:10.1111/j.1748-6653.2011.02015.x
Nunn, J. A., Gregory, L. J., Brammer, M., Williams, S. C. R., Parslow, D. M., Morgan, M. J., Gray, J. A.
(2002). Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words.
Nature Neuroscience, 5(4), 371–375. doi:10.1038/nn818
Paffen, C. L. E., van der Smagt, M. J., & Nijboer, T. C. W. (2011). Colour?Grapheme Synesthesia Affects
Binocular Vision. Frontiers in Psychology, 2. doi:10.3389/fpsyg.2011.00314
Palmeri, T. J., Blake, R., Marois, R., Flanery, M. A., & Whetsell, W. (2002). The perceptual reality of
synesthetic colors. Proceedings of the National Academy of Sciences, 99(6), 4127–4131.
Ramachandran, V. S., & Hubbard, E. M. (2001a). Neural cross wiring and synesthesia. Journal of Vision, 1(3),
67–67. doi:10.1167/1.3.67
Ramachandran, V. S., & Hubbard, E. M. (2001b). Psychophysical investigations into the neural basis of
synesthesia. Proceedings of the Royal Society B: Biological Sciences, 268, 979–983.
Ramachandran, V. S., & Hubbard, E. M. (2001c). Synaesthesia–a window into perception, thought and
language. Journal of Consciousness Studies, 8(12), 3–34.
Rey, A., Dufau, S., Massol, S., & Grainger, J. (2009). Testing computational models of letter perception with
item-level
event-related
potentials.
Cognitive
Neuropsychology,
26(1),
7–22.
doi:10.1080/09541440802176300
Rich, A. N., Bradshaw, J. L., & Mattingley, J. B. (2005). A systematic, large-scale study of synaesthesia:
implications for the role of early experience in lexical-colour associations. Cognition, 98(1), 53–84.
doi:10.1016/j.cognition.2004.11.003
Rich, A. N., & Karstoft, K.-I. (2013). Exploring the benefit of synaesthetic colours: Testing for “pop-out” in
individuals with grapheme–colour synaesthesia. Cognitive Neuropsychology, 30(2), 110–125.
doi:10.1080/02643294.2013.805686
Rich, A. N., & Mattingley, J. B. (2002). Anomalous Perception in Syneaesthesia: A Cognitive Neuroscience
Perspective. Nature Reviews Neuroscience, 3(1), 43–52. doi:10.1038/nrn702
Rich, A. N., & Mattingley, J. B. (2003). The effects of stimulus competition and voluntary attention on colourgraphemic synaesthesia. NeuroReport, 14(14), 1793–1798.
Rich, A. N., & Mattingley, J. B. (2010). Out of sight, out of mind: The attentional blink can eliminate
synaesthetic colours. Cognition, 114(3), 320–328. doi:10.1016/j.cognition.2009.10.003
Robertson, L. C. (2003). Binding, spatial attention and perceptual awareness. Nature Reviews Neuroscience,
4(2), 93–102. doi:10.1038/nrn1030
Rouw, R., & Scholte, H. S. (2007). Increased structural connectivity in grapheme-color synesthesia.
NatureNeuroscience, 10(6), 792–797. doi:10.1038/nn1906
34 / 35
Writing assignment
Jonathan van Leeuwen
Rouw, R., & Scholte, H. S. (2010). Neural Basis of Individual Differences in Synesthetic Experiences. Journal
of Neuroscience, 30(18), 6205–6213. doi:10.1523/JNEUROSCI.3444-09.2010
Saiki, J., Yoshioka, A., & Yamamoto, H. (2011). Type-based associations in grapheme-color synaesthesia
revealed by response time distribution analyses. Consciousness and Cognition, 20(4), 1548–1557.
doi:10.1016/j.concog.2011.07.005
Schmolesky, M. T., Wang, Y., Hanes, D. P., Thompson, K. G., Leutgeb, S., Schall, J. D., & Leventhal, A. G.
(1998). Signal timing across the macaque visual system. Journal of Neurophysiology, 79(6), 3272–
3278.
Simner, J., Glover, L., & Mowat, A. (2006). Linguistic Determinants of Word Colouring in Grapheme-Colour
Synaesthesia. Cognitive Neuroscience Perspective on Synaesthesia, 42, 281–289.
Simner, J., Mulvenna, C., Sagiv, N., Tsakanikos, E., Witherby, S. A., Fraser, C., Ward, J. (2006).
Synaesthesia: The prevalence of atypical cross-modal experiences. Perception, 35(8), 1024–1033.
doi:10.1068/p5469
Skelton, R., Ludwig, C., & Mohr, C. (2009). A novel, illustrated questionnaire to distinguish projector and
associator synaesthetes. Cortex, 45(6), 721–729. doi:10.1016/j.cortex.2008.02.006
Smilek, D., Callejas, A., Dixon, M. J., & Merikle, P. M. (2007). Ovals of time: Time-space associations in
synaesthesia. Consciousness and Cognition, 16(2), 507–519. doi:10.1016/j.concog.2006.06.013
Smilek, D., & Dixon, M. J. (2002). Towards a synergistic understanding of synaesthesia. Psyche, 8(01).
Retrieved from http://www.theassc.org/files/assc/2529.pdf
Smilek, D., Dixon, M. J., Cudahy, C., & Merikle, P. M. (2001). Synaesthetic photisms influence visual
perception. Journal of Cognitive Neuroscience, 13(7), 930–936.
Specht, K. (2012). Synaesthesia: cross activations, high interconnectivity, and a parietal hub. Translational
Neuroscience, 3(1), 15–21. doi:10.2478/s13380-012-0007-z
Sperling, J. M., Prvulovic, D., Linden, D. E., Singer, W., & Stirn, A. (2006). Neuronal Correlates of ColourGraphemic Synaesthesia: Afmri Study. Cortex, 42(2), 295–303.
Spruyt, A., Koch, J., Vandromme, H., Hermans, D., & Eelen, P. (2009). A time course analysis of the synesthetic
colour priming effect. Canadian Journal of Experimental Psychology/Revue Canadienne de
Psychologie Expérimentale, 63(3), 211–215. doi:10.1037/a0015299
Synesthesia. (2013, December 6). Wikipedia, the free encyclopedia. Retrieved December 6, 2013, from
http://en.wikipedia.org/w/index.php?title=Synesthesia&oldid=584819331
Thornley Head, P. D. (2006). Synaesthesia: Pitch-colour isomorphism in RGB-space? Cortex, 42(2), 164–174.
Van Leeuwen, T. M., den Ouden, H. E. M., & Hagoort, P. (2011). Effective Connectivity Determines the Nature
of Subjective Experience in Grapheme-Color Synesthesia. Journal of Neuroscience, 31(27), 9879–
9884. doi:10.1523/JNEUROSCI.0569-11.2011
Van Leeuwen, T. M., Petersson, K. M., & Hagoort, P. (2010). Synaesthetic Colour in the Brain: Beyond Colour
Areas. A Functional Magnetic Resonance Imaging Study of Synaesthetes and Matched Controls. PLoS
ONE, 5(8), e12074. doi:10.1371/journal.pone.0012074
Walsh, V., & Butler, S. R. (1996). Different ways of looking at seeing. Behavioural Brain Research, 76(1), 1–3.
Ward, J. (2013). Synesthesia. Annual Review of Psychology, 64(1), 49–75. doi:10.1146/annurev-psych-113011143840
Ward, J., Huckstep, B., & Tsakanikos, E. (2006). Sound-colour synaesthesia: To what extent does it use crossmodal mechanisms common to us all? Cortex, 42(2), 264–280.
Ward, J., Jonas, C., Dienes, Z., & Seth, A. (2009). Grapheme-colour synaesthesia improves detection of
embedded shapes, but without pre-attentive “pop-out” of synaesthetic colour. Proceedings of the
RoyalSociety B: Biological Sciences, 277(1684), 1021–1026. doi:10.1098/rspb.2009.1765
Ward, J., Li, R., Salih, S., & Sagiv, N. (2007). Varieties of grapheme-colour synaesthesia: A new theory of
phenomenological and behavioural differences. Consciousness and Cognition, 16(4), 913–931.
doi:10.1016/j.concog.2006.09.012
Ward, J., & Mattingley, J. B. (2006). Synaesthesia: an overview of contemporary findings and controversies.
Cortex, 42(2), 129–136.
35 / 35