Cognitive Brain Research 15 (2002) 17–29 www.bres-interactive.com Interactive report How does attention attenuate target–distractor interference in vision? Evidence from magnetoencephalographic recordings J.-M. Hopf a , *, K. Boelmans a , A.M. Schoenfeld a , H.-J. Heinze a , S.J. Luck b a Department of Neurology II, Otto-von-Guericke-University, Leipziger Str. 44, D-39120 Magdeburg, Germany b Department of Psychology, University of Iowa, Iowa City, IA 52242 -1407, USA 8 September 2002 Abstract This study used magnetoencephalographic and electroencephalographic recordings to investigate the neural mechanisms that underlie the attentional resolution of ambiguous feature coding in visual search. We addressed this issue by comparing neural activity related to target discrimination under conditions of more versus less feature overlap between the target and distractor items. The results show that increasing feature overlap leads to a focal enhancement of neural activity in ventral occipito-temporal areas, consistent with the larger need to attenuate distractor interference. Furthermore, the results suggest that distractor attenuation proceeds as a stepwise operation, with different spatial locations containing interfering features being suppressed successively. These findings support theories of visual search that emphasize location-based attentional selection as a key mechanism in resolving ambiguous feature coding in vision. 2002 Elsevier Science B.V. All rights reserved. Theme: Neural basis of behaviour Topic: Neural plasticity Keywords: Attentional resolution; Visual search; Distractor attenuation; Neural activity 1. Introduction It is commonly assumed that searching for a target item among distractors requires attentional focusing. According to an influential proposal [36,37], visual processing begins with a stage of automatic, preattentive feature registration. This initial step produces spatially organized maps of simple features (color, orientation, form etc.), which can be used to detect the presence of features but is not sufficient to detect multifeature targets. For multifeature targets, attention is thought to mediate target identification by binding the independent feature representations into a coherent object representation [35]. Consistent with this proposal, there is considerable evidence showing that the allocation of attention differs depending on the particular distribution of features across *Corresponding author. Tel.: 149-391-671-3430; fax: 149-391-6715032. E-mail address: [email protected] (J.-M. Hopf). target and distractors [8,37,38,43]. For example, a target item containing a unique feature may be detected easily because the preattentive feature analysis can indicate whether the target is present or absent without the use of focused attention. In contrast, when the features of the target are also present in the distractors, the preattentive feature analysis is insufficient to determine whether the target-defining features are present in the same object or in different objects, and focused attention is therefore necessary to bind together the features of an object and determine whether it is a target. Electrophysiological studies have supported this proposal, showing that the amount of attention allocated to a target depends on whether feature binding is necessary [20,21] Many theories propose that the feature-binding role of attention is mediated, at least in part, by inhibitory mechanisms that suppress information from the distractors surrounding the target. Indeed, neurophysiological evidence from single-unit recordings in monkeys, event-related brain potentials (ERPs) in humans, and functional brain imaging in humans suggests that the suppression of 0926-6410 / 02 / $ – see front matter 2002 Elsevier Science B.V. All rights reserved. PII: S0926-6410( 02 )00213-6 18 J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 distractors is an important mechanism of attentional selection [4,5,15,19,21,24,25,32,33,41]. For example, singleunit recordings in macaque extrastriate cortex during visual search revealed that, when two objects are within a neuron’s receptive field, attending to one of the objects will suppress the neuron’s responses to the other object [3,4]. These and related studies [19,24] led to the proposal that attention may filter out irrelevant visual input by means of a principle called biased competition [6,7,31]. That is, multiple stimuli inside one RF give rise to competitive interactions, and attention acts by biasing these competitive interactions in favor of the attended stimulus [6,7,31]. The investigation of visual search tasks with ERPs in humans has also provided evidence that attention may act, in part, by suppressing interference from distractor items. A particularly revealing ERP component has been the N2pc component (N2 posterior contralateral)—a negativegoing voltage deflection in the N2 latency range, with a maximum over the posterior scalp contralateral to the attended item. This component, usually elicited between 180 and 300 ms after search frame onset, has been demonstrated to reflect the operation of focusing attention onto potential target items [10,22,23,44]. Three important properties of the N2pc are that: (1) it is larger for targets surrounded by competing distractor items than for isolated targets [23]; (2) it is larger for multifeature targets than for single-feature pop-out targets [21]; and (3) it is generated primarily in lateral occipito-temporal regions, with a small contribution from posterior parietal cortex [13]. Thus, the N2pc component is similar to single-unit attention effects observed in macaque IT cortex [4] and area V4 [5] in terms of both its time course and its response to experimental manipulations. Both measures may therefore reflect the same neural activity linked to distractor suppression within the ventral stream (see Ref. [21] for a discussion). The present MEG / ERP experiments further investigated the relationship between distractor interference and attention. According to the theoretical accounts sketched above, enhancing ambiguities of feature coding should require more suppressive neural activity that should, in turn, be reflected by the N2pc component and it’s magnetic counterpart, the mN2pc. The amount of ambiguous feature coding was manipulated by changing the number of features that overlap between target and distractors. In one condition, target and distractors shared two feature-dimensions (color and orientation), in another condition they shared only one feature (color). We predicted that the N2pc and mN2pc would be larger when the target and distractors shared two features than when they shared only one, which would be taken as evidence that suppression of competing features is an important role of attention within visual cortex. Furthermore, parallels between single-unit attention effects in macaque extrastriate cortex and the N2pc in humans [21] suggest that source activity related to distractor interference may be found extrastriate regions of the ventral stream. To test this prediction, we compared results of inverse source modeling (current source localization based on minimum norm least square estimates) of the mN2pc under conditions of more or less interference. This allowed to identify neural activity in cortical regions where distractor interference impacts attentional processing. Two experiments were conducted, one to test these predictions and another to rule out a potential confound. 2. Methods 2.1. Subjects Both experiments were undertaken with the understanding and written consent of the subjects. Subjects were paid for participation. Twelve subjects (mean age 25.4 years, nine female) participated in the first experiment; six subject participated in the second control experiment (mean age 24.8 years, five female). All subjects were right handed, with normal color vision and normal or corrected-tonormal visual acuity. 2.2. Stimuli and procedure 2.2.1. Experiment 1 The stimuli used in this experiment are illustrated in Fig. 1A. They were presented via microcomputer-controlled back projection at a viewing distance of 120 cm. The background was grey (8 cd / m 2 ), and a white fixation cross was continuously visible in the center of the display. Subjects were instructed to fixate this point and to minimize blinking. Fixation was monitored by an infrared video camera with a zoom lens. Each stimulus array contained 12 double-colored circles presented below the fixation point, with six in the left visual field (LVF) and six in the right visual field (RVF). Stimuli were arranged such that a central target circle was surrounded by five distractor circles in each visual field. The central circle’s distance from fixation (8 of visual angle) was 3.58 to the left or right and 3.38 towards the lower visual field. The five distractor circles were even spaced around the central circle, with a center-to-center distance of 1.78 from the central circle. Each circle was divided into two differently colored halves, blue on one side and either red or yellow on the other. The two halves formed either a left-right pair with a vertical border or a top-bottom pair with a horizontal border (see Fig. 1A). Blue-and-yellow squares were presented in one visual field and blue-and-red squares were presented in the other; the assignment of colors to visual field varied unpredictably across trials. The luminance of each color was 95 cd / m 2 . On double-interference trials, the central target and surrounding distractors were presented in the same orientation, which was intended to produce interference along two dimensions (color and orientation), thereby increasing target–distractor similarity and the need for attentional suppression of the distractors. J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 19 Fig. 1. (A) Stimulus types (double, single) and principal structure of an experimental run of experiment 1. (B) Stimulus types used for the central and peripheral control task in experiment 2. In single-interference trials, the target and distractors were presented in orthogonal orientations, producing interference in only one dimension (color) and thereby decreasing target–distractor similarity and the need for attentional suppression. Single- and double-interference trials were randomly intermixed within trial blocks. For both types of trials, the task was to determine which of the two central target items contained a particular color and to report the relative location of this color within the target circle. In half of the trial blocks, subjects were instructed to find the central target circle that contained the color yellow; they pressed one button (right index finger) if the yellow color was on the left side or the top of the circle, and they pressed a different button (right middle finger) if the yellow color was on the right side or the bottom of the circle. In the other blocks, they performed this same task with the color red. Speed and accuracy were stressed equally. Stimulus arrays were presented for 700 ms, with a variable-duration blank interval of 1500–1600 ms between arrays. Subjects performed 10 trial blocks, five with yellow as the target color and five with red as the target color. 20 J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 Each block consisted of 160 stimulus presentations, 80 double-interference and 80 single-interference, yielding at total of 400 trials for every combination of target visual field and single-interference / double-interference display type for each subject. In this experiment, the same arrays were used for LVF and RVF targets, and only the instructions differed (e.g. an array with a yellow item in the LVF and a red item in the RVF would be a LVF target trial when yellow was the target and a RVF target when red was the target). This was important for controlling for any effects of stimulus color per se. However, the single- and double-interference trials were physically different, and any neurophysiological differences between these trial types may have been due to low-level physical differences (e.g. differences in orientation contrast) rather than differences in attentional allocation. Experiment 2 was designed to assess the possibility that these low-level physical differences contributed to the effects observed in experiment 1. 2.2.2. Experiment 2 To assess the effects of the physical differences between the single- and double-interference displays, we presented these two stimulus configurations while the subjects were performing tasks in which these stimuli were irrelevant. The timing, the sequence of stimulation, and the number of runs and trials were identical to those in experiment 1, but additional stimuli were added to the displays, as illustrated in Fig. 1B. Two different tasks were used, a central task in which attention was focused narrowly around the fixation point and a peripheral task in which attention was distributed broadly. In the central task, small uppercase letters (0.33 0.38 of size) were presented 0.48 above and below fixation (see Fig. 1B, left). These two characters were randomly chosen from a set of six letters (A, E, F, H, L, T). The two letters were identical on 50% of the trials and differed on 50% of trials; the subjects were instructed to press one button when the two letters were identical (right index finger) and a different button when they differed (right middle finger). The peripheral task was identical, except that the letters were 0.730.78 in size and presented 78 lateral to and 3.38 below the fixation point. Match and non-match trials were randomly combined with doubleinterference and single-interference arrays. Subjects performed the central and peripheral tasks in separate trial blocks; peripheral and central runs alternated across the session. 2.3. Recording and analysis The MEG and EEG signals were recorded simultaneously using a BTi Magnes 2500 whole-head MEG magnetometer system with 148 sensors (Biomagnetic Technologies, Inc.) for the MEG and an electrode cap in conjunction with a 32-channel Synamps amplifier (Neuro- Scan, Inc.) for the EEG. Electrode locations were chosen according to standard electrode montage of the American Electroencephalographic Society [34] (Fpz, Fz, Cz, Pz, Oz, Iz, Fp1, Fp2, F7, F8, F3, F4, FC1, FC2, T7, T8, C3, C4, CP1, CP2, P7, P8, P3, P4, PO3, PO4, PO7, PO8, IN3, IN4). The EEG was recorded with reference to the right mastoid. The MEG and EEG signals were filtered with a bandpass of DC 50 Hz and digitized with a sampling rate of 254 Hz. Artifact rejection was performed offline by removing epochs with peak-to-peak amplitudes exceeding a threshold of 3.0310 212 T for the MEG and 100 mV for the EEG. EEG electrode positions and the sensor frame coordinate system were spatially co-registered by using a Polhemus 3Space Fastrak system. That is, the individual electrode setup together with anatomical landmarks (nasion and left and right preauricular points) were digitized. The locations of these landmarks in relation to sensor positions were derived on the basis of precise localization signals provided by five spatially distributed coils attached to the head with a fixed spatial relation to the landmarks. The 32 EEG electrode locations were also digitized to permit co-registration with the coordinate system. To compute the grand average activity over all subjects, the coordinate system for each subject was readjusted to the coordinate system of the Montreal MNI brain (average of 152 T1-weighted stereotaxic volumes from the ICBM project, see www.bic.mni.mcgill.ca / cgi / icbm]view / ) whose anatomical surface structure was segmented (see below) and used for the grand-average source analyses. Separate averages for both MEG and EEG were computed for targets occurring in the LVF and the RVF. The data were collapsed over the two color combinations (redblue and yellow-blue). The N2pc was then isolated by computing LVF-minus-RVF difference waves (i.e. difference waves constructed by subtracting the RVF-target waveforms from the LVF-target waveforms). These difference waves eliminated activity due to purely sensory responses, because all arrays contained red-blue items in one visual field and yellow-blue items in the other, with red-blue items being attended in some trial blocks and yellow-blue items being attended in others. Any higherlevel cognitive activity that was equal for ipsilateral and contralateral targets was also eliminated in these difference waves, leaving only lateralized cognitive responses. Statistical analyses of the N2pc were conducted using within-subjects analyses of variance (ANOVAs) with the Greenhouse–Geisser epsilon adjustment for nonsphericity. The N2pc was quantified as the mean voltage or field strength between 180 and 300 ms, relative to an 100-ms prestimulus baseline. MEG source analysis was performed using the multimodal neuroimaging software Curry 4.0 (Philips Electronics N.V.) in the following way. First, on the basis of a high resolution MR scan, a 3-D reconstruction of the head, cerebrospinal fluid space (CSFS), and cortical surface was J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 created for each subject using the boundary element method [12]. Second, this realistic volume conductor model was used in conjunction with the observed MEG fields to estimate a model of the distribution of currents over the cortical surface by means of the minimum norm least squares method [9,11]. We will refer to these distributions as source density estimates (SDEs). Source analysis was performed in several steps. We first computed SDEs based on the LVF-minus-RVF difference waves to characterize the source activity underlying the mN2pc. To analyze its general time course and distribution, the initial analysis was conducted on the data after collapsing across single- and double-interference trials. The effect of feature interference was analyzed in a second step in which SDEs of the mN2pc (based on the LVFminus-RVF difference waves) were separately computed for single- and double-interference trials and then compared (mN2pc analysis). In a third step, the single- and double-interference trials were compared for each attended visual field separately (within-VF analysis). Computations were always performed for each subject individually, and the resulting SDEs were then averaged across subjects to maximize the signal-to-noise ratio. For visualization, SDE distributions are shown as 2D-azimuth projection in form of a schematically flattened cortex surface (see inset ‘azimuth projection’ in Fig. 4A). In this projection regions from the lateral and bottom part of the brain (i.e. regions ventral to the axial AC–PC plane of the Talairach reference space) become situated anteriorly (frontal and fronto-basal regions) and laterally (lateral and inferior-temporal regions) as indicated by areas with corresponding color in Fig. 4A (inset). To construct these 21 2D distribution maps, average SDEs were taken from 164 even spaced adjacent regions of the 3D cortical surface and interpolated at the 2D distribution map using the splineinterpolation method [30]. 3. Results 3.1. Experiment 1 3.1.1. Behavioral data The comparison of error rates between conditions (Fig. 2, left) revealed a slightly larger mean error rate on the double-interference trials (7.5%) than on the single-interference trials (3.9%). A two-way repeated measures ANOVA with factors of interference (double, single) and visual field (LVF, RVF) revealed a significant main effect of interference (F(1,11)55.33, MSE527.53, P,0.05). A significant interference3visual field interaction was also observed (F(1,11)59.09, MSE52.11, P,0.05), which was due to larger error rate difference between the double and single condition in the LVF. Slower mean reaction times were observed on the double-interference trials (655 ms) in comparison to the single-interference trials (609 ms) (Fig. 2, right), but this difference was only marginally significant (F(1,11)55.57, MSE55532.7, P50.055). A significant main effect of VF (F(1,11)540.7, MSE562.6, P, 0.05) and a significant interference3visual field interaction (F(1,11)513.8, MSE560.2, P,0.05) were observed, indicating that responses were generally slower for RVF targets, especially for double-interference trials. Fig. 2. Behavioral data. Percent correct responses (left) and mean response times (correct responses, right) of the single and the double condition of experiment 1. Separate averages are shown for LVF and RVF targets. The error bars indicate the standard error of the mean. 22 J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 3.1.2. Electrical and magnetic waveforms and distributions Electrical waveforms for the single- and double-interference trials are illustrated in Fig. 3A. Shown are grand average data (n512) at two selected electrode sites (PO7 / PO8), with waveforms for LVF targets and RVF targets superimposed. A prominent N2pc effect can be observed approximately 170–300 ms poststimulus (indicated by the colored regions). Confirming previous studies, the effect appeared as a relative negativity over the parieto-occipital scalp contralateral to the attended target item. This effect was similar in size for the single- and double-interference trials. For statistical validation, a three-way within-subjects ANOVA was computed with factors of electrode hemisphere (PO7, PO8), target side (ipsilateral or contralateral relative to the electrode site), and interference (double, simple). The presence of the N2pc effect was reflected by a significant main effect of target lateralization (F(1,11)5 8.67, P,0.05). The N2pc effect was larger in the left hemisphere than in the right hemisphere, leading to a significant interaction between target lateralization and electrode hemisphere (F(1,11)528.54, P,0.0005). The N2pc effect was slightly larger on double-interference trials than on single-interference trials, but the corresponding interference3lateralization interaction was only marginally significant (F(1,11)53.96, P50.072). Fig. 3B illustrates the scalp topography of the LVFminus-RVF difference waves between 230 and 290 ms poststimulus. Nearly identical voltage distributions were observed for single- and double-interference trials. Fig. 3C shows the magnetic waveforms at representative sensor sites. Waveforms for LVF targets and RVF targets are superimposed, with the mN2pc effect indicated by the colored regions. As in the electrical data, the mN2pc effect began around 170 ms and ended around 300 ms. Like the N2pc, the mN2pc was slightly larger for double-interference trials than for single-interference trials. To validate this statistically, a two-way ANOVA with factors of target lateralization and interference (double, simple) was computed. To cancel out the effects of the field polarity inversion across sensor sites, we inverted the values from sensor sites S127 and S99 and added them to the values from sites S61 and S60, respectively. In addition, the data were collapsed over corresponding sensor sites in the two hemispheres (S1271S99, S611S60). The presence of the mN2pc effect in the magnetic data was reflected by a significant main effect of target lateralization (F(1,11)5 9.59, P,0.05). The larger mN2pc effect for the doubleinterference trials resulted in a significant lateralization3 interference interaction (F(1,11)511.74, P,0.05). Fig. 3D illustrates corresponding average magnetic field distributions of the LVF target-minus-RVF target difference waves between 230 and 290 ms poststimulus. The mN2pc is characterized by peaks of magnetic flux leaving the head (red lines) over both the left and right occipital regions, with a transition to magnetic flux entering the head (blue lines) close to the left and right occipitotemporal borders. Note that this transition zone is over the cortical region in which the origin of the generating current sources would be expected. The polarity of the magnetic field for the LVF-minus-RVF difference wave is the same over the left and right hemisphere, whereas the corresponding ERP distribution shows opposite polarities (see Fig. 3B). Note, the finding of opposite polarities in the left and right hemispheres in the ERP distributions, but similar polarities across hemispheres for the MEG distributions, was expected and matches previous studies [13]. Specifically, the magnetic flux leaving left occipital lobe and entering into the left occipito-temporal region is consistent with a downward-pointing current dipole; the magnetic flux leaving the right occipital lobe and entering into the right occipito-temporal region is consistent with an upward-pointing current dipole. Therefore, the magnetic field distributions in Fig. 3D indicate the presence of opposite polarity current sources in the left and right hemispheres, consistent with the ERP voltage distributions in Fig. 3B. 3.1.3. Source density estimates To provide an initial characterization of the current sources underlying the mN2pc for the single- and doubleinterference trials, average source density estimates (SDEs) of the LVF-minus-RVF difference waveforms were computed from the MEG data, averaged over the single- and double-interference conditions. SDEs were computed at each time point (every 4 ms) over a time window that spanned the entire N2pc component in the ERP waveforms (150–350 ms). Fig. 4A shows the resulting SDE at the peak of activation (¯250 ms) in two different views, a surface representation of the reference MR scan and an azimuth projection map (see Section 2 and Fig. 4A inset). SDE maxima were observed in the lateral inferior Fig. 3. (A) Grand-average ERP waveforms for the double-interference (upper row) and single-interference (lower row) trials. Waveforms for RVF targets (solid lines) and LVF targets (broken lines) are superimposed. The colored areas indicate the time-range of the N2pc-effect. Waveforms shown on the left side were recorded from the left occipito-parietal electrode site (PO7); waveforms shown on the right side were recorded from the right occipito-parietal electrode (PO8). (B) Average voltage maps (230–290 ms) of the LVF-target minus RVF-target difference waves for the double-interference (top) and single-interference (bottom) trials. These voltage distributions correspond to the potential differences indicated by the colored areas in A. (C) Grand-average magnetic waveforms from selected sensors at opposite sites of the magnetic efflux–influx transition zone in the occipital cortex of the left (S60, S99) and right (S61, S127) hemisphere. Waveforms for RVF targets (solid lines) and LVF targets (broken lines) are superimposed. The colored areas indicate the time-range of the magnetic analog of the N2pc effect (mN2pc). (D) Grand-average magnetic field maps (230–290 ms) of the LVF target minus RVF target difference waves (colored areas in C). J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 23 24 J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 occipito-temporal cortex of both hemispheres, and the distribution of activity remained largely constant at each time point from 180 to 350 ms. A highly similar SDE distribution was previously observed for the mN2pc by Hopf et al. [13] in a time range of 220–280 ms. In this previous study, SDE maxima were also found over the J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 posterior parietal cortex from 180 to 220 ms, but very little activity was observed in that region in the present experiment, suggesting that attentional modulations in these parietal regions may be less important for the present task (see Section 4). The primary goal of this study was to investigate the cortical sites in which interference modulates the operation of attention. We therefore compared the time course and distribution of the mN2pc source density estimates between the single- and double-interference trials. For each observer, SDEs from the LVF-minus-RVF difference waveforms were computed for successive time samples in the interval from 150 to 350 ms, and the resulting maps were then averaged across observers. Difference images were then computed by subtracting the single-interference maps from the double-interference maps, making it possible to visualize the regions in which mN2pc activity was greater under conditions of greater interference. Fig. 4B shows the distribution of this SDE difference at its maximum (approximately 250 ms), as well the time course of the difference at its maximal location in each hemisphere. The difference was largest in occipito-temporal cortex, especially in the left hemisphere. No difference was observed in occipito-parietal regions. The N2pc analysis reported so far was based on attendLVF-minus-attend-RVF difference waveforms. One useful consequence of computing SDEs from these difference waveforms is that any brain activity that was insensitive to the visual field of the target was subtracted away. A shortcoming of this approach, however, is that it is not possible to separately examine activity elicited by LVF and RVF targets. We therefore conducted a within-VF analysis that was intended to assess the effects of feature interference separately for attend-LVF and attend-RVF trials. In this analysis, we removed brain activity unrelated to our hypotheses by subtracting the single-interference trials from the double-interference trials (rather than by subtracting RVF trials from LVF trials). Specifically, SDEs for the single- and double-interference trials were computed separately for LVF and RVF targets, and the SDEs for the single-interference trials were then subtracted from SDEs for the double-interference trials. This analysis makes it possible to observe brain activity that is enhanced for the double-interference trials, whether or not this activity is 25 lateralized (and may therefore differ from the mN2pc analyses, which focused solely on lateralized activity). Fig. 3C shows the resulting difference SDEs at the time points of maximum difference, along with the time course at the location of strongest activity within each hemisphere. Red traces represent source activity from the hemisphere contralateral to the target, and blue traces represent activity from the ipsilateral hemisphere. Note that positive values indicate greater source density in the double condition. We first consider the results for LVF targets (Fig. 4C, left). Activity began and ended at similar times in both the ipsilateral (left) hemisphere and the contralateral (right) hemisphere, but the ipsilateral activity peaked earlier than the contralateral activity (¯200 versus 300 ms). A complementary pattern was observed for RVF targets. In both cases, the early ipsilateral and late contralateral peaks occurred at almost identical locations, within the general region of the mN2pc double-minus-simple difference, as estimated from the LVF-minus-RVF analyses shown at the right side in Fig. 4C (SDE maxima, see red and blue squares). Thus, conditions of increased interference modulated both ipsilateral and contralateral activity, but the modulation was initially larger in the ipsilateral hemisphere and then became larger in the contralateral hemisphere. In addition to these occipito-temporal effects, we also observed SDE differences in frontal cortical regions (see Fig. 3C, frontal regions). Specifically, frontal activity was greater for the double-interference trials than for the single-interference trials, but this effect was not lateralized and was primarily observed for LVF targets. We will not consider this effect further in the present article. 3.2. Experiment 2 A possible objection to experiment 1 deserves consideration. Namely, it is possible that the observed SDE differences reflect bottom-up sensory mechanisms like feature contrast processing and not attentional processing per se. Low-level sensory mechanisms may have come into play because the distractors were closely surrounding the target and were always uniform regarding their orientation. Therefore, in the single but not in the double-interfer- Fig. 4. (A) Source density estimates (SDEs) from LVF-minus-RVF target MEG difference waves (mN2pc analysis). Waveforms were collapsed across the single- and double-interference trials to reveal the principal current distribution that underlies the mN2pc effect. SDEs are shown as a surface representation using the reference MR scan (top) and as an azimuth projection map (bottom). The inset illustrates the relative location of cortical regions in the 2D azimuth map in relation to the 3D cortical surface map. (B) Average difference map (double minus single) of SDEs from LVF-minus-RVF target MEG difference waves (mN2pc analysis). SDEs were first computed for each condition and observer, then averaged across observers and subtracted. The traces at the bottom show the time course of the SDE difference between 150 and 350 ms at both occipito-temporal maxima. Note, the difference is always positive throughout the complete time-range, indicating larger SDEs in the double condition. (C) SDEs from the double-minus-single MEG difference waves of the within-VF analysis. The traces below show the time course of these estimates between 150 and 350 ms at cortical locations with maximum effects in the ipsilateral (blue traces) and contralateral (red traces) hemispheres. At the right side, locations of peak estimates from the within-VF analysis are superimposed onto the double-minus-simple SDE difference map of the mN2pc analysis shown in B. Small squares indicate peak locations for LVF targets, and small circles show peak locations for RVF targets. Colors refer to the ipsilateral (blue) and contralateral (red) hemispheres. 26 J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 ence condition, orientation contrast between the target and the orthogonally oriented surround may have given rise to orientation pop-out [26]. Such feature contrast effects have been shown to modulate cell-firing in visual cortex including V1 [16–18] even in aesthesized and paralyzed mon- keys [27]. Hence, it is possible that the observed SDE differences reflect such pre-attentional bottom-up processes. Experiment 2 explores this possibility. In this experiment, the task requirements were changed to make the target stimuli task-irrelevant. If the effects Fig. 5. (A) Grand-average event-related potential waveforms for the double-interference (upper row) and single-interference (lower row) trials of experiment 2. Waveforms for RVF targets (solid lines) and LVF targets (broken lines) as well as the peripheral (blue traces) and central (red traces) conditions are superimposed. Averages for LVF and RVF targets for experiment 2 were computed by selectively averaging over stimulus frames that served as LVF and RVF targets in experiment 1. The principal differences between the waveforms of the peripheral and the central condition arise from physical stimulus differences and differences with respect to the size of the attentional focus. (B) Grand-average magnetic waveforms from selected sensors (S60, S99) at opposite sites of the magnetic efflux–influx transition zone in the occipital cortex of the left hemisphere. Waveforms for RVF targets (solid lines) and LVF targets (dashed lines) as well as the peripheral (blue traces) and central (red traces) conditions are superimposed. J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 observed in experiment 1 were due to bottom-up effects of the low-level sensory differences between the single- and double-interference stimuli, then these effects should also be present in experiment 2. If the previous effects were attention-related, however, they should be eliminated in experiment 2. In experiment 2, attention was directed towards the region of the fixation point (central task, see Fig. 1B, left) or towards two peripheral locations that were situated beyond the extent of the stimulus arrays (peripheral task, see Fig. 1B, right). Fig. 5A shows the ERP waveforms from the central task (red traces) and the peripheral task (blue traces), separately averaged for single- and doubleinterference trials. Fig. 5B shows the analogous MEG waveforms from two left-hemisphere sensor sites. For both the central and peripheral tasks, neither the ERP waveforms nor the MEG waveforms exhibited an N2pclike pattern of lateralization. In addition, there was no discernable difference between the responses elicited by single- versus double-interference stimuli. A two-way ANOVA confirmed the absence of significant effects of lateralization and interference. Taken together, the results of the experiment 2 make it unlikely that the effects of feature-interference observed in experiment 1 arose from more elementary bottom-up mechanisms like orientation contrast. In addition, the negative results of the peripheral condition speak also against an explanation in terms of nonspecific effects of attention that may have enhanced the neural responses at irrelevant locations within a wide focus of attention. 4. Discussion 4.1. Localization of mN2 pc Source density estimates of the mN2pc for both the single- and double-interference trials revealed neural activity in focal areas of the ventral occipito-temporal cortex of both hemispheres. Similar source locations were obtained in a previous MEG study [13] with a different search task and different stimuli. The stability of source locations across experiments allows increased confidence in these mN2pc localizations and provides additional evidence for the importance of these ventral stream cortical areas for attentional focusing in visual search [4,19]. In the study of Hopf et al. [13], the mN2pc was found to consist of an early parietal source (180–200 ms) followed by later ventral occipito-temporal sources (220–240 ms). In the present study, however, no significant source activity was observed in the parietal cortex. Although, this seems unexpected at the first glance, it is not completely unpredicted in view of the interpretation of the parietal current source offered by Hopf et al. [13]. The parietal source was proposed to reflect the initiation of spatial shifts of attention to the target locations, and the need for 27 attention shifting differed substantially between experiments. Specifically, the target location was highly predictable in the present study, always appearing at one of two stable locations, whereas the targets in the Hopf et al. [13] study varied unpredictably in location throughout the entire visual field. Thus, the pattern of results across experiments is consistent with the proposal that the parietal subcomponent reflects the mechanisms that initiates shifts of attention, whereas the occipito-temporal subcomponent reflects the mechanisms the implement the selection of relevant information once attention has been shifted. A recent MEG investigation of visual discriminative processing that did not involve search supports this view [14]. In this study, current source activity related to color discrimination was observed in similar regions of the ventral stream, with no parietal activity. 4.2. Suppression and interference The primary goal of the present study was to investigate the neural mechanisms that underlie the attentional resolution of ambiguous feature coding. We addressed this by comparing current source activity underlying the mN2pc under conditions of more or less feature-overlap with the distractor items. The results clearly show that increasing feature overlap leads to a modulation of mN2pc activity in ventral occipito-temporal regions, which is consistent with the enhanced need for suppressive neural activity to attenuate the increased interference. This also provides evidence for the proposal that the neural activity underlying the N2pc reflects suppression of interference from distractor items, as has been suggested previously [21]. The larger mN2pc in the double-interference condition is suggestive of an underlying suppressive mechanism, and the within-VF comparison of the single- and double-interference trials in the mN2pc time-range provides further support for this claim. In line with the mN2pc findings, the within-VF comparison revealed larger source activity for the double- than the single-interference trials in ventral occipito-temporal regions, and the maximum differences were localized within the general region of the mN2pc. More importantly, the expected maximum difference in the contralateral visual cortex is regularly preceded (90–100 ms) by a maximum difference in the ipsilateral visual cortex. In other words, the difference between the singleand double-interference conditions was initially larger at locations ipsilateral to the target, and then became larger at contralateral locations. On the assumption that suppressive activity is likely to be observed in the hemisphere contralateral to the suppressed items, this pattern suggests that the distractors in the visual field opposite to the target were suppressed first, leading to a large effect ipsilateral to the target and contralateral to the opposite-field distractors. This was then followed by activity contralateral to the target, which presumably reflects suppression of the distractors that surrounded the target in the same visual field 28 J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 (although it may also represent enhancement of the target itself). This ipsilateral-followed-by-contralateral pattern would be difficult to explain by a pure enhancement mechanism because enhanced processing of irrelevant information in the unattended hemisphere is less plausible. Furthermore, the presence of an ipsilateral effect suggests that although target-color would have been sufficient to unambiguously highlight the target-region, it did not prevent interference from the non-target VF. This may relate to psychophysical evidence showing that attention relies on location-based selection even when selection by color would be more effective [1]. In general, our results are in line with theories on visual search that assume feature-driven spatial selection to be followed by a location-based operation of focused attention [2,37,38,42]. Finally, the ipsilateral-followed-by-contralateral sequence of source activity indicates that the attenuation of irrelevant input does not proceed simultaneously across all distractor items in the search array. Rather, suppressive operations are applied step by step, with input from the irrelevant visual field being discarded first, and unwanted input from within the relevant visual field being discarded subsequently. Several explanations of this sequence are viable. First, this sequence may reflect a selection hierarchy of distractor attenuation that moves stepwise from course to fine. Such mechanism of attentional selection has been proposed by several computational models [28,39,40]. For example, the selective tuning model of Tsotsos et al. [40] proposes a hierarchical winner-take-all process that selects the target by recursively pruning away input from distractor items in a coarse-to-fine manner. Second, the ipsilateral-followed-by-contralateral sequence may just reflect the fact that interfering items could be spatially chunked together to allow collective suppression. The particular stimulus configuration in this study may have invited such strategy. Then, the observed sequence would rather be a consequence of the distribution of interfering features than evidence for a hierarchical courseto-fine selection process. There is some psychophysical evidence that, when the number of items exceeds a certain limit, attention parses items into chunks which are searched through one at a time [29]. Since the stimulus configuration was not changed in the present experiments, we cannot decide among these explanations, and further experiments are necessary to clarify this issue. Acknowledgements This research was made possible by grant HE1531 / 3-5 from the Deutsche Forschungsgemeinschaft and grant R01 MH63001 from the National Institutes of Health. We thank Alan Richardson Klavehn for helpful comments on earlier versions of the manuscript. References [1] K.R. Cave, H. Pashler, Visual selection mediated by location: selecting successive visual objects, Percept. Psychophys. 57 (1995) 421–432. [2] N.J. Cepeda, K.R. Cave, N.P. Bichot, M.-S. Kim, Spatial selection via feature-driven inhibition of distractor locations, Percept. Psychophys. 60 (1998) 727–746. [3] L. Chelazzi, J. Duncan, E.K. Miller, R. Desimone, Response of neurons in inferior temporal cortex during memory-guided visual search, J. Neurophysiol. 80 (1998) 2918–2940. [4] L. Chelazzi, E.K. Miller, J. Duncan, R. Desimone, A neural basis for visual search in inferior temporal cortex, Nature 363 (1993) 345. [5] L. Chelazzi, E.K. Miller, J. Duncan, R. Desimone, Responses of neurons in macaque area V4 during memory-guided visual search, Cereb. Cortex 11 (2001) 761–772. [6] R. Desimone, Visual attention mediated by biased competition in extrastriate visual cortex, Philos. Trans. R. Soc. Lond. B 353 (1998) 1245–1255. [7] R. Desimone, J. Duncan, Neural mechanisms of selective visual attention, Annu. Rev. Neurosci. 18 (1995) 193–222. [8] J. Duncan, G.W. Humphreys, Visual search and stimulus similarity, Psychol. Rev. 96 (1989) 433–458. [9] M. Fuchs, M. Wagner, T. Kohler, H.A. Wischmann, Linear and nonlinear current density reconstructions, J. Clin. Neurophysiol. 16 (1999) 267–295. [10] M. Girelli, S.J. Luck, Are the same attentional mechanisms used to detect visual search targets defined by color, orientation, and motion?, J. Cogn. Neurosci. 1 (1997) 1. [11] M.S. Hamalainen, R.J. Ilmoniemi, Interpreting magnetic fields of the brain: minimum norm estimates, Med. Biol. Eng. Comput. 32 (1994) 35–42. ¨ ¨¨ [12] M.S. Hamalainen, J. Sarvas, Realistic conductivity geometry model of the human head for interpretation of neuromagnetic data, IEEE Trans. Biomed. Eng. 36 (1989) 165–171. [13] J.-M. Hopf, S.J. Luck, M. Girelli, T. Hagner, G.R. Mangun, H. Scheich, H.-J. Heinze, Neural sources of focused attention in visual search, Cereb. Cortex 10 (2000) 1233–1241. [14] J.-M. Hopf, E.K. Vogel, G. Woodman, H.J. Heinze, S.J. Luck, Localizing visual discrimination processes in time and space, J. Neurophysiol. (2002) in press. [15] S. Kastner, P. De Weerd, R. Desimone, L.G. Ungerleider, Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI, Science 282 (1998) 108–111. [16] S. Kastner, H.-C. Nothdurft, I.N. Pigarev, Neuronal correlates of pop-out in cat striate cortex, Vision Res. 37 (1997) 371–376. [17] J.J. Knierim, D.C. Van Essen, Neuronal responses to static texture patterns in area V1 of the alert macaque monkey, J. Neurophysiol. 67 (1992) 961–980. [18] V.A.F. Lamme, The neurophysiology of figure–ground segregation in primary visual cortex, J. Neurosci. 15 (1995) 1605–1615. [19] S.J. Luck, L. Chelazzi, S.A. Hillyard, R. Desimone, Mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex, J. Neurophysiol. 77 (1997) 24–42. [20] S.J. Luck, M.A. Ford, On the role of selective attention in visual perception, Proc. Natl. Acad. Sci. USA 95 (1998) 825–830. [21] S.J. Luck, M. Girelli, M.T. McDermott, M.A. Ford, Bridging the gap between monkey neurophysiology and human perception: an ambiguity resolution theory of visual selective attention, Cogn. Psychol. 33 (1997) 64–87. [22] S.J. Luck, S.A. Hillyard, Electrophysiological correlates of feature analysis during visual search, Psychophysiology 31 (1994) 1. [23] S.J. Luck, S.A. Hillyard, Spatial filtering during visual search: evidence from human electrophysiology, J. Exp. Psychol. Hum. Percept. Perform. 20 (1994) 1000–1014. J.-M. Hopf et al. / Cognitive Brain Research 15 (2002) 17–29 [24] J. Moran, R. Desimone, Selective attention gates visual processing in the extrastriate cortex, Science 229 (1985) 782–784. [25] B.C. Motter, Neural correlates of feature selective memory and pop-out in extrastriate area V4, J. Neurosci. 14 (1994) 2190–2199. [26] H.C. Nothdurft, Texture segmentation and pop-out from orientation contrast, Vision Res. 31 (1991) 1073–1078. [27] H.C. Nothdurft, J.L. Gallant, D.C. Van Essen, Response modulation by texture surround in primate area V1: correlates of ‘popout’ under anesthesia, Vis. Neurosci. 16 (1999) 15–34. [28] B.A. Olshausen, C.A. Anderson, D.C. Van Essen, A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information, J. Neurosci. 13 (1993) 4700–4719. [29] H. Pashler, Detecting conjunctions of color and form: reassessing the serial search hypothesis, Percept. Psychophys. 41 (1987) 191– 201. [30] F. Perrin, J. Pernier, O. Bertrand, J. Echallier, Spherical splines for scalp potential and current density mapping, Electroencephalogr. Clin. Neurophysiol. 72 (1989) 184–187. [31] J.H. Reynolds, L. Chelazzi, R. Desimone, Competitive mechanisms subserve attention in macaque areas V2 and V4, J. Neurosci. 19 (1999) 1736–1753. [32] B.J. Richmond, R.H. Wurtz, T. Sato, Visual responses of inferior temporal neurons in awake rhesus monkey, J. Neurophysiol. 50 (1983) 1415–1432. [33] A.T. Smith, K.D. Singh, M.W. Greenlee, Attentional suppression of activity in the human visual cortex, NeuroReport 11 (2000) 271– 277. [34] A.E. Society, Guideline seven: a proposal for standard montages to [35] [36] [37] [38] [39] [40] [41] [42] [43] [44] 29 be used in clinical EEG, Am. Electroencephalogr. Soc. J. Clin. Neurophysiol. 11 (1994) 30–36. A. Treisman, Solutions to the binding problem: progress through controversy and convergence, Neuron 24 (1999) 105–110. A. Treisman, G. Gelade, A feature-integration theory of attention, Cogn. Psychol. 12 (1980) 97–136. A. Treisman, S. Gormican, Feature analysis in early vision: evidence from search asymmetries, Psychol. Rev. 95 (1988) 15–48. A. Treisman, S. Sato, Conjunction search revisited, J. Exp. Psychol. Hum. Percept. Perform. 16 (1990) 459–478. J.K. Tsotsos, S.M. Culhane, F. Cutzu, From foundational principles to a hierarchical selection circuit for attention, in: J. Braun, C. Koch, J.L. Davis (Eds.), Visual Attention and Cortical Circuits, MIT Press, Cambridge, MA, 2001, pp. 285–306. J.K. Tsotsos, S.M. Culhane, W.Y.K. Wai, Y. Lai, N. Davis, F. Nuflo, Modeling visual attention via selective tuning, Artif. Intell. 78 (1995) 507–545. W. Vanduffel, R.B.H. Tootell, G.A. Orban, Attention-dependent suppression of metabolic activity in early stages of the macaque visual system, Cereb. Cortex 10 (2000) 109–126. J. Wolfe, Guided search 2.0 A revised model of visual search, Psychonom. Bull. Rev. 1 (1994) 202–238. J.M. Wolfe, K.R. Cave, S.L. Franzel, Guided search: an alternative to the feature integration model for visual search, J. Exp. Psychol. Hum. Percept. Perform. 15 (1989) 419–433. G.F. Woodman, S.J. Luck, Electrophysiological measurement of rapid shifts of attention during visual search, Nature 400 (1999) 867–869.
© Copyright 2026 Paperzz