Magnetoencephalography as a Research Tool in Neuroscience

REVIEW „
Magnetoencephalography as a Research Tool in
Neuroscience: State of the Art
ANDREAS A. IOANNIDES
Laboratory for Human Brain Dynamics
RIKEN Brain Science Institute, Saitama, Japan
Magnetoencephalography (MEG) is a noninvasive neuroimaging method for detecting, analyzing, and interpreting the magnetic field generated by the electrical activity in the brain. Modern hardware can capture the
MEG signal at hundreds of points around the head in a snapshot lasting only a fraction of a millisecond. The
sensitivity of modern hardware is high enough to permit the extraction of a clean signal generated by the brain
well above the noise level of the MEG hardware. It is possible to identify signatures of superficial and often
deep generators in the raw MEG signal, even in snapshots of data. In a more quantitative way, tomographic
images of the electrical current density in the brain can be extracted from each snapshot of MEG signal, providing a direct correlate of coherent collective neuronal activity. A number of recent studies have scrutinized
brain function in the new spatiotemporal window that real-time tomographic analysis of MEG signals has
opened. The results have allowed the variability in a single area to be seen in the context of activity in other
areas and background rhythmic activity. In this view, normal brain function is seen as a cascade of extremely
fast events and the unfolding of specialized processes, segregated in space and time and organized into
well-defined stages of processing. NEUROSCIENTIST 12(6):524–544, 2006. DOI: 10.1177/1073858406293696
KEY WORDS
Magnetoencephalography (MEG), Magnetic field tomography (MFT), MEG spikes, Oscillations, Connectivity
Our brains are made up of neurons of varying sizes and
shapes that are intricately connected to each other.
Functionally, these neurons form transient coherent networks in an ever-changing tapestry of alliances using
chemical and electrical synapses and producing changes in
local electrical and chemical properties. It is possible to
detect, with sensors outside the head, changes relating to
either electrical activity (instantaneous reflections of neural events) or changes in metabolic consumption of nutrients and oxygen (caused by neuronal demand and
mediated by blood supply). Established neuroimaging
methods relying on well-understood physical laws allow
the noninvasive study of much of the human brain in
spatial scales from a fraction of a millimeter to many centimeters and temporal scales from a fraction of a millisecond to many hours. The central point of this review is that
although other neuroimaging techniques cover some part
of this spatiotemporal window, only magnetoencephalography (MEG) can cover the entire range, beginning with
tomographic descriptions of almost the entire brain,
extracted from a snapshot less than a millisecond long
(see Box 1 and Figure 1).
MEG deals with the detection, analysis, and interpretation of the minute magnetic fields generated by the brain
(see Box 2 and Figure 2). The MEG signal is directly
related to instantaneous changes in electrical activity in
the brain. Modern MEG hardware and software can
Address correspondence to: Andreas A. Ioannides, Laboratory for Human
Brain Dynamics, Brain Science Institute, Riken, 2-1 Hirosawa, Wako-shi,
Saitama 351-0198, Japan (e-mail:[email protected]).
524
THE NEUROSCIENTIST
Volume 12, Number 6, 2006
Copyright © 2006 Sage Publications
ISSN 1073-8584
disentangle the signal generated by the brain from ambient and biological noise, over a remarkably wide range of
frequencies: from near DC levels to thousands of cycles
per second (Fig. 3). Information about brain activity can
therefore be extracted from the same MEG signal at multiple time scales, from a fraction of a millisecond to many
hours, provided that signal processing and analysis methods are appropriate. To move from a description of the
MEG signal to descriptions of generators in the brain, one
must solve the inverse problem (see Box 3). The mathematical properties of the inverse problem demand that a
nonlinear problem be solved independently for each time
slice of data (Taylor and others 1999). This singles out
magnetic field tomography (MFT; Ioannides and others
1990) as the most appropriate algorithm for delivering a
tomographic description of activity from a single map of
MEG data. Nevertheless, the analysis of MEG data continues to rely on oversimplified assumptions, partly
because of the computational demands of single-trial
tomographic analysis and partly for historical rather than
scientific reasons (Ioannides 1994).
This review illustrates how tomographic estimates of
activity from single snapshots of MEG data begin to fully
use the capabilities of MEG. The results open up new
ways of studying brain function using methods already
developed for data mining (see Box 4). The first part of the
review uses tomographic analysis of average MEG data to
simplify the comparison with the raw signal and the
results from conventional analysis methods. The full
potential of MEG is realized only with tomographic
reconstructions of the real-time (single-trial) MEG data.
Magnetoencephalography in Neuroscience
Box 1. Methods of Neuroimaging: The MRI Family, Electroencephalogram, and
Magnetoencephalogram
Magnetic resonance imaging (MRI) uses radiofrequency (RF) pulses modulating a strong, steady magnetic field
to locally disturb the spin of protons and detect the radiation emitted as the excited nuclei return to their ground
states. MRI has constantly spawned new innovations of the basic technology that revolutionized the visualization
of brain anatomy, chemistry, and function. The same basic MRI hardware can be used for different types of imaging, often by simply using different pulse sequences. MRI, as originally introduced, provides a three-dimensional
image of proton density, primarily water molecules. MRI is suitable for visualizing soft tissue and has developed
into the method of choice for imaging anatomical structure in the brain, so we will refer to it hereafter structural
MRI (sMRI). In recent years, diffusion tensor MRI (DT-MRI) has advanced rapidly. DT-MRI allows measurements
of the local flow of material, mainly water, and hence the determination of diffusion properties (the coefficients of
the local diffusion tensor) in each brain voxel (Le Bihan and others 2001). DT-MRI can be used to visualize white
matter tracts and hence to visualize the neural pathways connecting different brain areas.
In the early 1980s, at about the same time as MRI became widely available, rapid development of emission computed tomography (ECT), especially in positron emission tomography (PET), started the modern era of noninvasive
brain functional imaging (Posner and Raichle 1994). PET relies on the detection of emissions from radioactively
labeled molecules introduced as a bolus into the bloodstream. After each bolus, the concentration of the radioactively labeled molecules increases for a few minutes, particularly in metabolically active areas. Injections of a bolus
are given in separate sessions, some just before the subject executes a task (the active sessions), and some while
the subject rests (the baseline sessions). Computing the difference or some statistical measure of the detected
radioactivity emanating from each brain voxel provides a map of the activated areas. Apart from the technical difficulties of producing and handling short-lived radioactive material, ECT techniques have two other limitations. They
are too slow, and safety issues limit the number of times a person can be a subject as well as the number of bolus
injections given per session (hence the independent task and baseline sessions). Until recently, it was possible to
obtain maps of brain activity only by combining measurements from many subjects.
In the early 1990s, yet another MRI innovation allowed images weighted by blood oxygenation level to be
obtained in as little as a few tens of milliseconds (Kwong and others 1992; Ogawa and others 1992). Because
blood oxygenation is finely controlled and responds promptly to local energy demand, voxel-by-voxel estimation
of changes in blood oxygenation represent maps of brain activation and are referred to as functional MRI (fMRI).
Although fMRI is a major advance over ECT because it is faster and less invasive (no injection of radioactive substances), it still relies on indirect measures of neuronal activity. Increases and decreases in measured activity are
difficult to interpret because the processes that regulate oxygen supply are complex and not fully understood.
Ultimately, the measurements still rely on blood supply. Although the data sampling can be extremely fast—on
the order of 20 milliseconds—the single shot fMRI map of changes accumulated over the last few seconds is
too blurred to make out any neural activity. Yet one more twist in the MRI story has unfolded recently with the
development of functional DT-MRI, measuring a local water phase transition that precedes the activationtriggered vascular responses by several seconds (Le Bihan and others 2006). Although the details of the swelling
in the activated cells are as yet unclear, this new capability of sensing intrinsic cellular events holds the promise
of an MRI-based functional imaging capability with temporal resolution well within 1 second.
The electrical activity within and among neurons in the brain generates electromagnetic disturbances that
propagate outside the head at the speed of light. The electroencephalogram (EEG) and magnetoencephalogram
(MEG) provide two complementary measures of these electromagnetic disturbances, namely, the electrical
potential on the scalp (the EEG signal) and the magnetic field just outside the head (the MEG signal). The activity of a single neuron produces too weak a signal to be detected outside the head; the MEG and EEG signals
require a large number of neurons to be aligned in space and electrically active at the same time. Estimates of
how many neurons are needed to generate a detectable MEG signal vary, depending on what assumptions are
made about the underlying generation mechanism (Hamalainen and others 1993; Ioannides and others 2005).
Modern hardware allows recording of EEG and MEG signals simultaneously from hundreds of independent positions and, at least in the case of MEG, with minimal cross-talk. EEG and MEG maps can be routinely collected
with sampling rates of many kilohertz, providing direct correlates of changes of electrical activity in the brain with
a time resolution of a fraction of a millisecond. The EEG is a blurred image of the generators because of the high
electrical resistance of the intervening tissue, especially the skull. In contrast, the MEG signal is more directly
related to the generators because the magnetic fields propagate with little attenuation from the generators to the
sensors. MEG signal quality can be gauged by comparing single-shot images extracted from average or even
raw MEG signal and single-shot fMRI images (Fig. 1).
Volume 12, Number 6, 2006
THE NEUROSCIENTIST
525
Fig. 1. Comparison of single-shot images of magnetoencephalography (MEG) and fMRI. A, The top two rows
show magnetic field tomography (MFT) solutions from
average MEG data elicited by the onset of a checkerboard pattern that covered the lower left part of the visual
field. The green traces show the outline of the calcarine
sulcus. The pink area shows the modulus (absolute magnitude), and the thin yellow arrow shows the direction of
the peak current density for tomographic (MFT) solutions
(see Box 3) derived from the instantaneous average MEG
signal (66 milliseconds after stimulus onset) for three
runs. The modern arrow corresponds to the equivalent
current dipoles (ECD) solution when it is within a centimeter of the displayed sMRI slice. Although the MFT
solution is remarkably stable, the ECD estimate varies
considerably because other labile activity from other
areas contributes as much as V1 to the MEG signal. B, In
contrast, the reconstruction from a single-shot fMRI
acquisition is dominated by contributions from blood
vessels and other artifacts such that signatures of neuronal activity can be seen only after statistical manipulation of many such single-shot acquisitions. C, The MFT
reconstructions derived from single-shot time slices of
single trials. The activity in V1 can be clearly identified in
these real-time single-shot MFT solutions.
The latter parts of the review summarize recent results and
the implications of the fascinating view they reveal of the
dynamic organization of brain function.
The Dynamic Range of the MEG Signal
The MEG signal is minute, but the exquisite sensitivity of
superconducting quantum interference devices (SQUIDs)
526
THE NEUROSCIENTIST
combined with the noise elimination hardware and software tools disentangles the signal generated by the brain.
The clean signal has sufficiently good dynamic range to
allow a tomographic reconstruction from a snapshot of
data. Such a reconstruction is demonstrated in Figure 1
for the activity in the primary visual cortex. The displayed
results show that the MFT reconstructions represent an
absolute measure of the instantaneous current density
vector. The image is informative in a quantitative way
with no need for reference to some baseline activation. In
contrast, the equivalent snapshot of fMRI data (representing the accumulation of seconds of activity) cannot be
interpreted on its own. Many such images must be combined before correlates of neuronal activity are identified.
Two related points are demonstrated by the next example
(Fig. 3). First, the huge dynamic range of the MEG signal
is maintained over long times, more than 4 minutes in the
case of Figure 3. The raw signal is free of noise contamination from the environment, except from narrow-band,
50-Hz noise from the power line. During the 4 minutes,
the subject goes through three repetitions of a sequence of
three eye states: closed, open (no fixation), and fixation on
a target. The second-order blind identification (SOBI)
algorithm (Tang 2002) is applied to the signal, producing
151 independent components (ICs). The signal for each
IC (or for a set of ICs) was projected back to the space of
MEG sensors, and the corresponding source was imaged
using MFT. Individual ICs or combinations of ICs corresponding to artifacts were identified from the correlation
of their time course with that of auxiliary channels (e.g.,
electrooculogram, electrocardiogram, etc.), their frequency spectra, or their localization signatures. The figure
shows that SOBI gathers the strong noise contributions
into a few ICs that can be studied separately or simply
eliminated from the signal. Although the raw signal generated by brain activity is one to two orders of magnitude
weaker, it is recovered with high fidelity and is still a couple of orders of magnitude stronger than the noise level of
the hardware (less than 10 fT). The second point is made
by the last row of the figure. The clean, low-pass–filtered
MEG signal is computed in two ways and compared with
the raw low-pass MEG signal (blue trace). The black trace
is the signal, first processed and cleaned by SOBI and
then low-pass filtered. The red trace is the signal after initially low-pass filtering the data and then running SOBI
and removing unwanted components. The order clearly
makes a difference, and this is because low-pass filtering
spreads the data in time and thus makes it impossible for
SOBI to bunch them together in just a few ICs. A similar
problem arises with heavy filtering and averaging of the
MEG signal before source localization. In this case, small
transient activations are eliminated, whereas other slower
components are spread in time.
Neural Sources: MFT Images and Signatures
in the Raw Data
We next consider MFT reconstructions for electrical stimulation of the right median nerve. This stimulation produces one of the most stereotypical MEG signals, the
M20 response. The M20 is generated by activity in the
Magnetoencephalography in Neuroscience
Box 2. Magnetoencephalography Recordings and Signal Processing
The strength of the MEG signal is minute. The earth’s magnetic field is about a billion times as strong, and even the
usual urban environment at frequency ranges that overlap the ones of interest in MEG is still many orders of magnitude stronger than the strongest MEG signal from a normal human brain. A prerequisite for useful MEG measurements
is therefore the availability of sensors that can detect the weak magnetic fields generated by the brain and methods
that can exclude the large ambient fields, separating the signal of interest from any interfering signals from the environment as well as irrelevant signals from the subject’s own body. Figure 2 provides examples of the hardware and
imaging tools that must be combined in an MEG experiment.
The basic MEG measurement relies on the detection of the electrical current in a small loop of wire, typically
about 1 cm across, induced by the change in the magnetic field component perpendicular to the loop surface.
Measurement of the induced current determines the value of the change in the magnetic field. Usually a set of coils
is used, arranged as a gradiometer to emphasize nearby signals from the brain at the expense of distant sources.
The detection of the minute current generated by the magnetic field changes in the brain is measured by coupling
the coil or gradiometer to an extremely sensitive superconducting quantum interference device (SQUID). As the
name implies, SQUIDs rely on superconductivity for their exquisite sensitivity, and together with their sensing coils,
they must be kept at extremely low temperatures, just a few degrees above absolute zero. To achieve this, sensing coils and SQUIDs are kept in a thermos-like container called a dewar, which is filled with liquid helium. In modern systems, the bottom of the dewar is shaped into a helmet with well more than 100 (nowadays a few hundred)
sensing coils evenly distributed on its inner surface. Just a few centimeters away, on the other side of the insulating layer, at normal room temperature, the subject can safely place his or her head inside the helmet. Each sensing coil samples the local magnetic field, and the full set of sensing coils can be scanned a few thousand times per
second. Each scan produces an independent measurement of the instantaneous magnetic field just outside the
head.
The second requirement (that of separating the signal of interest from ambient and other interfering signals) is
achieved by a combination of passive shielding, use of gradiometer design either in hardware or in software, and/or
by using additional reference channels. A figure-eight gradiometer is effective at eliminating noise and has been
used in some MEG systems (Makela and others 1993). However, the same effect can be obtained with software by
using a mathematical transformation of the signal of conventional sensors (Ioannides 1987), which can also be used
as a general noise elimination algorithm. Other signal processing techniques (e.g., independent component analysis) coupled to the use of information from auxiliary channels such as the electrooculogram and electrocardiogram
effectively eliminate biological and other artifacts.
Fig. 2. A, The magnetoencephalography hardware viewed from just outside the shielded room. B, A subject with
his head in position inside the helmet-like base of the dewar. C, The relative position of the brain and sensors, showing the projections of the sensor close to the superimposed axial sMRI slice. The asterisks show the position of the
center of the coil closest to the head, and the line shows the symmetry axis of the coil, which coincides with the
symmetry axis of the first-order gradiometer (line joining the centers of the two coils). The red and green colors denote
sensors on the near or far side of the displayed sMRI slice. D, The error in co-registration before and after correction
for distortion of soft tissue (see text). The most noticeable difference is around the cheeks, and the error is probably
due to padding during the sMRI acquisition. E, The position during each run is measured by activating head
localization coils placed near the nasion and left and right preauricular points. The electrodes for recording the
horizontal and vertical (over only one eye) electrooculogram are also seen in the image.
Volume 12, Number 6, 2006
THE NEUROSCIENTIST
527
Fig. 3. Second-order blind identification (SOBI) analysis of a 4-minute, 20-second–long record of magnetoencephalography (MEG) data sampled at 2084 Hz (more than 500,000 time slices). Raw MEG (MLF12, MRF12, and MRT32) and/or
auxiliary channels (electrooculogram [EOG], electrocardiogram [ECG]) are displayed with the corresponding independent
components activation curves (ICs) for (A) eye movements and (B) heart activity. C, The raw MEG signal for one MEG
channel is displayed in the time and frequency domains with the corresponding MEG signal for the same channel after
back-projection of the 3 ICs with the strong power line signal. D, The raw MEG signal with two versions of a 4-Hz
low-pass-filtered clean signal, differing only in the order of SOBI and low-pass filtering operations. MFT = magnetic field
tomography.
528
THE NEUROSCIENTIST
Magnetoencephalography in Neuroscience
Box 3. Forward and Inverse Problem, Generator Models, and Magnetic Field Tomography
The determination of the electroencephalography (EEG) and magnetoencephalography (MEG) signal from the
knowledge of the sources, the electrical properties of their biological environment, and the configuration of the
measuring devices is known as the forward problem. The estimation of generator strength, location, and time course
from the EEG and MEG signal is known as the inverse problem. The laws of electromagnetism define how the forward and inverse problems should be tackled and what assumptions about the generators are justified a priori.
The forward problem is linear and has a unique solution. In other words, the electric and magnetic field generated by any combination of instantaneous current elements is uniquely defined for each current element, and the
total is simply the sum of individual contributions, one from each element. In the case of continuous primary current density, the instantaneous electric and magnetic field can be computed by integrating the contributions from
each small-volume element in the source space. The source space for MEG includes only regions in which gray
and possibly white matter exist; any intervening regions and boundaries are not part of the source space as long
as they do not generate primary currents.
In contrast to the forward problem, the inverse problem has no unique solution (von Helmholtz 1853), but this is
much less of a problem in practice than what appears from the dry mathematical statement of the inverse problem. A unique solution to the inverse problem can be obtained as a probabilistic estimate under suitable constraints. Until recently, the most popular constraint reduced the generators to one or more point-like sources, or
current dipoles. These point-like sources are interpreted as representative of their neighborhood and are referred
to as equivalent current dipoles. Another popular constraint assumes that the continuous current density can be
written as a linear sum of functions, each defining the sensitivity profile, or lead field, of the sensors. The lead fields
decay fast away from each sensor, so a compensating weight function usually is used to ameliorate biases toward
superficial sources. These methods lead to a solution with smallest length and are known as minimum norm (MN)
or weighted minimum norm (wMN) solutions. Because the wMN leads to a linear system of equations, standard
pseudoinverse techniques can be used to define the inverse operator that can then be applied directly to the data.
Using a linear inverse solution makes the computations simpler in other ways too. Linear noise elimination techniques can be superimposed so that linear signal–processing operations (e.g., using the covariance matrix to
account for noise) can be applied at the level of the signal. Unfortunately, close examination of the mathematical
properties of the lead fields shows that neither current dipoles nor linear solutions are justified a priori. The key
point is rather subtle: There is no justification for expressing the full primary current density vector as a weighted
sum of lead fields. The laws of electromagnetism allow only the direction of the primary current density to be represented by a weighted linear sum of lead fields, and this leads inevitably to a nonlinear relationship between the
measurements and the distribution of generators. This conclusion was reached on the basis of simulation studies
leading to the standard form of magnetic field tomography (MFT; Ioannides and others 1990). A mathematical
analysis of lead fields showed that the expansion of the direction of the unknown current density as a weighted
sum of lead fields, as used by standard MFT, is the optimal (nonlinear) relationship between generators and signals for yielding tomographic description of the generators (Taylor and others 1999). Allowing the weights to
depend on some general power of the modulus of the unknown current density leads to a generalized version of
MFT, which describes most of the other popular distributed source algorithms (Ioannides and Taylor 1999; Taylor
and others 1999). The use of a priori weights was introduced in the first version of MFT, and their possible use was
noted for introducing constraints such as restricting the source space to the cortical surface or biasing the solutions according to results from other methods (Ioannides and others 1990). It has not been used with MFT because
the reconstructions are in general accurate enough without this constraint. It is then possible to compare the MFT
solutions with the anatomy as a direct test of the localization accuracy.
contralateral primary somatosensory cortex (S1), peaking
about 22 milliseconds after stimulus onset. The columns
in Figure 4 show, from left to right, the butterfly display
of the MEG signal time course, the signal topography at
the M20 peak, the MFT localization for the M20, and two
region of interest (ROI) activation curves. The first activation curve is obtained from the MFT solutions for the S1
ROI. The second activation is obtained by a data-driven
approach using the main feature (negative-positive dipolar pattern seen as blue-red patches on each map) of the
M20 topography. The average of the five channels around
the negative peak is subtracted from the average of the
Volume 12, Number 6, 2006
five channels around the positive peak, producing a virtual
channel (VC) for the S1 activation. In summary, the
columns of Figure 4 show in turn the raw MEG signal, the
signal topography, MFT solutions, and their activation
curves together with a VC. These results are shown in rows
from bottom to top, for two single trials, for two average
runs, and for the grand average across four subjects. Two
points are worth noting: First, it is evident that the virtual
channel represents the S1 activation well, as would be
expected from a superficial and dominant source. Second,
both MFT and the virtual channel provide a reasonable
representation of the time course shape, despite the
THE NEUROSCIENTIST
529
Box 4. Post–Magnetic Field Tomography and Exploratory Data Analysis
Magnetic field tomography (MFT) analysis generates independent tomographic estimates of the current density
vector for each snapshot of data. Because each snapshot is obtained independently, the MFT solutions and
quantities derived from them can be analyzed further using statistics. Specifically, statistical parametric mapping
(SPM) can be performed just like in fMRI. Different active conditions can be compared to each other or each one
with its baseline (taken as the control condition), or a variable of the active condition can be varied parametrically. The crucial difference, however, is that statistical parametric maps based on MFT reconstructions from
magnetoencephalography (MEG) data can be obtained for latency windows only a few milliseconds long. Sliding
this window in time can therefore describe changes in activity as a function of time.
For each time slice and condition in the experiment, the activity within a region of interest (ROI) can be summarized by computing the integral over the ROI volume of either the modulus of the current density vector or its
projection along some direction. The activation time course for an ROI can then be obtained by simply forming
the time series for successive activations. Time series can be analyzed by a variety of techniques to determine
frequency spectra, average measures of power or phase, and signal-to-noise ratio (SNR; Laskaris and Ioannides
2001; Ioannides, Kostopoulos, and others 2002). The availability of simultaneous regional activations from different areas allows the computation of measures of linkage between those areas, for example, by computing the
correlation or a nonlinear alternative, mutual information, between time-shifted segments of these areas’ activations (Ioannides, Liu, Kwapien, and others 2000).
Modern data-mining techniques provide powerful ways of analyzing sequences of MFT solutions, ROI activation time series, or simply linear combinations of MEG channels (Laskaris and others 2004). Each time point in
the sequence can be represented as a dimension so that each regional response (in the predefined latency range)
casts a point image in a multidimensional space. Representative prototypes and selective averages can be computed in a reduced feature space, providing a data-driven, principled summary of the variation in the data
(Laskaris and Ioannides 2001). Three potentially significant theoretical developments of these ideas have been
achieved recently (Laskaris and Ioannides 2002). First, by embedding time-delay images of responses into the
reduced feature space, pattern analysis and nonlinear dynamical methods were combined in a common analysis framework. Second, by tracing the evolution of controlled cases (e.g., by parametrically varying the strength
of a stimulus), the reduced space could be “sign posted,” leading to what were termed semantic geodesic maps.
Finally, by quantifying the similarity of the trajectories in different spaces—each representing responses from a
given brain area—powerful nonlinear measures of the coupling between brain regions could be computed.
We introduced examples of powerful generalizations of these ideas in the main text to describe collective brain
excitations. The responses from each area are used to define a dimension in a generalized space. Using data samples from either the prestimulus period or some other control condition, a global space is defined and then reduced
to fewer dimensions by standard multidimensional scaling techniques. Embedding all responses (latencies, trials,
conditions, etc.) in the feature space defines a trajectory for the evolution of activity for each condition that can be
visualized in a parsimonious way. Representative prototypes and selective averages can be computed in the
reduced feature space, providing a data-driven, principled summary of the similarities and differences in regional
responses within and across conditions, just as was done in single time series data earlier (Laskaris and Ioannides
2001). Because, by construction, the origin of the global space is the most representative point for the baseline (or
control condition), the distance of the corresponding point on the trajectory from the origin, r0(t), provides an objective measure of the collective excitation. Similarly, Dij(t), the distance between coincident or same-latency points in
two trajectories, is a measure of the dissimilarity of the collective responses for conditions i and j at that latency.
These measures can be averaged across subjects and/or grouped according to condition similarity, providing robust
but flexible time-dependent summaries of collective excitations and how they vary across conditions.
Most events in the brain are dictated more by endogenous influences than by exogenous stimuli. The real-time
MFT solutions provide equal access to events triggered by internal or external precursors. We developed a family
of algorithms for analyzing endogenously generated organization (EGO). EGO analysis has been particularly
successful recently in identifying and studying very transient and reproducible events in the real-time MFT solutions, what we called MEG spikes. The concept of spike-triggered averaging was adapted for the EGO analysis of
MEG spikes. Toward the end of the review, we will discuss the first demonstration of recovery of the underlying
state-dependent rhythms and activity levels by MEG-spike-triggered averaging.
approximate nature of the signal averaging. Although the
shape is preserved, amplitude is reduced, especially for
the grand average across subjects.
530
THE NEUROSCIENTIST
The same analysis is repeated in Figure 5, but this time
highlighting a relatively deep generator at the base of the
ventral occipital cortex. For this analysis, the MEG data
Magnetoencephalography in Neuroscience
Fig. 4. The first column shows a butterfly plot of the magnetoencephalography (MEG) signal elicited by median nerve
stimulation of the right hand. The vertical lines mark the time of stimulus onset (blue) and the M20 peak (22 milliseconds;
red). The second column shows the MEG signal topography at the M20 peak. The third column shows the magnetic field
tomography (MFT) solution for the M20 at two axial slices on the left and their zoomed images on the right. The last column shows the virtual channel (VC) output together with the MFT activation for a region of interest (ROI) defined functionally from the MFT solutions of the M20. For display purposes, each VC and activation curve is normalized so that the
maximum is one; the relative magnitude across figures is printed separately for VCs and activation curves. The first four
rows from the bottom show results for one subject, the two bottom rows for two single trials, and the two rows above for
the average of two runs. The top row shows the grand average results after averaging two runs from four subjects. The VC
is defined from the M20 topography of the first average run (map marked with an asterisk on the third row, second column). The same channels are used for all VC computations, with no correction for differences in head location and shape
even when the MEG signal from different runs and subjects is averaged. The MEG channels used for the VC definition are
highlighted inside the solid and dashed ellipses marking the negative and positive extrema of the dipolar pattern.
were elicited by face stimuli presented to the lower left
quadrant of the visual field. We focus on the activation
from the right fusiform gyrus (FG). This generator is
rather deep and not so well covered by the MEG sensor
array, so there is no a priori reason for its activity to produce a clear dipolar pattern in the MEG signal topography.
Even if a dipolar pattern is produced, it could be easily
masked by stronger contributions to the MEG signal from
more superficial sources. We therefore defined, in addition
to the virtual channel derived from the topography of the
Volume 12, Number 6, 2006
average MEG signal of one run, a second virtual channel
derived from the properties of the MFT solution.
Specifically, we computed the signal topography for a
current dipole located at the center of the fusiform activation of the MFT solution and with current dipole moment
along the local current density direction. We used this signal topography to define the second virtual channel.
Remarkably, even in this case, the agreement between
MFT and the virtual channels is good, especially for
latencies between 130 and 200 milliseconds, when face
THE NEUROSCIENTIST
531
Fig. 5. Summary results for brain activity elicited by a face stimulus presented in the lower left quadrant of the visual field.
The arrangement of the figure is as in Figure 4, with the two bottom rows showing 2 single trials and the next two averages from two runs, each with 30 trials. The top row shows the grand average of 21 runs: 3 runs for each of seven subjects. In this case, the red vertical line shows the peak latency for the M170 (184 millisecond) component, frequently
reported to show selectivity for face stimuli. The magnetic field tomography (MFT) solutions are shown in an axial and coronal slice through the peak activity in the FG. For this case, two virtual channels (VCs) are used. The first is defined from the
magnetoencephalography (MEG) map topography of the first average signal. The second VC is defined from a computergenerated signal, with the topography shown at the top of the third column. This signal is generated by computing the forward problem with a current dipole source placed at the peak of the MFT fusiform activation for the M170 and in the same
direction as the current density vector. The same channels are used for all VC computations, with no correction for differences in head location and shape even when the MEG signal from different runs and subjects is averaged.
stimuli elicit a distinctive MEG signal (Sams and others
1997). The response is evident for both the MFT solution
and the virtual sensors, even after averaging the
MEG signal of all runs for seven subjects. Compared
to the somatosensory stimulation presented before, the
MFT solutions elicited by faces are less stable in terms of
532
THE NEUROSCIENTIST
localization, and they become weaker faster with averaging across trials and subjects. The MFT solutions after
adjustment for changes in head position are nevertheless
remarkably stable for averages of even a few trials (data
not shown; Ioannides 2001). Note also that the single-trial
maps and activations are stronger and much more variable
Magnetoencephalography in Neuroscience
than what the average would imply. This variability is
usually interpreted as physiological noise, but the figure
indicates otherwise. First, the fusiform activations in single trials are identified intermittently over wider periods
than what the averages would suggest, and they are more
transient than the average. The fusiform activation in the
first single trial (bottom row) even has opposite polarity
from the average at the time of the M170. The conclusion
from the results of Figures 4 and 5 is that averaging across
trials, runs, and subjects can reveal stereotypical
responses, and these can be obtained surprisingly well
even with simple linear combinations of signals. These
stereotypical responses represent the real-time activations
well in only a few cases, typically for early responses in
primary sensory areas evoked by strong stimuli. For late
components, the stereotypical responses are poor descriptions of the underlying real-time dynamics.
The Localization Accuracy of MEG
The simplest way to test the accuracy of a method is with
phantom or computer-generated data. Such tests have
repeatedly demonstrated accuracy of a few millimeters for
MEG, including tests with a realistic human skull phantom (Leahy and others 1998). In general, however, there
is no guarantee that the assumed source generator model
used in a phantom or computer-generated test adequately
describes real events in the brain. The equivalent current
dipoles (ECD) model, for example, appears reasonable
in some applications but blatantly fails to fit data, even
those of Figure 1, where the activity of interest (in V1)
is focal. The influence of other sources (such as V5) can
shift the solution for a single ECD by centimeters
(Tzelepi and others 2001). The obvious test is to compare MEG localization with the results of a technique
that can localize accurately, ideally by simultaneously
recording the two signals. Unfortunately, the only available technique for accurate and noninvasive localization
of brain function is fMRI. It is obviously not possible to
simultaneously record fMRI and MEG, so the next best
option is to record the same responses to identical stimuli in the same subjects by both methods and compare
the results. Many such studies have been performed, but
until recently, the results were inconclusive. It is possible to localize real brain activity with fMRI with submillimeter accuracy (Cheng and others 2001). This,
however, can be achieved only with high fields, after
contributions from large vessels are eliminated, and in
reasonable times over a limited region along the acquisition slices. In the case of MEG, the localization accuracy
is compromised by the choice of model and the preprocessing of the stimuli. After all these choices are made,
it is still unclear what the appropriate measure of MEG
activity is to compare with the fMRI activations. The
available choices include instantaneous measures of
activity and activity filtered within a frequency band
and/or integrated over a latency range. We used statistical parametric maps comparing short 6-millisecond segments of stimulation with similar segments of the
control condition (subject fixating on a cross with the
Volume 12, Number 6, 2006
same luminosity as in the active condition but with no
stimuli delivered). The active window was stepped by
one time slice (1.6 milliseconds) for the next statistical
parametric mapping (SPM) comparison.
For fMRI, we employed hardware (Varian Unity Inova
4-T whole-body MRI system) and an analysis that had
already demonstrated submillimeter localization accuracy
(Cheng and others 2001) to serve as a gold standard for
the comparison. For stimuli, we used circular flickering
checkerboard patterns covering part of one of the two
lower visual field quadrants on a homogeneous gray background. The visual field quadrant to be stimulated was
selected individually for each of the four subjects used in
the experiment so that the available visual field (excluding
the foveal region up to about 3 degrees) corresponded to
a relatively smooth portion of the dorsal V1 for that subject. Two preliminary fMRI experiments were performed
for each subject to determine the optimal location and orientation of the fMRI acquisition slices for the main experiment (Cheng and others 2001). The results from the two
techniques were compared by simply superimposing the
contours of statistically significant activity elicited by the
stimuli. With fMRI, clear activations were observed, and
after eliminating contributions from large vessels, the
expected V1 activation was delineated from the activations of other areas, including V2 (whose boundaries had
already been determined by the preliminary experiments).
For MEG, a significant increase in activity was identified
in two early waves, one between 40 and 50 milliseconds
and the other beginning between 50 and 60 milliseconds
and leading to the dominant M70 peak. The beginning of
the first wave was localized in V1 in three of the four subjects, and the beginning of the second wave was localized
in all four subjects. In each case, the brief V1 activation
was followed within a few milliseconds by widely distributed activation that included, in addition to V2 activation, strong activations in V5 and the putative V6
homologue. The two early V1 activations were remarkably close to each other and to the fMRI V1 activation,
with a center-to-center distance of the corresponding
statistical parametric maps of about 3 mm (Moradi and
others 2003). The accuracy attained in this study was
comparable to the (sMRI)/MEG co-registration accuracy,
derived from the position of the sensors relative to the
head (i.e., the brain).
We have developed a new co-registration algorithm that
uses, in addition to the old magnetic stylus recordings,
data obtained from the reflection of a low-power infrared
laser. The analysis also corrects for distortions that often
arise because of differences in acquisition of sMRI and
MEG (Hironaga and Ioannides 2002). With the new
method, we can determine the position of the sensors
relative to a fixed space defined by the sMRI of the subject with an accuracy of about 1 mm. We repeated and
extended the MEG part of the experiment using stimuli
confined to parafoveal and peripheral locations in
each of the four quadrants of the visual field. Three new
subjects were used, and each subject was measured three
times on three separate days. Using the new co-registration
procedure and our standard MFT-SPM analysis, we
THE NEUROSCIENTIST
533
demonstrated localization accuracy and reproducibility of
1 to 2 mm throughout V1 (Poghosyan and Ioannides,
unpublished data).
There are no localization accuracy tests for areas outside V1 with comparable sophistication, so the best that
can be done is to make inferences based on theoretical
arguments and the known anatomy and physiology.
From a theoretical point of view, localization within V1
is no easier than localization elsewhere on the cortical
mantle. MFT results are consistent with this expectation
for extrastriate cortex activation (Poghosyan and
Ioannides, unpublished data) and for activations elicited
by somatosensory and auditory stimuli and associated
with motor execution and inhibition. The accuracy is
also good for relatively deep areas on the border of the
MEG array such as the FG. In a number of MEG experiments with faces, we have identified activity at foci with
Talairach coordinates (Talairach and Tournoux 1988)
matching those reported for face-selective response by
fMRI studies. As already demonstrated (Fig. 5),
fusiform activity generates an MEG signal that has a signature that can be seen in the raw MEG maps, even in
single trials. We will discuss brain activations elicited by
face stimuli later in this review.
The MFT solutions have always shown a constant interplay between superficial and deep activity. Activations in
the amygdalae (Ioannides, Poghosyan, and others 2004)
and orbitofrontal cortex (Ioannides, Liu, Theofilou, and
others 2000) were identified when stimuli expected to
activate these areas were used. Recently, MFT studies of
saccadic eye movements demonstrated localization in the
brain stem and cerebellum consistent in location and timing with known anatomy and physiology (Ioannides,
Corsi-Cabrera, and others 2004; Ioannides and Fenwick
2005; Ioannides and others 2005).
The Timing of Early Visual Responses
MFT analysis of visual responses consistently identifies activations earlier than most MEG and electroencephalography (EEG) reports in the literature but is more
in agreement with what is known from animal physiology.
For example, in the localization studies for V1 described
above, we identify activity in V1 and the extrastriate cortex earlier than what is usually reported in EEG studies
(Di Russo and others 2002). In a different experiment,
we have identified arousal/attentional modulation of
V1 activity within 100 milliseconds by contrasting the
responses to identical stimuli viewed passively or in
a GO/NOGO task (Poghosyan and others 2005). The
earliest attentional modulation of V1 reported in other
electrophysiological studies was between 140 and 250
milliseconds (Noesselt and others 2002). It is important to
note that in our GO/NOGO experiment, an earlier activation was identified around 40 milliseconds in V1, which
was not modulated by attention (i.e., it was the same
in both the active GO/NOGO task and during passive viewing of identical visual stimuli). In fact, the earliest attentionrelated modulation was identified in the right inferior
parietal lobule (IPL). As demonstrated schematically in
534
THE NEUROSCIENTIST
Fig. 6. A very fast right inferior parietal lobule (R-IPL)
activity is identified within 50 milliseconds of the onset of
a visual cue for a GO/NOGO task. The figure shows
schematically how the R-IPL activity could influence the
strong activity in V1 around 100 milliseconds. No R-IPL
activity is present when subjects view the same visual
stimuli passively.
Figure 6, our results agree with the prevailing view of topdown attentional control and support studies suggesting
involvement of the IPL (Corbetta and others 2000;
Kastner and Ungerleider 2000). Early top-down influence
was also seen in another recent study. In this case, faces
presented as stimuli in the upper visual field elicited activity 70 to 80 milliseconds after stimulus onset in the
FG, which in turn influenced activity in V1/V2 a few
milliseconds later (Liu and Ioannides 2006).
Our results agree in general with other studies for late
components—for example, the ones evoked by visual
stimuli around 100 milliseconds and later (Tzelepi and
others 2001; Liu and Ioannides 2006). The discrepancies
are either for early responses or early modulations, and
these are usually weaker components that can be easily
missed, depending on how the data are analyzed. First,
source models are often very different; we consistently
used MFT, allowing for activity throughout the brain.
Many EEG and MEG studies use single or multiple current dipoles. In the cases in which we used current
dipoles, we also failed to reliably identify the early activations, although a direct comparison is difficult because
we typically used fewer trials in each run. The post-MFT
operations such as the computation of statistical parametric maps provide high sensitivity and can easily identify
weak activations. If current dipoles or the statistical properties of the signal (e.g., the covariance matrix) have
already been used as part of the source reconstruction, no
additional statistical manipulation can be consistently
applied to the solutions. The failure to identify early activations may have to do with the way the data are processed
Magnetoencephalography in Neuroscience
Fig. 7. The occluded stimulus (small insert in the middle
of the figure) follows 300 milliseconds after the simple figure (top insert) also presented for 50 milliseconds. In the
prime condition (top row of top insert), the simple figure
was either a global, local, or mosaic interpretation of the
occluded figure. In the control condition (lower part of top
insert), the simple figure was a square or two small black
patches. Activation time courses for regions of interest
(ROIs) in left and right V1/V2, lateral occipital cortex, and
fusiform gyrus were computed from magnetic field
tomography solutions for responses elicited by the
occluded figure for separate runs for each condition. A
parsimonious interpretation of global brain excitation was
derived through multidimensional scaling of the computed time courses for the ROIs. The average global excitation for prime responses is weaker between 130 and
200 milliseconds than the responses to the control
(unprimed) identical stimuli.
before the source reconstruction analysis. It is our practice
to minimally alter the raw MEG signal and do so only if
there is a good reason. Specifically, we use either the full
bandwidth allowed by the Nyquist frequency of our sampling rate, or if we filter off-line, we usually use the lowpass filter at 200 Hz. In many EEG and MEG studies, the
data are low-pass filtered at less than 40 Hz. This operation
could easily eliminate short-lived early activations directly
or mask them by spreading the stronger and more sustained activations in time. Another very obvious reason for
the loss of early activations is the very conservative acceptance criterion used in many studies, of admitting activations that remain stable for at least 10 or 20 milliseconds.
If we had filtered our data at less than 40 Hz and/or required
brain activations to last for 10 milliseconds, we would have
missed the early V1 and fusiform activations and the attentional modulation of V1 within 100 milliseconds.
Visual Responses to Complex Stimuli:
Amodal Completion
We studied the process of amodal completion in a same/
different task in which test pairs were preceded by a
sequence of two figures (see Fig. 7). In the prime condition,
the first figure could be congruent to a global or local completion or a mosaic interpretation of an occluded part
Volume 12, Number 6, 2006
(behind a square) in the second figure. In the control (unrelated prime) condition, the first figure was either two
patches (instead of the occluded figure) or a square. We
analyzed the average MEG data for the responses to the
second, occluded figure, testing for differences depending
on what the preceding (first) stimulus was. We concluded
two separate analyses.
The first analysis emphasized the information at the
level of MEG signals (Plomp and others 2006). Sensors
with high consistent responses were identified, and the
latencies and amplitudes of peaks in the MEG signals
were compared for the different preceding stimuli. First,
slightly reduced latencies and increased amplitudes were
found for prime (local, global, or mosaic) compared
with control stimuli. Peak latencies occurred at 123 and
128 milliseconds, respectively, for prime and control
conditions. Second, within the prime conditions, the
mosaic interpretation gave rise to the largest amplitude
and the fastest response. The mean latencies for mosaic,
local, and global peaks were 119, 124, and 125 milliseconds, respectively. The results singled out the mosaic
interpretation as one that can rapidly emerge in visual
processing when context favors it.
The second analysis used MFT solutions and statistical parametric maps of the same data with ROIs in the
left and right V1/V2, lateral occipital cortex (LOC), and
FG (Liu and others 2006). In this analysis, we found significantly reduced activation in the right fusiform cortex
between 120 and 200 milliseconds after occluded figure
onset for mosaic, local, or global preceding stimuli as
compared with the preceding control figures. This was
interpreted as a neural correlate of priming by the preceding congruent figure, suggesting that in early stages
of perception, the right FG acts as a hub for different
occluded figure interpretations.
The results of the two studies stand independently but
are difficult to interpret within a unified framework. The
first analysis is independent of localization because the
same sensors are used for each subject, so the technique
pools processes in which either different areas are activated or the same set of areas is activated but at different
latencies in different subjects. The second analysis relied
strictly on localization. SPM results were pooled together
only if they were identified in the same areas and latencies
in all subjects. The latter analysis revealed, however,
significant spatiotemporal differences between local,
global, and mosaic interpretations within individual subjects, at the latencies identified in the first study, but without common trends. To carry the analysis further, we
adapted methods from time-series analysis (Laskaris and
Ioannides 2002) to describe collective excitations of many
brain areas in a unified framework (see Box 4). We used
the moduli of the current density vector (as computed by
MFT) in the previously defined six areas (one for V1/V2,
LOC, and FG in each hemisphere). The set of points corresponding to activity in the prestimulus period for all
conditions was used to explore this global 6-dimensional
space and to reduce it to a 4-dimensional feature space.
We computed the average across subjects of r0(t) and
Dij(t) for each condition (see Box 4 for the definition of
THE NEUROSCIENTIST
535
these quantities). The Dij(t) identified differences between
the main prime conditions from 90 milliseconds, with
strongest peaks at about 100 and 120 milliseconds for
the difference between global and either local or mosaic
interpretations (data not shown). The time course of r0(t)
averaged across all runs, the 10 subjects, and condition
category (prime or control) showed clearly the priming
effect in the same latency range (120–200 milliseconds)
as in our second study (Fig. 7). The new framework
describes the global excitation associated with each previous stimulus by its corresponding r0(t) and quantifies the
dissimilarities between them by Dij(t). A parsimonious
explanation of the results is consistent with the idea that
the preceding stimulus sets up processing of the current
stimulus more efficiently in many areas and reduces the
load on the “hub”, the right FG, that coordinates processing during the period of the priming effect.
From Average to Real-Time Tomographic
Analysis of MEG Data
It was stated from the outset that the real power of MEG
lies in its ability to map activity throughout the brain in
real time, over a huge range of temporal scales. Events
that last few milliseconds can be tracked and related to
processes that last hours. Yet all examples discussed so far
used MFT solutions obtained from average MEG data.
We used MFT analysis of average data for two reasons.
First, the single-trial analysis is demanding on both computer resources and post-MFT analysis. Second, the spatiotemporal scales that open up are not accessible by any
other method, so before venturing into unknown terrain, it
is critical to establish that the methodology employed
reproduces the results that have been established by
nearly a century’s work in electrophysiology. The linearity of the forward problem provides a stringent test of how
well the single-trial MFT solutions represent real events in
the brain. The linearity of the forward problem trivially leads
MFT
to the following equation: <J (r,t; single trial)>single trials =
MFT
J (r,t; average), where <JMFT(r,t; single trial)>single trials
is the expectation value (average) of the current density
vector field of single-trial MFT solutions and JMFT(r,t;
average) is the current density vector field of the MFT of
the average MEG signal. Because MFT uses a nonlinear
algorithm, the result is not guaranteed a priori. How well
the equation holds is therefore a measure of how accurate
the MFT single-trial reconstruction is. In all our studies,
we found that this equation holds remarkably well
(Ioannides 2001). Linearity can also be used to check how
well the average describes events in single trials. The contribution of a generator to the average signal will be similar to the single trial activation if the generator activity is
reproducible in each single trial. For radial gradiometers
it is difficult to isolate the contribution of a given generator in the raw signal for one MEG channel because the
signal is affected by many generators. A consistent presence of the contribution of any one generator will be lost
amongst the many other contributions from generators
that are activated differently in each single trial. Virtual
channels, as defined and used earlier, offer an acceptable
536
THE NEUROSCIENTIST
alternative because they can describe well the activity of a
focal generator while reducing others. Furthermore, comparison of the virtual channel and activation curves
derived from MFT solutions provide a further test of how
well the signal that survives the averaging process represents a focal activation. For strong evoked responses in
primary sensory areas, the average captures the structure
of events in single trials reasonably well (Fig. 4). Even
averaging across subjects naïvely appears to provide a
good approximation, albeit with much loss in amplitude.
The conclusion, however, is very different for weak stimuli or late components (Fig. 5). In this case, the waveform
captured by the average is a poor representation of the single-trial events. Nevertheless, a current dipole approximating the focal FG activity of the MFT solution (derived
from the average MEG data) produces an MEG topography that can be recognized in the raw MEG signal. What
is remarkable is how similar the virtual channels derived
either from the raw signal or from the current dipole
approximation to the MFT solution are to each other, and
to the activation time course for the FG derived from the
MFT solutions. There is clearly a tangible connection
between the MFT estimate of brain activity and patterns
in the raw signal, and these patterns can be approximately
extracted by simple methods even for single trials.
When we use the average MEG signals, we rarely use
hundreds of trials and often as few as five. There are two
reasons for this intermediate approach. First, we wish to
study subjects that are comfortable during the experiment
and in as natural an environment as possible. We do not
generally employ a bite bar or other head fixation methods. We use short runs instead so that head movement is
minimized. Second, using a large number of trials in the
average does not help with accurate localization because it
often increases what we term area cross-talk. As we will
discuss in more detail later, the high variability from trial
to trial is far from being random noise—it is the source of
information. If we average too many trials, we get a
smooth signal, but we lose detail in time (both within the
latency range of each trial and across trials) and space. We
lose accuracy in space because activations in nearby areas
(say in V1 and V2) follow each other in quick succession,
and this, coupled to the latency jitter, is bound to mix them
in the average. Therefore, we use averaging of few trials to
reduce the computations while maintaining some of the
variability. The post-MFT statistics will then sort out what
is noise and what is signal (e.g., which activations are consistently higher in active compared to baseline conditions).
More discussion about the advantages and disadvantages
of analysis of average and single-trial MEG data can be
found elsewhere (Ioannides 1994; Ioannides 2001).
Real-Time Analysis of Responses to
Simple Sensory Stimuli
We have studied the responses to simple stimuli in three
modalities: auditory (Liu and Ioannides 1996; Liu and
others 1998; Laskaris and Ioannides 2001), somatosensory (Ioannides, Kostopoulos, and others 2002), and
visual (Laskaris and others 2003). The results from these
Magnetoencephalography in Neuroscience
studies converge on the following conclusions. In each
modality, the early entry to the system is fast and often
associated with weak activations. The most prominent
early response in the auditory and visual signal (between
60 and 100 milliseconds) is associated with excitation of
a number of areas and not, as is often assumed, just the
primary sensory cortex. In fact, if the variance of the
signal is used directly to classify the responses, then
much of the signal appears to come from oscillations in
the α band, which precede and outlast the stimulus
(Laskaris and Ioannides 2001; Laskaris and others 2003).
In the case of the visual stimulus, the generators appear
to be in polymodal areas (Laskaris and others 2003). An
apt analogy is that of a Greek dance. The evoked activity
enters the cortical arena as a new dancer while the
orchestra in the polymodal areas plays on its α tune.
Every dancer (area) adjusts a little, and the new dancer
fits into the flow. This analogy also explains well why
averaging is often misleading. One must take into
account background activity—not just a static background as suggested by optical imaging (Arieli and others 1996) but rather a continuously varying one,
especially in the α band (Ioannides and others 1998). If
the “beat” is overlooked, then the view across single trials appears noisy, but in reality, the smooth average is a
mirage produced by a sandwich of histories (Liu and
Ioannides 1996). The average captures well the first entry
into the primary sensory areas, but this is often weak.
Later activations appear noisy, but if the single trial
responses from one brain area are clustered into groups
of similar responses, (e.g., by the methods described in
Box 4), then the network structure that links the brain
area in a larger network of areas becomes apparent as the
linked responses from different nodes in this network are
revealed (Ioannides, Kostopoulos, and others 2002).
The response in an area can be influenced by input
other than external stimuli, as recently demonstrated by
a tactile discrimination experiment (Liu and others
2003). In this study, multidimensional scaling techniques were used to classify the activation of the primary
sensory cortex (S1) during electrical stimulation of the
right-hand digits 2, 3, and 4. The subjects were required
to estimate the frequency of a comparison stimulus
(stim2: 21–29 Hz) delivered after a standard stimulus
(stim1: 21 Hz). The results are summarized in Figure 8.
During the first half of stim2, (50–250 milliseconds after
stim2 onset), the points in the feature space describing
the S1 activity clustered according to the frequency
of stim2, but in the second half of the stimulation
(800–1000 milliseconds after stim2 onset), the clustering was also influenced by the subjects’ intended
response. Thus, the S1 activity was influenced by the
decision, presumably made in other areas, despite the
conflict with the ongoing stimulation.
Study of Large-Scale Networks
Neuroimaging data and invasive electrophysiology have
consistently shown that the brain activity for specialized
operations is segregated into distinct regions. The aim
of much contemporary research is to understand how a
Volume 12, Number 6, 2006
Fig. 8. Characterization of primary sensory cortex (S1)
response while a stimulus (stim2) is applied to fingers (2,
3, and 4) of the right hand (see text for details). The S1
activity following stim2 is displayed on the left for the
beginning of stimulation (50–250 milliseconds after stim2
onset) and on the right at the end of the stim2 period
(800–1000 milliseconds). In each case, the minimal spanning tree (MST) representation of the single-trial time
series is displayed (Laskaris and Ioannides 2001). The
MST shows the single-trial set as an ordered list, with
each node (symbol) representing the time series of one
single trial over a predefined latency range. An edge of
the MST connects nearby nodes, and it is an objective
representation of the similarity of the two single-trial time
courses associated with the nodes on either side of
the edge. The MST map in the left panel shows that at
the beginning of stimulation, the single-trial distribution is
concordant with the stimulus input. The MST map on the
right shows that by the end of stimulation, both stimulus
input and the subject’s perception influence the S1
activity. This is the first evidence from neuroimaging of
perception-related correlates in the activity of human S1.
complex task is first divided among segregated areas and
then how the output is integrated. We have applied tomographic analysis of MEG signals to this problem, focusing
much of our effort on two tasks that involved specialized
areas widely distributed in the brain, namely, saccadic eye
movements and the recognition of objects, particularly
faces and especially the emotional expression of faces.
We first summarize results for facial emotion processing
in normal and schizophrenic subjects.
Face and Facial Emotion Recognition
Electrophysiological recordings in animals (Desimone
and others 1984; Tanaka 1993) and human patients
(Allison and others 1994) have demonstrated that neurons in the ventral temporal cortex respond preferentially to classes of objects. Recent fMRI studies have
confirmed the object sensitivity of the ventral temporal
cortex and marked responsiveness to faces (Puce and
others 1995). In most subjects, fMRI statistical parametric maps contrasting faces and other objects highlight a
well-circumscribed region called the face fusiform
area (FFA; Kanwisher and others 1997). In the past
few years, many EEG and MEG studies have identified
THE NEUROSCIENTIST
537
activations between 100 and 200 milliseconds that show
some specificity to faces, and a negative component
N170 and its MEG analogue M170 have been widely
accepted as indices of early face processing. In some
studies, the signal from individual MEG sensors was
analyzed, focusing on sensors of interest (SOIs) that
showed face sensitivity (Liu and others 2002). In a
recent study, multidimensional scaling analysis was
applied to a number of sensitive sensors (Furey and
others 2006). In many recent EEG and MEG studies, the
N170, M170, and SOI peaks were associated with activity in the fusiform. As we will see below, although the
fusiform is definitely activated between 100 and 200
milliseconds, particularly with face stimuli, the MEG
(and by inference the EEG) reflect a network activity with
the fusiform one of the main hubs for some of the time.
Primates, and particularly humans, have evolved the
ability to recognize the facial expression of emotion on
another’s face because this is one of the skills most relevant to human communication and social cognition.
Studies with brain-lesioned patients, using EEG, MEG,
and particularly fMRI, have associated the amygdalae,
inferior frontal cortex, middle temporal cortex, FG,
and anterior cingulate with the neural network activated
during recognition of facial expressions across different
emotions (Sprengelmeyer and others 1998). Schizophrenic
patients show deficits in the recognition of facial expressions of emotion (Morrison and others 1988). During a
facial expression recognition task, schizophrenic subjects show reduced EEG activity in frontal electrodes
(Streit, Wolwer, and others 2001). Likewise, PET and
fMRI activations have consistently identified reduced
activity in brain areas known to be involved in facial
expression recognition (Andreasen and others 1997).
MFT analysis was used to study brain activity and connectivity during face and facial affect recognition tasks in
normal and schizophrenic subjects. The data were collected with two different MEG machines at the Juelich
Research Center, Germany. In parallel studies, we mapped
activity using either the average MEG signal, to connect
with the large number of earlier studies, or real-time data,
to gain a deeper understanding. Face stimuli evoked the
expected activations in visual and fusiform areas. Stronger
activations were found for emotional faces compared to
either neutral or blurred faces in several cortical and subcortical brain regions including the orbitofrontal cortex
and amygdalae (Streit and others 2003). The early studies
prepared the ground for the main study of the series. In
this study, the full-head BTi Magness hardware was used
to record the MEG signal from 15 partly remitted schizophrenic inpatients and 12 healthy controls. A nearly identical experimental protocol to that of our earlier studies
was used. The analysis of average MEG signals elicited
from the brain in response to facial emotions identified
weaker activations within a spatiotemporally well-defined
network of brain regions in schizophrenic patients (Streit,
Ioannides, and others 2001). These results were consistent
with earlier electrophysiological, fMRI, and PET studies
of patients and controls.
The single-trial analysis of the sets of MEG data produced new insights for both normal processing and the
538
THE NEUROSCIENTIST
way it fails in pathology. The earliest of two studies with
normal subjects used data from the BTi twin Magnes system (2 × 37 channels), which offered only partial coverage of the two hemispheres. In the next study, real-time
ROI activity was analyzed (Liu and others 1999). It
showed that all the object stimuli excited the areas studied, so any face specificity was a relative increase in the
fusiform rather than a qualitative change in activity.
Amygdala activation was found to vary according to emotion. Exactly the same experiment was repeated soon after
the first BTi whole-head helmet system (148 channels)
became available, initially with just one normal subject.
The single-trial data from this experiment were analyzed
extensively using post-MFT SPM and mutual information
(MI) analysis (Ioannides, Liu, Kwapien, and others 2000;
Ioannides 2001). Statistical parametric maps were computed, contrasting the responses elicited by face stimuli
with the responses elicited by the other five object categories. This is the same contrast as the one used in the
fMRI study that identified the FFA originally (Kanwisher
and others 1997). This post-MFT SPM analysis identified
a face-selective increase in activity in the fusiform
between 130 and 150 milliseconds after stimulus onset.
Lateral fusiform activity started as an activity in the anterior hippocampus, and amygdala activity diminished.
This lateral fusiform activity preceded and outlasted the
main FFA activity by about 10 milliseconds. The singletrial activations from the posterior calcarine cortex
(referred to here as V1/V2), the left and right FFA, and the
left and right amygdalae were used for the MI analysis.
We computed MI between each pair of areas using all
single-trial time series and contrasted the resulting MI
maps for different tasks (object or emotion recognition)
and for categories within each task. The MI analysis
showed that through feed-forward and feedback linkages,
the computational load associated with the task of identifying objects and emotions is spread across both space
(different ROIs and hemispheres) and time (different
latencies and delays in couplings between areas). Within
200 milliseconds, processing for different objects shows
different connectivity structure, beginning with right hemisphere V1/V2 and FG coupling. Processing of different
emotions shows different connectivity structure in the right
hemisphere FG and amygdala coupling, particularly at
latencies after 200 milliseconds (Ioannides, Liu, Kwapien,
and others 2000). In the main study, only right-handed
subjects were included, and the data from all were used for
the MFT analysis of the average data (already discussed
above). The data from seven normal and five schizophrenic subjects survived the tight selection criteria for the
single-trial analysis.
The single-trial analysis showed differences between
males and females, so the analysis was restricted to only
males: four normal and four schizophrenic subjects
(Ioannides, Poghosyan, and others 2004). The only new
brain area identified from the single-trial SPM that
showed a different pattern of activation between healthy
and schizophrenic individuals when responses to emotional and neutral faces were contrasted was the right
amygdala Specifically, the statistical parametric maps
showed a highly significant increase in right amygdala
Magnetoencephalography in Neuroscience
activity of patients for emotional faces during the first
100 ms after stimulus onset (Ioannides, Poghosyan, and
others 2004). More detailed inspection of the data
showed that the presentation of emotional faces in the
emotional face recognition task induced an irregular,
persistent, and sustained change in the right amygdala of
patients but not in control subjects. The detailed singletrial analysis showed that the reduced activations identified in the average MEG signal of schizophrenic
subjects was due to high variability across single trials
rather than reduced activity in each single trial. Finally,
in control subjects, measures of linkage demonstrated
distinct stages of processing of emotional faces within a
well-defined network of brain regions. Activity in each
node of the network, confined to 30- to 40-millisecond
latency windows, is linked to earlier and later activations
of other nodes in part of the overall network. In schizophrenic subjects, no such well-defined stages of processing were observed. Instead, the activations, although
strong, were poorly linked to each other, manifesting
only isolated links between pairs of areas (Ioannides,
Poghosyan, and others 2004). The most striking
result was a weak and early modulation of the right
amygdala between 30 and 50 milliseconds for the
emotion recognition runs of all controls, which led to
a modulation of V1 activity 40 milliseconds later
(Ioannides, Poghosyan, and others 2002). No such early
modulation and interaction between amygdala and V1
was identified in schizophrenic subjects. Early modulation of the amygdala has been demonstrated for fear
conditioning with auditory stimuli (Quirk and others
1995), and together with psychophysical and neuroimaging data, they suggest that a fast low road to the
amygdala might exist in the visual system. This modulation can influence the representation of emotional
events, especially when related to threat (Vuilleumier
2005). Our results are consistent with such a circuit as
well as with the timing of normal extraction of emotional content from visual information. They show that
the process is very fast, enough to influence early visual
processing and percept formation within 100 milliseconds of stimulus onset and thereby influence the following stages of processing. The overactive amygdalae in
schizophrenic patients and the absence of the early modulation suggest that a failure of this mechanism may
play an important role in schizophrenia.
How Fast Thinking Really Is
Recent studies at the cellular level have provided evidence for synchronous synaptic input to dendrites and
volleys of near-simultaneous action potentials. MEG
studies have also identified high-frequency oscillations
well above 200 Hz after averaging large numbers of
somatosensory-evoked responses (Haueisen and others
2001). Inspection of real-time MFT solutions shows transient events, lasting just a few milliseconds, which we
call MEG spikes. These events are ubiquitous in the brain
and are easy to explain away as noise; neither their power
nor their frequency changes much with task demands or
Volume 12, Number 6, 2006
stimulus properties. They are not, however, likely to be
noise because they often appear in quick succession in
task-relevant areas far from each other on the cortical
mantle (e.g., left and right frontal eye fields in saccadic
tasks). We designed an experiment to investigate MEG
spikes and their role in planning, preparation, and execution or inhibition of saccades (Ioannides and others
2005). The saccadic task was specified by either a single
visual cue or a sequence of cues, each providing partial
information. We used the highest sampling rate (2 kHz)
available with our hardware. Tomographic analysis
of real-time MEG data identified MEG spikes that were
widely distributed across the cortex, cerebellum, and
brain stem during cue presentations and saccades. As
expected, stimulus properties and task demands did not
change either their frequency or strength. More detailed
analysis, however, showed that stimulus properties and
task demands influenced the distribution of directions of
the MEG-spike current-density vector and the fine temporal organization across brain areas. The results showed
that very quickly after the onset of a visual cue providing
relevant information for an impending saccade, brain
activity changed accordingly and competing motor programs for yet undecided future actions were activated.
These motor programs were maintained until cues with
new information resolved the uncertainty. MI analysis
showed further that the MEG spikes were organized into
feed-forward and corollary discharge sequences that
could, when combined with the slower activity-linked
processing in discrete brain areas over long periods,
lasting hundreds of milliseconds.
Oscillatory activity provides a good candidate for
linking MEG spike activity across time. To test this idea,
we measured the MEG signal while subjects relaxed with
eyes closed, opened their eyes, and fixated on a cross
in front of them. We have shown earlier in this review
(Fig. 3) some of the data and the SOBI analysis for identifying and eliminating the large artifacts. From each one
of the three conditions, six segments of 4-second MEG
data were analyzed with MFT. Endogenously generated
organization (EGO) analysis was applied to these segments, identifying and aligning MEG spikes in the left
and right FG. The aligned MFT solutions for each condition and ROI were averaged. The activation curves for the
left and right fusiform ROIs were computed from each
MEG-spike-triggered average. The results are displayed
in Figure 9. Low-pass filtering of the data at less than 40
Hz (Fig. 9A) shows clear evidence that MEG spikes ride
on the crest of oscillations in the α band and that the
baseline level of each condition is different. The eyesopen condition shows little evidence for oscillations, and
its baseline level is between that of the other two conditions. The very transient nature of the MEG spikes is difficult to see in the raw MEG signal (Fig. 9B), so the raw
signal is displayed on two zoomed ranges (after baseline
subtraction) in Figures 9C and D. The alignment according to MEG spikes of the fusiform of one hemisphere
shows no evidence for MEG spikes in the fusiform of the
other hemisphere and no oscillations (except possibly for
the eyes-closed condition).
THE NEUROSCIENTIST
539
Fig. 9. Endogenously generated organization
(EGO) analysis of the 4-minute data of Figure 3. The
single-trial magnetic field tomography (MFT) solutions were averaged after alignment to magnetoencephalography (MEG) spikes for 250 milliseconds on
either side of each MEG spike. Separate MEGspike-triggered averaging was performed for the
eyes-closed, eyes-open, and fixate conditions.
Activation curves were then computed for regions of
interest (ROIs) in the left and right fusiform from each
average. A, The raw MEG-spike-triggered averages
after low-pass filtering at 40 Hz. B, The raw MEGspike-triggered averages. C, Zoomed view (–50
to +50 milliseconds) of the raw MEG-spiketriggered averages after baseline removal (–200 to
–100 milliseconds). D, Zooming further on the MEG
spike, showing just 5 milliseconds on either side
(baseline removed as in c). FG = fusiform gyrus. In
each part of the figure (A, B, C, and D) the top and
bottom rows show results after EGO alignment of
MEG spikes of the left and right FG, respectively. The
left and right columns respectively show the resulting
average timecourses for the left and right FG.
540
THE NEUROSCIENTIST
Magnetoencephalography in Neuroscience
The New View of Brain Function
Conclusion and Outlook
The results of real-time tomographic analysis of MEG
signals paint a very different view of brain function than
the one that is implied by the conventional results of
averaging and heavy filtering of data (Fig. 10). In the
old view, a stimulus sets in motion a sequence of activations in different brain areas that tends to propagate
every few tens of milliseconds from one area to the next.
Any background rhythms are just uninteresting noise
that must be eliminated. The new view is rather different: Because the cortex is always active, any stimulusevoked effect must be seen as a perturbation of ongoing
activity in many brain areas. To understand the influence
of the stimulus on the activity of one area, or even on a
primary sensory area, the interaction between the effect
of the stimulus and the local background activity must
be taken into account together with indirect stimulusevoked effects mediated by other areas that can very
quickly reach even primary sensory areas. We have
already described results showing that within 100 milliseconds, the processing in V1 is modulated by attention (Poghosyan and others 2005) and activity from the
fusiform (Liu and Ioannides 2006) and amygdala
(Ioannides, Poghosyan, and others 2002).
The effect oscillations in the α band have been encountered every time the single-trial activity in an area was
organized into similar patterns, either by exploratory data
analysis or EGO analysis. Exploratory data analysis has
shown that much of the energy in the MEG signal is due
to oscillations of generators in polymodal areas that guide
the effect of the stimulus in the primary sensory areas
(Laskaris and Ioannides 2001; Laskaris and others 2003).
Figure 9 shows that MEG spikes are bunched at the peaks
of local oscillations in the α band. If MEG spikes are a
manifestation of highly synchronous axon potentials, as
already suggested (Ioannides and others 2005), then their
association with the α band oscillations assumes greater
significance because it offers a possible noninvasive window into mechanisms for working memory and attention
that have, until now, been studied only in animal experiments (Fries and others 2001; Lee and others 2005).
An earlier study showed that eliminating stimulusevoked responses from single trials in auditory, linguistic, and GO/NOGO experiments left an oscillatory
activity with a clear peak in the α range. This α oscillation changed consistently with training, suggesting that
as the subject becomes familiar with the task, the activity in widespread brain areas participates in the processing, including areas not originally involved (Ioannides
and others 1998). This interpretation is consistent with
MI analysis of the single-trial data. For example, the MI
analysis of the face and face-affect recognition data
showed that a complex task is tackled in the brain by
dividing the workload across areas and time. The apparent randomness of the trial-to-trial variability becomes a
manifestation of the high-level organization of stages of
processing.
The challenge for the future is to understand the neuronal basis of this new, highly dynamic view of brain
function. In particular, we would like to understand how
transient events such as MEG spikes are generated, how
they are organized, how they relate to neuronal properties (fluctuations in membrane potential and up and
down states, gap junctions, etc.), and how they are modified in pathology. Clearly there is a need to combine the
results of real-time MFT analysis with other methods.
The popular ways of restricting MEG solutions to fMRI
foci of activity will not help much, however, because
events mapped by MEG may simply not scale up to the
time scales of fMRI. The MRI family can, however, be
invaluable in other ways. Anatomical information from
sMRI coupled with probabilistic cytoarchitectonic maps
(Barnikol and others 2006) can provide detail for individual subjects that can push the MFT resolution further,
possibly to the point that functional units can be mapped
within specialized areas. A most exciting prospect for
the future is the true combination of the diffusion tensor
(DT)–MRI family with MEG. Conventional DT-MRI
can provide information about connectivity and thus link
with the functional information from mutual information
analysis of MFT solutions. If functional DT-MRI breaks
through the 1-second barrier for temporal resolution, it
can provide tomographic maps of activity that can be
combined with MEG maps to better describe events in
roughly similar time scales with each technique. In conclusion, real-time tomographic analysis of MEG data,
together with other new neuroimaging tools, can help us
better understand how our consciousness is founded on
dances of fleeting activations across the entire brain. Our
moment-to-moment consciousness is shielded from this
never-ending avalanche of activations that would otherwise overwhelm us, but our mental stability may in the
end rest on their flawless operations.
Volume 12, Number 6, 2006
Acknowledgments
The work on face processing was initiated through a collaboration with the late Marcus Streit of Düsseldorf
University, and the first experiments were conducted at the
Institute of Medicine, Research Center Jülich, Germany.
The bulk of the analysis of the face data and all other studies was completed at the Laboratory for Human Brain
Dynamics (LHBD), Brain Science Institute (BSI), RIKEN,
Japan. The contribution of LHBD members is acknowledged, with special thanks to Lichan Liu, Vahe Poghosyan,
Peter Fenwick, and Nikos Laskaris. Collaborations within
BSI are also acknowledged for the fMRI/MEG study with
Keiji Tanaka, Allen Waggoner, and Kang Cheng (who also
provided the fMRI image in Fig. 1) and for the occlusion
study with Cees van Leeuwen and Gijs Plomp. Finally,
I thank Daniel Palomo, Mari Aoki, Yuka Okazaki, Afiza
Abu Bakar, and Christos Papadelis for help during the
preparation of the article.
THE NEUROSCIENTIST
541
Fig. 10. A, A view of brain function consistent
with averaging. The response to be analyzed is not
influenced by background brain activity. The influence of a stimulus excites a dormant primary area
(PA). B, A view of brain function more consistent
with the results of real-time tomographic analysis
of magnetoencephalography (MEG) data. The
brain is always active, and any new stimulus must
be seen as a disturbance of ongoing activity that
could influence one of many interacting networks as
it invades and integrates with background activity.
Even early activation of primary sensory areas may
be strongly modulated by ongoing activity or by
early, automatic, and largely unconscious processing of the stimulus. C, Activity evoked by the stimulus and endogenous activity interact over different
time scales, which can be as fast as a few milliseconds (e.g., MEG spikes) or state-dependent effects
lasting many seconds (e.g., background rhythms
depending on whether the subject has his or her
eyes open, closed, or fixating). IC stands for independent component.
542
THE NEUROSCIENTIST
Magnetoencephalography in Neuroscience
References
Allison T, McCarthy G, Nobre A, Puce A, Belger A. 1994. Human
extrastriate visual-cortex and the perception of faces, words, numbers, and colors. Cereb Cortex 4:544–54.
Andreasen NC, Oleary DS, Flaum M, Nopoulos P, Watkins GL,
Ponto LLB, and others. 1997. Hypofrontality in schizophrenia: distributed dysfunctional circuits in neuroleptic-naive patients. Lancet
349:1730–4.
Arieli A, Sterkin A, Grinvald A, Aertsen A. 1996. Dynamics of ongoing activity: explanation of the large variability in evoked cortical
responses. Science 273:1868–71.
Barnikol UB, Amunts K, Dammers J, Mohlberg H, Fieseler T,
Malikovic A, and others. 2006. Pattern reversal visual evoked
responses of V1/V2 and V5/MT as revealed by MEG combined
with probabilistic cytoarchitectonic maps. Neuroimage 31:86–108.
Cheng K, Waggoner RA, Tanaka K. 2001. Human ocular dominance
columns as revealed by high-field functional magnetic resonance
imaging. Neuron 32:359–74.
Corbetta M, Kincade JM, Ollinger JM, McAvoy MP, Shulman GL.
2000. Voluntary orienting is dissociated from target detection in
human posterior parietal cortex. Nat Neurosci 3:292–7.
Desimone R, Albright TD, Gross CG, Bruce C. 1984. Stimulus-selective
properties of inferior temporal neurons in the macaque. J Neurosci
4:2051–62.
Di Russo F, Martinez A, Sereno MI, Pitzalis S, Hillyard SA. 2002.
Cortical sources of the early components of the visual evoked
potential. Hum Brain Mapp 15:95–111.
Fries P, Reynolds JH, Rorie AE, Desimone R. 2001. Modulation of
oscillatory neuronal synchronization by selective visual attention.
Science 291:1560–3.
Furey ML, Tanskanen T, Beauchamp MS, Avikainen S, Uutela K, Hari R,
and others. 2006. Dissociation of face-selective cortical responses by
attention. Proc Natl Acad Sci U S A 103:1065–70.
Hamalainen M, Hari R, Ilmoniemi RJ, Knuutila J, Lounasmaa OV. 1993.
Magnetoencephalography: theory, instrumentation, and applications
to noninvasive studies of the working human brain. Reviews of
Modern Physics 65:413–97.
Haueisen J, Schack B, Meier T, Curio G, Okada Y. 2001. Multiplicity
in the high-frequency signals during the short-latency somatosensory evoked cortical activity in humans. Clin Neurophysiol
112:1316–25.
Hironaga N, Ioannides AA. 2002. Accurate co-registration for MEG
reconstructions. In: Nowak H, Haueisen J, GieBler F, Huonker R,
editors. Proceedings of the 13th international conference on biomagnetism. Berlin: Verlag. p 931–3.
Ioannides AA. 1987. Graphical solutions and representations for the
biomagnetic inverse problem. 1. Orlando (FL): Academic Press.
p 205–16.
Ioannides AA. 1994. Estimates of brain activity using magnetic field
tomography and large scale communication within the brain. In:
Wan H-M, Popp F-A, Warnke U, editors. Bioelectrodynamics and
biocommunication. Singapore: World Scientific. p 319–53.
Ioannides AA. 2001. Real time human brain function: observations
and inferences from single trial analysis of magnetoencephalographic signals. Clin Electroencephalogr 32:98–111.
Ioannides AA, Bolton JPR, Clarke CJS. 1990. Continuous probabilistic solutions to the biomagnetic inverse problem. Inverse Probl
6:523–42.
Ioannides AA, Corsi-Cabrera M, Fenwick PBC, Portilla YD, Laskaris
NA, Khurshudyan, and others. 2004. MEG tomography of human
cortex and brainstem activity in waking and REM sleep saccades.
Cereb Cortex 14:56–72.
Ioannides AA, Fenwick PB. 2005. Imaging cerebellum activity in real
time with magnetoencephalographic data. Prog Brain Res
148:139–50.
Ioannides AA, Fenwick PBC, Liu LC. 2005. Widely distributed magnetoencephalography spikes related to the planning and execution
of human saccades. J Neurosci 25:7950–67.
Ioannides AA, Kostopoulos GK, Laskaris NA, Liu LC, Shibata T,
Schellens M, and others. 2002. Timing and connectivity in the
human somatosensory cortex from single trial mass electrical
activity. Hum Brain Mapp 15:231–46.
Volume 12, Number 6, 2006
Ioannides AA, Liu LC, Kwapien J, Drozdz S, Streit M. 2000. Coupling
of regional activations in a human brain during an object and face
affect recognition task. Hum Brain Mapp 11:77–92.
Ioannides AA, Liu LC, Theofilou D, Dammers J, Burne T, Ambler T,
and others. 2000. Real time processing of affective and cognitive
stimuli in the human brain extracted from MEG signals. Brain
Topogr 13:11–9.
Ioannides AA, Poghosyan V, Dammers R, Streit M. 2004. Real-time
neural activity and connectivity in healthy individuals and schizophrenia patients. Neuroimage 23:473–82.
Ioannides AA, Poghosyan V, Liu LC, Streit M. 2002. Early amygdala
activations in normal and schizophrenic subjects. Society for
Neuroscience Abstracts. p 521.5.
Ioannides AA, Taylor JG. 1999. Minimum norm, magnetic field
tomography and FOCUSS. In: Yoshimoto T, Kotani M, Kuriki S,
Karibe H, Nakasato N, editors. Recent advances in biomagnetism.
Sendai (Japan): Tohoku University Press. p 228–31.
Ioannides AA, Taylor JG, Liu LC, Gross J, Muller-Gartner HW. 1998.
The influence of stimulus properties, complexity, and contingency
on the stability and variability of ongoing and evoked activity in
human auditory cortex. Neuroimage 8:149–62.
Kanwisher N, McDermott J, Chun MM. 1997. The fusiform face area:
a module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302–11.
Kastner S, Ungerleider LG. 2000. Mechanisms of visual attention in
the human cortex. Annu Rev Neurosci 23:315–41.
Kwong KK, Belliveau JW, Chesler DA, Goldberg IE, Weisskoff RM,
Poncelet BP, and others. 1992. Dynamic magnetic-resonanceimaging of human brain activity during primary sensory stimulation. Proc Natl Acad Sci U S A 89:5675–9.
Laskaris NA, Fotopoulos S, Ioannides AA. 2004. Mining information
from event-related recordings: a user-friendly framework for intelligent single-trial analysis of multichannel encephalographic recordings. IEEE Signal Processing Magazine 21:66–77.
Laskaris NA, Ioannides AA. 2001. Exploratory data analysis of
evoked response single trials based on minimal spanning tree. Clin
Neurophysiol 112:698–712.
Laskaris NA, Ioannides AA. 2002. Semantic geodesic maps: a unifying geometrical approach for studying the structure and dynamics
of single trial evoked responses. Clin Neurophysiol 113:1209–26.
Laskaris NA, Liu LC, Ioannides AA. 2003. Single-trial variability in
early visual neuromagnetic responses: an explorative study based
on the regional activation contributing to the N70m peak.
Neuroimage 20:765–83.
Leahy RM, Mosher JC, Spencer ME, Huang MX, Lewine JD. 1998. A
study of dipole localization accuracy for MEG and EEC using a
human skull phantom. Electroencephalogr Clin Neurophysiol
107:159–73.
Le Bihan D, Mangin JF, Poupon C, Clark CA, Pappata S, Molko N,
and others. 2001. Diffusion tensor imaging: concepts and applications. J Magn Res Imaging 13:534–46.
Le Bihan D, Urayama S, Aso T, Hanakawa T, Fukuyama H. 2006.
Direct and fast detection of neuronal activation in the human brain
with diffusion MRI. Proc Natl Acad Sci U S A 103:8263–8.
Lee H, Simpson GV, Logothetis NK, Rainer G. 2005. Phase locking of
single neuron activity to theta oscillations during working memory
in monkey extrastriate visual cortex. Neuron 45:147–56.
Liu LC, Fenwick PB, Laskaris NA, Schellens M, Poghosyan V,
Shibata T, and others. 2003. The human primary somatosensory
cortex response contains components related to stimulus frequency
and perception in a frequency discrimination task. Neuroscience
121:141–54.
Liu J, Harris A, Kanwisher N. 2002. Stages of processing in face perception: an MEG study. Nat Neurosci 5:910–6.
Liu LC, Ioannides AA. 1996. A correlation study of averaged and single trial MEG signals: the average describes multiple histories each
in a different set of single trials. Brain Topogr 8:385–96.
Liu LC, Ioannides AA. 2006. Spatiotemporal dynamics and connectivity pattern differences between centrally and peripherally presented faces. Neuroimage 31:1726–40.
Liu LC, Ioannides AA, Muller-Gartner HW. 1998. Bi-hemispheric
study of single trial MEG signals of the human auditory cortex.
Electroencephalogr Clin Neurophysiol 106:64–78.
THE NEUROSCIENTIST
543
Liu LC, Ioannides AA, Streit M. 1999. Single trial analysis of neurophysiological correlates of the recognition of complex objects and
facial expressions of emotion. Brain Topogr 11:291–303.
Liu LC, Plomp G, van Leeuwen C, Ioannides AA. 2006. Neural correlates of priming on occluded figure interpretation in human
fusiform cortex. Neuroscience 141:1585–97.
Makela JP, Ahonen A, Hämäläinen M, Hari R, Ilmoniemi R, Kajola M,
Knuutila J, and others. 1993. Functional differences between auditory cortices of the two hemispheres revealed by whole-head neuromagnetic recordings. Hum Brain Mapp 1:48–56.
Moradi F, Liu LC, Cheng K, Waggoner RA, Tanaka K, Ioannides AA.
2003. Consistent and precise localization of brain activity in human
primary visual cortex by MEG and fMRI. Neuroimage 18:595–609.
Morrison RL, Bellack AS, Mueser KT. 1988. Deficits in facial-affect
recognition and schizophrenia. Schizophr Bull 14:67–83.
Noesselt T, Hillyard SA, Woldorff MG, Schoenfeld A, Hagner T,
Jancke L, and others. 2002. Delayed striate cortical activation during spatial attention. Neuron 35:575–87.
Ogawa S, Tank DW, Menon R, Ellermann JM, Kim SG, Merkle H,
and others. 1992. Intrinsic signal changes accompanying sensory
stimulation—functional brain mapping with magnetic-resonanceimaging. Proc Natl Acad Sci U S A 89:5951–5.
Plomp G, Liu LC, van Leeuwen C, Ioannides AA. 2006. The “mosaic
stage” in amodal completion as characterized by MEG responses.
J Cogn Neurosci 2006;18:1394–405.
Poghosyan V, Shibata T, Ioannides AA. 2005. Effects of attention and
arousal on early responses in striate cortex. Eur J Neurosci 22:225–34.
Posner MI, Raichle ME, editors. 1994. Images of mind. New York:
Scientific American Library.
Puce A, Allison T, Gore JC, Mccarthy G. 1995. Face-sensitive regions
in human extrastriate cortex studied by functional MRI. J
Neurophysiol 74:1192–9.
Quirk GJ, Repa JC, Ledoux JE. 1995. Fear conditioning enhances
short-latency auditory responses of lateral amygdala neurons—
parallel recordings in the freely behaving rat. Neuron 15:1029–39.
544
THE NEUROSCIENTIST
Sams M, Hietanen JK, Hari R, Ilmoniemi RJ, Lounasmaa OV. 1997.
Face-specific responses from the human inferior occipito-temporal
cortex. Neuroscience 77:49–55.
Sprengelmeyer R, Rausch M, Eysel UT, Przuntek H. 1998. Neural
structures associated with recognition of facial expressions of basic
emotions. Proc R Soc Lond B Biol Sci 265:1927–31.
Streit M, Dammers J, Simsek-Kraues S, Brinkmeyer J, Wolver W,
Ioannides A. 2003. Time course of regional brain activations during
facial emotion recognition in humans. Neurosci Lett 342:101–4.
Streit M, Ioannides A, Sinnemann T, Wolwer W, Dammers J, Zilles K, and
others. 2001. Disturbed facial affect recognition in patients with schizophrenia associated with hypoactivity in distributed brain regions: a
magnetoencephalographic study. Am J Psychiatr 158:1429–36.
Streit M, Wolwer W, Brinkmeyer J, Ihl R, Gaebel W. 2001. EEGcorrelates of facial affect recognition and categorisation of blurred
faces in schizophrenic patients and healthy volunteers. Schizophr
Res 49:145–55.
Talairach J, Tournoux P, editors. 1988. Co-planar stereotaxic atlas of
the human brain. Stuttgart (Germany): G. Thieme.
Tanaka K. 1993. Neuronal mechanisms of object recognition. Science
262:685–8.
Tang AC. 2002. Independent components of magnetoencephalography: localization. Neural Comput 14:1827–58.
Taylor JG, Ioannides AA, Muller-Gartner HW. 1999. Mathematical
analysis of lead field expansions. IEEE Trans Med Imaging
18:151–63.
Tzelepi A, Ioannides AA, Poghosyan V. 2001. Early (N70m) neuromagnetic signal topography and striate and extrastriate generators following pattern onset quadrant stimulation. Neuroimage 13:702–18.
von Helmholtz H. 1853. ber einige Gesetze der Vertheilung elektrischer Stroéme in koéperlichen Leitern, mit Anwendung auf
die thierisch-elektrischen Versuche. Ann Phys Chem 89:211–33,
353–77.
Vuilleumier P. 2005. How brains beware: neural mechanisms of emotional attention. Trends Cogn Sci 9:585–94.
Magnetoencephalography in Neuroscience