Linking the Brain with Behavior: The Neural Dynamics
of Success and Failure in Goal-directed Behavior
Amanda K. Robinson1,2
, Anina N. Rich1, and Alexandra Woolgar1,3
Abstrakt
■ The human brain is extremely flexible and capable of rapidly
selecting relevant information in accordance with task goals.
Regions of frontoparietal cortex flexibly represent relevant task
information such as task rules and stimulus features when par-
ticipants perform tasks successfully, but less is known about
how information processing breaks down when participants
make mistakes. This is important for understanding whether
and when information coding recorded with neuroimaging is
directly meaningful for behavior. Hier, we used magnetoen-
cephalography to assess the temporal dynamics of information
processing and linked neural responses with goal-directed
behavior by analyzing how they changed on behavioral error.
Participants performed a difficult stimulus–response task using
two stimulus–response mapping rules. We used time-resolved
multivariate pattern analysis to characterize the progression of
information coding from perceptual information about the
stimulus, cue and rule coding, and finally, motor response.
Response-aligned analyses revealed a ramping up of perceptual
information before a correct response, suggestive of internal
evidence accumulation. Auffallend, when participants made a
stimulus-related error, and not when they made other types
of errors, patterns of activity initially reflected the stimulus
vorgeführt, but later reversed, and accumulated toward a repre-
sentation of the “incorrect” stimulus. This suggests that the
patterns recorded at later time points reflect an internally gen-
erated stimulus representation that was used to make the
(incorrect) Entscheidung. These results illustrate the orderly and
overlapping temporal dynamics of information coding in per-
ceptual decision-making and show a clear link between neural
patterns in the late stages of processing and behavior. ■
EINFÜHRUNG
A primary function of the human brain is to flexibly
respond to relevant perceptual information in accordance
with current context and task goals. The sound of a phone
ringing, Zum Beispiel, should prompt a different response if
it is your phone than if it belongs to someone else. This set
of complex processes, termed cognitive control, involves
interpreting incoming information given the current con-
text to determine an appropriate action (Posner & Presti,
1987; Posner & Snyder, 1975). Cognitive control involves
dynamic information exchange at different levels of pro-
Abschließen, from perceptual information processing to
decision-making and response selection. Understanding
how these different processes unfold could provide a great
deal of insight into how the brain achieves goal-directed
behavior.
A large body of neuroimaging research implicates fron-
toparietal brain regions in goal-directed behavior, welche
form a distributed network responsible for cognitive
Kontrolle (Duncan, 2010). This multiple-demand (MD)
Netzwerk (Duncan, 2010), elsewhere referred to as the
cognitive control network (Cole & Schneider, 2007),
frontoparietal control system ( Vincent, Kahn, Snyder,
Rachel, & Buckner, 2008), or task-positive network (Fuchs
1Macquarie University, 2The University of Sydney, 3Universität
Cambridge
et al., 2005), appears to flexibly represent different types
of information depending on task context. Zum Beispiel,
activity in these regions encodes task rules (z.B., Crittenden,
Mitchell, & Duncan, 2016; Woolgar, Afshar, Williams &
Reich, 2015; Woolgar, Hampshire, Thompson, & Duncan,
2011) and auditory, visuell, and tactile stimulus features
(Long & Kuhl, 2018; Bracci, Daniels, & Op de Beeck, 2017;
Jackson, Reich, Williams, & Woolgar, 2017; Woolgar & Zopf,
2017; für eine Rezension, see Woolgar, Jackson, & Duncan, 2016).
These regions particularly encode task elements that are
demanding (Woolgar, Afshar, et al., 2015; Woolgar et al.,
2011) or at the focus of attention (Jackson & Woolgar, 2018;
Jackson et al., 2017; Woolgar, Williams, et al., 2015). Activity in
some of these regions has also been causally implicated in
selectively facilitating coding of task-relevant information
(Jackson, Feredoes, Reich, Lindner, & Woolgar, 2021). Das
lends support to the possibility that flexible responses within
the MD regions play a causal role in goal-directed behavior
(z.B., Duncan, Assem, & Shashidhara, 2020; Woolgar,
Dermody, Afshar, Williams, & Reich, 2019; Woolgar, Duncan,
Manes, & Fedorenko, 2018; Woolgar et al., 2010).
A characteristic feature of cognitive control is that it
dynamically changes in response to task-relevant informa-
tion. Research using fMRI has yielded insight into the
brain networks involved in goal-directed behavior, Aber
the slow nature of the blood-oxygen-level response has
limited the exploration of the corresponding dynamics.
© 2022 Massachusetts Institute of Technology. Veröffentlicht unter
eine Creative-Commons-Namensnennung 4.0 International (CC BY 4.0) Lizenz.
Zeitschrift für kognitive Neurowissenschaften 34:4, S. 639–654
https://doi.org/10.1162/jocn_a_01818
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
e
D
u
/
J
/
Ö
C
N
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
J
Ö
C
N
_
A
_
0
1
8
1
8
P
D
.
F
B
j
G
u
e
S
T
T
Ö
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
Time-resolved neuroimaging methods such as magneto-
encephalography (MEG) and EEG have been more fruitful
in understanding how cognitive control unfolds over time
(für eine Rezension, see Gratton, Cooper, Fabiani, Fuhrmann, &
Karayanidis, 2017). Zum Beispiel, conflict-related process-
ing involving incongruent task features elicits a larger
evoked response than a congruent condition approxi-
mately 200–400 msec after stimulus onset, which has been
linked to activity within the anterior cingulate (Folstein &
Van Petten, 2008), and task-switching involves a larger
parietal positivity around 300 msec relative to task repeats
(Karayanidis et al., 2010). The newer method of multivar-
iate pattern analysis (MVPA) in conjunction with MEG/EEG
allows further insight into processing dynamics underly-
ing cognitive control. MVPA uses pattern classification
approaches applied to neuroimaging data to show what
information is being coded within the brain (Haxby,
2012; Haxby et al., 2001). Time-resolved MVPA has been
used to characterize how information coding changes over
Zeit (Hebart & Bäcker, 2018; Carlson, Hogendoorn, Kanai,
Mesik, & Turret, 2011). Zum Beispiel, Hebart, Bankson,
Harel, Bäcker, and Cichy (2018) had participants perform
different tasks on visual object stimuli while measuring
MEG and showed that task-relevant object features were
enhanced at late stages of processing, mehr als 500 ms
after the stimulus was presented. Other work has shown
clear progression of task-relevant information during com-
plex tasks, with different dynamics for features such as
stimulus, Aufgabe, und Reaktion (Kikumoto & Mayr, 2020;
Hubbard, Kikumoto, & Mayr, 2019; Wen, Duncan, &
Mitchell, 2019). This line of research has also highlighted
the importance of combining relevant task information for
successful behavior (Kikumoto & Mayr, 2020). Diese
MVPA studies provided great insight into the neural
dynamics of goal-directed behavior, but all used designs
where the task cue was presented before the target, erlauben-
ing participants to prepare for the task in advance. In ADDI-
tion, these studies focused on stimulus-aligned neural
responses. It seems likely that tracking the dynamic cod-
ing of relevant task features relative to both stimulus onset
und Reaktion, using a task that induces more flexible
behavior, might elucidate stronger links between dynamic
neural responses and goal-directed behavior.
Decades of neuroimaging research have focused on the
neural correlates of behavior, but assessing whether
particular patterns of brain activity are necessary for
behavior has presented a challenge. In MVPA, a classifier
algorithm is trained to distinguish between conditions
using patterns of neural data from multiple trials of each
condition. If a classifier can predict the conditions of
new neural data better than chance, this demonstrates that
the patterns of activity in the data must contain, or repre-
sent, information about the different conditions. Wie-
immer, the conclusion that decodable patterns represent
information has been questioned on theoretical grounds
(de Wit, Alexander, Ekroll, & Wagemans, 2016): Nur
because information is decodable using machine learning
does not necessarily mean it is used by the brain to gener-
ate behavior. This awareness has led researchers to push
for more explicit links between MVPA patterns and behav-
ior, Zum Beispiel, comparing details of patterns with RTs or
accumulation rates in models of behavior (Grootswagers,
Cichy, & Carlson, 2018; Ritchie & Carlson, 2016; Ritchie,
Tovar, & Carlson, 2015).
Exploring how information coding changes when par-
ticipants make errors is another way to establish how
behaviorally meaningful patterns of activation are. Für
Beispiel, Williams, Dang, and Kanwisher (2007) Dämon-
strated that multivariate fMRI patterns in lateral occipital
Kortex, but not those in early visual regions, reduced to
chance when participants made errors on a shape discrim-
ination task, indicating that patterns in early visual cortex
were not directly read out in behavior. In another study,
participants performed a scene classification task
( Walther, Caddigan, Fei-Fei, & Beck, 2009), and classifier
prediction error patterns correlated with the types of
errors in behavior within high-level object and scene-
specific brain regions, but not within early visual cortex.
Using MEG, we have recently shown that this logic can
even be used to predict behavioral errors before they
geschehen (Karimi-Rouzbahani, Woolgar, & Reich, 2021).
A stronger requirement for a behaviorally meaningful
pattern of activity is that it should not only change on error
but also change to something that predicts the particular
error to be made (Woolgar et al., 2019). We tested this in
fMRI and found that patterns of activation in frontoparie-
tal cortex indeed reversed on error, such that patterns of
activation on error trials represented information that was
not presented to the participant, in a manner that was
diagnostic of the particular behavioral error they made
( Woolgar et al., 2019). In that study, participants per-
formed a difficult response-mapping task. When partici-
pants made a rule error, MD patterns of activity reflected
the incorrect rule, and when participants made other
Fehler, MD patterns of activity reflected the incorrect
stimulus ( Woolgar et al., 2019). Within visual cortex, In
Kontrast, there was no evidence of relevant information
(correct or incorrect) during errors. Daher, some multivar-
iate patterns appear to be more directly relatable to
behavior that others, and there is a tight link between
frontoparietal activity patterns and behavioral outcome.
In the current study, we used MEG and MVPA to exam-
ine the dynamics of this effect, asking whether information
coding through the course of a trial was equally associated
with behavior. We aimed to (1) characterize the neural
dynamics of multiple types of task-relevant information
Und (2) examine their relationship to behavior over time.
Participants performed a difficult response-mapping task
that required different responses to a target stimulus
depending on the current rule. To determine what aspects
of this representation could be directly linked to behavior,
we examined information coding on incorrect trials:
when the wrong rule was applied or when there were
errors in perception. We found a clear progression in
640
Zeitschrift für kognitive Neurowissenschaften
Volumen 34, Nummer 4
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
e
D
u
/
J
/
Ö
C
N
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
J
Ö
C
N
_
A
_
0
1
8
1
8
P
D
.
F
B
j
G
u
e
S
T
T
Ö
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
onset of information coding, such that stimulus features
are evident shortly after stimulus onset, followed by
abstract rule coding and then the response, mit dem
information about each task feature accumulating up to
the time of response. When participants made stimulus
Fehler, stimulus information was initially coded veridically
but later accumulated in the opposite direction, toward a
representation of the incorrect stimulus. Im Gegensatz,
stimulus information was encoded correctly when partici-
pants made rule errors. The data reveal the dynamics with
which information coding in the brain can be tightly
linked to participant behavior.
METHODEN
All code and materials are available on the Open Science
Project at https://osf.io/2nwhr/.
Teilnehmer
Participants were 22 healthy adults (14 Frauen, eight
men; age range: 18–38 years) with normal or corrected-
to-normal vision recruited from Macquarie University.
This study was approved by the Macquarie University
ethics committee, and informed consent was obtained
from all participants. Participants took part in two ses-
sionen: a 1-hr behavioral session and a 2-hr MEG session,
on separate days. They were compensated $15 for the behavioral session and $40 for the MEG session. Für
two participants, initial photodiode inaccuracies meant
that the timing for two and five trials, jeweils, War
not adequately marked, so these trials were excluded
from analyses. Data from an additional two participants
(two men) were collected and excluded: Both participants
had very few stimulus position errors during the MEG ses-
sion (<10), and for one of the participants, there was a
recording error such that MEG data were recorded for
only 680 of 800 trials.
Design and Procedure
Participants learned to apply two difficult response-
mapping rules regarding the position of a target stimulus.
The target was a gray square approximately 2° × 2° of
visual angle that appeared in one of four positions. All
positions were equidistant from fixation at an eccentricity
of 4° of visual angle. Within the left and right visual fields,
the two possible target locations overlapped by 60% hori-
zontally and 65% vertically to create a high degree of posi-
tion uncertainty (Figure 1A). Participants had to respond
to the position of the stimulus using two possible
response-mapping rules (Figure 1A). The two rules each
comprised four unique position transformations and were
mirror images of each other. The color of a central fixation
square acted as a cue for the rule. There were two cues per
rule, to dissociate neural responses to cues from the
neural responses to rules (e.g., blue and yellow = Rule
1, pink and green = Rule 2; counterbalanced across partic-
ipants). Participants responded by pressing one of four
response keys with their right hand. The stimuli were pre-
sented using PsychToolbox in MATLAB (The MathWorks).
The stimulus–response rule mappings were designed to
distinguish correct responses and specific types of errors
(Figure 1C). An error was considered a “rule error” when
the button press response reflected the combination of
the correct stimulus position with the wrong rule. In con-
trast, a “stimulus error” was defined as a button press
response consistent with the combination of the adjacent
perceptually confusable position with the correct rule. For
example, under Rule 1, if the stimulus appeared on the far
left, the correct response would be Button 4, a rule error
(i.e., using Rule 2 applied to the correct position) would
lead to a Button 3 response, a stimulus error (i.e., using
Rule 1 correctly but confusing the stimulus with the
other left position) would lead to a Button 1 response,
and confusing both the rule and the stimulus led to a
Button 2 response.
Training Session
Participants learned each rule in a separate session outside
the MEG. They were trained to perform the task using
increasingly difficult blocks of trials (see below). Feedback
was given on every trial. For every incorrect response, par-
ticipants were shown the correct response.
Initially, stimuli were presented in nonoverlapping
positions (i.e., further apart than the final paradigm) so
there was no position uncertainty. Stimuli were pre-
sented on the screen until a response was made (i.e.,
not time limited). In the first block, participants learned
the first rule (Rule 1 or Rule 2, counterbalanced across
participants). Each stimulus position was shown with
its associated response four times (16 trials), and partic-
ipants had to press the appropriate button for each stim-
ulus. In each trial, cue color was chosen randomly from
the two possible cues for that rule. The second block
followed the same protocol, but for the other rule (Rule
1/Rule 2). In the third block, participants had to perform
the task by implementing both rules, but still with well-
separated stimuli. In the fourth block, the stimuli were
presented in their final, overlapping experimental posi-
tions. Finally, in the fifth block, the stimuli were presented
with the same procedure as the final experimental para-
digm: The stimuli were overlapping and were presented
for only 500 msec. Blocks 3–5 contained 32 trials each,
consisting of two repeats of each cue and stimulus posi-
tion, randomly ordered. In all blocks, participants had to
perform at 60% accuracy or above to progress to the next
block type. Blocks were repeated if they did not reach this
threshold. On average, participants completed 8.61 train-
ing blocks (SD = 2.46). Block 3 was most often repeated
(M = 3.09 repeats).
Robinson, Rich, and Woolgar
641
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
j
o
c
n
_
a
_
0
1
8
1
8
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Figure 1. Experimental design.
(A) Response mapping rules.
Participants had to indicate the
position of a target stimulus that
appeared in one of four
possible locations. There were
two cues per rule, designated by
blue/yellow and green/pink
squares at fixation. The button
press associated with each
position is indicated by the
specific rule. (B) Trial timeline.
After a fixation screen, the
target stimulus and colored
fixation cue appeared
simultaneously, and participants
had to apply the correct
response-mapping rule using a
button press. (C) Behavioral
response types. In this example,
the stimulus was in Position 1
and the rule was Rule 1 (blue
cue), so the correct response
was Button 4. A rule error
occurred if the rule was
mistaken for Rule 2, leading
to a response of Button 3.
A stimulus position error
occurred if the position was
mistaken to be Position 2,
leading to a response of
Button 1. (D) Depiction of MEG
data collation: data aligned to
stimulus onset (left) or RT
(right). The temporal dynamics
of stimulus-related and decision-related neural responses vary across trials, with different processes aligned with onset and response. Aligning
the MEG data to stimulus onset versus response highlights different neural stages on the aggregate of all trials, although the content of each
trial is identical.
Experimental Session
In the second session, participants performed the task
while their neural activity was recorded using MEG. At
the start of each block, participants were shown a graphi-
cal depiction of the rules for at least 2 sec. When they were
ready, they pressed a button to begin the block. In each
trial, participants were shown a gray fixation marker for
500 msec, and then, the square target stimulus and col-
ored rule cue were presented for 500 msec (Figure 1B).
The participants were instructed to respond as quickly as
possible without sacrificing accuracy. After they
responded, there was an intertrial interval of 1000 msec
before the next trial started. There were 10 blocks of 80
trials, each containing five trials per stimulus and cue color
combination. Within each block, the order of the trials was
randomized. Instead of feedback on every trial, like in
training, participants were given feedback about their
mean accuracy and RTs at the end of each block.
system containing 160 gradiometers (Kado et al., 1999).
The participant’s head was fitted with a cap containing five
marker coils. The head shape and position of the marker
coils was marked using a Polhemus digitization system.
Once inside the MEG, the position of the marker coils
was measured to ensure the MEG sensors had good
coverage over the participant’s head. Marker position
measurements were repeated halfway through the exper-
iment and at the end of the session. Raw MEG data were
collected at 1000 Hz with online 0.03-Hz high-pass and
200-Hz low-pass filters.
Stimuli were projected onto the ceiling of the magneti-
cally shielded room. Stimulus timing was measured using a
photodiode placed on the projection mirror and marked
in an additional channel in the MEG recording. Partici-
pants indicated their response using a four-button fiber
optic response pad (Current Designs). Response tim-
ing was marked in the MEG recording using a parallel
port trigger.
MEG Acquisition
MEG Data Analysis
MEG data were collected at Macquarie University in the
KIT-MQ MEG facility with a whole-head supine Yokogawa
MEG data were analyzed using multivariate decoding,
which is very sensitive to reliable effects in the data and
642
Journal of Cognitive Neuroscience
Volume 34, Number 4
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
j
o
c
n
_
a
_
0
1
8
1
8
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
resistant to artifacts such as eye blinks that are not consis-
tent across time and condition (Carlson, Grootswagers, &
Robinson, 2020; Grootswagers, Wardle, & Carlson, 2017).
Because of the robustness of decoding to such artifacts,
data were minimally preprocessed using EEGLAB
(Delorme & Makeig, 2004). Data were filtered using a
Hamming window finite impulse response filter (default
EEGLAB filter pop_eegfiltnew) with high pass of 0.1 Hz
and low pass of 100 Hz and then downsampled to
200 Hz before epoching. For separate analyses, trials were
epoched relative to stimulus onset, marked by the photo-
diode, and to the button press response, marked by the
parallel port trigger.
Data were analyzed using time-resolved classification
methods (e.g., Carlson et al., 2020; Robinson, Grootswagers,
& Carlson, 2019; Grootswagers et al., 2017) and imple-
mented using the CoSMoMVPA toolbox (Oosterhof,
Connolly, & Haxby, 2016). For each time point, data were
pooled across all 160 MEG sensors, and we tested the ability
of a linear discriminant analysis classifier to discriminate
between the patterns of neural responses associated with
the different conditions. Trials were divided according to
their associated behavioral responses: correct trials, rule
errors, and stimulus position errors (Figure 1C). The classi-
fiers were always trained on correct trials. To ensure that
there were equal numbers of trials for each condition,
correct trials were subsampled to be equal for each position
and rule combination for each block per participant. To
ensure adequate trial numbers for each of the analyses,
blocks with fewer than two trials per Rule × Position
combination were excluded; this amounted to nine
excluded blocks in total across eight participants, with the
remaining 14 participants having all blocks included. The
total number of selected trials per participant was M =
437.09 (minimum = 280, maximum = 600).
Temporal Dynamics of Stimulus, Cue, Rule, and
Response Coding
We performed pattern classification analyses to determine
the time points at which stimulus position, cue, rule, and
response representations emerge in the brain. First, we
decoded stimulus position by comparing neural represen-
tations of the inner two stimulus positions (Positions 2
and 3) with those of the outer two stimulus positions
(Positions 1 and 4). Separating position in this manner
meant that motor responses and rule were balanced
across the two position conditions and could not drive
the classification results, ensuring we are detecting infor-
mation related to stimulus position.
Next, we assessed the time course of rule coding by
training a classifier to distinguish between Rule 1 and
Rule 2. In having two color cues per rule, this analysis
focused on rule coding over and above the physical prop-
erties of the cues (Rule 1 [blue and yellow cues] vs. Rule
2 [pink and green cues]).
We can also, however, decode cue coding separately
from rule coding. To assess how cue decoding differed
from rule decoding, we decoded between the two cues
per rule (i.e., blue vs. yellow color cue for Rule 1 and pink
vs. green for Rule 2). Cue coding was quantified as the
mean of the two pairwise analyses.
As a final analysis, we decoded motor response by
comparing the inner two button presses with the outer
two button presses. This comparison ensured that stim-
ulus position and rule were balanced within each class,
so that the classifier would be driven by the motor
response alone.
For each decoding analysis, classification analyses were
performed using a leave-one-block-out cross-validation
approach. This resulted in 10-fold cross-validation for
participants with no excluded blocks (n = 14). The
remaining participants used ninefold (n = 7) and eight-
fold cross-validation (n = 1). For all decoding analyses,
chance performance was 50%.
Error Representations
The next set of analyses focused on decoding neural
activity when participants made errors, to explore the
relationship between patterns of activity and behavior. To
investigate the representation of rule and stimulus errors,
we trained the classifier on the correct trials and tested on
the error trials. This allowed us to decode what information
was present in the patterns of response across sensors
when participants made different kinds of mistakes.
Specifically, the analyses assessed whether the error pat-
terns resembled the “correct” stimulus and rule patterns
(above-chance decoding) or the neural patterns associated
with the “incorrect” stimulus and rule (below-chance
decoding). Note that, in this approach, below-chance clas-
sification is meaningful: It indicates the representation of
the pattern that is instantiated when the other (incorrect
in this case) rule or stimulus position is encoded.
We performed error decoding for stimulus position and
rule information. In a comparable procedure to the cor-
rect trial analysis, we used leave-one-block-out cross-
decoding analyses. In each fold, the classifier was trained
on “correct” trials from all but one block and tested on all
“error” trials across the whole session. This ensured the
same training data (and thus decoding models) were
used as in the correct trial analyses but allowed well-
characterized results for the relatively small number of
error trials. Participants made an average of 5.71% rule
errors and 9.82% stimulus position errors (Figure 2A).
Table 1 shows the mean number of trials used for stimulus
and rule decoding per trial response type (correct, stimu-
lus error, rule error).
Exploratory Searchlight Analysis
To illustrate the spatial extent of the MEG signal containing
relevant task-related information, we applied searchlight
Robinson, Rich, and Woolgar
643
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
j
o
c
n
_
a
_
0
1
8
1
8
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
j
o
c
n
_
a
_
0
1
8
1
8
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Figure 2. Behavioral results in the MEG session (n = 22). (A) Proportion of trials and (B) median RT for correct, rule errors, stimulus errors, and
other errors. Gray lines denote individual participants, and black markers denote group means. Error bars are 95% confidence intervals across
participants.
decoding. For each sensor in turn, we defined a search-
light consisting of that sensor and its immediate neighbors
(mean = 5.6 sensors per searchlight). We then ran the
same decoding schemes as on the whole head (above)
in each of these searchlights. Decoding accuracy for each
searchlight was plotted on the central sensor, resulting in a
head map of decoding accuracies, showing the regions
containing task-related information at a given time. For
each task feature and condition (e.g., Rule 1 vs. Rule 2
on stimulus-aligned correct trials), searchlight results were
plotted using 20-msec time windows of interest centered
around representative time points: 150 and 1000 msec for
the onset-aligned analyses, and −600 and −200 msec for
the response-aligned analyses.
Statistical Testing
To assess performance of the classifier, we used Bayesian
statistics to determine the evidence that decoding perfor-
mance was different from chance (Teichmann, Moerel,
Baker, & Grootswagers, 2021; Dienes, 2011, 2016; Rouder,
Speckman, Sun, Morey, & Iverson, 2009; Wagenmakers,
2007; Jeffreys, 1961). A Bayes factor (BF) is the probability
of the data under the alternative hypothesis relative to the
null hypothesis. In all analyses, the alternative hypotheses
of above- and below-chance (50%) decoding were tested
using the BayesFactor package in R (Morey et al., 2018).
BFs were calculated using a JZS prior, centered around
chance decoding of 50% (Rouder et al., 2009) with a
default scale factor of 0.707, meaning that for the alterna-
tive hypotheses of above- and below-chance decoding,
we expected to see 50% of parameter values falling
within −0.707 and 0.707 SDs from chance ( Wetzels &
Wagenmakers, 2012; Rouder et al., 2009; Zellner & Siow,
1980; Jeffreys, 1961). A null interval was specified as a
range of effect sizes between −0.5 and 0.5.
In accordance with the BF literature, we did not make a
correction for multiple comparisons for the large number
of time points tested (Teichmann et al., 2021; Świątkowski
& Carrier, 2020; Dienes, 2011, 2016). BFs assess the
strength of evidence for the null hypothesis versus the
alternative hypothesis; here, they are used to directly test
Table 1. Mean Number of Trials Used for Stimulus and Rule Decoding Analyses per Participant
Inner positions
Outer positions
Rule 1
Rule 2
Correct
218.55 (46.00)
218.55 (46.00)
218.55 (46.00)
218.55 (46.00)
Stimulus Error
30.00 (29.35)
48.50 (26.05)
38.14 (16.09)
40.36 (21.44)
Rule Error
17.55 (9.14)
28.14 (17.94)
22.18 (13.29)
23.50 (12.19)
Group means (standard deviation) for trial numbers are presented according to the two different stimulus classes (inner or outer positions; regard-
less of rule) and two rules (regardless of stimulus position). Trials are split by behavior: correct response, stimulus error, and rule error. Decoding
models were always trained using correct trials.
644
Journal of Cognitive Neuroscience
Volume 34, Number 4
the evidence for above-chance (or below-chance) decod-
ing and the evidence that decoding is equivalent to
chance. Thus, we assess the magnitude of evidence in
either direction, rather than a probability of the observed
data occurring by chance as in traditional null hypothesis
testing. BF > 3 is typically considered evidence for the
alternative hypothesis; and BF < 1/3, as evidence in favor
of the null hypothesis ( Wetzels et al., 2011; Jeffreys, 1961).
When the magnitude of BFs is interpreted at face value,
rather than applying a threshold for “significance,” there
is no need to correct for the number of tests (time points;
Teichmann et al., 2021). Additional tests provide addi-
tional evidence and can be interpreted as such without
correcting for multiple comparisons (Dienes, 2011,
2016). Accordingly, we do not interpret high BFs at iso-
lated time points as evidence for decoding; rather, we
assess the pattern of evidence through time in support
of the null or alternative hypotheses. Single time points
are not considered to provide substantial evidence if
neighboring time points support the opposite hypothesis.
We will refer to periods with sustained evidence for the
alternative hypothesis as times when information could
be decoded, indicating information was represented in
the brain.
RESULTS
Behavioral Results
All participants performed above 60% on the final block of
the response-mapping task in the training session and
therefore participated in the experimental MEG session.
In the MEG session, participants performed well above
chance (M = 81.92%) but still made both rule errors
(M = 5.71%) and stimulus position errors (M = 9.82%;
Figure 2A). There were very few other errors (M =
1.43%) or trials with no response (M = 1.13%). RTs were
slower for stimulus error trials than rule error and correct
trials (Figure 2B).
Temporal Dynamics of Goal-directed Behavior
First, we investigated neural coding during correct trials by
decoding different task-related information from the MEG
signal when each trial was aligned to stimulus onset (anal-
ogous to classic event-related analyses). We then realigned
the MEG signal of each trial to the response and per-
formed the same decoding analyses (see Figure 1D for a
depiction of realignment). This gives us a unique insight
into the time course of the processing stages during
goal-directed behavior.
Time-resolved decoding performed relative to stimulus
onset revealed a progression of relevant information over
time (Figure 3A). Stimulus position information was repre-
sented in the neural signal from approximately 75 msec
after the stimulus appeared, with a double-peak response.
Cue information could be decoded from 170 msec, and
the dynamics were similar for the blue versus yellow
(53.34% at 170 msec) and green versus pink (51.86% at
170 msec) cue color decoding (mean presented in
Figure 3A), indicating the decoding reflects general cue
information rather than being specific to one set of cues.
The timing of stimulus and cue information was thus
consistent with early visual stages of retinotopic position
(Battistoni, Kaiser, Hickey, & Peelen, 2020; Carlson et al.,
2011) and color processing (Teichmann, Grootswagers,
Carlson, & Rich, 2019), respectively.
Rule information was briefly evident at about the same
time as the cues (around 150 msec), but also prominent
from approximately 400 to 1200 msec, likely coinciding
with higher-level cognitive stages of processing. Rule
information was quite low in general. One possibility is
that there was a carryover effect such that the rule type
on a given trial subsequently affected rule coding on the
next trial. In an additional exploratory analysis, we
assessed rule decoding separately for rule switch and rule
repeat trials by training Rule 1 versus Rule 2 on correct tri-
als (as in the original analysis) and testing on repeat and
switch trials separately. We found that rule decoding
exhibited similar dynamics regardless of the rule on the
previous trial, with slightly higher decoding on switch tri-
als (see OSF repository). Thus, inertia from the previous
trial did not appear to cause a switch cost in the represen-
tation of rule information in the brain.
Finally, we assessed the temporal dynamics of response
information. The button press response was represented
from about 715 msec, corresponding with RTs on some of
the faster trials. Together, decoding accuracy peaked at
125 msec for stimulus position, 175 msec for cue color,
600 msec for rule, and 1055 msec for response button,
showing a clear progression in information processing
through time.
Searchlight decoding results showed that position, cue,
and rule information at 150 msec localized to posterior
regions of the brain (Figure 3A, bottom). At a later period,
1000 msec, position and response information were more
frontal and diffuse across the MEG sensors. Rule informa-
tion was much lower in general but again showed a disso-
ciation for the early versus late time points, with frontal
and central topography at the later period.
As is typical in difficult tasks, there was a wide variation
in RTs across trials and participants, indicating that the
dynamics of high-level task-related processes such as
decision-making vary trial to trial with respect to stimulus
onset. Time-resolved decoding relies on processes occur-
ring at the same time across trials, so this temporal jitter
can mask results ( Vidaurre, Myers, Stokes, Nobre, &
Woolrich, 2019). To capture processes that are more
closely aligned with the response, we next realigned the
MEG data to the RT (Figure 1D) and performed the same
decoding analyses. The temporal dynamics of relevant
task-related information were markedly different com-
pared with onset-aligned results (Figure 3B). Notably,
cue information could no longer be reliably detected,
Robinson, Rich, and Woolgar
645
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
j
o
c
n
_
a
_
0
1
8
1
8
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
j
o
c
n
_
a
_
0
1
8
1
8
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Figure 3. The temporal dynamics of correct stimulus position, cue color, rule, and response information coding. (A) Decoding analyses conducted
relative to stimulus onset. (B) Decoding analyses conducted relative to RT. Shaded areas show standard error across participants (n = 22). Decoding
accuracy is smoothed with a 20-msec window for visualization. Line at the top of Plot A marks the mean and 95% confidence interval of median
RTs per participant. BFs for above-chance decoding are displayed below the x axes for every time point using a log scale and color coded according
to the evidence for above-chance decoding (see inset). Head maps depict sensor searchlight decoding results for each task-related feature at
representative periods. The color bar indicates decoding accuracy per sensor searchlight, calculated as the mean of a 20-msec time window centered
on the time of interest.
presumably because cue color representations were
transient and tightly stimulus locked because, by design,
the cue distinctions were irrelevant as soon as rule infor-
mation could be extracted from them. In contrast, decod-
ing of stimulus position coding was evident more than
1000 msec before the response, and rule coding was
evident more than 600 msec before the response, with evi-
dence for stimulus processing earlier than rule processing.
Motor response coding was sporadically present from
more than 1000 msec before the response but was sus-
tained from around 485 msec before when the response
was made. Response coding peaked after the response
was given, potentially reflecting the contribution of
somatosensory feedback from the different button
presses. Response coding 200 msec before the response
was associated with highest decoding over central-left
sensors, which would be consistent with motor and
somatosensory cortex activity associated with a right-hand
response. Interestingly, the representation of stimulus
position and response information appeared to ramp up
before the response, plausibly reflecting the accumulation
of evidence leading to a decision.
Error Representations
We were particularly interested in understanding whether
and how the task-related information we can decode with
MVPA is related to participant performance. Specifically,
we investigated how information coding changes when
an error is made. Recall that our design explicitly allows
us to identify the likely source of the error based on the
behavioral response (Figure 1C). We assessed stimulus
646
Journal of Cognitive Neuroscience
Volume 34, Number 4
and rule information in the neural signal when participants
made stimulus errors versus rule errors. On the basis of
our previous work with fMRI ( Woolgar et al., 2019), we
hypothesized that the brain would represent the incorrect
stimulus before a stimulus error and the incorrect rule
before a rule error. Classifiers were trained to classify stim-
ulus position and rule using correct trials and tested on
incorrect trials. Therefore, for each time point on each
error trial, the analysis reveals whether activation patterns
were more similar to the usual patterns for the presented
rule and stimulus (correct rule and stimulus) or the alter-
nate one (incorrect) corresponding to the participant’s
decision (as shown by the behavior response).
Stimulus Decoding—Aligned to Stimulus Onset
In this analysis, we looked at how stimulus position was
coded on error trials. We found that, when participants
made rule errors, in which behavior suggested that the
stimulus was encoded correctly but the incorrect rule
had been used, there was sustained stimulus decoding
with similar dynamics to that on correct trials (Figure 4A,
blue line). Stimulus coding on stimulus errors, however,
was present only transiently at 335 msec after which cod-
ing attenuated (Figure 4A, green line). After 495 msec,
there was substantial evidence that stimulus coding was
higher when participants made errors based on applying
the wrong rule than when the response suggested they
had misperceived the stimulus. This indicates that, when
participants made stimulus errors, correct stimulus infor-
mation was lost.
Stimulus Decoding—Aligned to RT
Next, we asked the same question but with the data rea-
ligned to the RT. On rule errors, there was a gradual ramp-
ing up of stimulus coding in the lead up to the response
(Figure 4B, blue line), as we had observed for correct
trials (Figure 3B). In contrast, on stimulus errors, activa-
tion patterns ramped toward the patterns encoding
the incorrect stimulus, as indexed by below-chance
decoding from approximately 355 msec before the
response (Figure 4B, green line). Given that the correct
stimulus had been encoded in the early part of these same
trials (Figure 4A), this suggests an evolution of information
coding toward the incorrect stimulus decision. Stimulus
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
j
o
c
n
_
a
_
0
1
8
1
8
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Figure 4. Stimulus position decoding on rule and stimulus error trials. (A) Decoding analyses conducted relative to stimulus onset revealed initial
stimulus coding on both rule and stimulus error trials, with sustained stimulus coding on rule error trials (similar to correct trials; Figure 3), but no
stimulus coding at later time points on stimulus error trials. The interaction, shown by BF difference (pink), confirmed that at later time points, there
was more evidence for stimulus coding on rule errors than stimulus errors. (B) Decoding analyses conducted relative to RT revealed evidence for
correct stimulus coding on rule error trials and evidence for “incorrect” stimulus coding on stimulus error trials, evident as below-chance decoding
accuracy. Decoding accuracy is smoothed with a 20-msec window for visualization. BFs are shown on a log scale and color coded according to
amount of evidence.
Robinson, Rich, and Woolgar
647
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
j
o
c
n
_
a
_
0
1
8
1
8
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Figure 5. Rule decoding on rule and stimulus error trials. (A) Decoding analyses conducted relative to stimulus onset. (B) Decoding analyses
conducted relative to RT. Decoding accuracy is smoothed with a 20-msec window for visualization. There was substantial evidence for the null (i.e.,
that rule could not be decoded) on both stimulus error and rule error trials, indicating the rule coding did not reverse for either type of error.
decoding accuracy on rule errors was higher than that
on stimulus errors for the bulk of the epoch, particularly
from about 795 msec before the response to 600 msec
after the response. Together, this finding shows that
stimulus coding in the latter part of the trial reflected
the decision ultimately made by participants, rather than
the stimulus presented.
Rule Decoding
Next, we asked whether the representation of task rule
in the correct trials would also generalize to error trials.
However, there were only very brief periods of evidence
for rule information coding on rule errors and stimulus
errors, whether we aligned the MEG data to the stimulus
onset (Figure 5A) or response (Figure 5B). There was
also no difference in rule coding between error types.
For onset-aligned analyses, BFs indicated evidence for
above-chance decoding on rule and stimulus errors for
some time points, but it was not sustained. There were
also some brief periods of below-chance decoding on rule
errors for response-aligned analyses, which would indicate
coding of the incorrect rule, consistent with behavior, but
this did not reach our interpretation levels for BFs (two
consecutive time points, BF > 3). Gesamt, rule information
that had been (weakly) present on correct trials was largely
absent on both types of behavioral error. Darüber hinaus, Die
“reversal” in coding—in this case, coding of the incorrect
rule—was not evident as it was for stimulus coding.
Taken together, the MEG decoding results show that,
on correct trials, all task-relevant aspects (stimulus posi-
tion, cue color, rule, und Reaktion) could be decoded.
The dynamics of coding varied such that analyses revealed
stimulus-locked coding of perceptual features (stimulus
Position, cue) early in the time course, and analyses
aligned to the response revealed coding of relevant task
Aspekte (Position, rule) and the resulting motor response
ramping up before the response being given. Auffallend,
the error decoding analysis showed that the increased
stimulus position coding in the latter part of the epoch
reflected the participants’ decision about the stimulus
more closely than the physical stimulus presented to
ihnen, providing strong evidence for the connection
between specific neural responses decoded with MVPA
and behavior.
DISKUSSION
In this study, we used MVPA with MEG to characterize the
neural dynamics of stimulus, cue, rule, und Reaktion
648
Zeitschrift für kognitive Neurowissenschaften
Volumen 34, Nummer 4
coding in a difficult response-mapping task as well as the
link between these codes and behavior. Our results
showed a clear and orderly progression of task-relevant
information coding after the stimulus was presented,
whereas analyses aligned to the RT revealed that informa-
tion coding for the stimulus and motoric response ramped
up over the ∼1 sec before the response was given, in einem
manner reminiscent of evidence accumulation (z.B.,
Tagliabue et al., 2019; Pisauro, Fouragnan, Retzler, &
Philiastides, 2017). Auffallend, for trials on which partici-
pants made an error in the stimulus position, Information
coding initially corresponded to physical stimulation, Aber
later accumulated in the opposite direction, so that activity
patterns at later time points resembled those encoding the
“incorrect” stimulus. This provides a crucial demonstra-
tion that patterns of neural activity recorded and classified
in this way can be predictive of behavior. These findings
give insight into the dynamics of processes underlying
cognitive control and provide a clear link between neural
responses and behavior.
The difficult response-mapping task implemented in
this study required complex processing for successful per-
Form. The task involved processing different types of
perceptual information (cue, stimulus), conversion of the
cue into the appropriate rule, application of the relevant
rule to the stimulus position, and selection of the correct
button-press response. Using MEG decoding with a
carefully balanced experimental design, we were able to
investigate the coding of each of these types of relevant
information over time and observe the succession of the
different task-related features. We summarize and con-
sider the findings below.
Information Coding After Stimulus Onset:
Correct Trials
Our results demonstrated different dynamics for percep-
tual, rule-related, and motor processes for analyses aligned
to stimulus onset (Abbildung 3A). Stimulus position was
represented early in the time course (<100 msec after
stimulus onset), consistent with early retinotopic visual
processes (Im, Gururajan, Zhang, Chen, & He, 2007;
Di Russo et al., 2005). The cue was represented shortly
thereafter at a time that is general color
processing and in line previous work found color
decoding most evident from 135–155 after
image onset (Teichmann 2019, 2020). Rule informa-
tion, by contrast, around 600 and
maintained for longer than information, perhaps
reflecting the ongoing process of combining stimulus
and rule information to derive response. Motor
responses emerged last exhibited broad, shallow
peak, perhaps reflective wide range RTs the
task. Our data thus emphasize progression coding
for different types task-relevant over time,
despite relevant sensory (stimulus and
cue) being presented simultaneously.
These onset-aligned analyses are with
previous time-resolved multivariate showed
progression task-related after stimulus pre-
sentation (Kikumoto Mayr, 2020; Hubbard 2019;
Wen 2019; Hebart 2018). For example, Hebart
et al. (2018) showed was
evident MEG signal shortly task pre-
sented but ramped up again target object was
presented. In more complex design, al.
(2019) used cued task-switching EEG, which allowed
them look coding multiple aspects
over using oscillatory power neural signal. Like
our results, they pre-
ceded decoding pro-
longed throughout trial period. Relevant irrelevant
stimulus stimuli were
presented, response present later
in Here, we show similar cascade infor-
mation arises when simultaneously. results this work
show features the
brain temporal dynamics, there are
periods represented,
potentially giving correlates information
integration needed on these tasks.
The color observed indicative of
transient processing before was
selected, point distinctions (e.g., blue
vs. yellow, both indicate 1) become irrelevant.
In prolonged position
and (far exceeding presentation of
500 msec) likely reflects position information
being maintained, accumulated,>500 msec after stimulus onset)
would be theoretically consistent with processing within
higher-level frontoparietal regions. Zum Beispiel, previous
combined MEG–fMRI research has shown task-related
enhancement of relevant features occurred after 500 ms
following stimulus presentation, and task coding in poste-
rior parietal cortex and lateral pFC seemed to peak from
500 ms (Hebart et al., 2018). Darüber hinaus, attention
enhances task-relevant information in frontoparietal
regions from 500 ms (Moerel, Reich, & Woolgar, 2021).
Andererseits, task-relevant stimulus information also
seems to persist in occipital regions until these late time
points (Moerel et al., 2021; Hebart et al., 2018; Goddard,
Carlson, Dermody, & Woolgar, 2016). Our exploratory
sensor searchlight analyses suggested that early position,
Robinson, Reich, and Woolgar
649
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
e
D
u
/
J
/
Ö
C
N
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
J
Ö
C
N
_
A
_
0
1
8
1
8
P
D
.
F
B
j
G
u
e
S
T
T
Ö
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
cue, and rule information was evident in occipital sensors,
whereas later position information was more diffuse
across the brain, and later rule information was more
frontal. Future work could address the spatial nature of
these processes with more precision, perhaps using
computational methods to combine fMRI and MEG data
such as similarity-based fusion (Cichy, Pantazis, & Oliva,
2014, 2016).
Information Coding Before the Response:
Correct Trials
The analyses aligned to the RT provided rich additional
information about the temporal dynamics of stimulus,
cue, rule, and response coding (Abbildung 3B). We expected
that these response-aligned analyses would emphasize
higher-level decision-related processes required for
behavior, which might not be so salient in data aligned
to stimulus onset because of variability in their timing
( Vidaurre et al., 2019). Previous EEG work has shown neu-
ral signals ramp up during perceptual decision-making,
which has been described as evidence accumulation
(z.B., Tagliabue et al., 2019; Pisauro et al., 2017), but these
effects could be related to a general decision-making pro-
cess rather than involving information about the stimulus
of interest and could be confounded with preparatory
motor activity. Hier, using decoding, we were able to
assess the dynamics of different types of task-related infor-
mation, separate from and in addition to response infor-
mation, that was represented in the brain before the
response. The results revealed an increase in stimulus
information from approximately 1000 msec before the
response that peaked around the RT, a pattern that was
noticeably absent in the onset-locked analyses. Response
coding, by contrast, showed a later, sharper ramping
in information that peaked just after the response was
made. The ramping of stimulus position and response
coding was, for the most part, when the stimulus and
cue were no longer visible; the stimulus and cue were only
presented for 500 ms, and the median RT was over
1400 ms, so on a typical trial, there was no stimulus pre-
sented in the 900 msec before the response. daher,
instead of perceptual accumulation, these pre-response
representations appear to be internally generated codes
that reflect the system moving toward different end states
as the person arrives at his or her decision.
The results revealed concurrent coding of position,
rule, and response information before the response,
which might reflect the need to combine position and rule
information to select the appropriate response. Kikumoto
and Mayr (2020) recently investigated the temporal
dynamics of action selection using EEG in a cued rule
selection task and provided evidence that conjunctions
between task-relevant features are necessary for action
Auswahl. In addition to the succession of individual task
Merkmale, they found rule stimulus–response conjunctive
representations could be decoded using stimulus-aligned
EEG, and the strength of the conjunctive information was
associated with faster responses, providing a link with
behavior. Other work has used temporal decomposition
of EEG data and concluded that stimulus–response bind-
ings have different temporal profiles to stimulus informa-
tion, with gradual activation and decay over time (Takacs,
Mückschel, Roessner, & Beste, 2020). Our exploratory
searchlight decoding results showed that position and rule
information before the response was mostly lateral and dif-
fuse across the sensors but with similar spatial patterns
(although lower for rule decoding), potentially reflecting
the integration of task-relevant information within brain
Regionen. We did not explicitly set out to look at conjunctive
Darstellungen, but our results certainly fit with this
account. During goal-directed behavior, it seems that mul-
tiple task-relevant features are represented concurrently,
presumably reflecting the need for this information to
be maintained, and are then combined over time.
Our onset-aligned and response-aligned analyses
revealed complementary aspects of the data. Das Muster
of results suggests that onset-aligned analyses may be
most sensitive to perceptual responses, whereas response-
aligned analyses may capture processes that are time-
varied relative to stimulus onset and more closely yoked
to the time of response, such as higher decision and motor
preparation processes. Speziell, we found that stimulus
position and cue color had sharp initial decoding when
aligned to stimulus onset, which was not visible after
realignment to response. Jedoch, neural representa-
tions of stimulus and response exhibited a ramping accu-
mulation before the button was pressed, which was not
visible in onset-aligned data. This highlights the utility of
including both approaches, perhaps particularly for diffi-
cult tasks with substantial RT variability, to yield additional
information about the dynamics underlying successful
task performance.
Information Coding Leading to Incorrect Behavior:
Error Trials
To test whether the neural coding of task-relevant infor-
mation detected with MVPA reflects activity necessary to
successfully perform a task, we examined how these codes
changed when participants made errors. We focused on
decoding stimulus and rule information during stimulus
errors and rule errors, situations in which the decision
made could be dissociated from the stimulus and rule
cue presented. Stimulus errors consisted of trials on which
participants correctly applied the rule but confused the
stimulus. Despite the behavioral evidence for correct rule
use on these trials, there was only some evidence of rule
coding, perhaps reflecting weak rule coding in general (An
correct trials) and the limited number of error trials. Wie-
immer, stimulus position coding on stimulus error trials
revealed a striking result: Initial stimulus coding showed
some fleeting evidence of the correct stimulus neural pat-
tern, but before the response, stimulus coding became
650
Zeitschrift für kognitive Neurowissenschaften
Volumen 34, Nummer 4
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
e
D
u
/
J
/
Ö
C
N
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
J
Ö
C
N
_
A
_
0
1
8
1
8
P
D
.
F
B
j
G
u
e
S
T
T
Ö
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
consistent with the incorrect stimulus. Daher, onset-aligned
analyses and responses at early time points reflected
perception, whereas response-aligned analyses and
coding at later time points reflected behavior. Recall in
the paradigm that stimulus position was designed to be
confusable, and a stimulus position error, by definition,
means participants confused two (of four) stimulus posi-
tionen. When the stimulus was presented, Teilnehmer
would see it, which is consistent with brief veridical stim-
ulus position decoding, but the insufficient maintenance
of this information correlates with the behavioral perfor-
Mance: Participants could not localize the stimulus pre-
cisely, which led to a decision in favor of the wrong
stimulus. It is this internal decision-related process that
seems to be reflected in below-chance (incorrect stim-
ulus) decoding before the response. Previous work has
shown that higher, but not early, perceptual regions
reflect behavior in terms of accuracy ( Walther et al.,
2009; Williams et al., 2007) and RT (Grootswagers et al.,
2018), although none of these studies revealed the code
reversal needed for a strong link with behavior. Hier, Wir
used the temporal domain to show “what” was coded on
error trials at different stages of processing. There was a
dissociation between the coding of early perceptual
information and the stimulus decision used to generate
the behavioral response.
Rule errors consisted of trials on which participants
appeared (in their behavior) to apply the wrong rule to
the correct stimulus. Entsprechend, for stimulus position
coding, the classifier trained on correct trials could suc-
cessfully classify the stimulus position after onset and
before the response on rule error trials. This indicates that
the stimulus coding reversal seen above was diagnostic of
the particular type of behavioral error, rather than reflec-
tive of errors in general, indicating a tight link with the
specific decision made and reflected in behavior.
For rule coding, we again found little evidence for rule
coding on rule error trials. A couple of time points just
before the response showed patterns of activity consistent
with the incorrect rule, as we had predicted for a full dou-
ble dissociation, but the effect was so transient that it is
difficult to interpret with confidence. This may reflect
the very small number of rule error trials and/or the rela-
tively weak coding of rule information in general in our
Daten (potentially attributable to more variability in timing
of this task aspect and/or relatively poor signal from frontal
regions that are further from the sensors in our supine
MEG system). This limitation means that, in contrast to
the stimulus information, we cannot conclude with confi-
dence whether or not the rule patterns we decoded were
closely linked to behavior.
Our research contributes to the growing literature
drawing links between neural responses and behavior
using MVPA. Using spatial and temporal neuroimaging,
classifier prediction errors and distances from the classifier
boundary have been shown to correlate with behavioral
error patterns and RTs (z.B., González-García, Formica,
Wisniewski, & Brass, 2021; Grootswagers et al., 2018;
Carlson, Ritchie, Kriegeskorte, Durvasula, & Ma, 2014;
Walther et al., 2009). Hier, we argue that a tighter link
between brain and behavior can be found by testing
“what” is represented on error trials when an incorrect
decision is made. The results parallel fMRI work showing
frontoparietal MD regions represent the correct stimulus
but wrong rule during a rule error as well as the correct
rule but wrong stimulus during other errors ( Woolgar
et al., 2019). The current study extends this work by
elucidating the dynamics with which the incorrect repre-
sentations evolve over time, with early representations
reflecting the stimuli presented, but a late gradual accu-
mulation toward the opposite stimulus at time points just
before behavioral response. We also show here that there
is a dissociation in the perceptual coding (indexed by
onset-aligned analyses) and high-level decision coding
(indexed by response-aligned analyses) for error trials.
Speziell, on stimulus errors, after a transient representa-
tion of the veridical stimulus, activity accumulated toward
a pattern state reflecting the opposite and incorrect stim-
ulus, apparently reflecting the internal generation of
accumulation toward the wrong decision. This pattern
was specifically diagnostic of behavioral errors attributable
to stimulus misperception, as position information was
coded correctly on other types of behavioral errors.
The results of this study provide new insights into how
task-relevant information is processed in the human brain
to allow successful goal-directed behavior. There was a
clear progression of the onset of task-relevant information
in the brain, from stimulus position and cue, to rule and
then response information. Complimentary response-
aligned analyses, which highlight later high-level pro-
cesses aligned in time to behavior, additionally revealed
dynamics of information coding resembling an accumu-
lation of multiple types of task-relevant information.
Darüber hinaus, when participants made behavioral errors,
the direction of accumulation was reversed. Under these
Bedingungen, the trajectory of representation moved in the
opposite direction such that the neural pattern increas-
ingly represented the incorrect stimulus (which had not
been shown) in a manner diagnostic of the subsequent
behavioral choice. The data highlight the orderly but
overlapping dynamics with which several task elements
can be represented in brain activity. Our findings empha-
size a particular role for the trajectory of information
coding at later time points in determining behavioral suc-
cess or failure and also demonstrate the utility of aligning
neural data differently to examine high-level complex
cognitive processes.
Danksagungen
We thank Christopher Whyte for assistance in data collection
and Dr. Tijl Grootswagers for helpful discussions. We acknowl-
edge the Sydney Informatics Hub and the University of
Sydney’s high-performance computing cluster Artemis for
Robinson, Reich, and Woolgar
651
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
e
D
u
/
J
/
Ö
C
N
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
J
Ö
C
N
_
A
_
0
1
8
1
8
P
D
.
F
B
j
G
u
e
S
T
T
Ö
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
providing high-performance computing resources that contrib-
uted to these research results.
Reprint requests should be sent to Amanda K. Robinson,
School of Psychology, The University of Sydney, Camperdown,
NSW 2006, Australia, oder per E-Mail: amanda.robinson@sydney
.edu.au.
Informationen zur Finanzierung
This work was funded by Australian Research Council
D i s c o v e r y P r o j e c t ( h t t p s : / / d x . d o i . o r g / 1 0 . 1 3 0 3 9
/501100000923), grant number: 170101840, Australian
Research Council Future Fellowship (https://dx.doi.org
/10.13039/501100000923), grant number: FT170100105,
Medical Research Council (Vereinigtes Königreich) intramural funding, gewähren
number: SUAG/052/G101400; and Australian Research
Council Discovery Early Career Researcher Award (https://
dx.doi.org/10.13039/501100000923), grant number:
DE200101159.
Vielfalt in der Zitierpraxis
Retrospektive Analyse der Zitate in jeder Artikelveröffentlichung-
in dieser Zeitschrift aufgeführt von 2010 Zu 2021 offenbart eine hartnäckige
Muster des Ungleichgewichts zwischen den Geschlechtern: Obwohl die Proportionen von
Autorenteams (kategorisiert nach geschätzter Geschlechtsidentität-
Angabe des Erstautors/Letztautors) publishing in the
Zeitschrift für kognitive Neurowissenschaften ( JoCN) during this
period were M(ein)/M = .407, W(Oman)/M = .32, M/W =
.115, and W/W = .159, the comparable proportions for the
articles that these authorship teams cited were M/M =
.549, W/M = .257, M/W = .109, and W/W = .085 (Postle
and Fulvio, JoCN, 34:1, S. 1-3). Folglich, JoCN
encourages all authors to consider gender balance explic-
itly when selecting which articles to cite and gives them
the opportunity to report their article’s gender citation
balance. The authors of this article report its proportions
of citations by gender category to be as follows: M/M =
.536, W/M = .145, M/W = .130, und W/ W = .188.
VERWEISE
Battistoni, E., Kaiser, D., Hickey, C., & Peeling, M. V. (2020). Der
time course of spatial attention during naturalistic visual
suchen. Kortex, 122, 225–234. https://doi.org/10.1016/j.cortex
.2018.11.018, PubMed: 30563703
Bracci, S., Daniels, N., & Op de Beeck, H. (2017). Task context
overrules object- and category-related representational content
in the human parietal cortex. Hirnrinde, 27, 310–321.
https://doi.org/10.1093/cercor/bhw419, PubMed: 28108492
Carlson, T. A., Grootswagers, T., & Robinson, A. K. (2020). Ein
introduction to time-resolved decoding analysis for M/EEG.
In M. G. Gazzaniga, G. R. Mangun & D. Kacke (Hrsg.), Der
cognitive neurosciences. Cambridge, MA: MIT Press.
Carlson, T. A., Hogendoorn, H., Kanai, R., Mesik, J., & Turret, J.
(2011). High temporal resolution decoding of object position
and category. Journal of Vision, 11, 1–17. https://doi.org/10
.1167/11.10.9.Einführung, PubMed: 21920851
Carlson, T. A., Ritchie, J. B., Kriegeskorte, N., Durvasula, S., &
Ma, J. (2014). Reaction time for object categorization is
predicted by representational distance. Zeitschrift für Kognition
Neurowissenschaften, 26, 132–142. https://doi.org/10.1162/jocn_a
_00476, PubMed: 24001004
Cichy, R. M., Pantazis, D., & Oliva, A. (2014). Resolving human
object recognition in space and time. Naturneurowissenschaften, 17,
455–462. https://doi.org/10.1038/nn.3635, PubMed: 24464044
Cichy, R. M., Pantazis, D., & Oliva, A. (2016). Similarity-based
fusion of MEG and fMRI reveals spatio-temporal dynamics
in human cortex during visual object recognition. Zerebral
Kortex, 26, 3563–3579. https://doi.org/10.1093/cercor/bhw135,
PubMed: 27235099
Cole, M. W., & Schneider, W. (2007). The cognitive control
Netzwerk: Integrated cortical regions with dissociable
functions. Neurobild, 37, 343–360. https://doi.org/10.1016
/j.neuroimage.2007.03.071, PubMed: 17553704
Crittenden, B. M., Mitchell, D. J., & Duncan, J. (2016). Task
encoding across the multiple demand cortex is consistent
with a frontoparietal and cingulo-opercular dual networks
distinction. Zeitschrift für Neurowissenschaften, 36, 6147–6155. https://doi
.org/10.1523/JNEUROSCI.4590-15.2016, PubMed: 27277793
Delorme, A., & Makeig, S. (2004). EEGLAB: An open source
toolbox for analysis of single-trial EEG dynamics including
independent component analysis. Zeitschrift für Neurowissenschaften
Methoden, 134, 9–21. https://doi.org/10.1016/j.jneumeth.2003
.10.009, PubMed: 15102499
de Wit, L., Alexander, D., Ekroll, V., & Wagemans, J. (2016). Is
neuroimaging measuring information in the brain?
Psychonomic Bulletin & Rezension, 23, 1415–1428. https://doi
.org/10.3758/s13423-016-1002-0, PubMed: 26833316
Di Russo, F., Pitzalis, S., Spitoni, G., Aprile, T., Patria, F., Spinelli,
D., et al. (2005). Identification of the neural sources of the
pattern-reversal VEP. Neurobild, 24, 874–886. https://doi
.org/10.1016/j.neuroimage.2004.09.029, PubMed: 15652322
Dienes, Z. (2011). Bayesian versus orthodox statistics: Which
side are you on? Perspectives on Psychological Science,
6, 274–290. https://doi.org/10.1177/1745691611406920,
PubMed: 26168518
Dienes, Z. (2016). How Bayes factors change scientific practice.
Journal of Mathematical Psychology, 72, 78–89. https://doi
.org/10.1016/j.jmp.2015.10.003
Duncan, J. (2010). The multiple-demand (MD) system of the
primate brain: Mental programs for intelligent behavior.
Trends in den Kognitionswissenschaften, 14, 172–179. https://doi.org/10
.1016/j.tics.2010.01.004, PubMed: 20171926
Duncan, J., Assem, M., & Shashidhara, S. (2020). Integrated
intelligence from distributed brain activity. Trends in
Cognitive Sciences, 24, 838–852. https://doi.org/10.1016/j.tics
.2020.06.012, PubMed: 32771330
Folstein, J. R., & Van Petten, C. (2008). Influence of cognitive
control and mismatch on the N2 component of the ERP: A
Rezension. Psychophysiology, 45, 152–170. https://doi.org/10
.1111/j.1469-8986.2007.00602.x, PubMed: 17850238
Fuchs, M. D., Snyder, A. Z., Vincent, J. L., Corbetta, M., Van Essen,
D. C., & Rachel, M. E. (2005). The human brain is intrinsically
organized into dynamic, anticorrelated functional networks.
Verfahren der Nationalen Akademie der Wissenschaften, USA.,
102, 9673–9678. https://doi.org/10.1073/pnas.0504136102,
PubMed: 15976020
Goddard, E., Carlson, T. A., Dermody, N., & Woolgar, A. (2016).
Representational dynamics of object recognition: Feedforward
and feedback information flows. Neurobild, 128, 385–397.
https://doi.org/10.1016/j.neuroimage.2016.01.006, PubMed:
26806290
González-García, C., Formica, S., Wisniewski, D., & Brass, M.
(2021). Frontoparietal action-oriented codes support novel
instruction implementation. Neurobild, 226, 117608.
https://doi.org/10.1016/j.neuroimage.2020.117608, PubMed:
33271270
652
Zeitschrift für kognitive Neurowissenschaften
Volumen 34, Nummer 4
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
e
D
u
/
J
/
Ö
C
N
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
J
Ö
C
N
_
A
_
0
1
8
1
8
P
D
.
F
B
j
G
u
e
S
T
T
Ö
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
Gratton, G., Cooper, P., Fabiani, M., Fuhrmann, C. S., & Karayanidis, F.
(2017). Dynamics of cognitive control: Theoretical bases,
paradigms, and a view for the future. Psychophysiology, 55,
e13016. https://doi.org/10.1111/psyp.13016
Grootswagers, T., Cichy, R. M., & Carlson, T. A. (2018). Finding
decodable information that can be read out in behavior.
Neurobild, 179, 252–262. https://doi.org/10.1016/j
.neuroimage.2018.06.022, PubMed: 29886145
Grootswagers, T., Wardle, S. G., & Carlson, T. A. (2017).
Decoding dynamic brain patterns from evoked responses: A
tutorial on multivariate pattern analysis applied to time series
neuroimaging data. Zeitschrift für kognitive Neurowissenschaften, 29,
677–697. https://doi.org/10.1162/jocn_a_01068, PubMed:
27779910
Haxby, J. V. (2012). Multivariate pattern analysis of fMRI: Der
early beginnings. Neurobild, 62, 852–855. https://doi.org
/10.1016/j.neuroimage.2012.03.016, PubMed: 22425670
Haxby, J. V., Gobbini, M. ICH., Furey, M. L., Ishai, A., Schouten,
J. L., & Pietrini, P. (2001). Distributed and overlapping
representations of faces and objects in ventral temporal
Kortex. Wissenschaft, 293, 2425–2430. https://doi.org/10.1126
/science.1063736, PubMed: 11577229
Hebart, M. N., & Bäcker, C. ICH. (2018). Deconstructing
multivariate decoding for the study of brain function.
Neurobild, 180, 4–18. https://doi.org/10.1016/j.neuroimage
.2017.08.005, PubMed: 28782682
Hebart, M. N., Bankson, B. B., Harel, A., Bäcker, C. ICH., & Cichy, R. M.
(2018). The representational dynamics of task and object
processing in humans. eLife, 7, 1–21. https://doi.org/10.7554
/eLife.32816, PubMed: 29384473
Hubbard, J., Kikumoto, A., & Mayr, U. (2019). EEG decoding
reveals the strength and temporal dynamics of goal-relevant
Darstellungen. Wissenschaftliche Berichte, 9, 9051. https://doi.org/10
.1038/s41598-019-45333-6, PubMed: 31227796
Ich bin, C.-H., Gururajan, A., Zhang, N., Chen, W., & Er, B. (2007).
Spatial resolution of EEG cortical source imaging revealed by
localization of retinotopic organization in human primary visual
Kortex. Journal of Neuroscience Methods, 161, 142–154. https://
doi.org/10.1016/j.jneumeth.2006.10.008, PubMed: 17098289
Jackson, J. B., Feredoes, E., Reich, A. N., Lindner, M., & Woolgar,
A. (2021). Concurrent neuroimaging and neurostimulation
reveals a causal role for dlPFC in coding of task-relevant
Information. Communications Biology, 4, 1–16. https://doi
.org/10.1038/s42003-021-02109-x, PubMed: 34002006
Jackson, J., Reich, A. N., Williams, M. A., & Woolgar, A. (2017).
Feature-selective attention in frontoparietal cortex:
Multivoxel codes adjust to prioritize task-relevant information.
Zeitschrift für kognitive Neurowissenschaften, 29, 310–321. https://doi
.org/10.1162/jocn_a_01039, PubMed: 27626230
Jackson, J. B., & Woolgar, A. (2018). Adaptive coding in the
human brain: Distinct object features are encoded by
overlapping voxels in frontoparietal cortex. Kortex, 108,
25–34. https://doi.org/10.1016/j.cortex.2018.07.006, PubMed:
30121000
Jeffreys, H. (1961). Theory of probability (3rd ed.). Oxford:
Oxford University Press.
Kado, H., Higuchi, M., Shimogawara, M., Haruta, Y., Adachi, Y.,
Kawai, J., et al. (1999). Magnetoencephalogram systems
developed at KIT. IEEE Transactions on Applied
Superconductivity, 9, 4057–4062. https://doi.org/10.1109/77
.783918
Karayanidis, F., Jamadar, S., Ruge, H., Phillips, N., Heathcote, A., &
Forstmann, B. U. (2010). Advance preparation in task-switching:
Converging evidence from behavioral, brain activation, Und
model-based approaches. Grenzen in der Psychologie, 1, 25.
https://doi.org/10.3389/fpsyg.2010.00025, PubMed: 21833196
Karimi-Rouzbahani, H., Woolgar, A., & Reich, A. N. (2021). Neuronal
signatures of vigilance decrements predict behavioral errors
before they occur. eLife, 10, e60563. https://doi.org/10.7554
/eLife.60563, PubMed: 33830017
Kikumoto, A., & Mayr, U. (2020). Conjunctive representations
that integrate stimuli, responses, and rules are critical for
action selection. Proceedings of the National Academy of
Wissenschaften, USA., 117, 10603–10608. https://doi.org/10.1073
/pnas.1922166117, PubMed: 32341161
Long, N. M., & Kuhl, B. A. (2018). Bottom–up and top–down
factors differentially influence stimulus representations
across large-scale attentional networks. Zeitschrift für
Neurowissenschaften, 38, 2495–2504. https://doi.org/10.1523
/JNEUROSCI.2724-17.2018, PubMed: 29437930
Moerel, D., Reich, A. N., & Woolgar, A. (2021). Selective attention
and decision-making have separable neural bases in space and
Zeit [preprint]. BioRxiv, 2021.02.28.433294. https://doi.org
/10.1101/2021.02.28.433294
Morey, R. D., Rouder, J. N., Jamil, T., Urbanek, S., Forner, K., &
Ly, A. (2018). Package “BayesFactor”. https://cran.r-project
.org/web/packages/BayesFactor/BayesFactor.pdf
Oosterhof, N. N., Connolly, A. C., & Haxby, J. V. (2016).
CoSMoMVPA: Multi-modal multivariate pattern analysis of
neuroimaging data in MATLAB/GNU octave. Grenzen in
Neuroinformatics, 10, 27. https://doi.org/10.3389/fninf.2016
.00027, PubMed: 27499741
Pisauro, M. A., Fouragnan, E., Retzler, C., & Philiastides, M. G.
(2017). Neural correlates of evidence accumulation during
value-based decisions revealed via simultaneous EEG–fMRI.
Nature Communications, 8, 15808. https://doi.org/10.1038
/ncomms15808, PubMed: 28598432
Posner, M. ICH., & Presti, D. E. (1987). Selective attention and
cognitive control. Trends in den Neurowissenschaften, 10, 13–17.
https://doi.org/10.1016/0166-2236(87)90116-0
Posner, M. ICH., & Snyder, C. R. R. (1975). Attention and cognitive
Kontrolle. In R. L. Solso (Ed.), Information processing and
Erkenntnis: The Loyola symposium. Erlbaum.
Ritchie, J. B., & Carlson, T. A. (2016). Neural decoding and
“inner” psychophysics: A distance-to-bound approach for
linking mind, Gehirn, and behavior. Frontiers in Neuroscience,
10, 1–8. https://doi.org/10.3389/fnins.2016.00190, PubMed:
27199652
Ritchie, J. B., Tovar, D. A., & Carlson, T. A. (2015). Emerging
object representations in the visual system predict reaction
times for categorization. PLoS Computational Biology, 11,
e1004316. https://doi.org/10.1371/journal.pcbi.1004316,
PubMed: 26107634
Robinson, A. K., Grootswagers, T., & Carlson, T. A. (2019). Der
influence of image masking on object representations during
rapid serial visual presentation. Neurobild, 197, 224–231.
https://doi.org/10.1016/j.neuroimage.2019.04.050, PubMed:
31009746
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson,
G. (2009). Bayesian t tests for accepting and rejecting the null
Hypothese. Psychonomic Bulletin & Rezension, 16, 225–237.
https://doi.org/10.3758/PBR.16.2.225, PubMed: 19293088
Świątkowski, W., & Carrier, A. (2020). There is nothing magical
about Bayesian statistics: An introduction to epistemic
probabilities in data analysis for psychology starters. Basic
and Applied Social Psychology, 42, 387–412. https://doi.org
/10.1080/01973533.2020.1792297
Tagliabue, C. F., Veniero, D., Benwell, C. S. Y., Cecere, R.,
Savazzi, S., & Thut, G. (2019). The EEG signature of sensory
evidence accumulation during decision formation closely
tracks subjective perceptual experience. Wissenschaftliche Berichte, 9,
4949. https://doi.org/10.1038/s41598-019-41024-4, PubMed:
30894558
Takacs, A., Mückschel, M., Roessner, V., & Beste, C. (2020).
Decoding stimulus–response representations and their
stability using EEG-based multivariate pattern analysis.
Robinson, Reich, and Woolgar
653
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
e
D
u
/
J
/
Ö
C
N
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
J
Ö
C
N
_
A
_
0
1
8
1
8
P
D
.
F
B
j
G
u
e
S
T
T
Ö
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
Cerebral Cortex Communications, 1, tgaa016. https://doi.org
/10.1093/texcom/tgaa016, PubMed: 34296094
Teichmann, L., Grootswagers, T., Carlson, T. A., & Reich, A. N.
(2019). Seeing versus knowing: The temporal dynamics of
real and implied color processing in the human brain.
Neurobild, 200, 373–381. https://doi.org/10.1016/j
.neuroimage.2019.06.062, PubMed: 31254648
Teichmann, L., Moerel, D., Bäcker, C., & Grootswagers, T.
(2021). An empirically-driven guide on using Bayes factors for
M/EEG decoding. BioRxiv, 2021.06.23.449663. https://doi.org
/10.1101/2021.06.23.449663
Teichmann, L., Quek, G. L., Robinson, A. K., Grootswagers, T.,
Carlson, T. A., & Reich, A. N. (2020). The influence of
object-color knowledge on emerging object representations
in the brain. Zeitschrift für Neurowissenschaften, 40, 6779–6789.
https://doi.org/10.1523/JNEUROSCI.0158-20.2020, PubMed:
32703903
Vidaurre, D., Myers, N. E., Stokes, M., Nobre, A. C., & Woolrich,
M. W. (2019). Temporally unconstrained decoding reveals
consistent but time-varying stages of stimulus processing.
Hirnrinde, 29, 874–863. https://doi.org/10.1093/cercor
/bhy290, PubMed: 30535141
Vincent, J. L., Kahn, ICH., Snyder, A. Z., Rachel, M. E., & Buckner,
R. L. (2008). Evidence for a frontoparietal control system
revealed by intrinsic functional connectivity. Zeitschrift für
Neurophysiologie, 100, 3328–3342. https://doi.org/10.1152/jn
.90355.2008, PubMed: 18799601
Wagenmakers, E. (2007). A practical solution to the pervasive
problems of p values. Psychonomic Bulletin and Review, 14,
779–804. https://doi.org/10.3758/BF03194105, PubMed:
18087943
Walther, D. B., Caddigan, E., Fei-Fei, L., & Beck, D. M. (2009).
Natural scene categories revealed in distributed patterns of
activity in the human brain. Zeitschrift für Neurowissenschaften, 29,
10573–10581. https://doi.org/10.1523/JNEUROSCI.0559-09
.2009, PubMed: 19710310
Wen, T., Duncan, J., & Mitchell, D. J. (2019). The time-course of
component processes of selective attention. Neurobild,
199, 396–407. https://doi.org/10.1016/j.neuroimage.2019.05
.067, PubMed: 31150787
Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., &
Wagenmakers, E. J. (2011). Statistical evidence in experimental
Psychologie: An empirical comparison using 855 t tests.
Perspectives on Psychological Science, 6, 291–298. https://doi
.org/10.1177/1745691611406923, PubMed: 26168519
Wetzels, R., & Wagenmakers, E.-J. (2012). A default Bayesian
hypothesis test for correlations and partial correlations.
Psychonomic Bulletin & Rezension, 19, 1057–1064. https://doi
.org/10.3758/s13423-012-0295-x, PubMed: 22798023
Williams, M. A., Dang, S., & Kanwisher, N. G. (2007). Only some
spatial patterns of fMRI response are read out in task
Leistung. Naturneurowissenschaften, 10, 685–686. https://doi
.org/10.1038/nn1900, PubMed: 17486103
Woolgar, A., Afshar, S., Williams, M. A., & Reich, A. N.
(2015). Flexible coding of task rules in frontoparietal
Kortex: An adaptive system for flexible cognitive
Kontrolle. Zeitschrift für kognitive Neurowissenschaften, 27,
1895–1911. https://doi.org/10.1162/jocn_a_00827,
PubMed: 26058604
Woolgar, A., Dermody, N., Afshar, S., Williams, M. A., & Reich, A. N.
(2019). Meaningful patterns of information in the brain
revealed through analysis of errors [preprint]. BioRxiv,
673681. https://doi.org/10.1101/673681
Woolgar, A., Duncan, J., Manes, F., & Fedorenko, E. (2018).
Fluid intelligence is supported by the multiple-demand
system not the language system. Nature Human Behavior,
2, 200–204. https://doi.org/10.1038/s41562-017-0282-3,
PubMed: 31620646
Woolgar, A., Hampshire, A., Thompson, R., & Duncan, J. (2011).
Adaptive coding of task-relevant information in human
frontoparietal cortex. Zeitschrift für Neurowissenschaften, 31,
14592–14599. https://doi.org/10.1523/JNEUROSCI.2616-11
.2011, PubMed: 21994375
Woolgar, A., Jackson, J., & Duncan, J. (2016). Coding of visual,
auditory, rule, and response information in the brain: 10
Years of multivoxel pattern analysis. Zeitschrift für Kognition
Neurowissenschaften, 28, 1433–1454. https://doi.org/10.1162/jocn_a
_00981, PubMed: 27315269
Woolgar, A., Parr, A., Cusack, R., Thompson, R., Nimmo-Smith,
ICH., Torralva, T., et al. (2010). Fluid intelligence loss linked
to restricted regions of damage within frontal and parietal
Kortex. Verfahren der Nationalen Akademie der Wissenschaften,
USA., 107, 14899–14902. https://doi.org/10.1073/pnas
.1007928107, PubMed: 20679241
Woolgar, A., Williams, M. A., & Reich, A. N. (2015). Attention
enhances multi-voxel representation of novel objects in
frontal, parietal and visual cortices. Neurobild, 109,
429–437. https://doi.org/10.1016/j.neuroimage.2014.12.083,
PubMed: 25583612
Woolgar, A., & Zopf, R. (2017). Multi-sensory coding in the
multiple-demand regions: Vibrotactile task information is
coded in frontoparietal cortex. Journal of Neurophysiology,
118, 703–716. https://doi.org/10.1152/jn.00559.2016,
PubMed: 28404826
Zellner, A., & Siow, A. (1980). Posterior odds ratios for selected
regression hypotheses. Trabajos de Estadistica y de
Investigacion Operativa, 31, 585–603. https://doi.org/10
.1007/BF02888369
654
Zeitschrift für kognitive Neurowissenschaften
Volumen 34, Nummer 4
l
D
Ö
w
N
Ö
A
D
e
D
F
R
Ö
M
H
T
T
P
:
/
/
D
ich
R
e
C
T
.
M
ich
T
.
e
D
u
/
J
/
Ö
C
N
A
R
T
ich
C
e
–
P
D
l
F
/
/
/
/
3
4
4
6
3
9
1
9
9
6
6
7
8
/
J
Ö
C
N
_
A
_
0
1
8
1
8
P
D
.
F
B
j
G
u
e
S
T
T
Ö
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3