Does Ventromedial Prefrontal Cortex Damage Really
Increase Impulsiveness? Delay and Probability
Discounting in Patients with Focal Lesions
Jenkin N. Y. Mok1, Leonard Green2, Joel Myerson2, Donna Kwan1, Jake Kurczek3,
Elisa Ciaramelli4, Carl F. Craver2, and R. Shayna Rosenbaum1,5
Astratto
■ If the tendency to discount rewards reflects individuals’ gen-
eral level of impulsiveness, then the discounting of delayed and
probabilistic rewards should be negatively correlated: The less a
person is able to wait for delayed rewards, the more they should
take chances on receiving probabilistic rewards. It has been
suggested that damage to the ventromedial prefrontal cortex
(vmPFC) increases individuals’ impulsiveness, but both inter-
temporal choice and risky choice have only recently been as-
sayed in the same patients with vmPFC damage. Here, we
assess both delay and probability discounting in individuals with
vmPFC damage (n = 8) or with medial temporal lobe (MTL) dam-
age (n = 10), and in age- and education-matched controls (n =
30). On average, MTL-lesioned individuals discounted delayed
rewards at normal rates but discounted probabilistic rewards
more shallowly than controls. In contrasto, vmPFC-lesioned indi-
viduals discounted delayed rewards more steeply but probabilis-
tic rewards more shallowly than controls. These results suggest
that vmPFC lesions affect the weighting of reward amount rela-
tive to delay and certainty in opposite ways. Inoltre, whereas
MTL-lesioned individuals and controls showed typical, nonsig-
nificant correlations between the discounting of delayed and
probabilistic rewards, vmPFC-lesioned individuals showed a sig-
nificant negative correlation, as would be expected if vmPFC
damage increases impulsiveness more in some patients than
in others. Although these results are consistent with the hy-
pothesis that vmPFC plays a role in impulsiveness, it is unclear
how they could be explained by a single mechanism governing
valuation of both delayed and probabilistic rewards. ■
l
D
o
w
N
o
UN
D
e
D
F
R
o
M
H
T
T
P
:
/
/
D
io
R
e
C
T
.
M
io
T
.
e
D
tu
/
j
/
o
C
N
UN
R
T
io
C
e
–
P
D
l
F
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
C
N
_
UN
_
0
1
7
2
1
P
D
.
F
B
sì
G
tu
e
S
T
T
o
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
INTRODUCTION
People must often make decisions involving future and/or
risky outcomes that require them to choose between
smaller-immediate and larger-delayed rewards or between
smaller-certain and larger-probabilistic rewards. Such deci-
sions are modeled in the laboratory using tasks that mea-
sure delay and probability discounting, where the terms
delay discounting and probability discounting, rispettivamente,
refer to the finding that increasing the time to a future
reward and/or decreasing the likelihood of a probabilistic
reward decrease the reward’s subjective value.
It has been proposed that a common mechanism (impul-
sive decision-making) underlies both delay discounting and
probability discounting. After all, rewards available after lon-
ger delays are actually less certain than immediate rewards,
and both types of discounting are well described by a
hyperboloid function (Verde & Myerson, 2004). Tuttavia,
previous research has shown that delay and probability
discounting respond in opposite ways to manipulations of
1York University, Toronto, Ontario, Canada, 2Washington
Università, St. Louis, Missouri, 3Loras College, Dubuque, Iowa,
4Università di Bologna, Italy, 5Rotman Research Institute,
Toronto, Ontario, Canada
© 2021 Istituto di Tecnologia del Massachussetts
reward amount, and also reflect relatively independent
traits in healthy adults, as evidenced by the finding that
the tendency to discount delayed rewards is often uncorre-
lated with the tendency to discount probabilistic rewards
(for a review, see Green & Myerson, 2013). Di conseguenza,
exactly how these two types of discounting are related
remains a matter of dispute.
Examining neural mechanisms of decision-making
could shed light on the relation between delay and prob-
ability discounting. Functional neuroimaging experiments
on delay discounting (per esempio., Benoit, Gilbert, & Burgess,
2011; Peters & Büchel, 2010) show that the effects of epi-
sodic imagining on the value of future rewards are medi-
ated by increased activity and coordination between the
ventromedial prefrontal cortex (vmPFC) and the medial
temporal lobes (MTLs). Direct support for a vmPFC role
in value-based decisions comes from studies showing that
lesions to the vmPFC may impact subjective valuation and
weighing of key visual attributes pertinent to the process
involved in reward-driven decision-making ( Vaidya,
Sefranek, & Fellows, 2018; Vaidya & Fellows, 2015).
Infatti, Seaman et al. (2018) found that subjective valua-
tion of different decision types—delay, probability, E
effort-based discounting—share overlapping activity in
the medial PFC after differences in participants’ discount
rates across the three tasks are taken into consideration.
Journal of Cognitive Neuroscience 33:9, pag. 1909–1927
https://doi.org/10.1162/jocn_a_01721
Activation of the vmPFC has further been shown to oc-
cur during value comparison and when evaluating differ-
ences between outcomes (cioè., magnitude, immediate
availability; Hare, Hakimi, & Rangel, 2014; Boorman,
Rushworth, & Behrens, 2013) and various categories or
perceptual inputs of rewards (Bartra, McGuire, & Kable,
2013; Levy & Glimcher, 2012; see Clithero & Rangel,
2014). The vmPFC/orbitofrontal cortex has been implicat-
ed in reward sensitivity and greater subjective risk-taking
tendencies (Blankenstein, Peper, Crone, & van
Duijvenvoorde, 2017; Engelmann & Tamir, 2009). In sep-
arate work, Luhmann, Chun, Yi, Lee, and Wang (2008)
found that vmPFC/orbitofrontal cortex contributes to the
valuation of both delayed and probabilistic reward types,
suggesting that activation in this region leads to the value
of both kinds of rewards being represented in a common
“neural currency” and domain-general subjective valua-
tion system (Bartra et al., 2013; Peters & Büchel, 2009;
Montague & Berns, 2002; see Weber & Huettel, 2008,
for a review).
Previous studies have reported that patients with lesions
to the vmPFC show steeper discounting of future rewards
compared to healthy and brain-damaged controls (Peters &
D’Esposito, 2016; Sellitto, Ciaramelli, & di Pellegrino, 2010;
but see Fellows & Farah, 2005), consistent with the view
that vmPFC is critical for reward valuation. As noted by
Stuss and Levine (2002), patients with vmPFC lesions also
have difficulties imagining detail-rich future events, and this
may relate to their steep delay discounting (see also
Bertossi, Tessini, Cappelli, & Ciaramelli, 2016). Tuttavia,
patients with MTL lesions also have impaired future think-
ing, yet they are indistinguishable from matched controls in
delay discounting (Kwan, Craver, Verde, Myerson, &
Rosenbaum, 2013; Kwan et al., 2012), at least in the absence
of episodic cues (Kwan et al., 2015; Palombo, Keane, &
Verfaellie, 2015). This warrants further inquiry into the rela-
tion between future thinking and delay discounting in
vmPFC (and MTL) patients. Per esempio, the future is inher-
ently less certain than the past. Is this the reason why, SU
delay discounting tasks, vmPFC patients tend to choose
smaller, immediate rewards available now, over larger re-
wards not available until later? Does this suggest that
such patients bypass more deliberate consideration in-
formed by reward utility? If this is the case, we would ex-
pect steep delay discounting in vmPFC patients to be
accompanied by steep probability discounting. Questo è,
as much as an individual with vmPFC damage will
choose smaller, immediate rewards over larger, delayed
ones, so, pure, will these patients be expected to choose
smaller, certain rewards as opposed to gambling on
larger, probabilistic ones. This dual pattern has been
observed in rats with lesions in homologous regions
(Mobini et al., 2002).
Notably, Tuttavia, vmPFC patients are not classically,
nor consistently, described as risk averse. In seminal
studies using the Iowa Gambling Task, vmPFC patients
were significantly more likely than controls to choose
from “bad” decks that result in large, immediate gains
but even larger losses overall than “good” decks (Hochman,
Yechiam, & Bechara, 2010; Bechara, Tranel, & Damasio,
2000; Bechara, Tranel, Damasio, & Damasio, 1996), sug-
gesting greater risk-taking. This pattern of results also is
observed in MTL patients (Rosenbaum et al., 2016;
Gupta et al., 2009; Gutbrod et al., 2006). Tuttavia, perfor-
mance on gambling tasks may be confounded because
probabilities must be learned, placing greater demands
on working memory and declarative memory (Mata, Josef,
Samanez-Larkin, & Hertwig, 2011; Floden, Alexander,
Kubu, Katz, & Stuss, 2008), and because reward delivery
and contingencies have differed markedly across studies.
A more recent study with vmPFC patients showed in-
creased risk-taking only under “hot” decision-making con-
ditions in which immediate reward feedback was provided
after each choice, requiring the online integration of affec-
tive states with other sources of information (per esempio., reward
probability or magnitude), and not under “cold” conditions
where feedback was provided cumulatively at the end of the
task, thus minimizing integration demands and leading to
more deliberate decision-making (Spaniol, Di Muro, &
Ciaramelli, 2019). Probability discounting tasks like the
one used in this study represent cold conditions, as no
feedback is provided, E, because they are quite different
from card tasks like the one used by Spaniol et al., Essi
provide a test of the robustness of their findings.
To date, only one other study has investigated both prob-
ability discounting and delay discounting in patients with
focal lesions to vmPFC (Peters & D’Esposito, 2020), E
the results were consistent with shallower probability
discounting and steeper delay discounting than in control
participants. Tuttavia, a separate patient-lesion study
comparing choice between sure and fixed risky gambles
of gains and losses (50% certainty) that used a smaller
patient group was unable to establish clear differences in
risky reward choice selection between vmPFC patients
and controls; a significant difference was found only when
vmPFC patients were compared to a nonspecific group of
patient controls (Pujara, Wolf, Baskaya, & Koenigs, 2015).
Così, this study will be one of the first to formally investi-
gate whether vmPFC patients discount probabilistic, risky
rewards more or less steeply than controls using an estab-
lished iterative choice-adjusting procedure (Verde &
Myerson, 2004). Inclusion of MTL-lesion patients as a
comparison group will further help to determine if delay
and probability discounting are affected similarly when
episodic future thinking is compromised (Bertossi, Aleo,
Braghittoni, & Ciaramelli, 2016; Bertossi, Tesini, et al.,
2016).
Here, we test the idea that focal lesions that affect one
type of discounting necessarily affect the other type.
Importantly, we test this idea at both the group level as well
as at the level of the individual patient. Per esempio, if a
lesion group’s discounting of probabilistic rewards is, SU
average, shallower than that of controls, reflecting greater
risk-taking, will their discounting of delayed rewards also
1910
Journal of Cognitive Neuroscience
Volume 33, Numero 9
l
D
o
w
N
o
UN
D
e
D
F
R
o
M
H
T
T
P
:
/
/
D
io
R
e
C
T
.
M
io
T
.
e
D
tu
/
j
/
o
C
N
UN
R
T
io
C
e
–
P
D
l
F
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
C
N
_
UN
_
0
1
7
2
1
P
D
.
F
B
sì
G
tu
e
S
T
T
o
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
differ from that of controls, and if so, will it be shallower or
steeper? And at the individual level, if a patient’s probability
discounting is shallower than average for their group, will
their delay discounting be shallower as well, or will it be
steeper, as would be predicted if their lesion has increased
their impulsiveness? If delay and probability discounting
share a component process supported by vmPFC, as we
suspect, then lesions of vmPFC should affect both types
of discounting. Inoltre, if that process contributes to
an individual’s impulsiveness, then delay and probability
discounting should be affected in opposite ways at both
the group and the individual level. In this study, we take a
patient-lesion approach inspired by Donald Stuss and
colleagues to shed light on the precise neural computa-
tion supported by vmPFC when rewards are evaluated as
well as on the very nature of impulsiveness.
METHODS
Participants
Focal Lesion Patients
All patients were recruited from Baycrest Health Sciences.
Patients were in the stable phase of recovery and had no
additional diagnosis that would affect cognitive abilities
other than those pertaining to their brain injuries.
vmPFC
Eight individuals (four men) with vmPFC lesions were
tested, seven of whom acquired focal brain lesions follow-
ing rupture of an anterior communicating artery (ACoA)
aneurysm (M age = 57.5 years, SD = 9.5 years). IL
eighth, R. l. (76 years old), was identified as having a focal
vmPFC lesion following an anterior cerebral artery stroke.
All patients were tested between 2015 E 2019, almeno
12 months post-lesion (range: 12–96 months). Inclusion of
patients was based on the location of their lesion evident
on MRI or computerized tomography scans (Guarda la figura 1).
Individual vmPFC lesions were manually drawn on each
slice of normalized T1-weighted template MRI scans from
the Montreal Neurological Institute using MRIcro software
(Rorden & Brett, 2000), based on the most recent MRI or
computerized tomography scan available. This manual
procedure combines segmentation (identification of le-
sion boundaries) and registration (to a standard template)
into a single step, with no additional transformation re-
quired (Kimberg, Coslett, & Schwartz, 2007). Figura 1
shows the location, extent, and overlap of the vmPFC pa-
tients’ lesions. Lesions were bilateral in six of the eight
cases and left-lateralized in the other two cases, largely af-
fecting Brodmann’s areas (BAs) 10, 11, 32, 24, E 25. Four
patients had minimal damage to lateral PFC (BAs 9, 46, 47),
constituting ∼5% of their lesion volume, whereas their
vmPFC lesions were on average 10 times larger. Patients
C. R. and R. l. had damage to visual cortex (BAs 17, 18,
19, 37) that constituted ∼41% and ∼32% of their lesion
volume, rispettivamente. These patients did not have visual
problems precluding their participation in the study.
They attained normal scores on the Rey–Osterrieth
Complex Figure test (percentile scores: 66 E 68;
Spreen & Strauss, 1998) and on the Wechsler Test of
Adult Reading (percentile scores: 55 E 47; Holdnack,
2001), and showed a good understanding of the dis-
counting test instructions.
MTL
Ten individuals (all men, M age = 55.3 years, SD =
5.9 years) with MTL lesions also were tested. The etiol-
ogy of brain damage for these cases included anoxia (n =
4), encephalitis (n = 2), stroke (n = 2), temporal lobe
resection (n = 1), and traumatic brain injury (n = 1).
All of the patients have been described previously
(Robin, Rivest, Rosenbaum, & Moscovitch, 2019; Keven,
Kurczek, Rosenbaum, & Craver, 2017; Kwan, Kurczek, &
Rosenbaum, 2016; Kwan et al., 2013, 2015), with the excep-
tion of two patients (R. V. and J. M.). K. C.’s and L. D.’s le-
sions were bilateral and included the hippocampus and
surrounding MTL cortices. K. C. had widespread lesions
beyond the MTL including small lesions to left and right
posteromedial orbitofrontal cortex (Gao et al., 2020).
D. A.’s lesions were also widespread, extending beyond
the MTL bilaterally (though primarily right) and into ven-
tral frontal, anterior cingulate, and occipital cortices. B. l.
experienced bilateral lesions to his hippocampus that se-
lectively affected the dentate gyrus and part of the CA3
subfield. He also experienced volume loss within the left
superior parietal lobe and right precuneus. S. N.’s hippo-
campal damage was greater on the left, with additional
volume loss to left occipital lobe and basal nuclei. M. H.
contracted herpes simplex encephalitis, resulting in bilat-
eral MTL atrophy as well as damage along the right medial
occipital and inferotemporal cortices (Keven et al., 2017).
D. G., J. D., and J. M. suffered anoxia secondary to cardiac
arrest and could not be scanned because of medical contra-
indications. MTL pathology in these cases was inferred based
on etiology and neuropsychological profiles (Tavolo 1).
Six of the participants with MTL lesions had been pre-
viously tested on the delay discounting task, and their
data were included for comparison in this study: K. C.
(Kwan et al., 2012), D. UN. and D. G. (Kwan et al., 2013),
l. D., B. L., and S. N. (Kwan et al., 2015). Data for three
of the patients (K. C., D. A., and D. G.) who had been tested
on the probability discounting task (Kwan et al., 2013)
were also included for comparison. See Table 1 for addi-
tional demographic information and neuropsychological
test performance for both patient groups.
Importantly, most of the vmPFC and MTL patients have
documented deficits in episodic prospection, producing
fewer internal (episodic) details than healthy controls on
a Galton-Crovitz cue-word test. Results for 5 del 10 MTL
patients (D. A., D. G., l. D., S. N., and B. L.) were previously
reported (Kwan et al., 2016). Results of the episodic pros-
Mok et al.
1911
l
D
o
w
N
o
UN
D
e
D
F
R
o
M
H
T
T
P
:
/
/
D
io
R
e
C
T
.
M
io
T
.
e
D
tu
/
j
/
o
C
N
UN
R
T
io
C
e
–
P
D
l
F
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
C
N
_
UN
_
0
1
7
2
1
P
D
.
F
B
sì
G
tu
e
S
T
T
o
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
Figura 1. Lesion location and
extent in vmPFC patients. (UN)
Axial slice template illustrating
lesion overlap across vmPFC
patients. Slices are 8 mm apart
at z = −30, −22, −14, −6,
+2, E +10, with level of
slice depicted in the sagittal
reference image. The color
bar indicates the number of
patients with damage to a
particular area, with purple
representing regions damaged
in only one patient and red
representing regions damaged
in all eight patients. The image
was created using MRIcro
software (Chris Rorden; www
.psychology.nottingham.ac.uk
/staff/cr1/mricro.html). (B) Axial
slice templates illustrating the
lesion location and extent for
each of the vmPFC patients.
Slices are 8 mm apart at z =
−22, −17, −12, −7, −2, +3,
+8, +13, +18, +23, +28.
Neurological convention is
followed (left hemisphere
presented on the left).
Details of lesion location
and size are provided in
the article, and etiology,
demographic information,
and neuropsychological profiles
are presented in Table 1.
l
D
o
w
N
o
UN
D
e
D
F
R
o
M
H
T
T
P
:
/
/
D
io
R
e
C
T
.
M
io
T
.
e
D
tu
/
j
/
o
C
N
UN
R
T
io
C
e
–
P
D
l
F
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
C
N
_
UN
_
0
1
7
2
1
P
D
.
F
B
sì
G
tu
e
S
T
T
o
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
pection abilities of three additional MTL patients and six of
eight vmPFC patients are listed in Table 2, with compari-
sons made with the control group from Kwan et al. (2016).
Controls
Performance of 30 age-matched control participants
(16 men; age range: 46–67 years, M age = 58.4 years, SD =
6.3 years) was compared to that of each patient group
on the delay and probability discounting tasks. Control
participants were screened for variables associated with
steeper than average discounting (Madden & Bickel,
2010), including smoking, significant alcohol and drug
use, and gambling problems according to Diagnostic and
Statistical Manual of Mental Disorders, Fourth Edition,
Text Revision (American Psychiatric Association, 2000);
DSM-5: Diagnostic and Statistical Manual of Mental
Disorders, Fifth Edition (APA, 2013) criteria. Although 31
participants were tested, one proved to be a significant
outlier on the probability discounting task and was ex-
cluded from all subsequent analyses. All participants were
fluent in English. Participants gave informed written con-
sent and received monetary compensation in accordance
with the Human Research Ethics Committees of York
University and Baycrest Health Sciences.
Delay Discounting
All participants completed the same computerized delay
discounting task that had been used previously to test
1912
Journal of Cognitive Neuroscience
Volume 33, Numero 9
Tavolo 1. Demographic and Neuropsychological Data for vmPFC and MTL Participants
Case
Etiology
Age
Sex
Edu
IQ/PF
WCST
vmPFC
C. R.
M. T.
R. l.
M. M.
J. W.
S. B.
M. P.
ACoA
ACoA
ACA
ACoA
ACoA
ACoA
ACoA
J. UN. G.
ACoA
MTL
D. UN.
D. G.
l. D.
S. N.
B. l.
K. C.
R. V.
Encephalitis
Anoxia
TLR
Stroke
Anoxia
TBI
Stroke
M. H.
Encephalitis
J. M.
J. D.
Anoxia
Anoxia
54
50
76
58
58
45
54
65
62
48
61
46
52
62
51
56
51
64
M
M
F
M
F
M
F
F
M
M
M
M
M
M
M
M
M
M
17
12
16
18
15
12
13
15
17
16
19
12
13
16
16
13
16
19
99
98
102
98
99
116
103
117
92
111
114
92
99
104
110
95
240
LF
–
20%
40%
–
> 16%
–
Word List Learning
ROCF
AQ
LDFR
Recog
Copy
DR
1%
4%
81%
8%
< 0.7% < 0.7% 50% < 0.7% 68–70% 84–86% 1–2% 13% 66–68% 61–63% 6–7% < 0.7% 22–23% 18–19% > 16%
< 2% – 11–16% 50% 30% > 16% 30–40%
1% < 0.02% 30–32% 1–2% 1% < 0.03% < 0.02% 58–61% 2–3% 2–3% – 50–60% 1% < 0.7% – 3–9% 8% 70% > 16% 21–32%
< 1% < 1% < 0.02% > 99%
> 16%
7–13%
3–8%%
3–6% < 0.02% 21–32% > 16% 21–32%
< 1% < 1% – 1% 21–32% 6–10% 21–32% 0.05% < 0.02% < 1% 21–32% > 16% 58–68% 21–32%
14–19%
< 0.7% 14–19% > 16%
11–16%
7–13%
7–13%
< 1% < 1% < 0.02% > 99%
1%
< 1% < 0.02% 14–19% > 16% 21–32%
7–13%
2–3% < 0.02% 70–81% > 16%
> 16%
2–3%
< 1%
< 1% < 0.02%
< 1%
7–13% 13–14%
< 1%
50%
–
1%
3–6%
< 1%
< 1%
3–6%
< 1%
–
13%
< 1%
42%
2–3%
< 1%
< 1%
Age = age in years; Edu = education in years; IQ = full scale IQ; P. F. = premorbid functioning, based on National Adult Reading Test for M. T. and M. M.;
Wechsler Test of Adult Reading for R. L. and J. A. G. (vmPFC); FSIQ based on Wechsler Adult Intelligence Scale–Revised for D. A., D. G., and K. C.,
Wechsler Adult Intelligence Scale–III for L. D. and S. N., Wechsler Adult Intelligence Scale–IV for B. L., R. V., and M. H. (MTL); The following were
reported in percentiles compared to normative samples: WCST = Wisconsin Card Sorting Task; L. F. = Letter Fluency; for Word List Learning, learning
based on Wechsler Memory Scale Verbal Paired Associates for M. P. and J. A. G., Hopkins Verbal Learning Test–Revised for L. D., Kaplan Baycrest
Neurocognitive Assessment, word-list Learning for S. N., California Verbal Learning Test–II for all others; for Stories ( WMS): LM I/ II = Logical
Memory I/II; ROCF = Rey–Osterrieth Complex Figure Test; DR = Delay Recall; ACA = anterior cerebral artery.
several of the participants with MTL lesions. Over a series of
trials, participants were presented with pairs of hypothetical
monetary amounts and made choices between a smaller,
immediate reward and a larger, delayed reward. They were
told that the task assessed their preferences and that there
were no correct or incorrect choices. An immediate reward
amount, which changed depending on participants’ previ-
ous choices, was presented along with a larger delayed re-
ward amount ($100 or $2000) that was available after one of
seven delays (1 week, 1 month, 3 months, 6 months, 1 year,
3 years, 10 years), presented in random order. Across six tri-
als, an iterative, adjusting-amount procedure converged on
the estimate of the amount of immediate reward that the
participant judged to be subjectively equal in value to the
delayed reward. For example, in the condition where a fu-
ture hypothetical reward of $2000, if chosen, would be received in 3 months, the first choice presented to the par- ticipants was “$1000 right now or $2000 in 3 months?” If the participant chose “$1000 right now,” the choice on the sec-
ond trial would be between “$500 right now” and “$2000 in
3 years.” If the participant chose “$2000 in 3 months,” the choice on the third trial would be “$750 right now or
$2000 in 3 months.” Thus, adjustments in the amount of immediate reward were made such that the first ad- justment was half the difference between the immediate and delayed reward amounts presented on the first trial, with each subsequent adjustment being half the preced- ing adjustment. Following the sixth and final trial of each delay condition, the subjective value of the delayed re- ward was estimated as the amount of immediate reward that would be presented if there were a seventh trial (see Green & Myerson, 2004). Mok et al. 1913 l D o w n o a d e d f r o m h t t p : / / d i r e c t . m i t . e d u / j / o c n a r t i c e - p d l f / / / 3 3 9 1 9 0 9 1 9 5 6 0 9 1 / / j o c n _ a _ 0 1 7 2 1 p d . f b y g u e s t t o n 0 8 S e p e m b e r 2 0 2 3 Probability Discounting Patients and controls also completed a probability dis- counting task previously described in Kwan et al. (2013). For patients, the probability discounting task was com- pleted on the same day as the delay discounting task, which was completed first, with a 30- to 45-min interval between discounting tasks, during which the participants completed questionnaires and other behavioral tasks unrelated to the discounting tasks (not reported in the current study). Control participants completed both discounting tasks in a counterbalanced order on separate days, with 1–3 weeks between the tasks. Participants were told that the task assessed their pref- erences and that there were no correct or incorrect choices. Over a series of trials, participants were presented with pairs of hypothetical monetary amounts and made choices between a smaller, certain reward and a larger, probabilistic reward. For each of two probabilistic amounts ($250 and $2,000), participants were asked to make choices between certain rewards and probabilistic rewards with a 90%, 75%, 50%, 20%, 10%, or 5% chance of receiving the reward, with the probabilities presented in random order. As in the delay discounting task, an iter- ative, adjusting-amount procedure was used in which the amount of the certain reward changed depending on the participant’s previous selection. Across six trials, this pro- cedure converged on an estimate of the amount of cer- tain reward that the participant judged to be subjectively equal in value to the probabilistic reward. For example, in the condition where a reward of $2000 had a 50% chance
of being received, the first choice was “$1000 for sure or Table 2. Performance on a Galton-Crovitz Cue Word Test of Episodic Prospection in vmPFC and MTL Patients Internal Details External Details Case z-Score % Rank Descriptive Label z-Score % Rank Descriptive Label vmPFC C. R. M. T. R. L. M. M. J. W. S. B. M. P. J. A. G. MTL D. A. D. G. L. D. S. N. B. L. K. C. R. V. M. H. J. M. J. D. −2.48 – 0.38 −2.02 – −1.97 −2.40 −1.79 −1.65 −2.46 −0.89 −2.07 −1.43 −2.68 – −2.28 −2.28 – < 0.9th Severely Impaired – > 63rd Average < 3rd Borderline – – – < 3rd Mild–Moderately Impaired < 0.9th Severely Impaired < 4th Borderline < 5th Borderline < 0.8th Severely Impaired < 19th Low Average < 2nd < 8th Moderately Impaired Borderline < 0.4th Severely Impaired – < 2nd < 2nd – – Moderately Impaired Moderately Impaired – −1.26 – −0.90 −1.03 – 0.92 −1.76 −1.42 −0.72 −1.85 0.40 1.23 1.46 −2.20 – −1.47 −1.91 – < 12th Low Average – < 19th < 16th – 82nd < 4th < 8th – Low Average Low Average – High Average Borderline Borderline < 25th Low Average < 4th Borderline > 63rd > 88th Average High Average > 92nd Superior < 2nd Moderately Impaired – < 8th < 3rd – – Low Average Mild–Moderately Impaired – Internal details refer to episodic information (e.g., time, place, people, objects, thoughts, and emotions) specific to a central event that a person might experience in the future. External details refer to details that are not specific to the central event and/or that are semantic (factual) in nature and not specific to time and place, repetitions, commentary on the event, or other metacognitive statements. Scoring of the Galton-Crovitz Task Episodic Prospection Task is based on internal and external details of the Autobiographical Interview (Levine, Svoboda, Hay, Winocur, & Moscovitch, 2002). “High Average” and “Superior” performance indicate an excess of details. Patients’ scores are compared to scores of a demographically matched control group reported in Kwan et al. (2016). 1914 Journal of Cognitive Neuroscience Volume 33, Number 9 l D o w n o a d e d f r o m h t t p : / / d i r e c t . m i t . e d u / j / o c n a r t i c e - p d l f / / / 3 3 9 1 9 0 9 1 9 5 6 0 9 1 / / j o c n _ a _ 0 1 7 2 1 p d . f b y g u e s t t o n 0 8 S e p e m b e r 2 0 2 3 $2000 with a 50% chance?” Adjustments in the amount of
the certain reward were made such that the first adjust-
ment was half of the difference between the certain and
probabilistic amount presented on the first trial, with
each subsequent adjustment being half the preceding
adjustment. Following the sixth and final trial of each
probability condition, the subjective value of the probabi-
listic reward was estimated as the amount of certain re-
ward that would be presented if there were a seventh trial.
Experimental Design and Statistical Analysis
The degree to which a participant discounted delayed and
probabilistic rewards was assessed using the area-under-
the-curve (AuC) discounting measure. The AuC is theoret-
ically neutral in that it represents the area under observed
subjective values rather than under a curve representing a
particular theoretical model fit to those subjective values
(Myerson, Green, & Warusawitharana, 2001). The “curve”
is actually a series of lines on a graph with the delays until
or odds against receiving a reward expressed as a propor-
tion of the maximum delay or odds against and the subjec-
tive values expressed as a proportion of the maximum
delayed or probabilistic amount. Note that the odds
against a probabilistic reward are equal to [(1 − p)/p],
where p is the probability of receiving the reward.
AuCs are calculated by first normalizing the delays, odds
against, and subjective values to make it easier to compare
the discounting of different reward amounts. The area un-
der the discounting curve is then subdivided into trape-
zoids, and the area of each trapezoid is calculated as A =
(x2 − x1)( y1 + y2) / 2, where values of x represent succes-
sive delays or odds against and values of y represent sub-
jective values associated with these delays or odds against.
The AuC represents the sum of the areas of all the trape-
zoids and can range from 0.0 (maximal discounting) to 1.0
(no discounting).
Because our plan was to compare each patient group’s
discounting rate to baseline measures based on a single,
larger control group, we began our analyses by assessing
the representativeness of our participant groups and the
reliability of our discounting measures and procedures.
We did this by examining the internal consistency of the
AuC data for our participant groups on each type of dis-
counting task and the degree to which their performances
met benchmarks established based on previous studies of
discounting in healthy adults (for a review, see Green &
Myerson, 2010).
We then subjected all of the AuC data to a single 3
(Group) × 2 (Task) × 2 (Amount) mixed ANOVA, with
Task (delay, probability) and Amount (smaller, larger) as
repeated-measures factors. We were primarily interested
in possible differences in discounting between the lesion
groups, although differences would likely have to be inter-
preted in light of any observed interactions. Based on pre-
vious reports that amount has opposite effects on delay
and probability discounting in healthy participants, we
predicted that Type of Task would interact with Amount,
perhaps even cancelling out the effects of Amount.
However, the effects of Amount might also be different
for different groups and/or types of task, leading to a
three-way interaction between Group, Task, and Amount
that might well cancel out the effects of Group.
Accordingly, our three-way ANOVA was followed by
four planned comparisons, each of which compared the
control group to a specific lesion group performing a
specific task (i.e., delay discounting by MTL patients, delay
discounting by vmPFC patients, probability discounting by
MTL patients, and probability discounting by vmPFC
patients) of both reward amounts in order to explicate
the observed pattern of interactions. Finally, because the
hypothesis of individual differences in a general impulsive-
ness trait predicts that individuals who show steep delay
discounting will also show shallow probability discount-
ing, we examined the correlation between delay and
probability discounting for each group separately.
RESULTS
We begin our analyses of the AuC data by assessing the
internal consistency of the discounting measures in our
patient groups. This is especially important for the
vmPFC group because previous studies have noted in-
creased vmPFC activity during irregular preference judg-
ments (Kurtz-David, Persitz, Webb, & Levy, 2019). In
patient studies, more erratic judgments and greater incon-
sistencies in choice selections under conditions of uncer-
tainty (e.g., risky or ambiguous decisions) have been
observed for patients with focal damage to the vmPFC
compared to age- and education-matched controls
(Henri-Bhargava, Simioni, & Fellows, 2012; Fellows,
2011; Fellows & Farah, 2007). In fact, additional research
has shown that the vmPFC may even be more specifically
involved in value-based decision-making for risky choices
across both human and animal models (Spaniol et al.,
2019; Abela & Chudasama, 2013; Weber & Huettel, 2008).
We first identified whether inconsistent preferences
were observed for each individual participant across both
discounting tasks, separately for the smaller and larger re-
ward amount conditions. For delay discounting, a mono-
tonically decreasing discounting curve is expected when
the subjective value (R1) of the future outcome R at a given
delay (t1) is greater than the subjective value (R2) at the
immediately following delay (t2; where t2 > t1; Johnson
& Bickel, 2008). In accordance with the method proposed
by Sellitto et al. (2010), we accounted for variability in the
data by counting the number of “inconsistent choices”
where the subjective value R2 was greater than the subjec-
tive value R1 at the preceding delay by more than 10% Di
the amount of the future outcome (cioè., R2 > R1 + R/10).
Neither the small amount (vmPFC = 0.75; MTL = 0.80;
control = 0.33), F(2, 45) = 2.83, p = .07, ηp
2 = .11, nor
the large amount (vmPFC = 0.75; MTL = 0.40; control =
0.33), F(2,45) = 0.84, p = .43, ηp
2 = .04, conditions revealed
Mok et al.
1915
l
D
o
w
N
o
UN
D
e
D
F
R
o
M
H
T
T
P
:
/
/
D
io
R
e
C
T
.
M
io
T
.
e
D
tu
/
j
/
o
C
N
UN
R
T
io
C
e
–
P
D
l
F
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
C
N
_
UN
_
0
1
7
2
1
P
D
.
F
B
sì
G
tu
e
S
T
T
o
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
Figura 2. Mean subjective value
as a function of delay until
receiving the reward for the
vmPFC, MTL, and control
groups. The top and bottom
present the data from the
smaller ($100) and larger ($2000) delayed reward amount
conditions, rispettivamente.
l
D
o
w
N
o
UN
D
e
D
F
R
o
M
H
T
T
P
:
/
/
D
io
R
e
C
T
.
M
io
T
.
e
D
tu
/
j
/
o
C
N
UN
R
T
io
C
e
–
P
D
l
F
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
C
N
_
UN
_
0
1
7
2
1
P
D
.
F
B
sì
G
tu
e
S
T
T
o
N
0
8
S
e
P
e
M
B
e
R
2
0
2
3
significant differences in the mean number of inconsistent
choices across participant groups for the delay discounting
task, replicating previous findings (Sellitto et al., 2010).
The same procedure also was applied for the probability
discounting task. Unlike delay discounting, one-way
ANOVA revealed a significant Group effect for the small
amount condition, F(2, 45) = 5.71, P < .01, ηp
2 = .20.
Post hoc comparisons revealed a significant difference
between the mean number of inconsistent choices for
the vmPFC group (M = 0.875) compared to the MTL
group (M = 0.00), t = 3.36, p < .01, d = 1.34, after
Bonferroni correction. For the large amount condition,
one-way ANOVA also revealed a significant Group differ-
ence, F(2, 45) = 8.89, p < .001, ηp
2 = .28. Post hoc com-
parisons revealed significant differences between the
vmPFC group (M = 1.25) and the MTL group (M =
0.30), t = 3.26, p < .01, d = 1.12, as well as the
vmPFC group with the control group (M = 0.23), t =
4.16, p < .001, d = 1.70, after Bonferroni correction.
These inconsistencies observed in probability discount-
ing but not delay discounting support our inclusion of
the “control” MTL patient-lesion group and agrees with
the notion that impaired preferences may be the result
of vmPFC’s contribution more to conditions of uncertainty
and risk (Abela & Chudasama, 2013; Weber & Huettel,
2008; Fellows & Farah, 2007).
We also looked at the correlation between the degree of
discounting of smaller and larger amounts for each of our
participant groups. As expected, the vmPFC group
showed strong correlations for both delay discounting (r
= .87, p ≤ .001) and probability discounting (r = .73, p <
.05). The MTL group did not show significant correlations
between amounts for delay discounting (r = .27, p = .45),
but showed strong correlations for probability discount-
ing, which is the task of primary interest in the current
study (r = .92, p ≤ .001), supporting the inclusion of the
MTL patients as a patient comparison group.
We also assessed the control group in the same manner.
Correlations between the degree of discounting of smaller
and larger rewards were equally strong for our controls,
regardless of whether the rewards were delayed (r =
.88, p < .001) or probabilistic (r = .89, p < .001). In con-
trast, the correlation between measures of delay and prob-
ability discounting was not significant, regardless of
whether the correlation between delay and probability dis-
counting was assessed for each amount condition sepa-
rately or whether the AuC measures for the control
group were averaged across the smaller and larger reward
1916
Journal of Cognitive Neuroscience
Volume 33, Number 9
Figure 3. Mean AuC for the
vmPFC, MTL, and control
groups. The top and bottom
present the data from the
smaller and larger delayed
reward amount conditions,
respectively. The circles
represent individual
participants’ data from each
group overlaid on their
respective bars.
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
conditions (r = .163, p = .389). The finding of a nonsignif-
icant positive correlation between delay and probability
discounting is consistent with the benchmark set by many
previous studies of discounting in healthy adults (Green &
Myerson, 2010). Finally, the control group showed both of
the benchmark magnitude effects commonly observed in
healthy adults: shallower discounting of larger delayed re-
wards (t = 3.87, p < .001, d = 0.71) but steeper discount-
ing of larger probabilistic rewards (t = 5.78, p < .001, d =
1.06).
With the patient and neurotypical control groups estab-
lished as appropriate comparison groups, the AuC data
for all three groups were submitted to a 3 (Group) × 2
(Task) × 2 (Amount) mixed ANOVA. Although the main
effect of Group was not significant, F(2, 45) = 1.97, p =
.151, Group strongly interacted with Task, F(2, 45) =
6.32, p = .004, ηp
2 = .219, consistent with the fact that
the vmPFC group showed steeper delay discounting
and shallower probability discounting than the other
two groups. A three-way Group × Task × Amount interac-
tion also was observed, F(2, 45) = 4.10, p = .023, ηp
2 =.154,
consistent with the fact that larger group differences were ob-
served in the larger amount condition. Finally, there was a
significant Task × Amount interaction, consistent with the
fact that, overall, the amount effects on the probability dis-
counting task tended to be larger than those on the delay dis-
counting task: F(1, 45) = 5.73, p = .021, ηp
2 =.113.
Delay Discounting
Figure 2 presents group mean subjective values of the
delayed rewards plotted as a function of the delay until
their receipt. Both patient groups and control participants
showed clear evidence of delay discounting as indicated
by decreases in subjective value as the delay until the
reward increased.
Mok et al.
1917
Group mean AuC scores are presented in Figure 3. The
vmPFC patients appear to have discounted delayed rewards
more steeply than the participants in the control group, as
indicated by their smaller AuCs. Only the control group
appears to show the usual magnitude effect in which
smaller delayed rewards are discounted more steeply than
larger ones (Green, Myerson, & McFadden, 1997).
Our first planned comparison was conducted on the
AuCs of the MTL and control groups for the delay dis-
counting task. Neither the main effect of Group nor the
effect of Amount was significant: F(1, 38) = 0.011, p =
.917, and F(1, 38) = 4.08, p = .051, respectively. The inter-
action between Amount and Group also failed to reach sig-
nificance, F(1, 38) = 1.73, p = .196, although as noted
previously, there was a significant effect of Amount (shal-
lower discounting of larger delayed rewards) in the control
group.
Our second planned comparison, conducted on the
delay discounting AuCs of the vmPFC and control groups,
also failed to reveal significant effects of Group or Amount:
F(1, 36) = 1.74, p = .196 and F(1, 36) = 1.43, p = .239.
However, these results must be interpreted in light of
the significant interaction between Group and Amount,
F(1, 36) = 6.50, p = .015, ηp
2 = .038, which suggests that
the magnitude of the differences between the groups are
significantly different between the two amount conditions.
This is consistent with the fact that the difference between
the patients and control participants (i.e., steeper dis-
counting by vmPFC patients) was larger for the larger
delayed reward than for the smaller delayed reward condi-
tion, although neither was significant ( ps = .07 and .51,
respectively; see Figure 3).
Probability Discounting
Figure 4 presents group mean subjective values of the
probabilistic rewards as a function of the odds against their
receipt. Again, both patient groups, as well as the controls,
exhibited discounting of both the smaller and larger re-
wards. In contrast to the delay discounting curves seen
in Figure 2, however, the vmPFC patients tended to show
higher subjective values for probabilistic rewards than
MTL patients and participants in the control group, partic-
ularly when the probability of reward was low (and the
odds against were high).
Figure 4. Mean subjective value
as a function of the odds against
receiving the reward for the
vmPFC, MTL, and control
groups. The top and bottom
present the data from the
smaller ($250) and larger ($2000) probabilistic reward
amount conditions,
respectively.
1918
Journal of Cognitive Neuroscience
Volume 33, Number 9
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Figure 5. Mean AuC for the
vmPFC, MTL, and control
groups. The top and bottom
present the data from the
smaller and larger probabilistic
reward amount conditions,
respectively. The circles
represent individual
participants’ data from each
group overlaid on their
respective bars. **p < .01.
***p < .001.
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Group mean AuC scores on the probability discounting
task are presented in Figure 5. The vmPFC patients appear
to have discounted probabilistic rewards less steeply than
the participants in the control group in both amount con-
ditions, and less steeply than the MTL group in the large
amount condition. Whereas both the MTL patients and
the control participants appear to have discounted smaller
probabilistic rewards less steeply than larger ones, the
vmPFC group discounted both smaller and larger amounts
to approximately the same degree.
Our third planned comparison was conducted on the
AuCs of the MTL and control groups for the probability dis-
counting task. This analysis revealed a significant effect of
Group, reflecting shallower discounting by the MTL
group: F(1, 38) = 10.13, p = .003, ηp
2 = .211. There also
was a significant effect of Amount, F(1, 38) = 29.60, p <
.001, ηp
2 = .438, consistent with the magnitude effect for
probabilistic rewards usually observed in healthy
participants. The interaction of group and amount was
not significant, F(1, 38) = 1.70, p = .200.
Finally, our fourth planned comparison focused on the
vmPFC and control groups’ probability discounting AuCs.
There was a significant main effect of Group, F(1, 36) =
23.10, p < .001, ηp
2 = .391, which may reflect the shallower
discounting of probabilistic rewards by the vmPFC group
compared to the controls. Although the main effect of
Amount was not significant, F(1, 36) = 1.28, p = .265,
there was a statistically significant interaction between
Amount and Group, F(1, 36) = 4.27, p = .046, ηp
2 =
.106, which may reflect the fact that, whereas the vmPFC
group’s discounting showed little effect of reward amount,
the control group showed the magnitude effect for prob-
ability discounting (steeper discounting of larger probabilis-
tic rewards) usually observed in healthy participants.
Consistent with this interpretation, tests for simple main
effects revealed group differences for both smaller and
Mok et al.
1919
task. As already noted with respect to the control group,
the correlation between participants’ delay and probability
discounting was not significant: r = .163, p = .389 (see the
top of Figure 6). A similar lack of significant correlation be-
tween delay and probability discounting was observed for
the MTL group: r = .214, p = .553 (see the middle of
Figure 6). Contrary to the idea that a unitary impulsiveness
trait underlies both the ability to delay gratification and
risk aversion, these correlations not only failed to reach
significance; they also were in the direction opposite to
that predicted.
The correlation between the vmPFC patients’ delay and
probability discounting was not only significant, r =
−.750, p = .032; it also was negative (see the bottom of
Figure 6), in contrast to the nonsignificant correlations ob-
served for participants in both the MTL and neurotypical
control groups. That is, the correlation for the vmPFC
group was in the direction expected if these patients var-
ied in impulsiveness, such that those who were less willing
to wait (as indicated by their lower delay discounting
AuCs) were also more willing to take risks (as indicated
by their higher probability discounting AuCs).
DISCUSSION
Financial choices are sensitive to the temporal proximity,
likelihood, and amount of each option (Rangel, Camerer,
& Montague, 2008), as is evident from the way neurotypi-
cal individuals tend to discount the value of delayed and
probabilistic outcomes (Green & Myerson, 2010).
However, a neurotypical individual’s tendency to discount
delayed rewards more or less steeply is relatively indepen-
dent of their tendency to discount probabilistic rewards
(Green & Myerson, 2013). The current study tested
whether focal lesions that affect one type of discounting
necessarily affect the other type, with the goal of revealing
component processes shared by different forms of dis-
counting. Importantly, we tested this idea at both the
group level as well as at the level of the individual patient.
In the current study, the vmPFC and MTL patient and
control groups all showed systematic discounting of both
delayed and probabilistic rewards, although important
quantitative differences in degree of discounting were ob-
served. On average, vmPFC-lesioned individuals dis-
counted delayed rewards more steeply but discounted
probabilistic rewards less steeply than controls, whereas
MTL-lesioned individuals discounted delayed rewards at
normal rates but discounted probabilistic rewards less
steeply than neurotypical controls. These results suggest
that vmPFC lesions affect the weighting of reward amount
relative to delay and certainty in opposite ways.
Notably, patients with MTL lesions did not differ from
controls in the degree to which they discounted delayed
rewards, but compared to the controls, they discounted
probabilistic rewards to a significantly lesser extent, sug-
gesting that they put less weight on the likelihood of actu-
ally getting a reward. That is, they were more likely to
Figure 6. Individual mean AuCs (averaged across the two amount
conditions) for the delay discounting task, plotted as a function of their
mean AuCs for the probability discounting task. Data for the control
group are shown in the top, data for the MTL group are shown in the
middle, and data for the vmPFC group are shown in the bottom.
larger reward amounts: F(1, 36) = 13.54, and 30.40, ps
< .001, respectively.
Relations between Delay and
Probability Discounting
Our final set of analyses examined the relations between
individuals’ performance on the two types of discounting
1920
Journal of Cognitive Neuroscience
Volume 33, Number 9
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
gamble on the possibility of getting a reward, whereas the
controls were significantly more risk averse. Importantly,
some of these patients have extensive lesions affecting the
hippocampus and surrounding MTL cortices (e.g., K. C.,
D. A.) and yet these patients are indistinguishable from
controls in delay discounting despite impaired episodic
memory and episodic future thinking. In contrast, patients
with vmPFC lesions did tend to discount delayed rewards
more steeply than the control group, with the size of the
difference increasing with the amount of reward; like MTL
patients, they discounted probabilistic rewards less steeply
than controls. Differences between the vmPFC and con-
trols were amplified with larger reward amounts, reflecting
the control participants’ tendency to be more risk averse
when the stakes were higher, whereas the vmPFC patients
were unaffected in this regard.
As Green and Myerson (2013) and others have noted,
delay and probability discounting are similar in that, in
both cases, subjective value shows systematic, negatively
accelerated decreases that are well described by hyperbo-
loid functions (see Figures 2 and 4). They are different,
however, in that, in healthy adults, varying the amount
of reward has opposite effects on delay and probability dis-
counting (Myerson, Green, Hanson, Holt, & Estle, 2003;
Green, Myerson, & Ostaszewski, 1999). Myerson et al.
(2003) further showed that the degree to which an individ-
ual discounts delayed rewards is, at most, weakly positively
related to the degree to which that individual discounts
probabilistic rewards. This finding, which was replicated
in our analyses of participants in the control group, argues
against the hypothesis that delay and probability discount-
ing represent a unitary underlying trait of impulsiveness in
healthy adults. The unitary trait hypothesis implies that in-
dividuals’ delay and probability discounting should be
negatively correlated with one another. According to this
view, impulsive individuals have both a strong preference
for immediate rewards over delayed ones and a strong ten-
dency to gamble on getting a large reward rather than a
smaller, certain one, although with the former, they risk
getting no reward at all.
As already noted, the correlation between delay and
probability discounting in the control group was weakly
positive, but not significantly so. Importantly, whereas a
similar relation was observed in the MTL patients, the
vmPFC patients showed a strong negative correlation be-
tween individual patients’ delay and probability discount-
ing (see Figure 6), a finding that would be expected if
vmPFC lesions affected the degree of their “impulsiveness.”
The fact that, as a group, vmPFC patients also showed both
steeper delay discounting and shallower probability dis-
counting is consistent with that interpretation.
Previously, researchers examining the effects of vmPFC
lesions in humans have primarily studied intertemporal
choice, which includes delay discounting (Peters &
D’Esposito, 2016; Sellitto et al., 2010; Fellows & Farah,
2005). Lesion studies on the vmPFC have also considered
risky choice but have relied for the most part on
laboratory-based gambling tasks or animal models (e.g.,
Spaniol et al., 2019; St. Onge & Floresco, 2010; Bechara
et al., 2000), or have not observed consistent findings sup-
porting comparative differences between patients and
matched controls in probability discounting (Pujara
et al., 2015). The overall patterns (i.e., steeper discounting
for delayed rewards or preference for risky rewards com-
pared to controls) have been reported, but this study is
among the first to observe both these patterns in the same
patients (see also Peters & D’Esposito, 2020). Importantly,
the present investigation did so by using analogous tasks
specifically designed to facilitate direct comparisons of in-
tertemporal and risky choice (Green & Myerson, 2004). It
is also the first study to directly compare performance of
vmPFC patients on both discounting tasks with that of
MTL patients who have similar deficits in episodic future
thinking. The results have important implications for the
localization of function in decision-making and for the
nature of the mechanisms involved.
Decision-making by Intact Brains
In neurotypical adults, there appear to be neural systems
for which activity reflects valuation of both delayed and
probabilistic rewards as well as other systems involved
in domain-specific valuation (e.g., Seaman et al., 2018).
Using fMRI to examine the neural bases of delay and
probability discounting, Peters and Büchel (2009) found
that activity in fronto-polar, lateral parietal, and posterior
cingulate cortices correlated with the value of delayed,
but not probabilistic, rewards, whereas activity in superior
parietal cortex and middle occipital areas correlated with
the value of probabilistic, but not delayed, rewards.
Notably, activity in ventral striatum and vmPFC coded for
subjective value in a domain-general manner, suggesting
that these regions integrate results from the domain-
specific valuation systems into a common neural currency
that is involved in value computation across tasks and is
utilized across different reward types and stages of
decision-making (Clithero & Rangel, 2014; Bartra et al.,
2013; Levy & Glimcher, 2012). Furthermore, activity in
these regions can be dissociated from activity in other re-
ward valuation regions (including anterior insula, other
striatal regions, and dorsomedial PFC) involved in arousal,
saliency of reward options, and meta-decision processes
(e.g., confidence and deliberation time of choices; see also
Clairis & Pessiglione, 2020). Studying individuals with focal
lesions to these brain regions provides more definitive ev-
idence regarding the localization of function in decision-
making mechanisms, particularly with respect to the issue
of domain-general versus domain-specific processes.
Decision-making by Brains with Focal Lesions
In this study, patients with vmPFC lesions not only showed
steeper delay discounting than controls, but they also
Mok et al.
1921
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
showed shallower probability discounting, and within the
vmPFC group, those who showed the steepest delay dis-
counting also showed the shallowest probability discount-
ing. These findings are consistent with the results of
previous studies that investigated each kind of decision-
making in isolation (for reviews, see Bechara, 2011;
Sellitto, Ciaramelli, & di Pellegrino, 2011). Sellitto et al.
(2010) demonstrated that vmPFC lesions affect delay dis-
counting (see also Peters & D’Esposito, 2016; but see
Leland & Grafman, 2005), systematically increasing pa-
tients’ preferences for immediate rewards even when
those rewards are smaller than delayed ones. Although
previous studies suggest vmPFC lesions also affect risky
choice, the procedures usually required the participants
to learn probabilities from experience (Iowa Gambling
Task; Bechara et al., 1996; Bechara, Damasio, Damasio,
& Anderson, 1994). As a result, findings from these proce-
dures may be confounded, as studies comparing younger
and older adults have shown (for a review, see Mata et al.,
2011). That is, observed differences could reflect deficits
in either decision-making, learning, or both.
Fortunately, the present probability discounting proce-
dures do not require new learning by participants, and
therefore our finding that vmPFC patients show shallower
probability discounting than controls strongly support
previous conclusions regarding the effects of vmPFC le-
sions on risky choice. Our results are consistent with those
of a recent study of decision-making by Peters and
D’Esposito (2020) that also found both steeper delay dis-
counting and shallower probability discounting in patients
with focal lesions to vmPFC/orbitofrontal than in controls.
Consistent with previous work is the current finding that
MTL patients’ probability discounting was shallower than
that of controls (Rosenbaum et al., 2016; Gupta et al.,
2009; Gutbrod et al., 2006) and that their delay discount-
ing did not differ from that of controls (e.g., Kwan et al.,
2012, 2013). Notably, MTL patients’ pattern of impaired
probability discounting with preserved delay discounting
provides additional evidence that the two kinds of dis-
counting involve at least some separate processes.
Nevertheless, there still could be a cognitive process or
processes common to both delay and probability dis-
counting that might be affected by lesions of the vmPFC.
The present findings provide an answer to Peters’ (2011)
question of whether vmPFC/orbitofrontal cortex damage
affects only the valuation of delayed rewards, or whether
it leads to “a more general impairment in cost-benefit
decision-making that extends beyond the domain of inter-
temporal choice.” The present findings support the latter
view: Patients with focal vmPFC lesions differed from con-
trols in both the intemporal and risky choice domains, as
indicated by performance on both delay and probability
discounting tasks. The question that remains is why this
might be so. Intuitively, it would seem likely that delay
and probability discounting would involve a common pro-
cess because the future is inherently risky, but this intuition
is not borne in the data: Were this the case, vmPFC patients
should have evinced steep probability discounting and
should be risk averse just as they are attracted to immedi-
ate rewards. In this study, we found the opposite pattern.
One common process that may underlie performance
on delay and probability discounting is prospection (see
Szpunar, Spreng, & Schacter, 2014; Gilbert & Wilson,
2007), a hypothesis we can test, as the current study in-
volves two patient populations with important, yet qualita-
tively different, prospection deficits ( Verfaellie, Wank,
Reid, Race, & Keane, 2019; Bertossi, Tesini, et al., 2016;
Rosenbaum et al., 2016; Kwan et al., 2013, 2015).
Although prospection is more commonly associated with
delay discounting (Boyer, 2008), some theories of risky
choice posit that choices involving probabilistic outcomes
also involve consideration of future outcomes (e.g.,
Loomes & Sugden, 1982). For example, regret theories
of risky choice posit that gambles involve prospection in
the form of imagining possible future outcomes (i.e., win-
ning and losing the gamble and the regret that would fol-
low a loss). The fact that both vmPFC patients and MTL
patients show steep probability discounting, and that both
groups fail to show consistent effects of reward magni-
tude, might support a link between discounting behavior
and prospection. However, the results observed on delay
discounting argue against this possibility.
Although previous studies of the effects of episodic cue-
ing demonstrate that prospection can play a role in delay
discounting (e.g., Mok et al., 2020; Bulley et al., 2019;
O’Donnell, Daniel, & Epstein, 2017), patients with MTL le-
sions who have severe prospection deficits nevertheless
exhibit typical, systematic discounting of delayed rewards.
As an extension of our previous findings, this systematic
discounting was observed at the group level and with a
larger group of patients than previously described by
Kwan et al. (2013). MTL patients also show the certainty
and common ratio effects (i.e., the Allais paradox; Craver
et al., 2014) benchmark characteristics of risky choice that
have been attributed to anticipated regret (Bell, 1982; see
also Klein, 2013).
Importantly, in this study, both patients with MTL le-
sions and patients with vmPFC lesions had deficits in pros-
pection, but only the vmPFC group differed significantly
from controls in delay discounting. One possibility is that,
although prospection can contribute to effective decision-
making, and may even compensate for cognitive deficits, it
is not required. Another possibility is that vmPFC and MTL
patients have qualitatively different prospection deficits,
and it is the form of prospection affected in vmPFC—but
not MTL—patients that has an impact on the valuation, or
even the conception, of future rewards. What then might
be the common process or mechanism that underlies the
observed effects of vmPFC lesions on delay and probability
discounting? It should be noted, of course, that there need
not be one. That is, the vmPFC could contain some neu-
rons contributing to intertemporal decision-making and
other neurons contributing to decisions involving risky
options, or it could contain neurons that do both.
1922
Journal of Cognitive Neuroscience
Volume 33, Number 9
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Delay and probability discounting require complex de-
cisions involving multiple cognitive processes. It is possi-
ble that performance on both tasks depends on schemas,
which refer to knowledge structures extracted across mul-
tiple experiences. Schemas influence how new events
(e.g., choice options) are perceived, and they have been
linked to the vmPFC in neuroimaging and patient-lesion
studies (Hebscher & Gilboa, 2016; Ghosh, Moscovitch,
Colella, & Gilboa, 2014; for a review, see Gilboa &
Marlatte, 2017). Reliance on schemas could explain the
surprising finding by Kwan et al. (2013) that MTL patients’
delay discounting does not differ from controls despite the
patients’ deficits in prospection. These results hold in the
current study, even with the addition of seven new MTL
patients to the patients described by Kwan et al. MTL patients
may compensate for their episodic memory deficits by rely-
ing on schemas along with simple heuristics or even apho-
risms that provide the basis for heuristics (e.g., sooner is
better, a bird in the hand). Although vmPFC patients, like
MTL patients, have prospection deficits, their schemas may
be compromised, unlike those of MTL patients, leading to
deficits in both delay and probability discounting for
vmPFC (but not MTL) patients.
An explanation for the direction of the differences on
the discounting tasks would not be necessary if impulsive-
ness were a basic behavioral tendency, as accounts that pit
impulsiveness against self-control imply. If it were, then
one could imagine a tendency toward impulsiveness being
“unmasked” or disinhibited by brain damage that some-
how weakened self-control. However, correlational data
from healthy adults do not support this view (for a review,
see Green & Myerson, 2010). This view is also not sup-
ported in light of previous findings by Donald Stuss
et al. who have shown that risk-taking can be dissociated
from impulsiveness within PFC (Floden et al., 2008). If
anything, the data support the opposite view; other things
being equal, the fundamental tendency may be to choose
rewards that are both immediate and certain, because
people generally prefer their rewards to come sooner
and with greater certainty.
Reward size also matters. People tend to want more (i.e.,
larger rewards), and they want their rewards sooner and for
sure. Reward amount is frequently pitted against immedi-
acy and certainty in choice situations. In light of the pres-
ent findings, the critical question no longer appears to be
whether the vmPFC’s contribution to decision-making
concerns valuation or prospection, as Peters (2011) had
suggested. Rather, the issue is how and why vmPFC le-
sions decrease the weight given to a reward’s amount rel-
ative to its immediacy, as reflected in steeper delay
discounting, but increase the weight given to a reward’s
amount relative to its likelihood, as reflected in shallower
probability discounting. An adequate account of the ef-
fects of vmPFC lesions will need to explain the differential
weighting of reward amount depending on whether a re-
ward is delayed or probabilistic. It is unclear at this time
how a single mechanism could underlie both of these
effects given that this pattern of behavior is not at all ob-
served in controls and likely plays no significant role in
reward discounting in neurotypical individuals.
There is indeed an alternative way to approach this is-
sue, as recently described by Hiser and Koenigs (2018).
They view the vmPFC as an area containing at least three
functionally specialized subregions, with each subregion
characterized by a pattern of connections with cortical
and subcortical structures appropriate to the subregion’s
function. Additional evidence is required to establish
whether or not this view of vmPFC function(s) is correct,
and, in any case, it is unclear how the proposed tripartite
structure could account for the apparent paradox of differ-
ential weighting of reward amount following vmPFC
lesions. Nevertheless, if the vmPFC is inherently multi-
functional, a thesis that forms the backbone of Donald
Stuss’s general approach to the PFC (Stuss, 2006, 2017;
Stuss, Rosenbaum, Malcolm, Christiana, & Keenan, 2005;
Stuss & Levine, 2002), then rather than being two aspects
of a single computational function, the integration of im-
mediacy and amount might well be a separate function
from the integration of likelihood and amount. In the ab-
sence of an alternative explanation for why focal lesions of
the vmPFC would have opposite effects on the weighting
of amount relative to other reward attributes (e.g., imme-
diacy, likelihood), the present findings suggest that these
are two distinct functions. Why these functions are differ-
entially affected by vmPFC lesions remains to be
understood.
Conclusions
Regardless of whether a multifunctional view or a more
traditional view of vmPFC function holds the key to under-
standing the issues raised by the current findings, we be-
lieve that these issues are fundamental and have
potentially important implications for our understanding
of both the vmPFC and decision-making itself. The present
findings suggest that, rather than being two aspects of a
single attribute-integration function involved in the valua-
tion of multi-attribute rewards, separate functions are
involved in the integration of amount with reward
immediacy and the integration of amount with reward
likelihood. This view raises the possibility that integration
of other outcome attributes also may involve separate
functions, although it should be noted that separate func-
tions do not require separate substrates (i.e., locations) or
even separate neurons, just separate circuits. The puzzle
of opposite effects of vmPFC lesions on the relative
weighting of reward amount remains, but one implication
is that consideration of the integration of other outcome
attributes, perhaps most prominently losses (Estle, Green,
& Myerson, 2019), may shed light on specialized integra-
tion functions in general. Although considerable effort,
both experimental and theoretical, may be required to
resolve these issues, we believe that their fundamental
nature justifies the effort.
Mok et al.
1923
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Discounting is an especially interesting aspect of
decision-making for two reasons: first, because the
outcomes of everyday choices typically have multiple attri-
butes and discounting focuses specifically on the problem
of attribute-integration, and second, because the relative
weighting of attributes like immediacy and likelihood ap-
pears to underlie many important behavioral problems at
both the individual (e.g., substance abuse) and societal
(e.g., climate change, pandemic) levels. The functions of
the vmPFC appear to be key to understanding such
attribute-integration issues, and as this study shows, focal
lesion patients can provide insight into these issues,
particularly when the same patients are studied using
tasks like delay and probability discounting that require
integration of different attributes.
Acknowledgments
This article is dedicated to the memory of Dr. Donald T. Stuss,
a pioneer in Clinical Neuropsychology and Cognitive
Neuroscience who moved the fields forward by uncovering the
complexity and fragility of the frontal lobes. His work continues
to influence theoretical, methodological, and clinical approaches
to understanding the basis of functions that may be at the core of
what makes us human. We thank Dr. Asaf Gilboa for assistance
in preparing images depicting lesion location and overlap.
Reprint requests should be sent to R. Shayna Rosenbaum,
Department of Psychology, York University, 4700 Keele St.,
Toronto, ON, M3J 1P3, Canada, or via e-mail: shaynar@yorku.ca.
Author Contributions
Jenkin N. Y. Mok: Conceptualization; Data curation; Formal
analysis; Investigation; Methodology; Project administration;
Writing—Original draft; Writing—Review & editing.
Leonard Green: Formal analysis; Funding acquisition;
Investigation; Methodology; Software; Writing—Original
draft; Writing—Review & editing. Joel Myerson: Formal
analysis; Funding acquisition; Investigation; Methodology;
Software; Writing—Original draft; Writing—Review &
editing. Donna Kwan: Conceptualization; Data curation;
Investigation; Methodology; Project administration; Writing—
Review & editing. Jake Kurczek: Conceptualization; Data
curation; Investigation; Methodology; Writing—Original
draft; Writing—Review & editing. Elisa Ciaramelli:
Methodology; Writing—Review & editing. Carl F. Craver:
Writing—Review & editing. R. Shayna Rosenbaum:
Conceptualization; Funding acquisition; Investigation;
Methodology; Resources; Supervision; Formal analysis;
Writing—Original draft; Writing—Review & editing.
Funding Information
Research reported in this article was funded by the Natural
Sciences and Engineering Research Council (NSERC;
https://dx.doi.org/10.13039/501100000038), grant RGPIN-
04238-2015, and Vision: Science to Applications ( VISTA)
York Research Chair in Cognitive Neuroscience of
Memory to R. S. R. Preparation of the article was also sup-
ported by the National Institute on Aging of the National
Institutes of Health (https://dx.doi.org/10.13039
/100000049), under award R01AG058885 to L. G. and J. M.
Diversity in Citation Practices
A retrospective analysis of the citations in every article
published in this journal from 2010 to 2020 has revealed
a persistent pattern of gender imbalance: Although the
proportions of authorship teams (categorized by esti-
mated gender identification of first author/last author) pub-
lishing in the Journal of Cognitive Neuroscience ( JoCN)
during this period were M(an)/M = .408, W(oman)/M =
.335, M/ W = .108, and W/ W = .149, the comparable pro-
portions for the articles that these authorship teams cited
were M/M = .579, W/M = .243, M/ W = .102, and W/ W =
.076 (Fulvio et al., JoCN, 33:1, pp. 3–7). Consequently,
JoCN encourages all authors to consider gender balance
explicitly when selecting which articles to cite and gives
them the opportunity to report their article’s gender cita-
tion balance.
REFERENCES
Abela, A. R., & Chudasama, Y. (2013). Dissociable contributions
of the ventral hippocampus and orbitofrontal cortex to
decision-making with a delayed or uncertain outcome.
European Journal of Neuroscience, 37, 640–647. DOI:
https://doi.org/10.1111/ejn.12071, PMID: 23190048
American Psychiatric Association. (2000). Diagnostic and
statistical manual of mental disorders (4th ed., text rev.).
Washington, DC: APA.
American Psychiatric Association. (2013). Diagnostic and
statistical manual of mental disorders (5th ed.). Arlington,
VA: American Psychiatric Publishing.
Bartra, O., McGuire, J. T., & Kable, J. W. (2013). The valuation
system: A coordinate-based meta-analysis of BOLD fMRI
experiments examining neural correlates of subjective value.
Neuroimage, 76, 412–427. DOI: https://doi.org/10.1016
/j.neuroimage.2013.02.063, PMID: 23507394, PMCID:
PMC3756836
Bechara, A. (2011) The somatic marker hypothesis and its
neural basis: Using past experiences to forecast the future in
decision making. In M. Bar (Ed.), Predictions in the brain
using our past to generate a future (pp. 122–133). New
York: Oxford University Press. DOI: https://doi.org/10.1093
/acprof:oso/9780195395518.003.0048
Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W.
(1994). Insensitivity to future consequences following damage
to the human prefrontal cortex. Cognition, 50, 7–15. DOI:
https://doi.org/10.1016/0010-0277(94)90018-3, PMID: 8039375
Bechara, A., Tranel, D., Damasio, H., & Damasio, A. R. (1996).
Failure to respond autonomically to anticipated future
outcomes following damage to prefrontal cortex. Cerebral
Cortex, 6, 215–225. DOI: https://doi.org/10.1093/cercor/6.2
.215, PMID: 8670652
Bechara, A., Tranel, D., & Damasio, H. (2000). Characterization
of the decision-making impairment of patients with bilateral
lesions of the ventromedial prefrontal cortex. Brain, 123,
2189–2202. DOI: https://doi.org/10.1093/brain/123.11.2189,
PMID: 11050020
1924
Journal of Cognitive Neuroscience
Volume 33, Number 9
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Bell, D. E. (1982). Regret in decision making under uncertainty.
Operations Research, 30, 961–981. DOI: https://doi.org/10
.1287/opre.30.5.961
Benoit, R. G., Gilbert, S. J., & Burgess, P. W. (2011). A neural
mechanism mediating the impact of episodic prospection
on farsighted decisions. Journal of Neuroscience, 31,
6771–6779. DOI: https://doi.org/10.1523/JNEUROSCI.6559
-10.2011, PMID: 21543607, PMCID: PMC6632845
Bertossi, E., Aleo, F., Braghittoni, D., & Ciaramelli, E. (2016).
Stuck in the here and now: Construction of fictitious and
future experiences following ventromedial prefrontal damage.
Neuropsychologia, 81, 107–116. DOI: https://doi.org/10.1016/j
.neuropsychologia.2015.12.015, PMID: 26707714
Bertossi, E., Tesini, C., Cappelli, A., & Ciaramelli, E. (2016).
Ventromedial prefrontal damage causes a pervasive
impairment of episodic memory and future thinking.
Neuropsychologia, 90, 12–24. DOI: https://doi.org/10.1016
/j.neuropsychologia.2016.01.034, PMID: 26827916
Blankenstein, N. E., Peper, J. S., Crone, E. A., & van
Duijvenvoorde, A. C. (2017). Neural mechanisms underlying
risk and ambiguity attitudes. Journal of Cognitive
Neuroscience, 29, 1845–1859. DOI: https://doi.org/10.1162
/jocn_a_01162, PMID: 28686139
Boorman, E. D., Rushworth, M. F., & Behrens, T. E. (2013).
Ventromedial prefrontal and anterior cingulate cortex adopt
choice and default reference frames during sequential multi-
alternative choice. Journal of Neuroscience, 33, 2242–2253.
DOI: https://doi.org/10.1523/JNEUROSCI.3022-12.2013,
PMID: 23392656, PMCID: PMC3743024
Boyer, P. (2008). Evolutionary economics of mental time travel?
Trends in Cognitive Sciences, 12, 219–224. DOI: https://doi
.org/10.1016/j.tics.2008.03.003, PMID: 18468941
Bulley, A., Miloyan, B., Pepper, G. V., Gullo, M. J., Henry, J. D., &
Suddendorf, T. (2019). Cuing both positive and negative
episodic foresight reduces delay discounting but does not
affect risk-taking. Quarterly Journal of Experimental
Psychology, 72, 1998–2017. DOI: https://doi.org/10.1177
/1747021818819777, PMID: 30501578
Clairis, N., & Pessiglione, M. (2020). Value, confidence and
deliberation in preference tasks: A triple dissociation in the
medial prefrontal cortex. bioRxiv. DOI: https://doi.org/10
.1101/2020.09.17.301291
Clithero, J. A., & Rangel, A. (2014). Informatic parcellation of
the network involved in the computation of subjective value.
Social Cognitive and Affective Neuroscience, 9, 1289–1302.
DOI: https://doi.org/10.1093/scan/nst106, PMID: 23887811,
PMCID: PMC4158359
Craver, C. F., Cova, F., Green, L., Myerson, J., Rosenbaum, R. S.,
Kwan, D., et al. (2014). An Allais paradox without mental time
travel. Hippocampus, 24, 1375–1380. DOI: https://doi.org/10
.1002/hipo.22318, PMID: 24976273
Engelmann, J. B., & Tamir, D. (2009). Individual differences in
risk preference predict neural responses during financial
decision-making. Brain Research, 1290, 28–51. DOI: https://
doi.org/10.1016/j.brainres.2009.06.078, PMID: 19576868,
PMCID: PMC4353645
Estle, S. J., Green, L., & Myerson, J. (2019). When immediate
losses are followed by delayed gains: Additive hyperboloid
discounting models. Psychonomic Bulletin & Review, 26,
1418–1425. DOI: https://doi.org/10.3758/s13423-019-01599-5,
PMID: 31012080, PMCID: PMC6710237
Fellows, L. K. (2011). Orbitofrontal contributions to value-based
decision making: Evidence from humans with frontal lobe
damage. Annals of the New York Academy of Sciences, 1239,
51–58. DOI: https://doi.org/10.1111/j.1749-6632.2011.06229.x,
PMID: 22145875
Fellows, L. K., & Farah, M. J. (2005). Dissociable elements of
human foresight: A role for the ventromedial frontal lobes for
framing the future, but not in discounting future rewards.
Neuropsychologia, 43, 1214–1221. DOI: https://doi.org/10
.1016/j.neuropsychologia.2004.07.018, PMID: 15817179
Fellows, L. K., & Farah, M. J. (2007). The role of ventromedial
prefrontal cortex in decision making: Judgment under
uncertainty or judgment per se? Cerebral Cortex, 17,
2669–2674. DOI: https://doi.org/10.1093/cercor/bhl176,
PMID: 17259643
Floden, D., Alexander, M. P., Kubu, C. S., Katz, D., & Stuss, D. T.
(2008). Impulsivity and risk-taking behavior in focal frontal lobe
lesions. Neuropsychologia, 46, 213–223. DOI: https://doi.org
/10.1016/j.neuropsychologia.2007.07.020, PMID: 17854845
Gao, A. F., Keith, J. L., Gao, F. Q., Black, S. E., Moscovitch, M., &
Rosenbaum, R. S. (2020). Neuropathology of a remarkable
case of memory impairment informs human memory.
Neuropsychologia, 140, 107342. DOI: https://doi.org/10.1016
/j.neuropsychologia.2020.107342, PMID: 31972232
Ghosh, V. E., Moscovitch, M., Colella, B. M., & Gilboa, A. (2014).
Schema representation in patients with ventromedial PFC
lesions. Journal of Neuroscience, 34, 12057–12070. DOI:
https://doi.org/10.1523/JNEUROSCI.0740-14.2014, PMID:
25186751, PMCID: PMC6608465
Gilbert, D. T., & Wilson, T. D. (2007). Prospection: Experiencing
the future. Science, 317, 1351–1354. DOI: https://doi.org/10
.1126/science.1144161, PMID: 17823345
Gilboa, A., & Marlatte, H. (2017). Neurobiology of schemas and
schema-mediated memory. Trends in Cognitive Sciences, 21,
618–631. DOI: https://doi.org/10.1016/j.tics.2017.04.013,
PMID: 28551107
Green, L., & Myerson, J. (2004). A discounting framework for
choice with delayed and probabilistic rewards. Psychological
Bulletin, 130, 769–792. DOI: https://doi.org/10.1037/0033
-2909.130.5.769, PMID: 15367080, PMCID: PMC1382186
Green, L., & Myerson, J. (2010). Experimental and correlational
analyses of delay and probability discounting. In G. J. Madden
& W. K. Bickel (Eds.), Impulsivity: The behavioral and
neurological science of discounting (pp. 67–92). American
Psychological Association. DOI: https://doi.org/10.1037
/12069-003
Green, L., & Myerson, J. (2013). How many impulsivities? A
discounting perspective. Journal of the Experimental
Analysis of Behavior, 99, 3–13. DOI: https://doi.org/10.1002
/jeab.1, PMID: 23344985, PMCID: PMC3893105
Green, L., Myerson, J., & McFadden, E. (1997). Rate of temporal
discounting decreases with amount of reward. Memory &
Cognition, 25, 715–723. DOI: https://doi.org/10.3758
/BF03211314, PMID: 9337589
Green, L., Myerson, J., & Ostaszewski, P. (1999). Amount of
reward has opposite effects on the discounting of delayed and
probabilistic outcomes. Journal of Experimental Psychology:
Learning, Memory, and Cognition, 25, 418–427. DOI:
https://doi.org/10.1037/0278-7393.25.2.418, PMID: 10093208
Gupta, R., Duff, M. C., Denburg, N. L., Cohen, N. J., Bechara, A.,
& Tranel, D. (2009). Declarative memory is critical for sustained
advantageous complex decision-making. Neuropsychologia, 47,
1686–1693. DOI: https://doi.org/10.1016/j.neuropsychologia.2009
.02.007, PMID: 19397863, PMCID: PMC2697903
Gutbrod, K., Kroužel, C., Hofer, H., Müri, R., Perrig, W., & Ptak,
R. (2006). Decision-making in amnesia: Do advantageous
decisions require conscious knowledge of previous
behavioural choices? Neuropsychologia, 44, 1315–1324.
DOI: https://doi.org/10.1016/j.neuropsychologia.2006.01
.014, PMID: 16513144
Hare, T. A., Hakimi, S., & Rangel, A. (2014). Activity in dlPFC
and its effective connectivity to vmPFC are associated with
temporal discounting. Frontiers in Neuroscience, 8, 50.
DOI: https://doi.org/10.3389/fnins.2014.00050, PMID:
24672421, PMCID: PMC3957025
Mok et al.
1925
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
Hebscher, M., & Gilboa, A. (2016). A boost of confidence: The
role of the ventromedial prefrontal cortex in memory,
decision-making, and schemas. Neuropsychologia, 90, 46–58.
DOI: https://doi.org/10.1016/j.neuropsychologia.2016.05
.003, PMID: 27150705
Henri-Bhargava, A., Simioni, A., & Fellows, L. K. (2012).
Ventromedial frontal lobe damage disrupts the accuracy,
but not the speed, of value-based preference judgments.
Neuropsychologia, 50, 1536–1542. DOI: https://doi.org/10
.1016/j.neuropsychologia.2012.03.006, PMID: 22433288
Hiser, J., & Koenigs, M. (2018). The multifaceted role of the
ventromedial prefrontal cortex in emotion, decision making,
social cognition, and psychopathology. Biological Psychiatry,
83, 638–647. DOI: https://doi.org/10.1016/j.biopsych.2017.10
.030, PMID: 29275839, PMCID: PMC5862740
Hochman, G., Yechiam, E., & Bechara, A. (2010). Recency gets
larger as lesions move from anterior to posterior locations
within the ventromedial prefrontal cortex. Behavioural
Brain Research, 213, 27–34. DOI: https://doi.org/10.1016/j
.bbr.2010.04.023, PMID: 20412820, PMCID: PMC3124685
Holdnack, H. A. (2001). Wechsler test of adult reading: WTAR.
San Antonio, TX: The Psychological Corporation.
Keven, N., Kurczek, J., Rosenbaum, R. S., & Craver, C. F. (2017).
Narrative construction is intact in episodic amnesia.
Neuropsychologia, 110, 104–112. DOI: https://doi.org/10
.1016/j.neuropsychologia.2017.07.028, PMID: 28757002
Kimberg, D. Y., Coslett, H. B., & Schwartz, M. F. (2007). Power
in voxel-based lesion-symptom mapping. Journal of
Cognitive Neuroscience, 19, 1067–1080. DOI: https://doi.org
/10.1162/jocn.2007.19.7.1067, PMID: 17583984
Klein, S. B. (2013). The complex act of projecting oneself into
the future. Wiley Interdisciplinary Reviews: Cognitive
Science, 4, 63–79. DOI: https://doi.org/10.1002/wcs.1210,
PMID: 26304175
Kurtz-David, V., Persitz, D., Webb, R., & Levy, D. J. (2019).
The neural computation of inconsistent choice behavior.
Nature Communications, 10, 1–14. DOI: https://doi.org
/10.1038/s41467-019-09343-2, PMID: 30952855, PMCID:
PMC6450930
Kwan, D., Craver, C. F., Green, L., Myerson, J., Boyer, P., &
Rosenbaum, R. S. (2012). Future decision-making without
episodic mental time travel. Hippocampus, 22, 1215–1219.
DOI: https://doi.org/10.1002/hipo.20981, PMID: 21997930,
PMCID: PMC3262098
Kwan, D., Craver, C. F., Green, L., Myerson, J., Gao, F., Black, S. E.,
et al. (2015). Cueing the personal future to reduce discounting
in intertemporal choice: Is episodic prospection necessary?
Hippocampus, 25, 432–443. DOI: https://doi.org/10.1002/hipo
.22431, PMID: 25676022
Kwan, D., Craver, C. F., Green, L., Myerson, J., & Rosenbaum, R. S.
(2013). Dissociations in future thinking following hippocampal
damage: Evidence from discounting and time perspective
in episodic amnesia. Journal of Experimental Psychology:
General, 142, 1355–1369. DOI: https://doi.org/10.1037
/a0034001, PMID: 23978187
Kwan, D., Kurczek, J., & Rosenbaum, R. S. (2016). Specific,
personally meaningful cues can benefit episodic prospection
in medial temporal lobe amnesia. British Journal of Clinical
Psychology, 55, 137–153. DOI: https://doi.org/10.1111/bjc
.12095, PMID: 26384730
Leland, J. W., & Grafman, J. (2005). Experimental tests of the
somatic marker hypothesis. Games and Economic Behavior,
52, 386–409. DOI: https://doi.org/10.1016/j.geb.2004.09.001
Levine, B., Svoboda, E., Hay, J. F., Winocur, G., & Moscovitch,
M. (2002). Aging and autobiographical memory: Dissociating
episodic from semantic retrieval. Psychology and Aging, 17,
677–689. DOI: https://doi.org/10.1037/0882-7974.17.4.677,
PMID: 12507363
Levy, D. J., & Glimcher, P. W. (2012). The root of all value: A
neural common currency for choice. Current Opinion in
Neurobiology, 22, 1027–1038. DOI: https://doi.org/10.1016/j
.conb.2012.06.001, PMID: 22766486, PMCID: PMC4093837
Loomes, G., & Sugden, R. (1982). Regret theory: An alternative
theory of rational choice under uncertainty. Economic
Journal, 92, 805–824. DOI: https://doi.org/10.2307/2232669
Luhmann, C. C., Chun, M. M., Yi, D. J., Lee, D., & Wang, X. J.
(2008). Neural dissociation of delay and uncertainty in
intertemporal choice. Journal of Neuroscience, 28,
14459–14466. DOI: https://doi.org/10.1523/JNEUROSCI.5058
-08.2008, PMID: 19118180, PMCID: PMC2742332
Madden, G. J., & Bickel, W. K. (2010). Impulsivity: The
behavioral and neurological science of discounting.
Washington: American Psychological Association. DOI:
https://doi.org/10.1037/12069-000
Mata, R., Josef, A. K., Samanez-Larkin, G. R., & Hertwig, R.
(2011). Age differences in risky choice: A meta-analysis.
Annals of the New York Academy of Sciences, 1235, 18–29.
DOI: https://doi.org/10.1111/j.1749-6632.2011.06200.x,
PMID: 22023565, PMCID: PMC3332530
Mobini, S., Body, S., Ho, M. Y., Bradshaw, C., Szabadi, E.,
Deakin, J., et al. (2002). Effects of lesions of the orbitofrontal
cortex on sensitivity to delayed and probabilistic
reinforcement. Psychopharmacology, 160, 290–298. DOI:
https://doi.org/10.1007/s00213-001-0983-0, PMID: 11889498
Mok, J. N. Y., Kwan, D., Green, L., Myerson, J., Craver, C. F., &
Rosenbaum, R. S. (2020). Is it time? Episodic imagining and
the discounting of delayed and probabilistic rewards in young
and older adults. Cognition, 199, 104222. DOI: https://doi
.org/10.1016/j.cognition.2020.104222, PMID: 32092551,
PMCID: PMC7152567
Montague, P. R., & Berns, G. S. (2002). Neural economics and
the biological substrates of valuation. Neuron, 36, 265–284.
DOI: https://doi.org/10.1016/S0896-6273(02)00974-1, PMID:
12383781
Myerson, J., Green, L., Hanson, J. S., Holt, D. D., & Estle, S. J. (2003).
Discounting delayed and probabilistic rewards: Processes and
traits. Journal of Economic Psychology, 24, 619–635. DOI:
https://doi.org/10.1016/S0167-4870(03)00005-9
Myerson, J., Green, L., & Warusawitharana, M. (2001). Area
under the curve as a measure of discounting. Journal of
Experimental Analysis of Behavior, 76, 235–243. DOI:
https://doi.org/10.1901/jeab.2001.76-235, PMID: 11599641,
PMCID: PMC1284836
O’Donnell, S., Daniel, T. O., & Epstein, L. H. (2017). Does goal
relevant episodic future thinking amplify the effect on delay
discounting? Consciousness and Cognition, 51, 10–16.
DOI: https://doi.org/10.1016/j.concog.2017.02.014, PMID:
28282631, PMCID: PMC5651988
Palombo, D. J., Keane, M. M., & Verfaellie, M. (2015). The
medial temporal lobes are critical for reward-based decision
making under conditions that promote episodic future
thinking. Hippocampus, 25, 345–353. DOI: https://doi.org
/10.1002/hipo.22376, PMID: 25284804, PMCID:
PMC4331231
Peters, J. (2011). The role of the medial orbitofrontal cortex in
intertemporal choice: Prospection or valuation? Journal of
Neuroscience, 31, 5889–5890. DOI: https://doi.org/10.1523
/JNEUROSCI.0268-11.2011, PMID: 21508212, PMCID:
PMC6632962
Peters, J., & Büchel, C. (2009). Overlapping and distinct neural
systems code for subjective value during intertemporal
and risky decision making. Journal of Neuroscience, 29,
15727–15734. DOI: https://doi.org/10.1523/JNEUROSCI.3489
-09.2009, PMID: 20016088, PMCID: PMC6666169
Peters, J., & Büchel, C. (2010). Episodic future thinking reduces
reward delay discounting through an enhancement of
1926
Journal of Cognitive Neuroscience
Volume 33, Number 9
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3
prefrontal-mediotemporal interactions. Neuron, 66, 138–148.
DOI: https://doi.org/10.1016/j.neuron.2010.03.026, PMID:
20399735
Peters, J., & D’Esposito, M. (2016). Effects of medial orbitofrontal
cortex lesions on self-control in intertemporal choice. Current
Biology, 26, 2625–2628. DOI: https://doi.org/10.1016/j.cub
.2016.07.035, PMID: 27593380
Peters, J., & D’Esposito, M. (2020). The drift diffusion model as
the choice rule in inter-temporal and risky choice: A case
study in medial orbitofrontal cortex lesion patients and
controls. PLoS Computational Biology, 16, e1007615.
DOI: https://doi.org/10.1371/journal.pcbi.1007615, PMID:
32310962, PMCID: PMC7192518
Pujara, M. S., Wolf, R. C., Baskaya, M. K., & Koenigs, M. (2015).
Ventromedial prefrontal cortex damage alters relative risk
tolerance for prospective gains and losses. Neuropsychologia,
79, 70–75. DOI: https://doi.org/10.1016/j.neuropsychologia
.2015.10.026, PMID: 26597003, PMCID: PMC4679627
Rangel, A., Camerer, C., & Montague, P. R. (2008). A framework for
studying the neurobiology of value-based decision making.
Nature Reviews Neuroscience, 9, 545–556. DOI: https://doi.org
/10.1038/nrn2357, PMID: 18545266, PMCID: PMC4332708
Robin, J., Rivest, J., Rosenbaum, R. S., & Moscovitch, M. (2019).
Remote spatial and autobiographical memory in cases of
episodic amnesia and topographical disorientation. Cortex,
119, 237–257. DOI: https://doi.org/10.1016/j.cortex.2019.04
.013, PMID: 31163312
Rorden, C., & Brett, M. (2000). Stereotaxic display of brain
lesions. Behavioural Neurology, 12, 191–200. DOI: https://
doi.org/10.1155/2000/421719, PMID: 11568431
Rosenbaum, R. S., Kwan, D., Floden, D., Levine, B., Stuss, D. T.,
& Craver, C. F. (2016). No evidence of risk-taking or
impulsive behaviour in a person with episodic amnesia:
Implications for the role of the hippocampus in future-
regarding decision-making. Quarterly Journal of
Experimental Psychology, 69, 1606–1618. DOI: https://doi
.org/10.1080/17470218.2015.1090461, PMID: 26440609
Seaman, K. L., Brooks, N., Karrer, T. M., Castrellon, J. J., Perkins,
S. F., Dang, L. C., et al. (2018). Subjective value representations
during effort, probability and time discounting across
adulthood. Social Cognitive and Affective Neuroscience, 13,
449–459. DOI: https://doi.org/10.1093/scan/nsy021, PMID:
29618082, PMCID: PMC6007391
Sellitto, M., Ciaramelli, E., & di Pellegrino, G. (2010). Myopic
discounting of future rewards after medial orbitofrontal damage
in humans. Journal of Neuroscience, 30, 16429–16436. DOI:
https://doi.org/10.1523/JNEUROSCI.2516-10.2010, PMID:
21147982, PMCID: PMC6634874
Sellitto, M., Ciaramelli, E., & di Pellegrino, G. (2011). The
neurobiology of intertemporal choice: Insight from imaging
and lesion studies. Reviews in the Neurosciences, 22, 565–574.
DOI: https://doi.org/10.1515/RNS.2011.046, PMID: 21967518
Spaniol, J., Di Muro, F., & Ciaramelli, E. (2019). Differential
impact of ventromedial prefrontal cortex damage on “hot”
and “cold” decisions under risk. Cognitive, Affective, &
Behavioral Neuroscience, 19, 477–489. DOI: https://doi.org
/10.3758/s13415-018-00680-1, PMID: 30535630
Spreen, O., & Strauss, E. (1998). A compendium of
neuropsychological tests: Administration, norms, and
commentary (2nd ed.). New York: Oxford University Press.
St. Onge, J. R., & Floresco, S. B. (2010). Prefrontal cortical
contribution to risk-based decision making. Cerebral Cortex,
20, 1816–1828. DOI: https://doi.org/10.1093/cercor/bhp250,
PMID: 19892787
Stuss, D. T. (2006). Frontal lobes and attention: Processes and
networks, fractionation and integration. Journal of the
International Neuropsychological Society, 12, 261–271.
DOI: https://doi.org/10.1017/S1355617706060358, PMID:
16573859
Stuss, D. T. (2017). Frontal lobes. In J. S. Kreutzer, J. DeLuca, &
B. Caplan (Eds.), Encyclopedia of clinical neuropsychology
(2nd ed.). Cham, Switzerland: Springer. DOI: https://doi.org
/10.1007/978-3-319-56782-2_318-2
Stuss, D. T., & Levine, B. (2002). Adult clinical neuropsychology:
Lessons from studies of the frontal lobes. Annual Review
of Psychology, 53, 401–433. DOI: https://doi.org/10.1146
/annurev.psych.53.100901.135220, PMID: 11752491
Stuss, D. T., Rosenbaum, R. S., Malcolm, S., Christiana, W., &
Keenan, J.P. (2005). The frontal lobes and self-awareness. In
T. E. Feinberg & J. P. Keenan (Eds.), The lost self: Pathologies
of the brain and identity (pp. 50–64). New York: Oxford
University Press. DOI: https://doi.org/10.1093/acprof:oso
/9780195173413.003.0005
Szpunar, K. K., Spreng, R. N., & Schacter, D. L. (2014). A
taxonomy of prospection: Introducing an organizational
framework for future-oriented cognition. Proceedings of the
National Academy of Sciences, U.S.A., 111, 18414–18421.
DOI: https://doi.org/10.1073/pnas.1417144111, PMID:
25416592, PMCID: PMC4284580
Vaidya, A. R., & Fellows, L. K. (2015). Ventromedial frontal
cortex is critical for guiding attention to reward-predictive
visual features in humans. Journal of Neuroscience, 35,
12813–12823. DOI: https://doi.org/10.1523/JNEUROSCI.1607
-15.2015, PMID: 26377468, PMCID: PMC6795201
Vaidya, A. R., Sefranek, M., & Fellows, L. K. (2018).
Ventromedial frontal lobe damage alters how specific
attributes are weighed in subjective valuation. Cerebral
Cortex, 28, 3857–3867. DOI: https://doi.org/10.1093/cercor
/bhx246, PMID: 29069371, PMCID: PMC6188550
Verfaellie, M., Wank, A. A., Reid, A. G., Race, E., & Keane, M. M.
(2019). Self-related processing and future thinking: Distinct
contributions of ventromedial prefrontal cortex and the
medial temporal lobes. Cortex, 115, 159–171. DOI: https://
doi.org/10.1016/j.cortex.2019.01.028, PMID: 30826623,
PMCID: PMC6513722
Weber, B. J., & Huettel, S. A. (2008). The neural substrates
of probabilistic and intertemporal decision making. Brain
Research, 1234, 104–115. DOI: https://doi.org/10.1016
/j.brainres.2008.07.105, PMID: 18710652, PMCID:
PMC2629583
Mok et al.
1927
l
D
o
w
n
o
a
d
e
d
f
r
o
m
h
t
t
p
:
/
/
d
i
r
e
c
t
.
m
i
t
.
e
d
u
/
j
/
o
c
n
a
r
t
i
c
e
-
p
d
l
f
/
/
/
3
3
9
1
9
0
9
1
9
5
6
0
9
1
/
/
j
o
c
n
_
a
_
0
1
7
2
1
p
d
.
f
b
y
g
u
e
s
t
t
o
n
0
8
S
e
p
e
m
b
e
r
2
0
2
3