Communicated by Stephen José Hanson

Communicated by Stephen José Hanson

Bridging the Gap Between Neurons and Cognition Through
Assemblies of Neurons

Christos H. Papadimitriou
christos@columbia.edu
哥伦比亚大学, 纽约, 纽约 10027, 美国.

Angela D. Friederici
friederici@cbs.mpg.de
马克斯·普朗克人类认知和脑科学研究所, Department
of Neuropsychology, D-04303 莱比锡, 德国

During recent decades, our understanding of the brain has advanced
dramatically at both the cellular and molecular levels and at the cogni-
tive neurofunctional level; 然而, a huge gap remains between the
microlevel of physiology and the macrolevel of cognition. We propose
that computational models based on assemblies of neurons can serve
as a blueprint for bridging these two scales. We discuss recently devel-
oped computational models of assemblies that have been demonstrated
to mediate higher cognitive functions such as the processing of simple
句子, to be realistically realizable by neural activity, and to possess
general computational power.

1 介绍

Over the past decades, neuroscientific research at the molecular and cellular
levels has dramatically increased our understanding of the physiology and
function of neurons, as well as their interconnectivity. At the other end of the
规模, cognitive neuroscience has advanced considerably our understand-
ing of the functional neuroanatomy of higher cognitive functions such as
memory and language. The gap between the microlevel of physiology and
the macrolevel of functional neuroanatomy, 然而, remains huge. 这
is due not only to the difference in granularity but also to current method-
ological difficulties in experimental measurements at the levels in between.
There is another gap separating the two scales: cognitive imaging stud-
ies are for the most part carried out on human subjects, while neuron-level
neuroscientific experiments typically involve laboratory animals. 然而,
comparative anatomical and electrophysiological studies across different
species provide compelling support for the idea that the computations re-
alized in local cortical networks enabling perceptual, motor and cognitive
functions are remarkably similar (Balaban et al., 2010; Douglas & 马丁,

神经计算 34, 291–306 (2022)
https://doi.org/10.1162/neco_a_01463

© 2021 麻省理工学院

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

292

C. Papadimitriou and A. Friederici

2004; Markov & 肯尼迪, 2013; 布莫尔 & 斯波恩斯, 2009). Modeling hu-
man cognitive function based on findings from animal studies is not unjus-
tified (哈里斯, 2005; Friederici & 歌手, 2015); 看, 例如, 直接的
comparison of event-related brain potentials to processing auditory stimuli
between human and nonhuman primates (Milne et al., 2016). It has been ar-
gued (Schomers, Garagnani, & Pulvermüller, 2017) that differences in cog-
nitive abilities between humans and animals, such as language, may be
attributed mainly to differences in connectivity between distal areas.

The need for bridging the gap between these two established approaches
to understanding the brain has been articulated recently by Richard Axel
(2018), who states in an interview, “[We need] a logic for the transformation
of neuronal activity into thought and action.”

What kind of computational model, mediating between the single-cell
level and the cognition level, would fit the bill? Several genres of computa-
tional models, operating between the two scales, have been developed over
the past decades, and in a recent review (Kriegeskorte & Douglas, 2018, 如图-
乌尔 3) they are categorized into three kinds according to the twin criteria of
cognitive fidelity and biological fidelity: (1) models of cognition (Bayesian
and graphic models, reinforcement learning models, and cognitive pro-
克, 除其他外) are good at expressing cognitive functions but
lack in biological plausibility; (2) models from computational neuroscience
can implement, through biologically faithful model neurons—and their cir-
cuits and dynamics—only relatively low-level cognitive functions, 例如
工作记忆; 和 (3), between these two in both axes, deep neural net-
works are capable of certain aspects of intelligent behavior but have been
broadly recognized to violate important biological constraints, such as lo-
cal sparsity, recurrence, lack of supervision, as well as information propaga-
tion from postsynaptic to presynaptic loci (but see Lillicrap, Santoro, Marris,
Akerman, & 欣顿, 2020, for a recent argument about the biological plau-
sibility of deep nets). We believe that none of these families of models
promises to bridge the gap—that is, to explicate “the transformation of neu-
ronal activity into thought and action” (Axel 2018).

2 Cognitive Modeling by Assemblies

D. 氧. Hebb (1949) proposed that there are persistent and densely intercon-
nected populations of neurons whose near-synchronous firing is cotermi-
nous with the subject thinking of an object, 概念, or word; he called
such populations assemblies. Assemblies of neurons were sought by neu-
roscientists for more than five decades after Hebb’s prediction, until they
were observed experimentally in the animal brain (哈里斯, Csicsvari, Hi-
rase, Dragoi, & Buzsáki, 2003). Novel neuroscientific methods have since
been developed (Carillo-Reid, Han Yang Akrouh, & Yuste, 2019) for de-
tecting, measuring, and manipulating assemblies. Results reported in Ison,

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Bridging Neurons and Cognition Through Assemblies of Neurons

293

Quiroga, and Fried (2015) and elsewhere suggest that in the human medial
−3 (IE。, 一个
temporal lobe (MTL), a typical assembly has sparsity roughly 10
assembly comprises about one in every 1000 excitatory neurons in the spe-
cific brain area), and consists of roughly 104 神经元, or a small multiple
of this number. There is a growing consensus (哈里斯, 2005; Buszáki, 2010,
Buszáki, 2019; Eichenbaum, 2018) that assemblies play an important role
in the way the brain works. Since their scale falls squarely between the two
extreme scales of single neurons and cognition discussed above, assemblies
hold definite promise of bridging the gap.

的确, computational models of cognition based on assemblies have
been proposed recently. 20世纪90年代, researchers seeking an explanation
for the continuing firing—after the stimulus was no longer present—of neu-
rons in the prefrontal cortex of animals engaged in a working memory task
(Amit, Brunel, & Tsodyks, 1994; Amit, Fusi, & Yakovlev, 1997; see also the
review by Durstewitz, Seamans, & Sejnowski, 2000) hypothesized that such
a neuron must be part of an assembly encoding the stimulus, an assembly
that was formed by the stimulus through recurrent excitation and Hebbian
plasticity. 在最近的两篇论文中 (Kunze, 彼得森, Haueisen, & 克诺舍,
2017; Kunze, Haueisen, & 克诺舍, 2019), the analysis of the dynamics
of canonical microcircuits of interacting populations of excitatory and in-
hibitory neurons in cortex reveals three basic modes of these systems, 全部
three corresponding to cognitive behaviors: gating (choosing one among
several synaptic input streams), 记忆 (creating a stable assembly), 和
priming (lowering a perceptual threshold). The authors also demonstrate
how such microcircuits can facilitate cognitive functions and, 尤其,
language understanding (much more on language below).

How are new assemblies created? A picture emerges from the above and
other related works. Synaptic input from an extant assembly—perhaps a
primitive assembly representing a stimulus at the hippocampus (Quiroga,
2016) or in the olfactory bulb (Franks et al., 2011)—causes a population of
neurons in a downstream area to fire. Inhibitory reaction in the downstream
area helps select a few of the neurons in the downstream area to keep fir-
英. 下一个, continuing afferent synaptic input, combined with the recurrent
excitation from the firing neurons in the downstream area, results in the
firing of a slightly different set of neurons, and then yet another. With con-
tinuing excitation from the upstream assembly, eventually a stable set of
excitatory neurons will be selected in the downstream area, and these will
form the new assembly. The resulting assembly has strong internal synap-
tic connectivity for two reasons, 第一的, the way its excitatory neurons were
selected favors neurons with synapses from within the set; furthermore, 这
repeated firing increases synaptic strengths through Hebbian plasticity. 这
new assembly also has strong synaptic connectivity from the parent assem-
布莱, again due to Hebbian plasticity: if the parent assembly fires again, 这
newly formed assembly will follow suit.

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

294

C. Papadimitriou and A. Friederici

重要的, this process can now be repeated. The new assembly, 如果
excited repeatedly, can create another assembly, in an area further down-
溪流, in the exact same manner. This seems to be an important behav-
ior of assemblies, which can be called projection. Projection creates a new
“copy” of an assembly, in a different brain area, that will henceforth fire
every time the parent assembly does, providing a mechanism whereby
memories formed at the hippocampus can be propagated further in the
cortex, thus mediating cognition, 推理, 规划, 语言, 所以
向前.

In a recent paper, Pokorny et al. (2020) verified through the simulation
of a circuit of realistic model spiking neurons with spike timing-dependent
plasticity (STDP) that indeed an assembly established in one brain area
can create a projection in another brain area and that this new assembly
will henceforth behave as described above. 此外, the simultaneous
presentation of two parent assemblies in the upstream area will modify,
through plasticity, the corresponding two assemblies in the downstream
区域, so they overlap more. Such an increase in overlap, recording the affin-
性, or association, of the two world objects represented by the two assem-
blies, had been recently noted in experiments in humans (Ison et al., 2015).
By presenting the image of a person known to an individuum (说, a sibling)
at a particular place (说, the pyramids) resulted in a neuron that thereto-
fore only responded to images of the pyramids to also respond to images of
the sibling. Presumably this means that two extant assemblies representing
the person and the place were modified in response to the presentation of
the combined image to increase their overlap.

Besides projection and association, a third behavior of assemblies, this time
related to language processing, has been recently captured by neurorealis-
tic simulations (穆勒, Papadimitriou, Maass, & Legenstein„ 2020). 这是
broadly accepted that words such as cat are encoded in a largely perma-
nent manner in a subarea of the left MTL containing the medial temporal
gyrus (MTG) and usually referred to as lexicon. The results in Müller et al.
(2020) suggest that the assembly representing the word cat in the lexicon
can be bound to the syntactic category subject in the context of the sentence,
“The cat chased the dog.” This binding can be accomplished through a so-
phisticated variant of projection, involving the creation of a newly formed
projected copy of the word cat without changing substantially the repre-
sentation of the word in the lexicon. 的确, in a recent MRI experiment
(Frankland & Greene, 2015) two different subareas of the superior tempo-
ral gyrus (STG) were found to exhibit activity in response to the word cat
in the sentences (1) “The cat chased the dog,” where cat is the subject. 和
(2) “The dog chased the cat,” where cat is the object of the sentence. 我们
hypothesize that this activity reflects the binding operation.

Note that the category subject can be encoded in a sentence by dif-
ferent means depending on the language and sentence type. It could be
encoded by word position in a sentence (the first noun is the subject in

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Bridging Neurons and Cognition Through Assemblies of Neurons

295

English or French), or by case marking in a language like German or Russian
(the nominative case indicates subject). In a passive sentence, the subject can
be marked by the preposition by (“by the man” where the thematic role of
the actor is indicated by the preposition). As already mentioned, brain data
and analysis by Frankland and Greene (2015) suggest that there may be two
distinct brain subareas in the STG to which new assemblies are created for
the subject and the object (or agent and patient) of a sentence during syn-
tactic processing.

Now let us consider how this binding of words to syntactic roles can
be accomplished. Consider two brain regions, one containing the lexicon
(stable representations of words) and another area (possibly located at the
posterior part of the superior temporal lobe, STL) corresponding to the syn-
tactic role of subject, and suppose that there is synaptic connectivity from
the lexicon area to the subject area, 然后回来. If the cat assembly fires (pre-
sumably because the auditory or visual stimulus cat was presented) 和
after the syntactic role of “cat” as subject has been decided (a process dis-
cussed below), then synaptic input will excite neurons in the subject area, 作为
in the beginning of the projection operation. But now, because of the back-
ward connectivity, from subject to lexicon, there will be afferent excitation
to the “cat” assembly. Eventually the projection in the subject area will sta-
bilize. When this happens—and the simulation experiments in Müller et al.
(2020) show that it does happen—the new assembly in the subject area will
have strong synaptic connectivity to and from the “cat” assembly in the
lexicon area: “cat” has been bound to “subject” through a new assembly
created in the subject area. This behavior of assemblies, which can be called
binding or reciprocal projection, was verified in Müller et al. (2020) 通过一个
realistic model of spiking neurons.

In another recent paper, Papadimitriou, Vempala, Mitropolsky, 柯林斯,
and Maass (2020) proposed that assemblies are capable of an even broader
repertoire of operations: the three operations project, associate, and bind
that we have seen, plus two more: pattern completion and merge. 图案
completion entails an assembly firing in response to a few of its neurons (说,
10% 到 20%) firing; this is a consequence of the dense synaptic connectivity
within the assembly. 最后, merge is an extension of binding: two assem-
blies, in two different brain areas A and B with synaptic connectivity to a
third area C and back, 创造, through the firing of their parent assemblies, A
new assembly in area C, which has strong synaptic connectivity to and from
the two original assemblies. Linguists have long believed that human brains
must be capable of such a merge operation, whereby two words (or other
syntactic elements) are combined to form a more complex syntactic element
(Chomsky, 1995). By iterating such merges, arbitrarily large syntactic trees
can be formed, capturing the hierarchical structure of language. 实际上, 它
has been verified experimentally (Zaccarella & Friederici, 2015; Zaccarella,
迈耶, Makuuchi, & Friederici, 2017) that on completion of a phrase or a
句子, there is neural activity in the posterior portion of Broca’s area, A

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

296

C. Papadimitriou and A. Friederici

brain area believed to be implicated in syntactic analysis; such activity could
very well be the result of a merge assembly operation.

At the neurophysiological level, one could ask why these particular five
assembly operations—projection, association, pattern completion, binding,
and merge—represent realistic behaviors of neurons and synapses. The ar-
gument is three-fold. 第一的. there is mathematical proof in a simplified and
analytically tractable abstract model of spiking neurons in cortex (Papadim-
itriou & Vempala, 2019) that these operations can indeed be simulated by
stylized neurons and synapses. 第二, as noted above, all of these oper-
ations have been corroborated through simulations in neurorealistic envi-
罗蒙兹 (Müller et al., 2020; Pokorny et al. 2020) and by simulations of the
abstract model presented in Papadimitriou et al., 2020). 最后, these oper-
ations are consistent with, and appear to provide an explanation for, several
experimental results mentioned above—Frankland and Greene 2015), Ison
等人. (2015), and Zaccarella and Friederici (2015), 除其他外.

In terms of computation, these five operations, complemented with three
more—inhibition and disinhibition of an area, firing (causing a particular as-
sembly to fire), and readout (identifying the assembly that fired in a par-
ticular area)—comprise a repertoire of operations on assemblies called the
Assembly Calculus. Papadimitriou et al. (2020) proved that the Assembly
Calculus is a full-fledged computational framework capable of arbitrary
computations, akin to programming languages and the Turing machine
(图灵, 1937). Such expressive power is an important desideratum for
a framework hypothesized to underlie general cognitive functions. (看
部分 4 for more about the computational power of the Assembly
Calculus.) As we mentioned above, there is evidence (through both math-
ematical proof and simulations) that the primitives of the Assembly Calcu-
lus can be “compiled down” to the level of neurons and synapses, in very
much the same way that a program written in a programming language like
Python and Matlab can be translated into machine code and executed on a
电脑. 此外, it has been shown that certain simplified cognitive
phenomena related to language processing can be expressed as programs
in the Assembly Calculus. 全面的, we believe that the Assembly Calcu-
lus appears quite well positioned to bridge the gap between neurons and
认识.

3 Language Processing through Assemblies

The Assembly Calculus can help explicate the ways in which neuronal ac-
tivity results in high-level cognitive phenomena. Here we focus on one im-
portant high-level cognitive phenomenon: the processing of language.

Why language? 第一的, language is well described in its functional sub-
parts by linguistic theory (Berwick & Chomsky, 2015). 第二, there are a
number of functional and structural experiments investigating and defin-
ing the neuroanatomical basis of language (Friederici, 2011; Fedorenko,

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Bridging Neurons and Cognition Through Assemblies of Neurons

297

Hsieh, Nieto-Castanon, Whitfield-Gabrieli, & Kanwisher, 2010; Pallier,
Devauchelle, & 德阿内, 2011). 第三, it is understood that language is
grounded on general neurophysiological principles (Friederici & 歌手,
2015).

The neural basis of language has been described as a fronto-temporal
network in the left hemisphere involving Broca’s area in the inferior frontal
gyrus (Brodmann areas (BA) 44 和 45), the medial temporal lobe (MTL)
and middle temporal gyrus (MTG), and the superior temporal gyrus (STG).
These regions are structurally connected by white matter fiber tracts run-
ning dorsally and ventrally between frontal and temporal brain regions.
These fiber tracts connect the language-relevant brain regions functionally
during language processing (see Figure 1A and Friederici, 2011, for a re-
看法). 例如, the important dorsal fiber called the arcuate fasciculus
connects the STG with the posterior portion of Broca’s area (BA 44), 它是
known to have, 在人类中, larger fiber density in the left hemisphere than
in the right (Nucifora, Verma, Melhem, Gur, & Gur, 2005); furthermore, 它是
degree of maturation in children is correlated with accuracy and the speed
of sentence processing (Skeide, Brauer, & Friederici, 2016).

最近几年, new insights have been gained into the workings of this
网络. It is known that soon after the onset of a sentence (read or heard)
and once word forms have been identified, neural activity in the MTL sig-
nals that the representations of those words contained in the sentence are
“looked up” in the lexicon, which is presumed to consist of a large set of
assemblies in the MTL (徐 & Sudhof, 2013; Breitenstein et al., 2005) 并重新-
lated assemblies in the MTG (Lau, Phillips, & Poeppel, 2008). The assembly
representing each word in the lexicon besides semantic information pre-
sumably encodes information about each word related to its use in lan-
规格, such as its phonological form (猫) and its syntactic category (这
word cat is a noun), which determines the corresponding roles it can play
in the sentence (in the case of noun, subject or object, 除其他外). 这
STG appears to assign the role of each word in the sentence under consid-
进化. In a sentence such as “The dog chased the cat,” dog is identified as
the subject, and cat as the object of the sentence, while chased is identified as
the verb. It has been proposed that in the STG, the word dog affects neural
activity in different subareas depending on its syntactic function in the two
sentences “the dog chased the cat” and “the cat chased the dog” (Frankland
& 绿色的, 2015), implying that new representations of the words are created
during processing. At this processing stage, words are bound to syntactic
roles such as subject, 目的, and verb. The details of this process at the neu-
rophysiological level need to be investigated in future studies. As a next
step, activity in the subareas of Broca’s area BA 44 and BA 45 suggests that
the buildup of phrases (syntactically licensed parts of the sentence, 例如
a verb phrase consisting of a verb and a determiner/noun phrase “chased
the cat”; see Figure 1B) are supported by BA 44. 最后, 陈述
of the whole sentence, and presumably its meaning, are constructed in the

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

298

C. Papadimitriou and A. Friederici

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

数字 1: Syntax of language mediated by assemblies. (A) Brain areas impli-
cated in language processing in the left hemisphere. Medial temporal lobe
(MTL) is located in the medial part of the temporal cortex behind the middle
temporal gyrus (MTG, purple) that is believed to contain the lexicon, 代表-
sentations of all words used in language. The superior temporal gyrus (STG,
绿色的) is believed to be implicated in syntactic manipulation of words; the pars
opercularis of Broca’s area (BA 44, orange) and the pars triangularis (BA 45, 嘛-
genda) are believed to be implicated in the building of more complex syntactic
元素, such as phrases and sentences. 最后, the neural fibers connect the
STG and frontal cortex. Two of them (蓝色的, purple) are located dorsally: 一
of them targets the premotor cortex (BA 6, 蓝色的) and the other the posterior
portion of Broca’s area (BA 44, purple). Two other fiber tracts (红色的, 黑色的) 是
located ventrally, with the red one targeting the anterior portion of Broca’s area
(BA 45). BA stands for Brodmann area according to the cytoarchitectonic classi-
fication of Brodmann (1909). (乙) The syntax tree is a tree-like structure capturing
the underlying structure, or syntax, of a sentence. The top node represents the
whole sentence (S), while the next lower node represents the verb phrase (副总裁)—
the part of the sentence describing what the subject does or is. Two nodes rep-
resent the two noun phrases (NP) corresponding to the subject (左边) 和
目的 (正确的) of the sentence. Each of these noun phrases consists of the deter-
miner the and a noun. Identifying the syntax tree of a sentence (or “parsing the

Bridging Neurons and Cognition Through Assemblies of Neurons

299

interplay between the temporal cortex and Broca’s area under the support
of BA 45.

This narrative identifies rather convincingly a very specific brain net-
work for the syntactic analysis of language, 哪个, at least according to the
“syntax first” school of thought in language processing, is the first step to
comprehension. 然而, this network cannot be static. The words in the
sentence must somehow be “copied” from the lexicon in MTL to the in-
ferior frontal gyrus to determine their syntactic role in the sentence, 然后
bound to the appropriate subarea of STG corresponding to this role. 还,
the representations of phrases and sentences in BA 44 and BA 45 must be
created through communication with the representations of their subparts
and presumably remain in communication with them after the new repre-
sentations are formed. Such communication between brain regions is pos-
sible via the brain’s white matter connections: the long-range connections
between the language-related regions in the frontal and temporal cortex
(Catani, 琼斯, & Ffytche, 2005; Friederici, 2009; Saur et al., 2008), 还有
as short-range connections within the frontal cortex (Makuuchi, Bahlmann,
安旺德, & Friederici, 2009) and the temporal cortex (Upadhyay et al..

sentence”) is considered the first important step toward comprehending the
句子. (C) A proposed dynamic architecture involving assemblies and as-
sembly operations in the left temporal and frontal lobes for performing syntac-
tic analysis of language. The colors of the domains of this architecture (盒子)
match the colors of areas in panel A. White circles in these boxes are assem-
blies in the corresponding areas. Starting from below, assemblies representing
the presented (through audio or text) words are identified in the lexicon. 他们的
syntactic category (动词, 名词) and their syntactic role (动词, 主题, 目的)
are determined first. For verbs, this syntactic role is often readily available in
the word’s representation; distinguishing between object and subject is subtle
and relies on word order (英语, 法语) or case (俄语, 德语). Once the
syntactic roles have been determined, the three assemblies representing, 在这个
例子, CAT, CHASED, and DOG, are projected through the bind assembly
手术 (red arrows), each to the appropriate subarea of the STG, 创造
three new assemblies there. 下一个, a merge operation creates an assembly in BA
44 representing the verb phrase. 最后, a second merge operation joins the sub-
ject with the verb phrase to create the sentence. These operations create a more
rudimentary parse tree than panel B, which encodes the syntactic analysis of the
句子. (D) The Parser in Mitropolsky et al. (in press) implements a different,
nongrammatical formalism of syntax called a dependency graph. For the same
句子, the Parser would generate the dependency graph shown, 其中
pairs of words are connected by directed edges (红色的), each labeled by the
kind of dependency connecting the two words (the labels used here are “verb,”
“subject,” “object,” and “determiner”). The root dependency always points to
the principal verb of the sentence.

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

300

C. Papadimitriou and A. Friederici

2008). But precisely how is this communication between cell populations
in different brain areas established and carried out? The second author of
this view predicted (Friederici, 2017, published almost three years before
Papadimitriou et al., 2020) “那, 对于语言, there are what I call mirror
cell ensembles through which two distinct brain regions communicate with
each other.”

Assemblies and assembly operations provide precisely the apparatus
that is needed here (this apparatus is illustrated in Figure 1C). An assembly
representing a word in the MTL can be copied via the projection, or binding,
operation to the STG and bound to the appropriate subarea corresponding
to its grammatical role in the sentence: 主题, 动词, or object. The impor-
tant step of the identification of these grammatical roles, which appears to
be happening in the inferior frontal gyrus together with the STG, needs fur-
ther investigation (see Figure 1C for a brief discussion). An assembly repre-
senting the verb phrase can be formed by a merge operation of the verb and
the object assemblies in BA 44. 最后, another merge of the subject assem-
bly and the verb phrase assembly will form a new assembly representing
the whole sentence. This completes the syntactic analysis of the sentence.
一路上, this process actually builds a “syntactic scaffold” of the sen-
张力, a simplified syntactic tree of the sentence with three leaves and two
internal nodes (the structure defined by the blue double arrows in Figure
1C), which can be used as a platform for understanding the precise meaning
of the sentence, as well as for, 例如, further processing, repetition,
and memorization.

In a recent paper, Mitropolsky, 柯林斯, and Papadimitriou (in press) 的-
scribe a program written in an enhanced version of the Assembly Calculus
that successfully parses (IE。, identifies the syntactic structure of) reasonably
complex English sentences such as, “This morning, the ferocious dog from
the next house briefly chased your cat.” The program, called Parser, 作品
exclusively by the spiking of artificial neurons through the commands of
the Assembly Calculus, with two bespoke enhancements: (1) there are com-
mands for inhibiting and disinhibiting neural fibers (synapse bundles con-
necting different brain areas), instead of whole areas only, 和 (2) it is as-
sumed that each word assembly in the lexicon is equipped with inhibitory
neurons that, upon the firing of the assembly, inhibit or disinhibit the ap-
propriate fibers. This latter capability enables the Parser to correctly identify
the syntactic role of words, based exclusively on the word’s part of speech
encoded in the (迪斯)inhibition actions, and the current state of the system.
Besides the lexicon, specific brain areas are employed, named, 例如,
“verb,” “subject,” and “adverb,” where the words in the sentence are pro-
jected, while the inhibition or disinhibition of fibers prepares each word for
projection to the correct area. The output of the Parser is not a syntactic tree
as described in the previous paragraph and Figure 1C, but a different ob-
ject also capturing the syntactic structure of the sentence, called dependency

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Bridging Neurons and Cognition Through Assemblies of Neurons

301

图形. 明显地, other languages will require different uses of this capa-
能力; in Mitropolsky et al. (in press), a toy Russian parser is also described
and implemented.

The Parser of Mitropolsky et al. (in press) is an important step toward
demonstrating that the Assembly Calculus can bridge the gap between the
cognitive and the neuronal level in the domain of language, 尤其是
syntactic analysis. But it does not come close to covering all of language.
One important aspect of syntax is recursion and center embedding—the abil-
ity of sentences to embed other sentences as in, “The dog who chased the
cat who scratched the baby is back.” Many consider center embedding to be
the hallmark of language and the Parser does not currently handle this fea-
真实. A brain area can support many assemblies, and presumably the verb
区域, 例如, can contain assemblies corresponding to the verbs of all
sentences in the embedding hierarchy simultaneously; 然而, the precise
implementation of center embedding is left in Mitropolsky et al. (in press)
as an open challenge.

4 Conclusion and Open Questions

We have presented some evidence that assemblies of neurons can be a use-
ful conceptual, even mathematical and computational, tool for bridging the
forbidding gap between neurons and cognition. But of course, 即使在
language domain where some progress is being made, we still do not know
the answers to most important questions. World languages rely on a stun-
ning diversity of features to encode a word’s grammatical role. How can
the same brain circuit adapt to a specific encoding, from among all these
very different versions, in the infant brain? Recent brain data indicate that
the language-specific cues, and the resulting processing demands, lead to
language-specific modulation of the fiber tracts connecting the different
brain areas (Goucha, 安旺德, & Friederici, 2015). Beyond syntax, how is
the meaning of a sentence—its semantics—unraveled in the human brain?
And how are sentences combined to form stories and discourses?

The use of the Assembly Calculus for tackling language processing raises
a theoretical question. Many decades ago, Noam Chomsky (1956) proposed
his influential hierarchy of languages for the purpose of characterizing nat-
ural language processing problems: 常规的, context-free, context-sensitive,
and recursively enumerable languages. Of these, the last is far too strong,
containing uncomputable problems. The question arises,1 Is the Assembly
Calculus computationally powerful enough to encompass the first three
levels of the Chomsky hierarchy? The Assembly Calculus is known to be
capable of simulating arbitrary computations with O(s−1) 空间 (see the SI

1

Many thanks to an anonymous reviewer for bringing this up.

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

302

C. Papadimitriou and A. Friederici

section of Papadimitriou et al. 2020), where s is the sparsity of assemblies
−3. 所以, what is known about the complex-
believed to be about 10
ity of these three levels (Papadimitriou, 1995) implies that regular, 语境-
自由的, and context-sensitive features of language can be handled through
the Assembly Calculus for sentences containing at least a few dozen
字.

At a more general level, let us revisit briefly the hypothesis that opera-
tions on assemblies underlie cognitive processes. According to all evidence,
it is highly unlikely that the brain works in the pristine mathematical, 如果
highly random, manner of the assembly operations, as described in Pa-
padimitriou et al. (2020) and sketched here. The interesting question may
rather be, Are these operations useful abstractions of the actual neural pro-
cesses underlying cognition, including the processing of language? 更远
work is needed to pursue this question.

最后, can assembly-based mechanisms such as the Assembly Calculus
be demonstrated through simulations to be capable of implementing fur-
ther cognitive functions beyond language (a domain in which very partial
progress has already been made)? Two cognitive tasks that come to mind as
interesting candidates are planning and reasoning. Extending the method-
ology developed for handling language to these and other realms of cogni-
tion seems both interesting and challenging.

致谢

We are grateful to Thomas R. Knösche for valuable feedback on a draft of
this view and to Stephen Jose´Hanson for a number of constructive com-
评论. The research of C. H. 磷. was supported by NSF Awards CCF1763970
and CCF1910700, by a research contract with Softbank, and by a grant
from Columbia’s Center for AI Technology. The research of A. F. was sup-
ported by the Deutsche Forschungsgemeinschaft, grants FR519/22-1 within
SPP2041.

参考

Amit, D. J。, Brunel, N。, & Tsodyks, 中号. V. (1994). Correlations of cortical Hebbian
reverberations: Theory versus experiment. 神经科学杂志, 14, 6435–6445.
10.1523/JNEUROSCI.14-11-06435.1994, 考研: 7965048

Amit, D. J。, Fusi, S。, & Yakovlev, V. (1997). Paradigmatic working memory (吸引子)
cell in IT cortex. 神经计算, 9, 1071–1092. 10.1162/neco.1997.9.5.1071,
考研: 9188192

Axel, 右. (2018). Richard Axel. 神经元, 99(6), 1110–1112.
巴拉班, E., Edelman, S。, Grillner, S。, Grodzinski, U。, Jarvis, 乙. D ., Kaas, J. H。, . . .
Pipa, G。, (2010). Evolution of dynamic coordination. 在C中. Von der Malsburg,
瓦. A. Phelps, & 瓦. 歌手 (编辑。), Dynamic coordination in the brain. From neurons
to mind (PP. 59–82). 剑桥, 嘛: MIT Press and FIAS.

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Bridging Neurons and Cognition Through Assemblies of Neurons

303

Berwick, 右. C。, & Chomsky, 氮. (2015). Why only us: Language and evolution. 凸轮-

桥, 嘛: 与新闻界.

Breitenstein, C。, Jansen, A。, Deppe, M。, Foerster, A. F。, 索默, J。, Wolbers, T。, &
Knecht, S. (2005). Hippocampus activity differentiates good from poor learners
of a novel lexicon. 神经影像, 25(3), 958–968. 10.1016/j.neuroimage.2004.12.019,
考研: 15808996

Brodmann, K. (1909). Beiträge zur histologischen Lokalisation der Grosshirnrinde:
六、. Die Cortexgliederung des Menschen. Journal für Psychologie und Neurologie,
10, 231–246.

布莫尔, E., & 斯波恩斯, 氧. (2009). 复杂的大脑网络: Graph theoretical analy-
sis of structural and functional systems. 自然评论神经科学, 10, 186–198.
10.1038/nrn2575, 考研: 19190637

Buzsáki, G. (2010). Neural syntax: Cell assemblies, synapsembles, and readers. 新-

ron, 68, 362–385.

Buzsáki, G. (2019). The brain from inside out. 牛津: 牛津大学出版社.
Carrillo-Reid, L。, Han S., Yang W., Akrouh, A。, & Yuste, 右. (2019). Controlling visu-
ally guided behavior by holographic recalling of cortical ensembles. 细胞, 178(2),
447–457.

Catani, M。, 琼斯, D. K., & Ffytche, D.H. (2005). Perisylvian language net-
works of the human brain. Annals of Neurology, 57(1), 8–16. 10.1002/ana.20319,
考研: 15597383

Chomsky, 氮. (1956). Three models for the description of language. IRE Trans. 通知.

理论, 2, 113–124. 10.1109/TIT.1956.1056813

Chomsky, 氮. (1995). The minimalist program. 剑桥, 嘛: 与新闻界.
Douglas, 右. J。, & 马丁, K. A. C. (2004). Neuronal circuits of the neocor-
tex. Annual Reviews Neuroscience, 27, 419–451. 10.1146/annurev.neuro.27.070203
.144152

Durstewitz, D ., Seamans, J. K., & Sejnowski, 时间. J. (2000). Neurocomputational mod-
els of working memory. 自然神经科学, 3(11), 1184–1191. 10.1038/81460,
考研: 11127836

Eichenbaum, H. (2018). Barlow versus Hebb: When is it time to abandon the notion
of feature detectors and adopt the cell assembly as the unit of cognition? Neuro-
science Letters, 680, 88–93. 10.1016/j.neulet.2017.04.006, 考研: 28389238
Fedorenko, E., Hsieh, 磷. J。, Nieto-Castanon, A。, Whitfield-Gabrieli, S。, & Kanwisher,
氮. (2010). New method for fMRI investigations of language: Defining ROIs
functionally in individual subjects. 神经生理学杂志, 104(2), 1177–1194.
10.1152/杰恩.00032.2010, 考研: 20410363

Frankland, S. M。, & Greene, J. D. (2015). An architecture for encoding sentence
meaning in left mid-superior temporal cortex. In Proceedings of the National
美国科学院, 112(37), 11732–11737. 10.1073/
pnas.1421236112

Franks, K. M。, Russo, 中号. J。, Sosulski, D. L。, 调度, A. A。, 海豹树, S. A。, &
Axel, 右. (2011). Recurrent circuitry dynamically shapes the activation of piriform
cortex. 神经元 72, 49–56 (2011). 10.1016/j.neuron.2011.08.020, 考研: 21982368
Friederici, A. D. (2009). Pathways to language: Fiber tracts in the human brain. Trends
in Cognitive Sciences, 13(4), 175–181. 10.1016/j.tics.2009.01.001, 考研: 19223226

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

304

C. Papadimitriou and A. Friederici

Friederici, A. D. (2011). The brain basis of language processing: From structure
to function. Physiological Reviews, 91, 1357–1392. 10.1152/physrev.00006.2011,
考研: 22013214

Friederici, A. D. (2017). Language in our brain. The origins of a uniquely human capacity.

剑桥, 嘛: 与新闻界.

Friederici, A. D ., & 歌手, 瓦. (2015). Grounding language processing on basic neu-
rophysiological principles. 认知科学的趋势, 19(6), 329–338. 10.1016/
j.tics.2015.03.012, 考研: 25890885

Goucha, T。, 安旺德, A。, & Friederici, A. D. (2015). How language shapes the brain:
Cross-linguistic differences in structural connectivity. Poster presented at the 45th
Annual Meeting of the Society for Neuroscience, 芝加哥.

哈里斯, K. D. (2005). Neural signatures of cell assembly organization. 自然评论

神经科学, 6(5), 399–407. 10.1038/nrn1669, 考研: 15861182

哈里斯, K., Csicsvari, J。, Hirase, Dragoi, G。, & Buzsáki, G. (2003). Organization of
cell assemblies in the hippocampus. 自然, 424, 552–556. 10.1038/nature01834,
考研: 12891358

Hebb, D. 氧. (1949). The organisation of behavior. 纽约: 威利.
Ison, 中号. J。, Quiroga, 问. R。, & 油炸, 我. (2015). Rapid encoding of new memories
by individual neurons in the human brain. 神经元, 87(1), 220–230. 10.1016/
j.neuron.2015.06.016, 考研: 26139375

Kriegeskorte, N。, & Douglas, 磷. K. (2018). Cognitive computational neuroscience. Na-
ture Neuroscience, 21, 1148–1160. 10.1038/s41593-018-0210-5, 考研: 30127428
Kunze, T。, Haueisen, J。, & 克诺舍, 时间. 右. (2019). Emergence of cognitive prim-
ing and structure building from the hierarchical interaction of canonical micro-
circuit models. Biological Cybernetics, 113, 273–291. 10.1007/s00422-019-00792-y,
考研: 30767085

Kunze T., Peterson A. D. H。, Haueisen J., & Knösche T. 右. (2017). A model of individ-
ualized canonical microcircuits supporting cognitive operations. PLOS One, 12,
e0188003. 10.1371/journal.pone.0188003, 考研: 29200435

Lau, 乙. F。, Phillips, C。, & Poeppel, D. (2008). A cortical network for semantics:
(的)constructing the N400. 自然评论神经科学, 9 (12), 920–933. 10.1038/
nrn2532, 考研: 19020511

Lillicrap, 时间. P。, Santoro, A。, Marris, L。, Akerman, C. J。, & 欣顿, G. (2020). Back-
propagation and the Brain. 自然评论神经科学, 21, 335–346. 10.1038/
s41583-020-0277-3, 考研: 32303713

Makuuchi, M。, Bahlmann, J。, 安旺德, A。, & Friederici, A. D. (2009). Segregating
the core computational faculty of human language from working memory. 在
Proceedings of the National Academy of Sciences of the USA, 106, 8362–8367. 10.1073/
普纳斯.0810928106, 考研: 19416819

Markov, 氮. T。, & 肯尼迪, H.

(2013). The importance of being hierarchi-
卡尔. 神经生物学的当前观点, 23, 187–194. 10.1016/j.conb.2012.12.008,
考研: 23339864
Milne, A. E., Mueller,

J. L。, Männel, C。, Attaheri, A。, Friederici, A. D ., &
Petkov, C. 我. (2016). Evolutionary origins of non-adjacent sequence process-
ing in primate brain potentials. Scientific Reports, 6: 36259. 10.1038/srep36259,
考研: 27827366

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Bridging Neurons and Cognition Through Assemblies of Neurons

305

Mitropolsky, D ., 柯林斯, M。, & Papadimitriou, C. H. (in press). A biologically plau-
sible parser. 计算语言学协会会刊. arXiv:
abs/2108.02189.

Müller M. G。, Papadimitriou, C. H。, Maass, W., & Legenstein, 右. (2020). A model for
structured information representation in neural networks of the brain. eNeuro,
7(3). 10.1523/ENEURO.0533-19.20207.

Nucifora, 磷. G, Verma, R。, Melhem, 乙. R。, Gur, 右. E., & Gur, 右. C. (2005). Leftward
asymmetry in relative fiber density of the arcuate fasciculus. NeuroReport, 16(8),
791–794. 10.1097/00001756-200505310-00002

Pallier, C。, Devauchelle, A.-D., & 德阿内, S. (2011). Cortical representation of the
constituent structure of sentences. In Proceedings of the National Academy of Sciences
美利坚合众国, 108(6), 2522–2527. 10.1073/pnas.1018711108

Papadimitriou, C. H. (1995). Computational complexity. Reading, 嘛: 艾迪生-

韦斯利.

Papadimitriou, C. H。, & Vempala, S. S. (2019). Random projection in the brain and
computation with assemblies of neurons. 10th Innovations in Theoretical Computer
科学. Waderman, 德国: Leibniz International Proceedings in Informatics,
Schloss Dagstuhl.

Papadimitriou, C. H。, Vempala, S. S。, Mitropolsky D., 柯林斯, 中号. J。, & Maass, 瓦.
(2020). In Proceedings of the National Academy of Sciences of the United States of Amer-
伊卡, 117(25), 14464–14472.

Pokorny, C。, Ison, 中号. J。, 饶, A。, Legenstein, R。, Papadimitriou, C. H。, & Maass,
瓦. (2020). STDP forms associations between memory traces in networks
of spiking neurons. 大脑皮层, 30(3), 952–968. 10.1093/cercor/bhz140,
考研: 31403679

Quiroga, 右. 问. (2016). Neuronal codes for visual perception and memory. Neuropsy-

chologia, 83, 227–241. 10.1016/j.neuropsychologia.2015.12.016

Saur, D ., Kreher, 乙. W., Schnell, S。, Kümmerer, D ., Kellmeyer, P。, Vry, M.-S., . . .
Weiller, C. (2008). Ventral and dorsal pathways for language. 在诉讼程序中
the National Academy of Sciences, 105(46), 18035–18040. 10.1073/普纳斯.0805234105
Schomers, 中号. R。, Garagnani, M。, & Pulvermüller, F. (2017). Neurocomputational
consequences of evolutionary connectivity changes in perisylvian language cor-
tex. 神经科学杂志, 37, 3045–3055. 10.1523/JNEUROSCI.2693-16.2017,
考研: 28193685

Skeide, 中号. A。, Brauer, J。, Friederici, A. D. (2016). Brain functional and structural
predictors of language performance. 大脑皮层, 26(5), 2127–2139. 10.1093/
cercor/bhv042, 考研: 25770126

图灵, A. 中号. (1937). On computable numbers, with an application to the Entschei-
dungsproblem. In Proceedings of the London Mathematical Society, 42, 230–265.
10.1112/plms/s2-42.1.230

乌帕迪亚, J。, Silver, A。, Knaus, 时间. A。, Lindgren, K. A。, Ducros, M。, Kim, D.-S.,
& Tager-Flusberg, H.
(2008). Effective and structural connectivity in the
human auditory cortex. 神经科学杂志, 28(13), 3341–3349. 10.1523/
JNEUROSCI.4434-07.2008, 考研: 18367601

徐, W., & Sudhof, 时间. C. (2013). A neural circuit for memory specificity and generaliza-
的. 科学, 339(6125), 1290–1295. 10.1126/science.1229534, 考研: 23493706

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

306

C. Papadimitriou and A. Friederici

Zaccarella, E., & Friederici, A. D. (2015). Merge in the human brain: a sub-region
based functional investigation in the left pars opercularis. 心理学前沿,
6, 1818. 10.3389/fpsyg.2015.01818, 考研: 26640453

Zaccarella, E., 迈耶, L。, Makuuchi, M。, & Friederici, A. D. (2017). Building by syn-
tax: The neural basis of minimal linguistic structures. 大脑皮层, 27(1), 411–
421. 26464476

Received April 26, 2021; accepted September 2, 2021.

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

/

e
d

n
e
C

A
r
t

C
e

p
d

/

F
/

/

/

/

3
4
2
2
9
1
2
0
0
6
7
9
9
n
e
C

_
A
_
0
1
4
6
3
p
d

.

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3Communicated by Stephen José Hanson image

下载pdf