INVESTIGACIÓN

INVESTIGACIÓN

Nonrandom network connectivity comes in pairs

Felix Z. Hoffmann1,2 and Jochen Triesch1

1Frankfurt Institute for Advanced Studies (FIAS), Johann Wolfgang Goethe University, Frankfurt am Main, Alemania
2International Max Planck Research School for Neural Circuits, Max Planck Institute for Brain Research,
Frankfurt am Main, Alemania

Palabras clave: Nonrandom connectivity, Cortical circuit, Bidirectional connections, Aleatorio
graph model

ABSTRACTO

Overrepresentation of bidirectional connections in local cortical networks has been
repeatedly reported and is a focus of the ongoing discussion of nonrandom connectivity.
Here we show in a brief mathematical analysis that in a network in which connection
probabilities are symmetric in pairs, Pij
and nonrandom structures are inherently linked; an overabundance of reciprocally
connected pairs emerges necessarily when some pairs of neurons are more likely to be
connected than others. Our numerical results imply that such overrepresentation can
also be sustained when connection probabilities are only approximately symmetric.

= Pji, the occurrences of bidirectional connections

RESUMEN DEL AUTOR

Understanding the specific connectivity of neural circuits is an important challenge of
modern neuroscience. In this study we address an important feature of neural connectivity,
the abundance of bidirectionally connected neuron pairs, which far exceeds what would be
expected in a random network. Our theoretical analysis reveals a simple condition under
which such an overrepresentation of bidirectionally connected pairs necessarily occurs: Cualquier
network in which both directions of connection are equally likely to exist in any given pair of
neuronas, but in which some pairs are more likely to be connected than others, must exhibit
an abundance of reciprocal connections. This insight should guide the analysis and
interpretation of future connectomics datasets.

Increasing evidence is showing the highly structured nature of cortical microcircuitry
(Perin, Berger, & Markram, 2011; Song, Sjöström, Reigl, nelson, & Chklovski, 2005). Not ev-
ery connection is equally likely to be established, but some pairs of neurons are more likely
to connect than others. In this context, the relative occurrence of bidirectionally connected
pairs has been of particular interest. Using data obtained from paired whole-cell recordings in
cortical slices, the amount of bidirectionally connected pairs was compared with the number
of reciprocal pairs that one would expect in a random network with the same overall con-
nection probability. The connectivity of Layer 5 pyramidal neurons in the rat visual cortex
(Song et al., 2005) and somatosensory cortex (Markram, Lübke, Frotscher, Roth, & Sakmann,
1997; Perin et al., 2011) was shown to have significantly more reciprocal connections than
esperado.

The prevalence of bidirectional connectivity has since been established as an important
indicator of the nonrandomness of a network (Lefort, Tomm, Floyd Sarria, & Petersen, 2009;

un acceso abierto

diario

Citación: Hoffmann, F. Z., & Triesch J.
(2017). Nonrandom network
connectivity comes in pairs.
Neurociencia en red, 1(1), 31–41.
doi:10.1162/netn_a_00004

DOI:
http://doi.org/10.1162/netn_a_00004

Supporting Information:
doi.org/10.6084/m9.figshare.3501860
doi.org/10.5281/zenodo.200368
https://non-random-connectivity-
comes-in-pairs.github.io/

Recibió: 16 Septiembre 2016
Aceptado: 19 December 2016

Conflicto de intereses: Los autores tienen
declaró que no hay intereses en competencia
existir.

Autor correspondiente:
Felix Z. Hoffmann
hoffmann@fias.uni-frankfurt.de

Editor de manejo:
Olaf Sporns

Derechos de autor: © 2017
Instituto de Tecnología de Massachusetts
Publicado bajo Creative Commons
Atribución 4.0 Internacional
(CC POR 4.0) licencia

La prensa del MIT

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

t

/

/

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

t

.

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

Nonrandom network connectivity comes in pairs

Cortical microcircuitry:
The set of neuron-to-neuron
connections in a small subset of cells
in the cortex.

Support:
The subset of the domain of a
real-valued function whose elements
are not mapped to zero.

Erd ˝os–Rényi graph:
Randomly wired network in which
each possible connection has the
same probability to exist.
Neurociencia en red

Bourjaily & Molinero, 2011). Sin embargo, the exact relationship between nonrandomness and rela-
tive reciprocity has not been explained. Aquí, we model cortical circuitry as random networks
in which each possible connection has a separate probability to exist. Using this model, we are
able to show that any nonrandom connectivity, expressed as higher connection probabilities
in some edges and lower probabilities in others, necessarily induces a relative overrepresen-
tation of bidirectional connections, as long as the connection probabilities remain symmetric
within pairs. Cuantitativamente, we analyze reciprocity in networks with one discrete and one
continuous distribution of connection probabilities to demonstrate that the relative abundance
of bidirectional connections reported in experimental studies can easily be obtained from
estos modelos.

RESULTADOS

The emergence of nonrandom connectivity patterns can be modeled by assigning each pos-
sible connection in a random graph a separate probability to exist.
In such a model some
connections are more likely to be realized than others, allowing for the encoding of patterns
within the specific probabilities of each connection.
In the limiting case, each connection
either exists or is absent with certainty, representing a blueprint for the network architecture.

To analyze the effect of nonrandom structures within a network—specifically, on the statis-
tics of bidirectionally connected pairs found in the network—we consider a random graph
model of N neurons in which the probability of node i to connect to node j is modeled
by a random variable Pij. For this analysis, we assume Pij, for i, j = 1, . . . , N with i (cid:2)= j,
to be identically distributed random variables in [0, 1], yielding a probability of connection
for each ordered pair of nodes in the graph. Outside of pairs, the random variables Pij are
assumed to be independent—that is, nonequal Pij and Pkl are independent as long as i (cid:2)= l
(cid:2)=k. Finalmente, we explicitly exclude self-connections in this model and assume at all
or j
times that i (cid:2)= j.

Given the distributions of connection probabilities, what is then the probability in this model
for a randomly selected node to have a projection to another randomly selected node? Desde
the random variables Pij are identically distributed, we compute this overall connection prob-
ability μ easily as the expected value of Pij,

μ = E(Pij

).

(1)

Por ejemplo, if the values of Pij have a probability density function f with support in [0, 1], nosotros
can compute the connection fraction as

μ =

(cid:2)

1

0

x f (X) dx.

(2)

En este trabajo, we are interested in the probability Pbidir that a bidirectional connection exists
in a random pair of neurons. We determine Pbidir as the expected value of the product of Pij
and Pji,

Pbidir

= mi(PijPji

).

(3)

The relative occurrence (cid:2) of such reciprocally connected pairs compares Pbidir with the
occurrence of bidirectional pairs in an Erd ˝os–Rényi graph, in which each unidirectional
connection is equally likely to occur with probability μ (Erd ˝os & Rényi, 1959; Gilbert, 1959).

32

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

/

/

t

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

.

t

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

Nonrandom network connectivity comes in pairs

The probability that a particular bidirectional connection exists in such a random graph is
simply μ2, and we obtain the relative occurrence as the quotient

(cid:2) = Pbidir
μ2

)
= mi(PijPji
(cid:4)
(cid:3)
2 .
Pij
mi

(4)

Experimental studies in local cortical circuits of rodents have repeatedly reported a rela-
tive occurrence of bidirectional connections (cid:2) > 1 (Markram et al., 1997; Perin et al., 2011;
Song et al., 2005). To understand in which cases such an overrepresentation occurs, nosotros estafamos-
sider two cases. In the first case, assume that connection probabilities are independently de-
termined within pairs, también, meaning that the random variables Pij and Pji are independent.
Entonces, because Pij and Pji are identically distributed,

mi(PijPji

) = mi(Pij

) mi(Pji

) = mi(Pij

)2,

(5)

and we would expect to observe no overrepresentation of reciprocal connections, (cid:2) = 1. En
= Pji.
the second case, assume that connection probabilities are symmetric with in pairs, Pij
En este caso,

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

/

t

/

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

t

.

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

and the expected relative occurrence of reciprocal connections becomes

Pbidir

= mi(P2
ij

),

(cid:2) =

)
mi(P2
ij
(cid:3)
(cid:4)
2 .

mi

Pij

(6)

(7)

Jensen’s inequality:
If ϕ is a convex function and X an
integrable random variable, entonces
ϕ(mi(X)) ≤ E(ϕ(X)), donde mi(X)
denotes the expected value of X.

We note that now any distribution of Pij with a nonvanishing variance will lead to a relative
occurrence that deviates from the Erd ˝os–Rényi graph, porque

Era(Pij

) = mi(P2
ij

) − E

(cid:3)

(cid:4)

2

.

Pij

(8)

Además, since x (cid:3)→ x2 is a strictly convex function, Jensen’s inequality (Cover & tomás,
2006; Jensen, 1906) yields

mi(P2
ij

) ≥ E(Pij

)2,

(9)

and we find that (cid:2) ≥ 1 in networks with symmetric connection probabilities. Jensen’s inequal-
ity further states that the equality in (9), y por lo tanto (cid:2) = 1, holds if and only if Pij follows a
degenerate distribution—that is, if all Pij take the identical value μ. In the other case, dónde
Pij takes on more than one value with nonzero probability, we speak of a nondegenerate
distribución.

As a central result of this study, we thus find that any nondegenerate distribution of sym-
= Pji) necessarily induces an overrepresentation of bi-
metric connection probabilities (Pij
directional connections in the network, (cid:2) > 1. En otras palabras, in a network in which both
directions of connection are equally likely within any given pair, but in which some pairs
are more likely to be connected than others, the count of expected reciprocally connected
pairs is strictly underestimated by the statistics of an Erd ˝os–Rényi graph with the same overall
connection probability E(Pij

) = μ.

Neurociencia en red

33

Nonrandom network connectivity comes in pairs

Upper Bound for (cid:2)
The overrepresentation of bidirectional connections (cid:2) in a network is maximal when every
connected pair is already a reciprocally connected pair. In terms of the model defined above,
this is the case when

The relative occurrence of reciprocal connections from (4) then becomes

mi(PijPji

) = mi(Pij

).

(cid:2) = 1
mi(Pij

)

= 1
μ .

(10)

(11)

De este modo, for local cortical circuits of Layer 5 pyramidal neurons with a typical connection prob-
ability of μ = 0.1 (Song et al., 2005; Thomson, Oeste, Wang, & Bannister, 2002), the network
model yields a maximal overrepresentation of (cid:2) = 10. While this theoretical maximum is
unlikely to exist in actual cortical networks, the precise degree of overrepresentation will
depend on the specific distribution of connection probabilities in the network. En el siguiente
secciones, we study two generic examples.

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

/

/

t

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

.

t

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

Orientation preference:
The property of neurons in primary
visual cortex to respond strongly to
visual stimuli with a certain
orientation appearing inside their
receptive fields.

Neurociencia en red

Two-Point Distribution

The simplest nondegenerate distribution of connection probabilities is a distribution that takes
two values x, y, with probabilities p and 1 − p, respectivamente, as illustrated in Figure 1A. Este
distribution may be seen as a crude approximation to the connection probabilities recently
observed in visual cortex as a function of the neurons’ absolute difference in orientation prefer-
ence, where a “high” connection probability was reported for a difference between 0° and 45°
and a “low” probability was seen for cells with a difference of 45
in orientation tuning
(Lee et al., 2016).

–90

Formalmente, let x, y ∈ [0, 1] with x > y and 0 < p < 1. A random variable X follows the two-point distribution T (p, x, y) if P(X = x) = p and P(X = y) = 1 − p. In our network model, let then the Pij be T (p, x, y) distributed. The overall connection probability μ is μ = E(Pij ) = px + (1 − p)y. (12) Assume again that Pij = Pji. The relative occurrence of bidirectional connections is given by Solving (12) for p as (cid:2) = ) E(P2 ij μ2 = px2 + (1 − p)y2 μ2 . p = μ − y x − y (13) (14) and inserting this result into (13) yields an expression for the relative overrepresentation that depends on x, y, and μ (see Hoffmann & Triesch, 2016c, SI1), (cid:2) = x + y μ − xy μ2 . (15) 34 Nonrandom network connectivity comes in pairs Figure 1. Relative overrepresentation (cid:2) of bidirectional connections in networks with a fraction of pairs connected with a high probability x and the rest of the pairs connected with a low probability y. (A) Diagram illustrating the targets with a high chance x of connecting (thick arrows) and targets with a low probability y of connecting (thin arrows) for a single source node (hatched). (B) Different pairings of x and y can induce a high relative overrepresentation (cid:2) in a network with two-point- x−y , x, y), and a fixed overall connection probability distributed connection probabilities, Pij μ = 0.1. The dashed line marks an overrepresentation of bidirectional connections of (cid:2) = 4, observed for Layer 5 pyramidal neurons in rat visual cortex (Song et al., 2005). ∼ T ( μ−y Here we fix μ = 0.1 in accordance with the overall connection probability found in local circuits of pyramidal cells in the rat visual cortex (Song et al., 2005) and obtain the relative occurrence dependent on the two connection probability values x and y. Given x ≥ μ, it follows that y ≤ μ (see Hoffmann & Triesch, 2016c, SI2) and that the possible values for x and y are 0.1 ≤ x ≤ 1 and 0 ≤ y ≤ 0.1. Figure 1B shows contours of (cid:2) for these (x, y) pairings, illustrating how different values for the relative overrepresentation of reciprocal connections can be induced by two-point-distributed connection probabilities. We find that in such net- works, higher values of (cid:2) are easily obtained with reasonable network configurations. For example, a relative overrepresentation of (cid:2) = 4 could be achieved by a two-point distribution of connection probabilities in which one group of neuron pairs is highly connected with prob- ability x = 0.7, while the other group of neuron pairs is sparsely connected with probability y = 0.05. Collectively, the highly connected pairs then make up less than 8% of all neuron pairs, showing that it is sufficient to have a small subgroup of highly connected neuron pairs to induce a high overrepresentation of bidirectionally connected pairs in the network. For more densely connected networks, μ > 0.1, the effect that two distinct connection probabilities have
on the overrepresentation of reciprocal connections is reduced (cf. Figure S1), as one would
intuitively expect from the dependence of the maximal overrepresentation on μ in (11).

Gamma Distribution

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

t

/

/

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

.

t

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

Próximo, we analyze the relative overrepresentation of bidirectional connections in a network
with continuously distributed connection probabilities. The gamma distribution Γ(a, b) con
probability density function


,b(X) =

1
βαΓ(a) X

α−1 e

−x/β

,

x ≥ 0,

0,

de lo contrario,

(16)

allows for the variance Var(X) = αβ2 of a gamma-distributed random variable X ∼ Γ(a, b),
to take on different values, while keeping its mean E(X) = αβ constant (Hogg & Craig, 1978).
The exponential distribution emerges as a special case of the gamma distribution (un = 1).

Neurociencia en red

35

Nonrandom network connectivity comes in pairs

To ensure that the randomly drawn connection probabilities lie within the interval [0, 1], nosotros
here consider a modification to the traditional gamma distribution, in the form of a truncated
versión. Let α, β > 0. A random variable X follows the truncated gamma distribution ΓT(a, b)
if it has the probability density function


a,b(X) =
f T

,b

1
βαΓ(a) X

α−1 e

−x/β

,

0 ≤ x ≤ 1,

0,

de lo contrario.

(17)

The factor Kα,β is the inverse of the cumulative probability that x ≤ 1 in the untruncated gamma
distribución,

and is needed to ensure that

,β =

(cid:8)(cid:2)

1

0

(cid:9)−1

,

,b(X) dx

(cid:2)

a,b(X) dx = 1.
f T

(18)

(19)

Consider the above network model in which the connection probabilities PT
distributed and PT
ij

ji . We compute the relative overrepresentation (cid:2) numerically from

= PT

ij are ΓT(a, b)

(cid:10)

μ = E
(cid:10)

mi

PT
ij

2

PT
ij

(cid:11)

(cid:11)

=

=

(cid:2)

0

(cid:2)

1

1

0

x f T

a,b(X) dx,

x2 f T

a,b(X) dx.

(20)

(21)

Pairings of the shape parameter α and the scale parameter β are chosen such that the over-
all connection probability reflects connectivity statistics in local cortical networks, μ = 0.1
(Song et al., 2005; Thomson et al., 2002). The probability density functions and the resulting
relative overrepresentation of reciprocal connections (cid:2) for four representative α, β pairs are
shown in Figure 2A. Aquí, β is determined so as to yield μ = 0.1 for the given α, following the
relationship shown in Figure 2B (solid curve).

= 1
In the sparse networks we modeled, the tail of the gamma distribution is near zero at PT
ij
(see Figure 2A). Thus Kα,β ≈ 1, and the truncated gamma distribution can be well approx-
imated by the untruncated version. Assuming the connection probabilities to be standard
gamma distributed, Pij

∼ Γ(a, b), tenemos

mi(P2
ij

) =Var(Pij

) + mi(Pij

)2 = αβ2 + α2β2,

y por lo tanto

(cid:2) =

(cid:11)

2

(cid:11)

2

(cid:10)

(cid:10)

mi

mi

PT
ij

PT
ij

(cid:10)

(cid:3)

Pij

mi

mi

Pij

(cid:11)

2
(cid:4)

2

=

α2β2
α2β2

+

αβ2
α2β2

= 1 + 1
a

=: ˜(cid:2).

(22)

(23)

The approximation (cid:2) ≈ ˜(cid:2) = 1 + 1

α works well for α ≥ 1, as is shown in Figure 2C.

To induce a high overrepresentation of reciprocal pairs in the network, the gamma distri-
bution of connection probabilities takes a highly skewed shape. To obtain (cid:2) = 4, solo 57% de
pairs are expected to have a higher connection probability than 0.01 (un = 0.248, β = 0.487).
Such a situation, in which a large part of all neuron pairs have a small connection probability

Neurociencia en red

36

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

/

/

t

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

t

.

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

Nonrandom network connectivity comes in pairs

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

Cifra 2. Relative occurrences of bidirectional connections (cid:2) in networks with gamma-distributed
(A) Probability density functions of the truncated gamma distribution
connection probabilities.
ΓT(a, b) for different shape parameters α and the induced relative overrepresentation (cid:2) in a net-
work with such distributed connection probabilities Pij. For a given α, the scale parameter β was
chosen such that μ = 0.1. The plot to the right continues the density functions at a different scale.
(B) Contours of α, β pairings that yield an overall connection probability of μ = 0.1. The dashed
line shows the approximation β = μ
a , where μ = 0.1. (C) Relative occurrences (cid:2) as a function of α
for fixed μ = 0.1. For α ≥ 1, this relationship is well approximated by (cid:2) ≈ 1 + 1
a .

/

/

t

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

t

.

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

while some few pairs have a high chance to be connected, is likely to occur if, por ejemplo,
the connection probability strongly depends on the spatial separation of the neurons, as was
found in Layer 5 excitatory circuits of the rat somatosensory cortex (Perin et al., 2011). Entonces
only nearby neurons are likely to be connected, while the larger part of more distant neurons
has a low probability of connection.

Symmetry of Connection Probabilities in Neural Circuits

In neural circuits, connection probabilities that are equal within pairs but differ across the net-
work are plausible from both an anatomical and a functional perspective. From the anatom-
ical point of view, the distance dependency of connection probabilities mentioned above
is a characteristic of cortical circuits that necessarily leads to symmetric probabilities: El
distance from the first neuron’s soma to the second neuron’s soma is the same as the distance
from the second to the first, resulting in equal probabilities within a pair of neurons when
interneuron distance determines the connection probabilities. Regarding the functional per-
perspectiva, connection probabilities may also depend on the functional properties of the cells
in the network. Por ejemplo, the probability of connections between orientation-tuned cells
in the mouse primary visual cortex depends on their absolute difference in orientation tuning
(Ko et al., 2011; Lee et al., 2016). Since the absolute difference in orientation tuning will be
the same in both directions, connection probabilities can be expected to be equal within a
pair of orientation-tuned cells.

Neurociencia en red

37

Nonrandom network connectivity comes in pairs

Sin embargo, even when connection probabilities within pairs do not match exactly, an over-
representation of reciprocal connections is still likely to be observed when connection proba-
bilities follow a nondegenerate distribution. To see this, consider that connection probabilities
(X). As before, we as-
Pij are distributed according to some probability density function fPij
sume that the values of Pij are independent outside of pairs. In the following discussion, nosotros
also assume that i > j without loss of generality. The expected probability of a reciprocal
connection within a pair can then be expressed as

mi(PijPji

) =

(cid:2)

(cid:2)

1

1

0

0

xy fPij,Pji

(X, y) dx dy,

where fPij,Pji

(X, y) is the joint probability density function of Pij and Pji,

fPij,Pji

(X, y) = fPji

|Pij

(y | X) fPij

(X).

(24)

(25)

= Pji, fPji

In the case that Pij and Pji are independent, we have fPji
of Pij
function that transitions between the two extreme cases by multiplying fPji
function of a normal distribution centered around x,

(y), and in the case
(y | X) = re(y − x). Here we propose a model for the conditional density
(y) by the density

(y | X) = fPji

|Pij

|Pij

fPji

|Pij

(y | X) = 1

(X) fPji

(y)

1

2Pi

pag

(y−x)2
2p2

,

mi

where the additional factor Nσ(X)−1 makes sure that fPji

|Pij

(y | X) integrates to 1,

(X) =

(cid:2)

1

0

(z)

fPji

1

2Pi

pag

(z−x)2
2σ2 dz.

mi

(26)

(27)

En efecto, as the standard deviation σ of
fPji

(y | X) approaches fPji

|Pij

(y), and in the limit σ → 0 tenemos

the modulating normal distribution increases,

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

/

t

/

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

t

.

lim
σ→0

fPji

|Pij

(y | X) = re(y − x).

(28)

In Figure 3A, the conditional density functions for various σ are shown for the truncated
gamma distribution. For low values of σ, the conditional density function resembles a narrow
Gaussian around x, reflecting approximately symmetric connection probabilities. For σ > 1,
a,b(y), reflecting
por otro lado, fPji
the independence of Pji from Pij.

(y | X) becomes virtually indistinguishable from f T

|Pij

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

Finalmente, we employ the model to examine how the relative overrepresentation of bidirec-
tional connections (cid:2) changes with the degree of symmetry in the connection probabilities
within a pair of neurons. para hacerlo, (cid:2) is computed as a function of σ for a given distribution of
Pij using

(cid:2) = mi(PijPji
μ2

)

,

(29)

the numerator is defined through (24–26), and the overall connection probability μ is calcu-
lated as

μ = 1
2

(cid:2)

1

0

x fPij

(X) dx + 1
2

(cid:2)

1

0

(X)

fPij

(cid:2)

1

0

y fPji

|Pij

(y | X) dy dx.

(30)

38

Neurociencia en red

Nonrandom network connectivity comes in pairs

|Pij

(y) = f T

a,b(y), with α = 0.248 and β such that E(Pij

Cifra 3. Relative overrepresentation of bidirectional connections (cid:2) is sustained when connection
probabilities are only approximately symmetric in pairs. (A) Illustration that the conditional density
(y | X) en (26) transitions from equality of the random variables Pij and Pji to indepen-
function fPji
) = 0.1.
dence with increasing σ. We use fPij
For the illustration, Pij was fixed as x = 0.15. Already for σ = 1, the conditional density function
a,b(y) (cf. Figura 2A). (B) Relative occurrences of recip-
becomes visually indistinguishable from f T
rocally connected pairs (cid:2) as a function of σ. The curves for α = 1 and α = 2 show numerical
) = 0.1. Relative recip-
solutions of (29) with fPij
rocal pair counts from generated networks following the model matched these theoretical curves
(data not shown). For α = 0.248, random variables with the respective probability density functions
were sampled and the average (cid:2) was computed via (29) using the sample means. Error bars show
SEMs; the curve for α = 0.248 (solid line) was fitted to the data points and is purely for illustrative
purposes.

a,b(y), where β was chosen such that E(Pij

(y) = f T

|Pij

since half of the connection probabilities are drawn according to fPij and the other half are
drawn according to fPji
given a particular value of x drawn according to fPij. Figure 3B shows
the change of (cid:2) with σ for connection probabilities Pij following a truncated gamma distribu-
tion ΓT(a, b). For the three parameter sets chosen, we see that a strong overrepresentation of
bidirectional connections is sustained when connection probabilities are only approximately
symmetric in pairs. Además, as long as Pji is at biased to take similar values to Pij, an over-
representation of (cid:2) > 1 se puede observar, implying that effects such as distance dependency
or the dependence on the absolute difference in orientation tuning of connection probabilities
will tend to increase the relative occurrence of bidirectional connections, even when other
effects are also influencing the neurons’ connection probabilities.

DISCUSIÓN

Experimental evidence suggests that any pair of excitatory cells within a cortical column has
contact points between axon and dendrite close enough to support a synaptic connection
between the cells (Kalisman, Silberberg, & Markram, 2005; Stepanyants, Tamás, & Chklovski,
2004). Despite this potential “all-to-all” connectivity, only a small fraction of the contacts are
realized as functional synapses. Uncovering the principles underlying which contact points get
utilized for synaptic transmission is crucial for our understanding of the structure and function
of the local cortical circuits in the mammalian brain.

Local networks in the rat visual and somatosensory cortices have been shown to feature non-
random structure (Perin et al., 2011; Song et al., 2005), and much attention has been given to
bidirectionally connected neuron pairs that occur more often than would be expected from
random connectivity (Bourjaily & Molinero, 2011; Clopata, Büsing, Vasilaki, & Gerstner, 2010;
Miner & Triesch, 2016).
In this study we have shown a condition under which nonrandom
network structure and the occurrence of reciprocally connected pairs are inherently linked;
a relative overrepresentation of bidirectional connections arises necessarily in networks with

Neurociencia en red

39

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

/

/

t

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

t

.

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

Nonrandom network connectivity comes in pairs

a nondegenerate distribution of symmetric connection probabilities. The absence of an over-
abundance of reciprocal pairs, por otro lado, as for example is found in the intralayer
connectivity of the mouse C2 barrel column (Lefort et al., 2009), points toward either a truly
random network or an asymmetry in the connection probabilities.

Cuantitativamente, a network in which connection probabilities take on one of two values
is easily able to account for even the highest values of overrepresentation reported. A network
with such a two-point distribution of connection probabilities might occur naturally, dónde
the probability of connection depends on whether a given pair of neurons shares a certain
feature—for example, have or do not have similar orientation preferences (Lee et al., 2016).

A continuous distribution in connection probabilities, por otro lado, might occur when
pair connectivity depends on a continuous parameter, such as the interneuron distance or the
neurons’ ages. We showed that networks in which connection probabilities follow a gamma
distribution can also have a high relative occurrence of reciprocally connected pairs; sin embargo,
in this case a larger fraction of pairs remain unconnected with a very high probability.

It is likely that a combination of such effects determines the connection probabilities in
local cortical networks. En tono rimbombante, we showed that as long as this probability is symmetric
for pairs, any such effect that creates a nondegenerate distribution of probabilities will cause
an increase of the reciprocity in the network.

Our results confirm the intuitive notion that reciprocity is favored in symmetric networks,
whereas asymmetric probabilities of connection inhibit the occurrence of bidirectionally con-
nected pairs. Network models with symmetric connectivity, such as Hopfield nets, generally
excel at memory storage and retrieval through fixed-point attractor dynamics (Hopfield, 1982),
while asymmetric network models such as synfire chains are suitable for reliable signal trans-
mission (Abeles, 1982; Diesmann, Gewaltig, & Aertsen, 1999). This suggests the intriguing
possibility that one may be able to infer the nature of the computations in a neural circuit
on the basis of certain statistics of its connectivity, such as the abundance of bidirectionally
connected pairs.

En conclusión, the present study puts the overrepresentation of bidirectional connections
found in local cortical circuits in a new light.
If connection probabilities are symmetric in
pares, the overrepresentation emerges as a symptom of any form of nonrandom connectiv-
idad.
It is thus crucial for both future experimental and modeling studies to develop a more
refined view of nonrandom network connectivity that goes beyond simple pair statistics.
Focusing on higher-order connectivity patterns and taking into account the actual synaptic
efficacies seem promising avenues for future research into the nonrandom wiring of brain
circuitos.

SUPPLEMENTARY INFORMATION

The supplementary information document for references SI1 and SI2 and for Figure S1 is
available online at DOI:10.6084/m9.figshare.3501860. Python code for the numerical comp-
utations is available as a GitHub repository, archived along with the generated data at
DOI:10.5281/zenodo.200368. A website documenting the code can be found at https://
non-random-connectivity-comes-in-pairs.github.io/

EXPRESIONES DE GRATITUD

The authors thank the anonymous reviewers for their helpful and constructive comments on
earlier versions of this article.

Neurociencia en red

40

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

t

/

/

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

.

t

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3

Nonrandom network connectivity comes in pairs

CONTRIBUCIONES DE AUTOR

J.T. is supported by the Quandt Foundation. F.Z.H. and J.T. conceived and designed the study.
F.Z.H. carried out the formal analysis and performed the simulations. And both F.Z.H. and J.T.
wrote the manuscript.

REFERENCIAS

Abeles, METRO. (1982). Local cortical circuits: An electrophysiological

estudiar. Berlina, Alemania: Saltador.

Bourjaily, METRO. A., & Molinero, PAG. (2011). Excitatory, inhibitory, y
structural plasticity produce correlated connectivity in random
networks trained to solve paired-stimulus tasks. Frontiers in Com-
putational Neuroscience, 5, 37. doi:org/10.3389/fncom.2011.
00037

Clopata, C., Büsing, l., Vasilaki, MI., & Gerstner, W.. (2010). Estafa-
nectivity reflects coding: A model of voltage-based STDP with
homeostasis. Neurociencia de la naturaleza, 13(3), 344–352. doi:org/10.
1038/nn.2479

Cover, t. METRO., & tomás, j. A. (2006). Elements of information

theory (2y ed.). Hoboken, Nueva Jersey: Wiley-Interscience.

Diesmann, METRO., Gewaltig, M.-O., & Aertsen, A.

(1999). Stable
propagation of synchronous spiking in cortical neural networks.
Naturaleza, 402(6761), 529–533. doi:org/10.1038/990101

Erd ˝os, PAG., & Rényi, A. (1959). On random graphs, I. Publicationes

Mathematicae, 6, 290–297.

Gilbert, mi. norte. (1959). Random graphs. Annals of Mathematical Statis-
tics, 30(4), 1141–1144. doi:org/10.1214/aoms/1177706098
Hoffmann, F. Z., & Triesch J. (2016a). Documentation for Nonran-
dom network connectivity comes in pairs. https://non-random-
connectivity-comes-in-pairs.github.io/

Hoffmann, F. Z., & Triesch J. (2016b). Non-random network con-
nectivity comes in pairs: Code & generated data to reproduce
the article. Zenodo, doi.org/10.5281/
results and figures of
zenodo.200368

Hoffmann, F. Z., & Triesch J. (2016C). Supporting information for
Nonrandom network connectivity comes in pairs. FigShare,
doi.org/10.6084/m9.figshare.3501860

Hogg, R. v., & Craig, A. t. (1978). Introduction to mathematical

Estadísticas (4th ed.). Nueva York, Nueva York: Macmillan.

Hopfield, j. j. (1982). Neural networks and physical systems with
emergent collective computational abilities. Actas de la
Academia Nacional de Ciencias, 79(8), 2554–2558.

Jensen, j. l. W.. V. (1906). Sur les fonctions convexes et les inégalités
entre les valeurs moyennes. Acta Mathematica, 30(1), 175–193.
doi:org/10.1007/BF02418571

Kalisman, NORTE., Silberberg, GRAMO., & Markram, h. (2005). The neocor-
tical microcircuit as a tabula rasa. Actas del Nacional

Academia de Ciencias, 102(3), 880–885. doi:org/10.1073/pnas.
0407088102

Ko, h., Hofer, S. B., Pichler, B., Buchanan, k. A., Sjöström, PAG. J., &
Mrsic-Flogel, t. D. (2011). Functional specificity of local synaptic
connections in neocortical networks. Naturaleza, 473(7345), 87–91.
doi:org/10.1038/nature09880

Sotavento, W.-C. A., Bonin, v., Reed, METRO., graham, B. J., Hood, GRAMO.,
Glattfelder, K., & Reid, R. C. (2016). Anatomy and function of an
excitatory network in the visual cortex. Naturaleza, 532, 370–374.
doi:org/10.1038/nature17192

Lefort, S., Tomm, C., Floyd Sarria, j. C., & Petersen, C. C. h. (2009).
The excitatory neuronal network of the C2 barrel column in
mouse primary somatosensory cortex. Neurona, 61(2), 301–316.
doi:org/10.1016/j.neuron.2008.12.020

Markram, h., Lübke, J., Frotscher, METRO., Roth, A., & Sakmann, B.
(1997). Physiology and anatomy of synaptic connections be-
tween thick tufted pyramidal neurones in the developing rat
neocortex. Revista de fisiología, 500(punto 2), 409–440.

Miner, D., & Triesch, j. (2016). Plasticity-driven self-organization
under topological constraints accounts for non-random features
of cortical synaptic wiring. PLOS Computational Biology, 12(2),
e1004759. doi:org/10.1371/journal.pcbi.1004759

Perin, R. Berger, t. K., & Markram, h. (2011). A synaptic orga-
nizing principle for cortical neuronal groups. Actas de
the National Academy of Sciences, 108(13), 5419–5424. doi:org/
10.1073/pnas.1016051108

Song, S., Sjöström, PAG. J., Reigl, METRO., nelson, S., & Chklovski, D. B.
(2005). Highly nonrandom features of synaptic connectivity in
local cortical circuits. Biología PLoS, 3(3), e68. doi:org/10.1371/
journal.pbio.0030068

Stepanyants, A., Tamás, GRAMO., & Chklovski, D. B. (2004). Clase-
specific features of neuronal wiring. Neurona, 43(2), 251–259.
doi:org/10.1016/j.neuron.2004.06.013

Thomson, A. METRO., Oeste, D. C., Wang, y., & Bannister, A. PAG. (2002).
Synaptic connections and small circuits involving excitatory
and inhibitory neurons in layers 2–5 of adult rat and cat
neocortex: Triple intracellular recordings and biocytin labelling
in vitro. Corteza cerebral, 12(9), 936–953. doi:org/10.1093/
cercor/12.9.936

Neurociencia en red

41

yo

D
oh
w
norte
oh
a
d
mi
d

F
r
oh
metro
h

t
t

pag

:
/
/

d
i
r
mi
C
t
.

metro

i
t
.

/

/

t

mi
d
tu
norte
mi
norte
a
r
t
i
C
mi

pag
d

yo

F
/

/

/

/

/

1
1
3
1
1
0
9
1
8
4
1
norte
mi
norte
_
a
_
0
0
0
0
4
pag
d

t

.

F

b
y
gramo
tu
mi
s
t

t

oh
norte
0
7
S
mi
pag
mi
metro
b
mi
r
2
0
2
3imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN
imagen de INVESTIGACIÓN

Descargar PDF