Nishikawa 2010 Network
Nishikawa 2010 Network
Nishikawa 2010 Network
Edited by Giorgio Parisi, University of Rome, Rome, Italy, and approved April 7, 2010 (received for review November 6, 2009)
Here we show that these and other apparently disparate properties follow from the discovery we present below that networks
optimal for synchronization have a quantized number of links, in
multiples of a constant that depends only on the number of nodes
and on the connection strengths. We derive our results for the
local stability of synchronous states in networks of identical units
and provide evidence that our main results remain valid for
networks of nonidentical units. We choose to focus on optimal
networks because, as we show, this class is very rich, can be
dealt with analytically, and forms a multicusped synchronization
landscape, which underlies all synchronizable networks and from
which suboptimal networks can be studied using perturbation and
Author contributions: T.N. and A.E.M. designed research; T.N. and A.E.M. performed
research; T.N. analyzed data; and T.N. and A.E.M. wrote the paper.
The authors declare no conflict of interest.
This article is a PNAS Direct Submission.
1
www.pnas.org/cgi/doi/10.1073/pnas.0912444107
Results
Optimal Networks for Synchronization. We represent the structure
of a network with n nodes using its adjacency matrix A
Aij 1i;jn , where Aij is the strength of the link from node j to
node i. We consider the network dynamics governed by
x_ i Fxi
[1]
j1
n
1
ji j2 ;
d2 n 1
where
i2
1 n
;
n 1 i
[2]
i2
[3]
these conditions holds for a wide variety of possible stability functions, including those for which the region defined by < 0
may be finite or semiinfinite, or have multiple disconnected components. Having the maximum range, minimum coupling cost,
and maximum dynamical robustness, the networks satisfying
Eq. 3 are called the optimal networks for synchronization. Similar
results can be derived for networks of nonidentical units, in which
the functions F and H are possibly different for different nodes,
and this more general case will be discussed below.
Quantized Number of Links. A surprising consequence of having
these optimal synchronization properties is the quantization of
the number of links in the networks. We find, for example, that
for binary interaction networks (i.e., Aij 0; 1) satisfying condition 3, the number of links m i ji Aij is quantized to multiples of n 1. That is,
m qk kn 1;
where k 1; 2; ; n:
[4]
mqk
z}|{ z}|{
0; k; ; k; k 1; ; k 1;
[5]
1
n 1d
q
m qk qk1 m;
[6]
June 8, 2010
vol. 107
no. 23
10343
APPLIED PHYSICAL
SCIENCES
numerical methods. An immediate consequence of our quantization result is that the addition of links to an optimal network
generally results in a suboptimal network, providing systematic
examples of link removals that enhance synchronizability. Similar
quantization results hold true for optimal networks with negative
interactions, which we derive using a generalized complement
transformation that maps them into networks with only positive
interactions. We show that negative interactions can reveal antagonistic structural relations and counterbalance structural heterogeneities, with potential implications for inhibitory interactions in
neural (2325), power-grid (6, 26), and cell-regulatory networks
(27). The interactions between power-grid generators, for example, can be positive or negative depending on the inductive vs.
capacitive nature of the corresponding network elements [e.g.,
for the Western U.S. power grid they are split 97% vs. 3% (26)].
minimizes (red arrow in Fig. 2B). The sharp valleys are observed along the lines m qk and therefore correspond to
the cusp points in Fig. 2A. Because two adjacent points on
the landscape may include networks that do not have similar
structures, it is surprising that one can actually move from
one point to the next often by a simple structural modification
(see Movie S1). Indeed, moving in the direction of the m coordinate can be achieved by simply adding or removing a link that
induces the smallest increase or largest decrease in . Along the
line m qk , an optimal network can be grown and kept optimal, by adding a node and connecting any k existing nodes to the
new node (see SI Text, Section 3). The flexibility of choosing new
links in this construction strongly suggests that optimal networks
can have arbitrarily complex connectivity structures as the network size grows. Another interesting landscape appears when we
compute the cost K as a function of m and n (Fig. 2C) based on
condition 5. In this landscape, optimal networks lie along the
lines of discontinuity, resulting from the discontinuous change
in s that occurs when m changes from qk 1 to qk and defines
a sawtooth function along the m coordinate. Note that for optimal networks, the cost K is independent of m, as mentioned
above, but increases linearly with n and can be expressed as K
K 2 n 1, where K 2 is the coupling cost for a network of two
coupled units. A different but potentially related structure is
the roughness of the time horizon considered in the synchronization of parallel processing units in distributed computing
(33, 34).
While the presentation above focused on networks of identical
units, the main results also hold true for networks of nonidentical
units. Adopting the framework of ref. 35 and developing further
analysis for networks of one-dimensional maps, we show in SI Text
and Figs. S1 and S2 (Section 4) that complete synchronization is
possible even for nonidentical units. Moreover, we show that this
is possible only for networks satisfying Eq. 3 in addition to the
condition that the Laplacian matrix L is diagonalizable. Since
any such networks must also exhibit the same quantization expressed in Eq. 4, we also expect cusps similar to those shown
in Fig. 2. For each quantized number of links qk , we can show
that there is a network that can synchronize completely despite
the heterogeneity of the dynamical units. Therefore, for both
identical and nonidentical units, condition 5 can be used to systematically construct examples of suboptimal networks that can
be made optimal by either adding or removing links.
Fig. 2. Quantization in the synchronization and cost landscapes. (A) Estimated by simulated annealing for networks with n 1012 nodes, the minimum value min (blue dots) of (Eq. 2) shows cusp points at periodic values of
the total interaction strength, m qk (Eq. 4). In this representation as a function of m, the results for networks with positive (Aij 0; 1) and mixed positive/negative (Aij 0; 1) interactions are identical (blue dots) and coincide
with the theoretical prediction (black curves) (Eq. 6). The results for the case
Aij 1 (red dots) show a similar but different quantization behavior,
following Eq. 8. (B) Synchronization landscape min as a function of both
m and n, computed from Eq. 6. Through simulated annealing, a network with
initially high (top red dot) evolves to a network satisfying Eq. 5 and min
(bottom red dot). (C) The coupling cost K as a function of m and n in units of
K 2 (the cost for a network of two coupled units). The cost takes the lower
values along the lines of discontinuity (m qk ).
www.pnas.org/cgi/doi/10.1073/pnas.0912444107
Acij Aij 1 ij :
[7]
min m
q
1
m qn2k1 qn2k m
n 1d
[8]
June 8, 2010
vol. 107
no. 23
10345
Conclusions
Even though negative interactions and link removals by themselves tend to destabilize synchronous states, we have shown that
they can compensate for other instabilities, such as those resulting from a forbidden number of interactions or from a heterogeneous in-degree distribution. This establishes an unexpected
relation between network synchronization and recent work on
metabolic networks, where locally deleterious perturbations have
been found to generate similar compensatory effects that are
globally beneficial in the presence of other deleterious perturbations (45, 46). For example, the removal of a metabolic reaction
or, equivalently, of its enzyme-coding gene(s)can often be
partially or totally compensated by the targeted removal of a second metabolic reaction. That is, the inactivation of specific metabolic reactions can improve the performance of defective or
suboptimally operating metabolic networks, and in some cases
it can even rescue cells that would be nonviable otherwise
(45). Other research has shown that similar reaction inactivation
occurs spontaneously for cells evolved to optimize specific metabolic objectives (47). These apparently disparate examples share
the common property that the collective dynamics is controlled,
and in fact enhanced, by constraining rather than augmenting the
underlying network. Such network-based control, including the
conditionally positive impact of otherwise detrimental interactions and constraints, is most likely not unique to these contexts.
In neuronal networks, for example, inhibitory interactions
have been predicted to facilitate synchronous bursting (2325,
4850). Even more compelling, it has been established for both
animal (51) and human (52, 53) cerebral cortices that the density
of synapses first increases and then decreases during early
brain development, suggesting a positive role played by link
removal also in neuronal networks. More generally, we expect
that the eigenvalue spectrum analysis that led to our conclusions
will help investigate analogous behavior in yet other classes of
network processes governed by spectral properties, such as
epidemic spreading (54) and cascading failures (55, 56).
Taken together, the highly structured characteristics revealed
by the synchronization landscape explain why the characterization of the network properties that govern synchronization has
been so elusive. Numerous previous studies performed under
comparable conditions have sometimes led to apparently conflicting conclusions about the role played by specific network
structural properties such as randomness, betweenness centrality,
and degree distribution (30). Our results indicate that at least part
of these disagreements can be attributed to the sensitive dependence of the synchronization properties on the specific combination of nodes and links, as clearly illustrated by the nonmonotonic, periodic structure of cusps exhibited by the synchronization
landscape. We suggest that insights provided by these findings will
illuminate the design principles and evolution mechanisms of
both natural and engineered networks in which synchronization
is functionally important (57).
Synchronization Stability Analysis. The stability analysis can be carried out
using a master stability approach based on linearizing Eq. 1 around synchronous states (28). We apply a coordinate transformation to reduce the
Laplacian matrix L to its Jordan canonical form and decompose the variational equations into components along the corresponding eigenspaces
(9, 10). This leads to a master stability equation,
[9]
www.pnas.org/cgi/doi/10.1073/pnas.0912444107
Pt r rt
e
0 as t
Qt
[10]
and, in particular, is less than 1 for sufficiently large t, implying that the
deviation will eventually become smaller for the optimal network.
Laplacian Spectrum of Generalized Complements. We show that if the eigenvalues of L are 0, 2 ; ; n (counting multiplicity), then the eigenvalues of the
Laplacian matrix Lc of the generalized complement (defined by Eq. 7) are 0,
n 2 ; ; n n . This result follows from the relation
Lc ; x 1n1
x
L; n x;
n x
[11]
Lc ; x detLc xI detnI J L xI
1n detLT J n xI
1n LT J; n x;
y_ DFs DHsy;
[12]
where LT denotes the transpose of L. Eq. 11 then follows from the fact that
LT J; zn z LT ; zz whenever L has row sums equal to zero
(which is the case, because L is the Laplacian matrix of a network). To prove
this fact, we will use elementary row operations, which do not change the
determinants. First, we replace the first row of the matrix LT J zI by the
sum of all rows, making each entry in this row n z. Next, we subtract this
row multiplied by n z (which makes it a row with all entries equal to )
from the remaining rows canceling out the contribution from the term J in
these rows. We denote the resulting matrix by M1. Finally, we take the matrix
LT zI and replace the first row by the sum of all rows. This results in a matrix
M2 with exactly the same entries as M1 except for the first row. For this
matrix, this is a row with all entries equal to z rather than n z. Dividing
the first rows of M1 and M2 by n z and z, respectively, which will scale the
determinants accordingly, we see that
31. Holland MD, Hastings A (2008) Strong effect of dispersal network structure on
ecological dynamics. Nature 456:792794.
32. Kinouchi O, Copelli M (2006) Optimal dynamical range of excitable networks at
criticality. Nat Phys 2:348351.
33. Guclu H, Korniss G, Novotny MA, Toroczkai Z, Rcz Z (2006) Synchronization landscapes in small-world-connected computer networks. Phys Rev E 73:066115.
34. Korniss G, Novotny MA, Guclu H, Toroczkai Z, Rikvold PA (2003) Suppressing roughness
of virtual times in parallel discrete-event simulations. Science 299:677679.
35. Sun J, Bollt EM, Nishikawa T (2009) Master stability functions for coupled nearly
identical dynamical systems. Europhys Lett 85:60011.
36. Diestel R (2005) Graph Theory, Graduate Texts in Mathematics (Springer-Verlag,
Berlin), 3rd Ed, Vol 173.
37. Donetti L, Hurtado PI, Muoz MA (2005) Entangled networks, synchronization, and
optimal network topology. Phys Rev Lett 95:188701.
38. Motter AE (2007) Bounding network spectra for network design. New J Phys 9:182.
39. Belykh I, de Lange E, Hasler M (2005) Synchronization of bursting neurons: What
matters in the network topology. Phys Rev Lett 94:188101.
40. Denker M, Timme M, Diesmann M, Wolf F, Geisel T (2004) Breaking synchrony by
heterogeneity in complex networks. Phys Rev Lett 92:074103.
41. Barabsi AL, Albert R (1999) Emergence of scaling in random networks. Science
286:509512.
42. Newman MEJ, Strogatz SH, Watts DJ (2001) Random graphs with arbitrary degree
distributions and their applications. Phys Rev E 64:026118.
43. Son SW, Kim BJ, Hong H, Jeong H (2009) Dynamics and directionality in complex
networks. Phys Rev Lett 103:228702.
44. Belykh I, Belykh V, Hasler M (2006) Synchronization in asymmetrically coupled
networks with node balance. Chaos 16:015102.
45. Motter AE, Gulbahce N, Almaas E, Barabasi AL (2008) Predicting synthetic rescues in
metabolic networks. Mol Syst Biol 4:168.
46. Motter AE (2010) Improved network performance via antagonism: From synthetic
rescues to multi-drug combinations. BioEssays 32:236245.
47. Nishikawa T, Gulbahce N, Motter AE (2008) Spontaneous reaction silencing in metabolic optimization. PLoS Comput Biol 4:e1000236.
48. Belykh I, Shilnikov A (2008) When weak inhibition synchronizes strongly desynchronizing networks of bursting neurons. Phys Rev Lett 101:078102.
49. Vreeswijk C, Abbott LF, Bard Ermentrout G (1994) When inhibition not excitation
synchronizes neural firing. J Comput Neurosci 1:313321.
50. Wang XJ, Buzsaki G (1996) Gamma oscillation by synaptic inhibition in a hippocampal
interneuronal network model. J Neurosci 16:64026413.
51. Bourgeois J, Rakic P (1993) Changes of synaptic density in the primary visual cortex of
the macaque monkey from fetal to adult stage. J Neurosci 13:28012820.
52. Huttenlocher P (1979) Synaptic density in human frontal cortexdevelopmental
changes and effects of aging. Brain Res 163:195205.
53. Huttenlocher PR, Dabholkar AS (1997) Regional differences in synaptogenesis in
human cerebral cortex. J Comp Neurol 387:167178.
54. Bogu M, Pastor-Satorras R (2002) Epidemic spreading in correlated complex
networks. Phys Rev E 66:047104.
55. Motter AE (2004) Cascade control and defense in complex networks. Phys Rev Lett
93:098701.
56. Simonsen I, Buzna L, Peters K, Bornholdt S, Helbing D (2008) Transient dynamics
increasing network vulnerability to cascading failures. Phys Rev Lett 100:218701.
57. Kiss IZ, Rusin CG, Kori H, Hudson JL (2007) Engineering complex dynamical structures:
Sequential patterns and desynchronization. Science 316:18861889.
58. Huang L, Chen Q, Lai YC, Pecora LM (2009) Generic behavior of master-stability
functions in coupled nonlinear dynamical systems. Phys Rev E 80:036204.
59. Mohar B, Poljak S (1990) Eigenvalues and the max-cut problem. Czech Math J
40:343352.
PNAS
June 8, 2010
vol. 107
no. 23
10347
APPLIED PHYSICAL
SCIENCES
n z
n z
n z
z
T
T
detL zI
L ; z
:
[13]
z
z