fengling.eth
Local structure identifies global spreaders
← Back

Complex networks · PNAS 2018

Local structure can identify and quantify influential global spreaders in large scale social networks

Yanqing Hu, Shenggong Ji, Yuliang Jin, Ling Feng, H. Eugene Stanley, Shlomo Havlin (equal contributions)

Sun Yat-sen University · Southwest Jiaotong University · Institute of Theoretical Physics, Chinese Academy of Sciences · Institute of High Performance Computing, A*STAR Singapore · National University of Singapore · Boston University · Bar-Ilan University

Viral spreading on a social network is global, so measuring how influential a user is seems to require the whole network. It does not. A spread that gets past a small characteristic number of people almost surely goes global; one that does not, dies out nearby. Counting how often a seed gets that far measures its global influence from local structure alone, in a time that does not grow with the size of the network.

The claim

Spreading is a nucleation process: beyond a characteristic size s∗s^* it reaches a point of no return.

s∗s^* is a property of the whole network but does not depend on its size. Within it, a spread travels only 3–4 hops in the nine online social networks we studied. A percolation-based greedy algorithm built on s∗s^* selects seed spreaders in constant time, with performance remarkably close to the true optimum.

0 · Context

A global process, and the question of whether local information is enough

Online social networks are now where information and opinions spread. They are also gigantic: in mid-2016 Facebook had about 1.5 billion monthly active users. Viral marketing, the adoption of new products and the control of false information all ask the same question: which users, if they start spreading something, will reach the most people?

Because a viral spread reaches a finite fraction of the whole network, the influence of a node is usually measured with global information: k-shell decomposition, degree discount, betweenness, closeness, the Katz index and others. On networks of a billion users these become impractical, because the full structure is not available or the computation does not scale. On the other side, Christakis and Fowler’s “three degrees of influence” suggests from social experiments that influence fades beyond friends of friends of friends, an unexplained local effect, and a local approximation was recently found to work for a global measure of collective influence. This apparent paradox raises a basic question:

Can local network structure accurately determine the size of global spreading?

1 · Two phases

A spread either dies out nearby or takes over a fixed share of the network, with nothing in between

We model spreading with the susceptible–infected–recovered (SIR) family, which describes information spreading in social media well. An active node activates each neighbour with probability β\beta. The spreading influence of node ii is the expected number of nodes it eventually activates,

S(i)≡∑s=1Ns g(i,s), S(i)\equiv\sum_{s=1}^{N}s\,g(i,s),
(1)

where g(i,s)g(i,s) is the probability that ss nodes in total end up activated, in a network of NN nodes. Above the epidemic threshold βc\beta_c, we find that g(i,s)g(i,s) has two well-separated peaks. A local peak sits at small ss. A viral peak, sharp as a delta function, sits at a large size s∞s^\infty that does not depend on the seed node or on the realization. Between them is a wide gap.

Panel A: six simulated spreads from the same red seed on the NOLA Facebook network, three staying small and three covering most of the network in orange. Panel B: illustration of a giant cluster and many finite clusters in bond percolation. Panel C: the size distribution of spreads with a red peak at small sizes, a blue peak at the giant component, and a green percolation curve. Panel D: the finite part on log-log axes with an exponential cutoff at s* = 32.9.
Fig. 1. (A) Local (1, 3, 5) and viral (2, 4, 6) SIR spreads from the same node (red, degree 27) on the New Orleans Facebook network, β=0.02\beta=0.02, βc=0.01\beta_c=0.01. (B) Giant and finite clusters in bond percolation. (C) The distribution g(i,s)g(i,s) (columns) and the percolation cluster-size distribution p(s)p(s) (green). (D) Fit of the finite part to Eq. 5 gives s∗=32.9±0.6s^*=32.9\pm0.6; inset: s∗s^* diverges near βc\beta_c with exponent σ=1.05\sigma=1.05. Tap to enlarge.

Percolation theory explains both features. An SIR process maps onto bond percolation: remove every link with probability 1−β1-\beta, and the nodes a seed activates are exactly the cluster it belongs to, so g(i,s)g(i,s) equals the cluster-size distribution p(i,s)p(i,s). Above the percolation threshold a giant component of size s∞∝Ns^\infty\propto N appears, and p(i,s)p(i,s) splits into a finite part pf(i,s)p_f(i,s) and the giant part p(i,s∞)p(i,s^\infty). Since the finite clusters contribute little,

S(i)≈S^(i)≡s∞ p(i,s∞): S(i)\approx\hat S(i)\equiv s^\infty\,p(i,s^\infty):
(2)

a node’s spreading power is the size of the giant component times the probability that the node is in it. For random networks with a given degree distribution this has a closed form; for real networks it does not, but the two-phase behaviour is the same.

Two phases, live
illustration on a random network: N=20,000N=20{,}000, mean degree 5, βc=0.2\beta_c=0.2

Scroll the panel sideways →

—

Each run starts a spread from a random node and records how many nodes it reaches; the histogram (log-spaced sizes) fills up run by run. Spreads end either in the local peak, cut off near s∗s^* (amber line, from the exact formula for this network type), or in the viral peak at the giant component. Nothing lands in between.

The readout compares two estimates of the chance of going viral: from complete runs, and from runs stopped as soon as they reach mm nodes. With mm a few times s∗s^*, the two agree, while the stopped runs touch only a tiny fraction of the nodes. This toy uses a random network, not the nine social networks of the paper.

2 · The size s*

A characteristic size, independent of the seed and of the network size, marks the point of no return

Four panels: A, truncated against exact spreading power for NOLA Facebook and Macau Weibo, lying on the diagonal; B, relative error against m dropping to zero by m = s* = 32.9; C, bars of influence radius, farthest distance and diameter for nine social networks and two random networks; D, influence radius against beta, between 3 and 4, below the other two distances.
Fig. 2. (A) Truncated vs. exact spreading power (NOLA Facebook, Macau Weibo). (B) Relative error vs. mm: below 1 % for m>s∗m>s^*. (C) Influence radius ℓ∗\ell^*, farthest distance ℓ∞∗\ell^*_\infty and diameter DD in nine social and two random networks. (D) ℓ∗\ell^* vs. β\beta (NOLA Facebook). Tap to enlarge.

Percolation theory says that the finite clusters have an exponentially decaying size distribution. Averaged over all nodes, the finite part of the cluster-size distribution behaves as

pf(s)∼s−τe−s/s∗, p_f(s)\sim s^{-\tau}e^{-s/s^*} ,
(5)

and s∗s^* is the characteristic size of finite clusters. In an Erdős–Rényi random network with mean degree ⟨k⟩\langle k\rangle, sER∗=1/(β⟨k⟩−1−ln⁡β−ln⁡⟨k⟩)s^*_{ER}=1/(\beta\langle k\rangle-1-\ln\beta-\ln\langle k\rangle), which near the threshold scales as s∗∼∣β−βc∣−1/σs^*\sim|\beta-\beta_c|^{-1/\sigma} with the mean-field exponent σ=0.5\sigma=0.5. In real networks we obtain s∗s^* by fitting Eq. 5 to simulations; on the Facebook network it also follows a power law near βc\beta_c, with a non-mean-field σ=1.05\sigma=1.05 (Fig. 1D).

So a spread that has activated more than about s∗s^* nodes is almost certainly in the giant component. This gives the truncated spreading power: run the SIR process from node ii and stop it once mm nodes are active,

S(i)≈S~(i)≡s~∞ p~(i,s~∞),p~(i,s~∞)≡∑s=mNp(i,s), S(i)\approx\tilde S(i)\equiv\tilde s^\infty\,\tilde p(i,\tilde s^\infty),\qquad \tilde p(i,\tilde s^\infty)\equiv\sum_{s=m}^{N}p(i,s),
(4)

where p~\tilde p is the probability of reaching at least mm nodes and s~∞=∑ip~(i,s~∞)\tilde s^\infty=\sum_i\tilde p(i,\tilde s^\infty). For m≥s∗m\ge s^* the error is small: the relative error Er(i,m)=[S~(i)−S(i)]/S(i)E_r(i,m)=[\tilde S(i)-S(i)]/S(i) falls quickly with mm and is below 1 % for m>s∗m>s^* (Fig. 2B). Because s∗s^*, like the giant component, is a property of the network and not of the seed, it can be determined once and used as the threshold for every node.

Exact influence costs time proportional to NN; the truncated estimate costs a constant O(m)O(m).

3 · Influence radius

Whether a spread goes global is decided within three to four steps of the seed

To see what s∗s^* means on the network, we define an influence radius ℓ∗\ell^*: run the SIR process until s∗s^* nodes are active and record the largest number of hops (shortest-path distance) between the seed and an active node, averaged over realizations and seeds. With β\beta chosen so that the giant component holds 30 % of the nodes in every network, ℓ∗≈3\ell^*\approx3–4 in all nine online social networks, much smaller than the average distance to the farthest nodes and the diameter (Fig. 2C).

So a local spread vanishes within three to four steps; otherwise it reaches about 30 % of the network. ℓ∗\ell^* grows as β\beta approaches βc\beta_c (Fig. 2D), as in a continuous phase transition: at the critical point the correlation length diverges, but away from it a characteristic scale appears. This resolves the paradox: spreading is global in the supercritical phase, yet whether a node starts a global spread depends only on its local environment.

NetworkTypeNodesMean degree
CA-GrQc (arXiv collaborations)undirected5,2425.53
CA-HepTh (arXiv collaborations)undirected9,8775.26
Macau Weibo (followers)directed24,0237.73
Email-Enronundirected36,69210
NOLA Facebook (friends)undirected63,73125.64
DBLP (co-authors)undirected317,0806.62
Delicious (subscribers)directed582,3772.90
QQ (friends)undirected1,113,43514.41
LiveJournalundirected3,997,96217.35
The nine online social networks studied (SI Appendix, section I).

4 · Picking seeds

A greedy search on the truncated estimate finds near-optimal seed sets in constant time

The practical problem is to choose MM seeds V={v1,…,vM}V=\{v_1,\dots,v_M\} from a set of LL candidates to maximize their collective spreading power S(V)S(V). Targeting many ordinary users is often more cost-effective than targeting a few hubs, and the full network is rarely available, so we take candidates of about average degree. The collective version of the estimator, S~(V)≡s~∞ p~(V,s~∞)\tilde S(V)\equiv\tilde s^\infty\,\tilde p(V,\tilde s^\infty), uses the probability that the MM seeds activate at least one cluster of at least mm nodes, and is again independent of NN.

Combining it with the natural greedy algorithm gives the percolation-based greedy algorithm (PBGA): pick the candidate with the largest S~\tilde S; then, with it fixed, add the candidate that most increases S~(V)\tilde S(V); repeat until MM seeds are chosen. With the real spreading power instead of S~\tilde S, this would be the natural greedy algorithm (NGA).

Two log-log plots of execution count against network size: the natural greedy algorithm grows linearly with N, the percolation-based greedy algorithm stays flat, in random networks (A) and in real social networks with extrapolations to Twitter and Facebook (B).
Fig. 3. Execution count of PBGA (red) and NGA (blue) against network size: (A) random networks, β=0.2\beta=0.2, βc=0.1\beta_c=0.1, choosing M=10M=10 from L=1000L=1000 candidates; (B) the real networks, with extrapolations to the whole of Twitter and Facebook (solid symbols).

The cost of PBGA does not grow with the network (Fig. 3), which matters for networks with billions of nodes. Maximum degree, degree discount and maximal collective influence (MCI) also have size-independent theoretical cost, but the first two perform much worse, and MCI is much slower, because it needs all nodes up to a distance ℓ\ell from the seeds, and in small-world networks even a small ℓ\ell means thousands of nodes. PBGA depends only on s∗s^*, which the small-world effect does not inflate.

Four panels. A and B: normalized collective spreading power against the number of seeds M for eleven algorithms on NOLA Facebook and Macau Weibo; PBGA, NGA and the genetic algorithm are on top and match brute force for small M. C: lower bounds of the performance ratio, near one. D: relative performance of solutions found at one beta and used at another, close to one above the threshold.
Fig. 4. (A, B) Collective spreading power S(V)/s∞S(V)/s^\infty of the seeds chosen by PBGA and ten other methods (brute-force search BFS, degree discount DDH, eigenvector, genetic algorithm GA, maximum betweenness, closeness, degree, Katz index, k-shell, NGA, MCI) from L=100L=100 candidates of median degree, NOLA Facebook (β=0.012\beta=0.012) and Macau Weibo (β=0.055\beta=0.055); insets: M≤6M\le6, where the brute-force optimum is known. (C) Lower bounds of the performance ratio on Facebook. (D) Solutions found at β0\beta_0 used at other β\beta. Tap to enlarge.
Ratio of seed influence of PBGA to MCI against the number of seeds M: 2.4 for Facebook and 1.25 for Weibo at M = 1, falling to 1 by about M = 40.
Fig. 5. Influence of PBGA seeds relative to MCI seeds, Facebook (β=0.012\beta=0.012) and Weibo.

For all numbers of seeds studied, PBGA, NGA and the genetic algorithm perform best, and for small MM their solutions are indistinguishable from the brute-force optimum (Fig. 4A, B insets). PBGA clearly beats MCI when MM is small (Fig. 5), probably because collective influence was designed to find the nodes whose removal breaks the network, which are not necessarily the best spreaders. As MM grows the differences between methods shrink.

Since the true optimum is usually unknown, we also derived two lower bounds on the performance ratio S(V~)/S(V∗)S(\tilde V)/S(V^*): a combined bound that is rigorous for any network and an approximate bound that becomes rigorous for random networks. The approximate bound is close to 1 for every MM considered (Fig. 4C), so we argue that PBGA gives a nearly optimal solution for any number of seeds.

The spreading rate β\beta is usually unknown in practice. Seeds chosen at a rate β0\beta_0 perform almost optimally at any higher rate, as long as both are above βc\beta_c (Fig. 4D), so one can choose seeds at a rate slightly above the threshold.

5 · Summary

Global influence, measured locally

Nucleation

A point of no return

Supercritical spreading has two separated outcomes; once a spread exceeds s∗s^*, it almost surely reaches the giant component.

Locality

Three to four hops

s∗s^* does not depend on the seed or on the network size; within it a spread travels only ℓ∗≈3\ell^*\approx3–4 hops in nine social networks.

Algorithm

Constant-time seed selection

The truncated spreading power turns influence estimation from O(N)O(N) into O(m)O(m); the PBGA built on it is close to optimal.

Our framework is shown for the basic SIR model, but it carries over to other spreading models with two properties: (i) the final state of a set of seeds is either a small local outbreak or a global one proportional to the network size, and (ii) the size of a global outbreak does not depend on the initial spreaders. The SI Appendix discusses a wider SIR family, models with stiflers, and the susceptible–infected–susceptible model. Applications range from viral marketing to surveillance of false information, epidemic control and network protection.