Efficiently identifying critical nodes in large complex networks
- Mario Ventresca^{1}Email author and
- Dionne Aleman^{2}
DOI: 10.1186/s40649-015-0010-y
© Ventresca and Aleman; licensee Springer. 2015
Received: 30 October 2014
Accepted: 19 January 2015
Published: 28 March 2015
Abstract
The critical node detection problem (CNDP) aims to fragment a graph G=(V,E) by removing a set of vertices R with cardinality |R|≤k, such that the residual graph has minimum pairwise connectivity for user-defined value k. Existing optimization algorithms are incapable of finding a good set R in graphs with many thousands or millions of vertices due to the associated computational cost. Hence, there exists a need for a time- and space-efficient approach for evaluating the impact of removing any v∈V in the context of the CNDP. In this paper, we propose an algorithm based on a modified depth-first search that requires O(k(|V|+|E|)) time complexity. We employ the method within in a greedy algorithm for quickly identifying R. Our experimental results consider small- (≤250 nodes) and medium-sized (≤25,000 nodes) networks, where it is possible to compare to known optimal solutions or results obtained by other heuristics. Additionally, we show results using six real-world networks. The proposed algorithm can be easily extended to vertex- and edge-weighted variants of the CNDP.
Introduction
Detecting important or critical vertices in a graph/network has many important applications. Depending on the context, these critical vertices/nodes may be used to promote or mitigate a diffusive process that is acting upon the network. If promoting a spreading process, such as to spread market advertisements or public health warnings, the notion of ‘critical’ refers to the identification of individuals who are most likely to be influential spreaders and maximally permit information spread through the network. In such cases, the selected individuals may be targeted for demonstrations and promotions or invited to public events. For mitigation contexts, such as stopping the spread of a computer virus or for the construction of stable power delivery networks, the identified vertices are those whose removal from the graph will maximally limit diffusive spread.
Numerous definitions of what a critical node ‘is’ have been previously investigated, including junctions in cell-signaling or protein-protein networks [1], highly influential individuals [2], smart grid vulnerability [3], targeted vaccination for pandemic prevention [4,5], or keys to decipher brain functionality [6]. In some contexts, an accurate mathematical definition for a critical node, particularly for highly complex systems such as the brain [7], may not yet exist. It is important to note that both promotion and mitigation can often be defined in a mathematically similar manner. In this paper, we focus on the context of mitigation; however, the results are typically applicable for problems where the goal is to maximally aid the diffusive process [8-11].
Related work
In general, graph partitioning has been an extremely active area of research for decades and we do not attempt a comprehensive review of those works here. Rather, in this section, we focus on the most related previous research to the CNDP and only highlight related works on graph partitioning for completeness.
The case where G is a tree structure has been examined and proven to be \(\mathcal {NP}\) complete when considering non-unit edge costs [14]. A polynomial-time dynamic programming algorithm with worst-case complexity \(\mathcal {O}\left (n^{3}k^{2}\right)\) for solving the problem with unit edge costs was also provided and applied to variants of the CNDP [15]. In [16], an integer linear programming model with a non-polynomial number of constraints is given and branch-and-cut algorithms were proposed. A reformulation of the CNDP that requires Θ(n ^{2}) constraints was recently shown and optimal solutions for small networks were ascertained [17,18].
Heuristic solutions without provable approximation bounds have also been investigated, but computation time for very large networks remains an important issue in these methods as well. The CNDP work of [12] utilizes a solution to the maximum-independent set (MIS) problem as a starting point for a local search, repeating the process until a desired termination criteria is reached. The algorithm is tested on a limited number of network structures with promising results. Two stochastic search algorithms are employed in [19] that permit solutions to significantly larger networks (having up to a few thousand vertices) to be solved within reasonable time and without significant resources. Randomized rounding-based algorithms have been also proposed in [20,21] but without approximation bounds (although, an instance-specific bound was derived). A \(\mathcal {O}(\log n \log \log n)\) pseudo-approximation algorithm was proposed in [13].
The CNDP is related to a variety of other graph partitioning problems in the literature; for instance, the minimum multi-cut problem, which aims to separate a set of source-sink pairs by removing a subset of minimum weighted edges. An \(\mathcal {O}(\log n)\) approximation for general graphs is provided in [22]. Another well-studied graph partitioning problem is the k-cut problem. Given an undirected weighted graph, the goal is to find a minimum cost set of edges that separates the graph into at least k connected components. An \(\mathcal {O}(2-2/k)\)-approximation algorithm has been devised for this problem [23]. Classical multi-way cut, multi-cut, and k-cut problems that include a budget constraint to limit the number edges or vertices that can be cut have been studied in [24], where the authors also propose the problem of maximizing the number of connected components. In [25,26], an \(\mathcal {O}(\sqrt {n})\)-approximation algorithm is presented for the sparsest cut, edge expansion, balanced separator, and graph conductance problems, all of which are based on the notion of graph partitioning. These approaches also minimize the size of the interface between the resulting components. Their approach is based on semi-definite relaxation to these problems in concert with expander flows and has influenced much subsequent research.
Among the many problems that have been defined, some of the most similar include the following. The goal of the minimum contamination problem is to minimize the expected size of contamination by removing a set of edges of at most a given cardinality [27]. A variant of this problem is also proposed with the goal of minimizing the proportion of vertices in the largest resulting network, and a bi-criteria algorithm is given that is able to achieve an \(\mathcal {O}\left (1+\epsilon,\frac {1+\epsilon }{\epsilon }(\log n)\right)\) approximation. In [28], a game-theoretic analysis is conducted that requires a solution to a generalization of the sum-of-squares partitioning problem [4]. Exact methods for link-based vulnerability assessment using edge disruptors have also recently been investigated [29,30].
The remainder of this paper is organized as follows. The proposed greedy algorithm and its motivation are provided in Section ‘The proposed algorithm’. Section ‘Experimental results’ provides experimental results on small- and medium-sized benchmark networks, as well as six real-world networks, and a comparison to the greedy MIS-based algorithm of [12] is conducted. Conclusions are then presented in Section ‘Conclusion’.
The proposed algorithm
In this section, we propose a greedy algorithm for the CNDP. Greedy algorithms are typically less computationally intensive than other strategies such as dynamic programming but usually sacrifice solution quality to attain this speed. One exception occurs in the case of maximizing a submodular function, where it was shown in [31] that unless \(\mathcal {P}=\mathcal {NP}\), a greedy algorithm will yield the optimal approximation. It is easy to verify that the CNDP is not a submodular function. However, the greedy approach is still an appealing framework in the CNDP context, especially for very large networks.
We first describe a linear-time algorithm to evaluate the impact of removing each v∈V and then use this within a greedy algorithm for determining a solution to Equation 1. The speed of the greedy algorithm is further enhanced by a priority-queue-based implementation that yields significant practical performance increases over a naive implementation. Our algorithm has a running-time complexity of \(\mathcal {O}(k(n+m))\) and is similar to the \(\mathcal {O}\left (kn^{2}\right)\) approach used for the maximum cascading algorithm in [3]. Both algorithms are based on Tarjan [32].
For large networks with many thousands or millions of vertices (and edges), a computationally efficient approach to minimizing the CNDP objective is required. Selecting a critical subset R⊂V from a single observation of the network may be easily deceived due to the influence of cut vertices, as indicated in Lemma 1 [12]. That is, selecting R in a sequential fashion may better allow for the discovery of a set that is more likely to fragment the network by detecting cut vertices that are not obvious unless a sequential approach is taken.
Lemma 1.
Let M _{1} and M _{2} be two sets of partitions obtained by deleting D _{1} and D _{2} sets of vertices from graph G=(V,E), where |D _{1}|=|D _{2}|=k. Let L _{1} and L _{2} be the number of components in M _{1} and M _{2} respectively and L _{1}≥L _{2}. If \(\mathcal {C}_{h}=\mathcal {C}_{\ell }, \quad \forall h, \ell \in M_{1}\), then we obtain a better objective function value by deleting the set D _{1} (where \(\mathcal {C}_{h}\) is the number of vertices in connected component h).
Thus, we propose the sequential greedy approach shown in Algorithm 1. At each iteration, the vertex whose removal will have the largest decrease on the objective function (Equation 1) is selected for removal and added to set R, where f() computes the CNDP objective value. Computation of line 3 is a bottleneck to solving large-scale problems. Naively, it implies removal of each v∈V∖R and re-evaluation of the objective function, which is too computationally intensive.
Observation 1.
Ignoring back edges, a leaf vertex v∈V of a DFS tree has no children. Hence, the subtree rooted at v contains a single vertex whose deletion will not create any new connected components in the residual graph. That is, G and G∖{v} contain the same number of connected components.
Observation 2.
So, upon removing a vertex v ^{∗}∈V, the residual graph will contain at least the same number of connected components as the previous graph. Now, let T(v) denote the set of subtrees of v in a DFS tree, as represented by the immediate descendant of v. For instance, in Figure 2b, T(3)={4} and for t _{ i }∈T(v), |t _{ i }|=5. We can then make the following observations.
Observation 3.
where |t _{ i }| is the number of vertices in DFS subtree t _{ i }∈T(v ^{∗}). As will be shown below, this sum can be straightforwardly computed for each vertex during the backtracking stage of DFS under the presumption that the current vertex being explored may be the next vertex removed.
Observation 4.
If v is a cut vertex, then it will be identified as being so after visiting the entire subtree of each of its children. However, the order in which vertices are visited during the DFS does not guarantee that all non-descendant vertices in the graph will be explored before reaching v. Hence, the number of vertices in the ancestor DFS tree of v must also be recorded. This is accomplished by computing the difference between the total number of vertices in the graph and those descendant vertices of v, i.e. |V(v)|−s(v), where V(v) indicates the set of vertices reachable from v. V(v) is the size of the connected component to which v belongs and can be easily monitored at run time.
which is accomplished during the backtracking phase of DFS. Pseudocode for implementing the approach is given in A Evaluating objective function in \(\mathcal {O}(|V|+|E|)\) . Since DFS has running time complexity of O(n+m) and Equation 4 can be executed in constant time per node during the search, then the proposed greedy algorithm requires O(k(n+m)) complexity to remove k vertices from G.
We make two further observations that will yield significant practical improvements by storing each connected component in a priority queue, indexed by the vertex whose removal in the component will most minimize Equation 1.
Observation 5.
Let Q⊆V∖{v ^{∗}} be the subset of vertices not reachable in graph G from vertex v ^{∗}. Then, it is not necessary to recompute the impact of removing any w∈Q from G∖{v ^{∗}} since v ^{∗} and each w belong to different network components. That is, only vertices u∈V(v ^{∗}) must be re-examined if v ^{∗} is deleted from G.
Observation 6.
Each connected component \(\mathcal {C}_{i}\) of graph G can be identified by a root vertex associated with a DFS tree. For each \(\mathcal {C}_{i}\), there will exist a vertex \(v^{\prime }_{i}\) whose removal maximally decreases the objective function value. Let \(v^{\prime }_{i}\) be the root of the i ^{ t h } DFS tree associated with \(\mathcal {C}_{i}\). This requires no significant computational or memory overhead since upon deletion of v ^{∗}, the subgraph to which it belongs must be re-evaluated with respect to the objective function. The proposed algorithm in A Evaluating objective function in \(\mathcal {O}(|V|+|E|)\) will successfully determine \(v_{i}^{\prime }\).
Observations 5 and 6 indicate that further practical improvements are possible. Specifically, a priority queue can be utilized to store the set of connected components C, which are represented and ordered by their respective root vertices and their impact on the objective value if removed, respectively. For each C _{ i }, removing its root vertex will most significantly decrease the CNDP objective value versus any other vertex in the same component. After the component to which v ^{∗} belongs is removed from the queue, it will be re-evaluated using the modified DFS search and any newly resulting connected components will be added to the priority queue with an appropriate root node. Depending on the queue implementation, maintaining priority should require no more than \(\mathcal {O}(\log |C|)\). The per-iteration run time will significantly improve as the number of vertices in each connected component decreases. Effectively, the expected computation time will be \(\approx k \left (\frac {(n+m)}{|C|} + \log |C| \right)\), although the worst case remains \(\mathcal {O}(k(m+n))\). Algorithm 2 outlines the priority queue-based approach.
Experimental results
Benchmark networks and their properties
Network | Type | | V | | | E | | ρ | δ | ξ |
---|---|---|---|---|---|---|
Conmat [33] | Collaboration | 23,133 | 93,439 | 0.264 | 15 | 0.134 |
Ego [34] | Social | 4,039 | 88,234 | 0.519 | 8 | 0.064 |
Flight [35] | Transportation | 2,939 | 15,677 | 0.255 | 14 | 0.051 |
Powergrid [36] | Power grid | 4,941 | 6,594 | 0.103 | 46 | 0.003 |
Relativity [33] | Collaboration | 5,242 | 14,484 | 0.630 | 17 | 0.659 |
Oclinks [37] | Social | 1,899 | 13,838 | 0.057 | 8 | −0.188 |
We compare results to the most similar approach in literature [12], which is an \(\mathcal {O}\left (n^{2}m\right)\) greedy algorithm based on MIS and local search. Unless stated otherwise, the MIS-based algorithm is run for k iterations (for similarity to the proposed algorithm) with one iteration during the local search phase. For medium-sized real-world networks, our experimental results also compare Algorithm 1 to three centrality measures used in greedy sequential fashion such as in [38]. These are used only as a base-level comparison for the quality of the greedy approach. We consider node degree, PageRank [39], and authority score [40] centrality attacks. The computer used for simulations was a 3.4 GHz Intel i7 processor with 16 GB RAM, running Linux Mint Debian Edition.
Small networks
Even though the purpose of the proposed algorithm is to provide a means of determining a set of critical nodes in very large networks, an analysis of its performance on small networks is useful to gauge approximation ability. The running time in all cases in negligible (less than 1 s). The MIS-based approach is also implemented for comparison and required up to 30 s to complete. There are four network types, and the number of nodes to remove is varied: k={5,10,15,…,50}. Gurobi Solver 5.6 [41] is used to determine the upper and lower bound, within a 3,000-s time limit.
Results of the proposed greedy algorithm (SEQ) versus the MIS-based algorithm and upper (UB) and lower bound (LB) as determined by Gurobi 5.6 solver within 3,000 s
Graph | k | LB | UB | SEQ | MIS | Graph | k | LB | UB | SEQ | MIS |
---|---|---|---|---|---|---|---|---|---|---|---|
ER125 | 5 | 405 | 405 | 851 | 715 | ER150 | 5 | 4,277 | 4,277 | 4,972 | 5,471 |
ER125 | 10 | 133 | 133 | 151 | 199 | ER150 | 10 | 837 | 2,301 | 2,678 | 4,862 |
ER125 | 15 | 66 | 66 | 76 | 81 | ER150 | 15 | 347 | 347 | 976 | 890 |
ER125 | 20 | 36 | 36 | 44 | 43 | ER150 | 20 | 167 | 167 | 220 | 410 |
ER125 | 25 | 20 | 20 | 23 | 24 | ER150 | 25 | 94 | 94 | 101 | 201 |
ER125 | 30 | 9 | 9 | 12 | 15 | ER150 | 30 | 58 | 58 | 69 | 124 |
ER125 | 35 | 3 | 3 | 7 | 10 | ER150 | 35 | 36 | 36 | 44 | 79 |
ER125 | 40 | 0 | 0 | 2 | 5 | ER150 | 40 | 22 | 22 | 29 | 52 |
ER125 | 45 | 0 | 0 | 0 | 0 | ER150 | 45 | 14 | 14 | 16 | 36 |
ER125 | 50 | 0 | 0 | 0 | 0 | ER150 | 50 | 8 | 8 | 11 | 22 |
BA200 | 5 | 818 | 818 | 818 | 1,073 | BA250 | 5 | 782 | 782 | 782 | 1,235 |
BA200 | 10 | 297 | 297 | 298 | 668 | BA250 | 10 | 342 | 342 | 342 | 626 |
BA200 | 15 | 156 | 156 | 156 | 413 | BA250 | 15 | 221 | 221 | 221 | 462 |
BA200 | 20 | 104 | 104 | 104 | 304 | BA250 | 20 | 143 | 143 | 143 | 355 |
BA200 | 25 | 70 | 70 | 70 | 206 | BA250 | 25 | 105 | 105 | 105 | 293 |
BA200 | 30 | 48 | 48 | 48 | 164 | BA250 | 30 | 77 | 77 | 77 | 243 |
BA200 | 35 | 33 | 33 | 33 | 135 | BA250 | 35 | 60 | 60 | 60 | 213 |
BA200 | 40 | 20 | 20 | 22 | 114 | BA250 | 40 | 45 | 45 | 45 | 183 |
BA200 | 45 | 15 | 15 | 17 | 98 | BA250 | 45 | 30 | 30 | 30 | 158 |
BA200 | 50 | 10 | 10 | 12 | 77 | BA250 | 50 | 21 | 21 | 23 | 135 |
WS100 | 5 | 2,766 | 4,465 | 4,465 | 4,465 | WS125 | 5 | 4,578 | 7,140 | 7,140 | 7,140 |
WS100 | 10 | 1,054 | 2,941 | 4,005 | 4,005 | WS125 | 10 | 1,796 | 6,005 | 6,555 | 6,555 |
WS100 | 15 | 572 | 945 | 3,570 | 1,784 | WS125 | 15 | 892 | 3,642 | 5,995 | 5,995 |
WS100 | 20 | 379 | 495 | 3,160 | 1,107 | WS125 | 20 | 618 | 3,187 | 5,460 | 5,460 |
WS100 | 25 | 234 | 300 | 2,775 | 578 | WS125 | 25 | 433 | 708 | 4,950 | 1,719 |
WS100 | 30 | 176 | 219 | 2,415 | 414 | WS125 | 30 | 309 | 467 | 4,465 | 758 |
WS100 | 35 | 132 | 148 | 2,080 | 271 | WS125 | 35 | 239 | 344 | 4,005 | 480 |
WS100 | 40 | 98 | 103 | 1,770 | 159 | WS125 | 40 | 195 | 246 | 3,570 | 370 |
WS100 | 45 | 70 | 72 | 1,485 | 94 | WS125 | 45 | 152 | 180 | 3,160 | 278 |
WS100 | 50 | 48 | 48 | 1,225 | 67 | WS125 | 50 | 117 | 137 | 2,775 | 207 |
FF125 | 5 | 3,237 | 3,643 | 3,874 | 5,280 | FF150 | 5 | 5,895 | 7,789 | 7,660 | 7,789 |
FF125 | 10 | 872 | 1,805 | 2,202 | 2,588 | FF150 | 10 | 2,362 | 9,591 | 6,252 | 6,711 |
FF125 | 15 | 318 | 318 | 1,198 | 515 | FF150 | 15 | 1,491 | 7,893 | 5,087 | 5,819 |
FF125 | 20 | 165 | 165 | 773 | 249 | FF150 | 20 | 911 | 3,909 | 4,043 | 5,192 |
FF125 | 25 | 111 | 111 | 422 | 158 | FF150 | 25 | 561 | 1,967 | 3,359 | 4,319 |
FF125 | 30 | 73 | 73 | 118 | 103 | FF150 | 30 | 339 | 1,237 | 2,322 | 3,869 |
FF125 | 35 | 46 | 46 | 65 | 69 | FF150 | 35 | 216 | 380 | 1,874 | 693 |
FF125 | 40 | 29 | 29 | 40 | 45 | FF150 | 40 | 159 | 174 | 1,275 | 344 |
FF125 | 45 | 16 | 16 | 25 | 31 | FF150 | 45 | 105 | 117 | 793 | 240 |
FF125 | 50 | 11 | 11 | 15 | 21 | FF150 | 50 | 79 | 79 | 321 | 155 |
Medium-sized networks
Summary benchmark results comparing PBIL [ 19 ], degree and PageRank-based sequential algorithms, and the proposed greedy approach
Problem | | V | | | E | | K | PBIL | Degree | PageRank | Greedy |
---|---|---|---|---|---|---|---|
ErdosRenyi | 235 | 350 | 50 | 6,700 | 1,086 | 1,953 | 3,011 |
ErdosRenyi | 466 | 700 | 80 | 44,255 | 9,299 | 25,892 | 28,994 |
ErdosRenyi | 941 | 1,400 | 140 | 225,576 | 123,947 | 113,752 | 116,135 |
ErdosRenyi | 2,344 | 3,500 | 200 | 2,009,132 | 1,851,950 | 1,708,603 | 1,395,584 |
BarabasiAlbert | 500 | 499 | 50 | 892 | 202 | 236 | 199 |
BarabasiAlbert | 1,000 | 999 | 75 | 3,057 | 622 | 689 | 559 |
BarabasiAlbert | 2,500 | 2,499 | 100 | 28,044 | 4,258 | 4,808 | 3,726 |
BarabasiAlbert | 5,000 | 4,999 | 150 | 146,753 | 13,038 | 13,971 | 10,216 |
WattsStrogatz | 250 | 1,246 | 70 | 13,768 | 16,110 | 16,110 | 16,110 |
WattsStrogatz | 500 | 1,496 | 125 | 53,779 | 70,125 | 62,149 | 69,751 |
WattsStrogatz | 1,000 | 4,996 | 200 | 308,596 | 319,600 | 319,600 | 319,600 |
WattsStrogatz | 1,500 | 4,498 | 265 | 703,241 | 761,995 | 700,474 | 761,995 |
ForestFire | 250 | 514 | 50 | 886 | 547 | 403 | 217 |
ForestFire | 500 | 828 | 110 | 1,904 | 902 | 490 | 293 |
ForestFire | 1,000 | 1,817 | 150 | 9,594 | 7,796 | 2,609 | 1,414 |
ForestFire | 2,000 | 3,413 | 200 | 12,569 | 27,451 | 11,419 | 5,002 |
The benchmark results in Tables 2 and 3 reveal two insights. Firstly, sequential algorithms may perform poorly when compared to non-sequential algorithms in the instance of many potential solutions of equal quality. This is especially observed from the Watts-Strogatz network results. In these cases, the networks are highly connected and so there is unlikely to be many cut vertices. Moreover, as the networks are more sparse, the greedy approach becomes increasingly desirable. These two insights are founded in the same observation.
Observation 7 (The Problem of Ties).
Highly connected graphs with few cut vertices will admit numerous candidate solutions, each with similar objective value. Due to sequential-based approaches lacking ability to investigate sets of potential solutions, these algorithms are best suited for sparse graphs.
The first consequence of The Problem of Ties concerns an explanation for the observed behavior, while the second leads to a conjecture.
Theorem 1.
Assume G is sufficiently large and connected such that randomly removing k vertices is, with very high probability, unlikely to reveal v ^{∗}. Then, the worst-case problem instance for the proposed greedy algorithm will result when G=(V,E) contains no cut vertices initially but a single vertex v ^{∗} exists whose removal immediately uncovers a sequence of k−1 residual graphs that each contain a cut vertex and whose union forms the optimal choice for set R.
Proof.
The exact value of z will depend on the number of new connected components created as each vertex is removed (after the initial v ^{ ∗ }). Of course, no better optimal solution can be constructed in this circumstance. Moreover, the greedy algorithm will attain the worst possible objective value since no connected components will be created as a result of removing k vertices.
Equation 6 also reveals insight into why highly connected networks are more difficult. That is, why the problem of ties is confounding. The difference between these two values will be smallest if many cut vertices exist, with few ties between solutions. Hence, we conjecture that reducing the Problem of Ties will result in higher quality solutions.
Real-world networks
To compare the quality of the greedy approach we vary k as 0.01,0.05,0.10,0.15, 0.20, and 0.25 proportion of each network, respectively. As with medium-sized networks, we compare results to methods of network attack (degree, PageRank, and Kleinberg’s authority score) in a similar greedy sequential approach. These strategies have been recognized as potentially useful for network fragmentation when considering other robustness measures such as minimizing the largest network component [38]. It should be noted that betweenness and closeness centrality, which are often also employed to test network vulnerability, are too computationally inefficient to be considered for these networks. We also compare the results to the MIS-based greedy heuristic. However, due to excessive computation time, we only report the result after one iteration of the MIS-based algorithm.
Comparison of the CNDP objective value after removing 10% and 20% of vertices from each network in Table 1
Problem | K | SEQ | Degree | PageRank | Authority | MIS |
---|---|---|---|---|---|---|
Comnat | 2313 | 58,796,393 | 103,398,683 | 87,630,163 | 126,804,602 | NA |
4627 | 83,686 | 90,610 | 92,242 | 7,399,785 | NA | |
Ego | 404 | 2,717,347 | 5,339,614 | 3,816,109 | 6,320,816 | 2,192,636 |
808 | 1,848,740 | 2,070,535 | 2,886,709 | 3,438,031 | 903,441 | |
Flight | 294 | 322,527 | 484,331 | 467,962 | 1,014,305 | 77,777 |
588 | 1,457 | 1,698 | 1,715 | 1,567 | 2,626 | |
Powergrid | 494 | 22,182 | 51,508 | 212,369 | 56,815 | 25,253 |
988 | 3,639 | 4,580 | 14,744 | 3,771 | 5,378 | |
Relativity | 524 | 224,010 | 1,628,337 | 302,309 | 3,382,195 | 23,620 |
1,048 | 4,089 | 4,896 | 9,023 | 6,390 | 6,163 | |
Oclinks | 190 | 637,936 | 785,662 | 758,328 | 835,297 | 746,085 |
380 | 218,215 | 258,277 | 246,876 | 306,289 | 402,824 |
Comparing the run times (in milliseconds) of each approach
Problem | Slow greedy | SEQ | Degree | PageRank | Authority | MIS |
---|---|---|---|---|---|---|
Conmat | 1,732,841 | 21,229 | 379 | 16,810 | 26,027 | 126,101,000 |
Ego | 7,036 | 2,129 | 92 | 1,480 | 3,750 | 111,931,000 |
Flight | 10,199 | 207 | 25 | 144 | 231 | 3,273,000 |
Powergrid | 29,896 | 252 | 41 | 288 | 3,470 | 22,292,000 |
Relativity | 43,679 | 421 | 44 | 180 | 601 | 43,016,000 |
Oclinks | 2,301 | 143 | 11 | 114 | 360 | 1,734,000 |
Running time (in milliseconds) for these networks was also investigated and shown in Table 5. In order to highlight the benefit of the priority queue-based solution, we sequentially remove vertices using both a naive greedy method that operates over the entire graph at each iteration (termed slow greedy) and the proposed fast greedy approach (SEQ), which will only consider vertices in the component that contained the most recently removed vertex. The significant improvement of the priority queue is obvious. The greedy approach requires similar time to run as PageRank, although optimizing our implementation may further reduce or surpass this gap. As expected, sequentially removing vertices based on node degree is by far the fastest method. The MIS-based approach is significantly more time consuming, which is expected based on its \(\mathcal {O}\left (n^{2}m\right)\) running time behavior.
Conclusion
In this paper, we proposed an efficient greedy heuristic for identifying critical vertices in networks whose removal leaves the residual network with minimum pairwise connectivity. We provided arguments for an upper-bound running time of \(\mathcal {O}(k(n+m))\), although the practical performance is significantly improved using a priority-queue-based strategy for storing connected components. We utilized both benchmark and larger networks with many thousands of nodes, where finding solutions using current approaches typically requires a significant amount of time. The resulting greedy algorithm is shown to yield better results than common centrality measures for large graphs while being computationally competitive with degree-based greedy vertex removal. The results on benchmark graphs led to the abstract construction of a worst-case input graph, which was a consequence of identifying The Problem of Ties. Interesting future work may aim to reduce the impact of this issue by incorporating additional information that is highly correlated with the objective in order to better identify potentially interesting candidate nodes for removal.
The algorithm proposed in this paper was given without any proof of approximation quality, only indicating the extreme circumstances of problem instance. Future work will prove this bound. Moreover, experimentation on different network types and much larger sized networks, including run time, should also be conducted. Potential improvements in run time may be attainable if within-connected component objective function evaluation was parallelized or a relationship between the nodes can be identified so that only an \(\mathcal {O}(n)\) process is required to update the impact of a vertex removal. Extensions to vertex- and edge-weighted variants of the CNDP are also possible.
Appendix
A Evaluating objective function in \(\mathcal {O}(|V|+|E|)\)
Declarations
Authors’ Affiliations
References
- Boginski, V, Commander, C: Identifying critical nodes in protein-protein interaction networks. In: Clustering Challenges in Biological Networks, pp. 153–166. Elsevier, Amsterdam, Netherlands (2009).
- Kempe, D, Kleinberg, J, Tardos, E: Maximizing the spread of influence in a social network. In: Proceedings of the 9th International Conference on Knowledge Discovery and Data Mining, pp. 137–146. ACM, New York, NY, US (2003).
- Nguyen, DT, Shen, Y, Thai, MT: Detecting critical nodes in interdependent power networks for vulnerability assessment. IEEE Trans. Smart Grid 4(1), 151–159 (2013).View ArticleGoogle Scholar
- Aspnes, J, Chang, K, Yampolskiy, A: Inoculation strategies for victims of viruses and the sum-of-squares partition problem. In: Proceedings of the sixteenth annual ACM-SIAM symposium on Discrete algorithms, SODA ’05, Society for Industrial and Applied Mathematics, pp. 43–52. ACM, New York, NY, USA (2005).
- Ventresca, M, Aleman, D: Evaluation of strategies to mitigate contagion spread using social network characteristics. Soc. Netw. 35(1), 75–88 (2013).View ArticleGoogle Scholar
- Joyce, KE, Laurienti, PJ, Burdette, JH, Hayasaka, S: A new measure of centrality for brain networks. PLoS ONE. 5(8), e12200 (2010).View ArticleGoogle Scholar
- Sporns, O: Networks of the Brain. The MIT Press, Cambridge, MA, USA (2010).Google Scholar
- Borge-Holthoefer J, Moreno, Y: Absence of influential spreaders in rumor dynamics. Phys. Rev. E. 85, 026116 (2012).View ArticleGoogle Scholar
- Kempe, D, Kleinberg, J, Tardos, E: Influential nodes in a diffusion model for social networks. In: Proceedings of the 32nd international conference on Automata, Languages and Programming, ICALP’05, pp. 1127–1138. Springer, Berlin Heidelberg (2005).
- Kitsak, M, Gallos, LK, Havlin, S, Liljeros, F, Muchnik, L, Stanley, HE, Makse, HA: Identification of influential spreaders in complex networks. Nat. Phys. 6(11), 888–893 (2010).View ArticleGoogle Scholar
- Richardson, M, Domingos, P: Mining knowledge-sharing sites for viral marketing. In: Proceedings 8th International Conference on Knowledge Discovery and Data Mining, pp. 61–70. ACM, New York, NY, USA (2002).
- Arulselvan, A, Commander, CW, Elefteriadou, L, Pardalos, PM: Detecting critical nodes in sparse graphs. Comput. Oper. Res. 36(7), 2193–2200 (2009).View ArticleMATHMathSciNetGoogle Scholar
- Dinh, TN, Xuan, Y, Thai, MT, Pardalos, PM, Znati, T: On new approaches of assessing network vulnerability: hardness and approximation. IEEE/ACM Trans. Netw. 20(2), 609–619 (2012).View ArticleGoogle Scholar
- Di Summa, M, Grosso, A, Locatelli, M: Complexity of the critical node problem over trees. Comput. Oper. Res. 38(12), 1766–1774 (2011).View ArticleMATHMathSciNetGoogle Scholar
- Addis, B, Di Summa, M, Grosso, A: Identifying critical nodes in undirected graphs: complexity results and polynomial algorithms for the case of bounded treewidth. Discrete Appl. Math. 161(16-17), 2349–2360 (2013).View ArticleMATHMathSciNetGoogle Scholar
- Di Summa, M, Grosso, A, Locatelli, M: Branch and cut algorithms for detecting critical nodes in undirected graphs. Computational Optimization and Applications. 53(3), 649–680 (2012).View ArticleMATHMathSciNetGoogle Scholar
- Veremyev, A, Boginski, V, Pasiliao, EL: Exact identification of critical nodes in sparse networks via new compact formulations. Optimization Lett. 8(4), 1245–1259 (2014).View ArticleMATHMathSciNetGoogle Scholar
- Veremyev, A, Prokopyev, OA, Pasiliao, EL: An integer programming framework for critical elements detection in graphs. J. Comb. Optimization. 28(1), 233–273 (2014).View ArticleMATHMathSciNetGoogle Scholar
- Ventresca, M: Global search algorithms using a combinatorial unranking-based problem representation for the critical node detection problem. Comput. Oper. Res. 39(11), 2763–2775 (2012).View ArticleMATHMathSciNetGoogle Scholar
- Ventresca, M, Aleman, D: A derandomized approximation algorithm for the critical node detection problem. Comput. Oper. Res. 43, 261–270 (2014).View ArticleMathSciNetGoogle Scholar
- Ventresca, M, Aleman, D: A randomized algorithm with local search for containment of pandemic disease spread. Comput. Oper. Res. 48, 11–19 (2014).View ArticleMathSciNetGoogle Scholar
- Garg, N, Vazirani, V, Yannakakis, M: Primal-dual approximation algorithms for integral flow and multicut in trees. Algorithmica. 18, 3–20 (1997).View ArticleMATHMathSciNetGoogle Scholar
- Saran, H, Vazirani, VV: Finding k-cuts within twice the optimal. SIAM J. Comput. 24, 101–108 (1995).View ArticleMATHMathSciNetGoogle Scholar
- Engelberg, R, Konemann, J, Leonardi, S, Naor, J: Cut problems in graphs with a budget constraint. In: Proceedings of the 7th Latin American Theoretical Informatics Symposium. Elsevier, Amsterdam, Netherlands (2006).
- Arora, S, Rao, S, Vazirani, U: Expander flows, geometric embeddings and graph partitioning. In: Proceedings of the thirty-sixth annual ACM symposium on Theory of computing, pp. 222–231. ACM, New York, NY, USA (2004).
- Arora, S, Rao, S, Vazirani, U: Expander flows, geometric embeddings and graph partitioning. J. ACM 56(2), 1–37 (2009).View ArticleMathSciNetGoogle Scholar
- Anil Kumar, VS, Rajaraman, R, Sun, Z, Sundaram, R: Existence theorems and approximation algorithms for generalized network security games. In: Proceedings of the 2010 IEEE 30th International Conference on Distributed Computing Systems, pp. 348–357. IEEE, New Jersey, USA (2010).
- Chen, P, David, M, Kempe, D: Better vaccination strategies for better people. In: Proceedings of the 11th ACM conference on Electronic commerce, pp. 179–188. ACM, New York, NY, USA (2010).
- Dinh, TN, Thai, MT, Nguyen, HT: Bound and exact methods for assessing link vulnerability in complex networks. J. Comb. Optimization. 28(1), 3–24 (2014).View ArticleMATHMathSciNetGoogle Scholar
- Shen, Y, Nguyen, NP, Xuan, Y, Thai, MT: On the Discovery of Critical Links and Nodes for Assessing Network Vulnerability. IEEE/ACM Transactions on Networking. 21(3), 963–973 (2013).View ArticleGoogle Scholar
- Nemhauser, GL, Wolsey, LA, Fisher, ML: An analysis of approximations for maximizing submodular set functions-i. Math. Program. 14(1), 265–294 (1978).View ArticleMATHMathSciNetGoogle Scholar
- Tarjan, R: Depth-first search and linear graph algorithms. SIAM J. Comput. 1(2), 146–160 (1972).View ArticleMATHMathSciNetGoogle Scholar
- Leskovec, J, Kleinberg, JM, Faloutsos, C: Graph evolution: Densification and shrinking diameters. ACM Trans. Knowl. Discov. Data. 1(1) (2007). http://doi.acm.org/10.1145/1217299.1217301.
- McAuley, JJ, Leskovec, J: Learning to discover social circles in ego networks. In: NIPS, pp. 548–556. ACM, New York, NY, USA (2012).
- Opsahl, T: Why anchorage is not (that) important: Binary ties and sample selection. (2011) http://wp.me/poFcY-Vw.
- Watts, DJ, Strogatz, SH: Collective dynamics of ‘small-world’ networks. Nature. 393, 400–442 (1998).View ArticleGoogle Scholar
- Opsahl, T, Panzarasa, P: Clustering in weighted networks. Soc. Netw. 31(2), 155–163 (2009).View ArticleGoogle Scholar
- Ventresca, M, Aleman, D: Network robustness versus multi-strategy sequential attack. J. Complex Netw. 3(1), 126–146 (2015).View ArticleGoogle Scholar
- Brin, S, Page, L: The anatomy of a large-scale hypertextual web search engine. Comput. Netw. ISDN Syst. 30, 107–117 (1998).View ArticleGoogle Scholar
- Kleinberg, JM: Authoritative sources in a hyperlinked environment. J. ACM 46(5), 604–632 (1999).View ArticleMATHMathSciNetGoogle Scholar
- Gurobi Optimization, Inc.: Gurobi Optimizer Reference Manual (2015). http://www.gurobi.com.
Copyright
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.