 Research
 Open Access
 Published:
MORO: a Cytoscape app for relationship analysis between modularity and robustness in largescale biological networks
BMC Systems Biologyvolume 10, Article number: 122 (2016)
Abstract
Background
Although there have been many studies revealing that dynamic robustness of a biological network is related to its modularity characteristics, no proper tool exists to investigate the relation between network dynamics and modularity.
Results
Accordingly, we developed a novel Cytoscape app called MORO, which can conveniently analyze the relationship between network modularity and robustness. We employed an existing algorithm to analyze the modularity of directed graphs and a Boolean network model for robustness calculation. In particular, to ensure the robustness algorithm’s applicability to largescale networks, we implemented it as a parallel algorithm by using the OpenCL library. A batchmode simulation function was also developed to verify whether an observed relationship between modularity and robustness is conserved in a large set of randomly structured networks. The app provides various visualization modes to better elucidate topological relations between modules, and tabular results of centrality and gene ontology enrichment analyses of modules. We tested the proposed app to analyze large signaling networks and showed an interesting relationship between network modularity and robustness.
Conclusions
Our app can be a promising tool which efficiently analyzes the relationship between modularity and robustness in large signaling networks.
Background
Network modularity represents the degree to which a network is divided into modules of separate community structures. A highly modularized network has dense connectivity between the nodes within each module but sparse connectivity between the nodes of different modules. Many plugins based on the Cytoscape platform [1] have been developed for modularity analysis in biological networks. For example, clusterMaker [2] implemented several clustering algorithms such as kmeans, kmedoid, SCPS, and AutoSOME to visualize a structure of modules within biological networks. GIANT [3] was proposed to investigate topological or functional relationships in a metabolic network by performing a clustering analysis and a functional cartography of nodes. Another wellknown plugin is NeMo [4], which can identify diverse network communities by means of a neighborsharing score based on a hierarchical agglomerative clustering method. These plugins have a limitation, though, in that they focus only on the structural analysis of a network and its visualization, without any consideration of dynamics analysis. This restricts their use to undirected networks such as protein–protein networks, or to analysis of directed networks that ignores the direction information.
Herein we note previous studies showing that dynamical behaviors, particularly robustness, of biological networks can be highly affected by their modularity characteristics. For instance, a recent study reported that a modular organization of cancer signaling networks is associated with the patient survivability, which suggests a relationship between modularity and network robustness [5]. Also, the robustness against state perturbations of a human signaling network was negatively correlated to network modularity [6]. Modular stabilizing in protein–protein interaction networks can be recombined to create highly robust chimeric proteins in evolution [7]. It has been also argued that modularity reduces robustness against mutation in metabolic networks [8]. Because of the importance of network modularity and robustness, there is a pressing need to develop a tool that can analyze both simultaneously. Accordingly, we devised a novel Cytoscape app called MORO that can analyze a relationship between dynamical robustness and structural modularity in biological networks represented by directed graphs. In addition, to make it possible to analyze very largescale networks, we implemented the robustness computation portion of the app as a parallel algorithm by using the OpenCL library. It was also designed to efficiently visualize how the detected modules are located relative to each other. Furthermore, it elucidates analysis results of centrality and gene ontology (GO) enrichment of modules. Moreover, it provides a batchmode simulation function to validate whether a result observed in a biological network is consistently conserved in many randomly organized networks. In this study, we tested our app in a case study investigating largescale signaling networks and observed that modularity and robustness are negatively correlated, similar to previous findings [6]. It was verified by means of batchmode simulation that these findings hold in random networks. Moreover, we found some GO terms which are differently enriched between the largest module and the rest of the modules, and it was shown that the module size is positively correlated with five centrality values. In summary, our app can efficiently analyze the relationship between modularity and robustness in large signaling networks.
Methods
Figure 1 illustrates the main process of our app. Firstly, a directed network is loaded for analysis. Next, the app computes the modularity and robustness of the network. In particular, the robustness algorithm was implemented in parallel computation by using the OpenCL library. The results can be visualized in three modes: a detailed visualization mode, a brief visualization with absolute relations, and a brief visualization with relative relations. Also, the results can be summarized in tables that include centrality and gene ontology analyses. Details of this process are given in the following subsections.
Network modularity
Given a network represented by a directed graph G(V, A) where V and A are the sets of nodes and interactions, respectively, we employ the modularity measure introduced in a previous study [9]. A partition P = {V _{1}, V _{2}, …, V _{ M }} of V is a set of nonempty disjoint subsets of V that covers V (i.e. V _{ i } ∩ V _{ j } = ∅ for all i, j ∈ {1, 2, …, M} and i ≠ j, and U _{ i = 1} ^{M} V _{ i } = V). Then, the modularity of the partition M(P) is defined as \( M(P)={\displaystyle {\sum}_{i=1}^M\left(\frac{\omega_{V_i{V}_i}}{\omega }\frac{\omega_{V_i}^{in}{\omega}_{V_i}^{out}}{\omega^2}\right)} \), where \( {\omega}_{V_i{V}_i} \) is the number of interactions whose starting and ending nodes are both included in module V _{ i }, \( {\omega}_{V_i}^{out} \), and \( {\omega}_{V_i}^{in} \) are the numbers of interactions whose starting or ending nodes only, respectively, are included in module V _{ i }, and ω is the total number of interactions in the network. Then, the modularity of the network is defined as M(G) = max _{ P } M(P). However, it is difficult to obtain the optimal partition. In our app, the modularity value of a network is averaged over 30 trials by using an optimization algorithm proposed in a previous study [10].
Robustness dynamics in a Boolean network model
A Boolean network model has been used to examine robustnessrelated dynamics of signaling networks and has been employed to investigate the dynamics of various biological networks [11–17]. A Boolean network is represented by a directed graph G(V, A) where V = {v _{1}, v _{2}, …, v _{ N }} is a set of Boolean variables and A is a set of ordered pairs of Boolean variables called directed links. Each v _{ i } ∈ V has a value of 1 (‘on’) or 0 (‘off’) that represents the state of the corresponding element. A directed link (v _{ i }, v _{ j }) has a positive (‘activating’) or negative (‘inhibiting’) relationship from v _{ i } to v _{ j }. In this model, each state s(t) = (v _{1}(t), v _{2}(t), …, v _{ N }(t)) at time t transits to the next state s(t + 1) according to the set of update rules F = {f _{1}, f _{2}, …, f _{ N }}, i.e., s(t + 1) = F(s(t)), where we randomly choose either a logical conjunction or disjunction for f _{ i } with a uniform probability distribution. For instance, if a Boolean variable v has a positive relationship from v _{1}, a negative relationship from v _{2} and a positive relationship from v _{3}, then the conjunction and disjunction update rules are \( v\left(t+1\right)={v}_1(t)\wedge {\overline{v}}_2(t)\wedge {v}_3(t) \) and \( v\left(t+1\right)={v}_1(t)\vee {\overline{v}}_2(t)\vee {v}_3(t) \), respectively. In the case of the conjunction, the value of v at time t + 1 is 1 only if the values of v _{1}, v _{2} and v _{3} at time t are 1, 0 and 1, respectively. A state of G is defined as a vector of values v _{1} through v _{ N }. A state trajectory starts from an initial state s(0) and eventually converges to either a fixedpoint or limitcycle attractor. Because these attractors can represent diverse biological network behaviors such as multistability, homeostasis, and oscillation, a change in the converging attractor can be interpreted as a loss of robustness. We denote the attractor converged to starting from an initial state s(0) by 〈s〉. The network is considered to be robust against mutation at v _{ i } if 〈s〉 is equal to \( \left\langle {s}_{{\overline{v}}_i}\right\rangle \), where \( {\overline{v}}_i\left(=\neg {v}_i\right) \) indicates the state perturbation of s subjected to v _{ i }. This concept to measure robustness has been widely used [18–20]. More specifically, the robustness of a network γ(G) is defined as follows:
where S is the set of whole states (i.e. S = 2^{N}), and I(⋅) is an indicator function. Because S is a very large number, we used a sample subset \( \tilde{S}\subseteq S \) with \( \left\tilde{S}\right=2N \) instead of S to calculate γ(G). Given a partition P = {V _{1}, V _{2}, …, V _{ M }}, we employed the inmodule and outmodule robustness of a module V _{ i }, γ _{ in }(V _{ i }), and γ _{ out }(V _{ i }), respectively, defined in [6] as follows:
and
where \( {{\displaystyle \prod}}_{V_i}\left\langle s\right\rangle \) represents a projection operator to extract the partial attractor of a given subset V _{ i } ⊆ V from an attractor 〈s〉, and H(〈s〉, 〈s ′ 〉) denotes a similarity measure between two attractors 〈s〉 and 〈s ′ 〉. More particularly, given 〈s〉 = s _{0} → s _{1} → … → s _{ l − 1} and \( \left\langle {s}^{\prime}\right\rangle ={s}_0^{\prime}\to {s}_1^{\prime}\to \dots \to {s}_{l^{\prime }1}^{\prime } \) (1 ≤ l ≤ l′ is assumed without loss of generality), H(〈s〉, 〈s′〉) is defined as follows:
where h is the Hamming distance (i.e. the number of different bits between two binary sequences). Then, the inmodule and outmodule robustness of a network, γ _{ in }(V _{ i }) and γ _{ out }(V _{ i }), respectively, are defined as follows:
and
Parallel computation of robustness
In our app, we employed a Boolean network model to compute robustness. In particular, we further calculated inmodule and outmodule robustness which represent how much the module subject to a perturbation and the groups of other modules, respectively, are robust against the perturbation. Unfortunately, it is very timeconsuming to compute robustness. To reduce the running time, we implemented the robustness calculation part of the app as a parallel algorithm by using the OpenCL library (see Additional file 1: Text S1).
A batchmode simulation on random Boolean networks
We developed a function for a batchmode simulation on random Boolean networks (RBNs) to examine if a finding in biological networks holds in RBNs or not similarly in a previous study [12, 19, 21–26]. The batchmode simulation requires two steps for configuring parameters. The first step is to select an RBN generation model from among five models: BarabásiAlbert (BA) model [27], ErdősRényi (ER) model [28], an ErdősRényi variant model [29] and two shuffling models [23, 30, 31], and the second step is to set the number of considered initialstates and the type of updaterule schemes (see the subsection “Robustness dynamics in a Boolean network model” for details). Once computations of modularity and robustness are completed, all results are saved in a resulting file, “net_based_result.txt” which describes modularity and robustness results of each RBN (see Additional file 1: Text S2).
Visualization of relations between modules
Our app provides three types of visualizations to show the relationship between modules. The first type is a detailed visualization mode in which all nodes and interactions of the loaded network are shown and the nodes are grouped into modules placed by using the Cytoscape group attributes layout. The second type is a brief visualization mode with absolute relations, in which a group node corresponds to a detected module and the weight of a link between group nodes denotes the number of interactions between a pair of modules. The last mode is the same as the second mode except that the weight of a link denotes the ratio of the number of interactions between a pair of modules to the maximal possible number of interactions between them, that is w/(n _{1} n _{2}), where w is the number of actual interactions between the pair of modules, and n _{1} and n _{2} are the numbers of nodes included in each of the modules.
Module centrality and GO analyses
Many previous studies have shown that the centrality properties of genes/proteins in biological networks are strongly related to their functional roles in a topological or dynamical sense. To extend this concept to modulebased centrality analysis, we implemented a function to examine five centrality measures including degree [32], closeness [33], betweenness [34], stress [35] and eigenvector [36] of modules (see Additional file 1: Text S3). Besides, we developed a GO analysis function to compare the functional difference between two groups of modules. To this end, we first identify two groups of genes by selecting some modules of interest. Then, Entrez gene id is mapped to UniProtKB by utilizing the web service at http://www.uniprot.org/ [37], and all relevant GO terms are extracted by using the web service at http://www.ebi.ac.uk/QuickGO/ [38]. Finally, GO terms which are most differently enriched between the two gene groups are listed in a table or exported into a text file.
Results and discussion
In this section, we tested MORO with two largescale signalling networks, the canonical cell signaling network (STKE; http://stke.sciencemag.org) and the human signal transduction network (HSN; http://www.bri.nrc.ca/wang) which consist of 754 proteins and 1624 interactions, and 5443 genes and 37,663 interactions, respectively.
Analysis of modularity and robustness
The analysis and visualization results of the STKE and HSN networks are shown in Fig. 2 and Additional file 2: Figure S1, respectively. In particular, Fig. 2(a) and in Additional file 2: Figure S1(a) explain various summarized results including the number of modules, modularity, robustness, in/outmodule robustness, and centrality values. Specifically, the number of modules were 16 and 22, the modularity values were 0.72825 and 0.54534, and the robustness values were 0.67721 and 0.75400 in the STKE and HSN networks, respectively. By selecting the visualization option, we can observe the relation between the detected modules in three different modes: a detailed mode (Fig. 2(b) and in Additional file 2: Figure S1(b)), a brief mode with absolute relations (Fig. 2(c) and in Additional file 2: Figure S1(c)), and a brief mode with relative relations (Fig. 2(d) and in Additional file 2: Figure S1(d)). In the detailed mode, each module is represented by a circular group of genes and all interactions between the genes are presented in the network. In other words, the visualized network is actually same with the first given network except that the genes belonging to a same module are located close to each other. On the other hand, each module is represented by a single node and a relation between modules is represented by a directed link in both of the brief modes. The only difference between the two brief modes is that the weight of a link means the number of interactions between a pair of modules in the brief mode with absolute relations, whereas it means the ratio of the number of interactions between a pair of modules to the maximal possible number of interactions between them. By properly specifying the appearance ratio parameter which is defined the ratio of the number of interactions to be visible over the total number of interactions between modules, we can retrieve more reduced information about the brief relations between modules. For example about the STKE network, Fig. 2(e) and (f) shows the visualization results reduced from Fig. 2(c) and (d), respectively, by specifying the appearance ratio to 0.3. Then, we can identified which module is strongly interacting with or isolated from other modules (see Additional file 2: Figure S1(e) and (f) for the result of the HSN network).
To validate effectiveness of our app, we also conducted the same case study about largescale signaling networks as in a previous study [6] which reported that the network modularity tends to be negatively correlated to the robustness against state perturbations. To reproduce such a negative relationship between network modularity and the robustness in this study, we generated 6400 random Boolean networks and computed the robustness and the modularity of each network by using MORO. We note that this extensive simulation could be conducted in a practical time by the parallel implementation of main functions in MORO. As a result, we could observe the same negative relationship between the modularity and the robustness, consistent to the result in [6] (see Additional file 2: Figure S2(a)). In addition, we observed that the results of STKE and HSN are very close to the trend line of the random Boolean networks. Moreover, we could also observe that the inmodule robustness is clearly negatively correlated with the network modularity (Additional file 2: Figure S2(b)), whereas the outmodule robustness is not (Additional file 2: Figure S2(c)). In addition, the inmodule robustness was positively correlated with the network robustness (Additional file 2: Figure S2(d)), whereas the outmodule robustness was not (Additional file 2: Figure S2(e)). As explained in the previous study, we could also conclude that the negative relationship between network robustness and modularity is mainly caused by the relationship between inmodule robustness and network modularity through intensive simulations using our app.
Time performance analysis
To show the computational cost of MORO, we examined the running time in calculating robustness and modularity in the HSN and STKE networks. We tested the app on a system with an NVIDIA GeForece GTX 680 GPU with 1536 processor at 1GHz, sevencore Intel(R) Core i74770 K CPU 3.50 GHz, and 16 GB of memory. Table 1 shows the result. In case of the HSN network, the speedup by the GPUbased parallel computation over the singleCPU was slightly greater than that by multicore CPU, and both speedups were proportional to the number of considered initial states. On the other hand, it is interesting that the speedup by multicore CPU was greater than that by GPU, and both were not proportional to the number of initial states in case of the STKE network. We infer that the analysis of the STKE network was terminated before the parallel computation power is fully utilized due to the relatively small size of the network. Taken together, we can efficiently analyze the relation between robustness and modularity in largescale networks by parallel computation with two options, multicore CPU and GPU.
Module centrality analysis
After we obtain the modular structure of a network, we can analyse the centrality of modules based on the brief mode visualization result. Specifically, we consider a module network where a node and a link represent a module and the set of interactions between a pair of modules, respectively. Then, we can examine five wellknown centrality values such as degree, closeness, betweenness, stress, and eigenvector in the module network. In this case study, we examined the change of the centrality values against the module size, which is defined by the number genes belonging to a module, in the STKE (Fig. 3) and HSN (Additional file 2: Figure S3) networks. It is interesting that all centrality measures or all except closeness showed the positive relations with the module size in the STKE and HSN networks, respectively. In other words, the module was likely to be more central as the module size gets larger. To investigate if this property is reserved in random networks, we generated two groups of 100 random networks by shuffling interactions of the STKE and HSN networks while preserving a degree distribution, and examined the change of the centrality values against the module size (see Additional file 2: Figures S4 and S5). Similar to the result in the signaling networks, the module size was positively correlated with the centrality values in the random networks. This suggests that the hub modules might play an important role in the community network [39–41]. Additionally, we examined the relationship between the in/outmodule robustness and the module centrality values in the STKE and HSN networks (see Additional file 2: Figures S6 and S7). Unlike the relation with the module size, the in/outmodule robustness was not significantly correlated with the centrality values. In other words, the centrality of modules cannot indicate the in/outmodule robustness in the signaling network.
GO analysis
It is possible to analyze GO enrichment [42] by using MORO. To show this function, we first specified two groups of genes, which consist of the genes in the largest module (1042 genes) and the rest of genes (4401 genes), respectively, in the HSN network. Table 2 shows all GO terms which were more enriched in the largest module than in the others: cytoplasm, nucleus, and protein complex in cellular component terms; protein, metal ion, nucleotide, and DNA bindings in molecular function terms; gene expression, viral process, and regulation of DNAtemplated transcription in biological processes terms. As a result, MORO can provide the useful information about GO analysis between any two groups of modules.
Conclusions
Many recent reports have reported that robust behavior against mutations might be correlated to the modularity of a signaling network. Motivated by these results, we developed a novel Cytoscape app called MORO, which can analyze the relationship between network robustness and modularity. We implemented it in parallel by using the OpenCL library to allow application to verylargescale networks. In addition, our app can provide information about topological relations between modules by means of various visualization modes and centrality analysis. MORO includes also five centrality measures which can examine how centrally each module is positioned in terms of relations among the modules. Moreover, it can conveniently analyze the gene ontology enrichment of modules only if Entrez id of gene is given. A batchmode simulation function was also included to allow verification of whether a finding is a design principle of random networks. In the future, MORO will be extended to consider various types of mutations such as a knockout and edge mutation, and to analyze publiclyavailable signaling networks represented by ordinary differential equations by devising a conversion method from continuous models to Boolean networks.
Abbreviations
 GO:

Gene ontology
 MORO:

Cytoscape app for modularity and robustness analysis
 RBN:

Random Boolean network
References
 1.
Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, Amin N, Schwikowski B, Ideker T. Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 2003;13(11):2498–504.
 2.
Morris J, Apeltsin L, Newman A, Baumbach J, Wittkop T, Su G, Bader G, Ferrin T. clusterMaker: a multialgorithm clustering plugin for Cytoscape. BMC Bioinformatics. 2011;12(1):436.
 3.
Cumbo F, Paci P, Santoni D, Di Paola L, Giuliani A. GIANT: a cytoscape plugin for modular networks. PLoS One. 2014;9(10):e105001.
 4.
Rivera C, Vakil R, Bader J. NeMo: Network Module identification in Cytoscape. BMC Bioinformatics. 2010;11 Suppl 1:S61.
 5.
Takemoto K, Kihara K. Modular organization of cancer signaling networks is associated with patient survivability. Biosystems. 2013;113(3):149–54.
 6.
Tran TD, Kwon YK. The relationship between modularity and robustness in signalling networks. J R Soc Interface. 2013;10(88):20130771.
 7.
Lin YS, Hsu WL, Hwang JK, Li WH. Proportion of solventexposed amino acids in a protein and rate of protein evolution. Mol Biol Evol. 2007;24(4):1005–11.
 8.
Holme P. Metabolic robustness and network modularity: a model study. PLoS One. 2011;6(2):e16605.
 9.
Leicht EA, Newman MEJ. Community structure in directed networks. Phys Rev Lett. 2008;100(11):118703.
 10.
Noack A. Modularity clustering is forcedirected layout. Physical Review E. 2009;79(2):026102.
 11.
Kauffman S, Peterson C, Samuelsson B, Troein C. Random Boolean network models and the yeast transcriptional network. Proc Natl Acad Sci. 2003;100(25):14796–9.
 12.
Kwon YK, Choi S, Cho KH. Investigations into the relationship between feedback loops and functional importance of a signal transduction network based on Boolean network modeling. BMC Bioinformatics. 2007;8(1):384.
 13.
Shmulevich I, Lähdesmäki H, Dougherty ER, Astola J, Zhang W. The role of certain Post classes in Boolean network models of genetic networks. Proc Natl Acad Sci. 2003;100(19):10734–9.
 14.
Kwon YK, Kim J, Cho KH. Dynamical Robustness Against Multiple Mutations in Signaling Networks. IEEE/ACM Trans Comput Biol Bioinform. 2016;13(5):9961002.
 15.
Kwon YK, Cho KH. Boolean dynamics of biological networks with multiple coupled feedback loops. Biophys J. 2007;92(8):2975–81.
 16.
Fauré A, Naldi A, Chaouiya C, Thieffry D. Dynamical analysis of a generic Boolean model for the control of the mammalian cell cycle. Bioinformatics. 2006;22(14):e124–31.
 17.
Garg A, Mohanram K, Di Cara A, De Micheli G, Xenarios I. Modeling stochasticity and robustness in gene regulatory networks. Bioinformatics. 2009;25(12):i101–9.
 18.
Ciliberti S, Martin OC, Wagner A. Robustness can evolve gradually in complex regulatory gene networks with varying topology. PLoS Comput Biol. 2007;3(2):e15.
 19.
Kwon YK, Cho KH. Quantitative analysis of robustness and fragility in biological networks based on feedback dynamics. Bioinformatics. 2008;24(7):987–94.
 20.
Kitano H. Biological robustness. Nat Rev Genet. 2004;5(11):826–37.
 21.
Kwon YK, Cho KH. Coherent coupling of feedback loops: a design principle of cell signaling networks. Bioinformatics. 2008;24(17):1926–32.
 22.
Le DH, Kwon YK. The effects of feedback loops on disease comorbidity in human signaling networks. Bioinformatics. 2011;27(8):1113–20.
 23.
Le DH, Kwon YK. A coherent feedforward loop design principle to sustain robustness of biological networks. Bioinformatics. 2013;29(5):630–7.
 24.
Trinh HC, Le DH, Kwon YK. PANET: a GPUbased tool for fast parallel analysis of robustness dynamics and feedforward/feedback loop structures in largescale biological networks. PLoS One. 2014;9(7):e103010.
 25.
Trinh HC, Kwon YK. Effective Boolean dynamics analysis to identify functionally important genes in largescale signaling networks. Biosystems. 2015;137:64–72.
 26.
Campbell C, Albert R. Stabilization of perturbed Boolean network attractors through compensatory interactions. BMC Syst Biol. 2014;8(1):1–16.
 27.
Barabási AL, Albert R. Emergence of Scaling in Random Networks. Science. 1999;286(5439):509–12.
 28.
Erdős P, Rényi A. On random graphs, I. Publicationes Mathematicae (Debrecen). 1959;6:290–7.
 29.
Le DH, Kwon YK. NetDS: a Cytoscape plugin to analyze the robustness of dynamics and feedforward/feedback loop structures of biological networks. Bioinformatics. 2011;27(19):2767–8.
 30.
Maslov S, Sneppen K. Specificity and stability in topology of protein networks. Science. 2002;296(5569):910–3.
 31.
Maslov S, Sneppen K, Alon U. Correlation profiles and motifs in complex networks. In: Handbook of Graphs and Networks. WileyVCH Verlag GmbH & Co. KGaA; 2002. p. 168–98.
 32.
Jeong H, Mason SP, Barabasi AL, Oltvai ZN. Lethality and centrality in protein networks. Nature. 2001;411(6833):41–2.
 33.
Wuchty S, Stadler PF. Centers of complex networks. J Theor Biol. 2003;223(1):45–53.
 34.
Freeman L. A set of measures of centrality based on betweenness. Sociometry. 1977;40(1):35–41.
 35.
Shimbel A. Structural parameters of communication networks. Bull Math Biophys. 1953;15(4):501–7.
 36.
Bonacich P. Power and centrality: a family of measures. Am J Sociol. 1987;92(5):1170–82.
 37.
Consortium TU. UniProt: a hub for protein information. Nucleic Acids Res. 2015;43(D1):D204–12.
 38.
Binns D, Dimmer E, Huntley R, Barrell D, O’Donovan C, Apweiler R. QuickGO: a webbased tool for Gene Ontology searching. Bioinformatics. 2009;25(22):3045–6.
 39.
Estrada E, RodríguezVelázquez JA. Subgraph centrality in complex networks. Physical Review E. 2005;71(5):056103.
 40.
Kim H, Anderson R. Temporal node centrality in complex networks. Physical Review E. 2012;85(2):026107.
 41.
Li M, Lu Y, Wang J, Wu FX, Pan Y. A topology potentialbased method for identifying essential proteins from PPI networks. IEEE/ACM Trans Comput Biol Bioinform. 2015;12(2):372–83.
 42.
Consortium TGO. The Gene Ontology project in 2008. Nucleic Acids Res. 2008;36 suppl 1:D440–4.
Acknowledgements
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2015R1D1A1A09060910). This work was supported by the 2016 Research Fund of the Hanoi University of Industry.
Declarations
This article has been published as part of BMC Systems Biology Volume 10, Supplement 4, 2016: Proceedings of the 27th International Conference on Genome Informatics: systems biology. The full contents of the supplement are available online at http://bmcsystbiol.biomedcentral.com/articles/supplements/volume10supplement4.
Funding
Publication charges for this work were funded by Basic Science Research Program through the National Research Foundation of Korea (NRF) from the Ministry of Education (2015R1D1A1A09060910).
Availability of data and materials
All data generated or analysed during this study are included in this published article and its supplementary information files.
Authors’ contributions
Conceived and designed the experiments: YKK. Performed the experiments: CDT. Analyzed the data: CDT, TDT. Contributed to the writing of the manuscript: CDT, TDT, YKK. Developed the software: CDT. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Not applicable.
Software availability and requirements

MORO website http://moro.sourceforge.net/.

Operating systems platform independent

Software requirement Cytoscape 3.2.0 (http://www.cytoscape.org/)

Programming language Java
Author information
Additional files
Additional file 1: Text S1.
Parallel robustness computation based on the OpenCL. Text S2. Output file by the batchmode simulation on RBNs. Text S3. Centrality measures. (PDF 753 kb)
Additional file 2: Figure S1.
Analysis results of the HSN network by MORO. Figure S2. Correlations between the modularity and robustness of 6,400 random Boolean networks where the number of nodes is 50 and the number of interactions is in the range of [49, 2031]. Figure S3. Changes of module centrality values against the module size in the HSN network. Figure S4. Changes of module centrality values against the module size in STKEshuffled random networks. Figure S5. Changes of module centrality values against the module size in HSNshuffled random networks. Figure S6. Correlation between module centrality values and in/outmodule robustness in the STKE network. Figure S7. Correlation between module centrality values and in/outmodule robustness in the HSN network. (PDF 1052 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Published
DOI
Keywords
 Cytoscape app
 Boolean network
 Network robustness
 Modularity
 Centrality
 Geneontology
 Parallel computation
 OpenCL