 Research article
 Open Access
 Published:
Biological network motif detection and evaluation
BMC Systems Biology volume 5, Article number: S5 (2011)
Abstract
Background
Molecular level of biological data can be constructed into system level of data as biological networks. Network motifs are defined as overrepresented small connected subgraphs in networks and they have been used for many biological applications. Since network motif discovery involves computationally challenging processes, previous algorithms have focused on computational efficiency. However, we believe that the biological quality of network motifs is also very important.
Results
We define biological network motifs as biologically significant subgraphs and traditional network motifs are differentiated as structural network motifs in this paper. We develop five algorithms, namely, EDGE GOBNM, EDGE BETWEENNESSBNM, NMFBNM, NMFGOBNM and VOLTAGEBNM, for efficient detection of biological network motifs, and introduce several evaluation measures including motifs included in complex, motifs included in functional module and GO term clustering score in this paper. Experimental results show that EDGE GOBNM and EDGE BETWEENNESSBNM perform better than existing algorithms and all of our algorithms are applicable to find structural network motifs as well.
Conclusion
We provide new approaches to finding network motifs in biological networks. Our algorithms efficiently detect biological network motifs and further improve existing algorithms to find high quality structural network motifs, which would be impossible using existing algorithms. The performances of the algorithms are compared based on our new evaluation measures in biological contexts. We believe that our work gives some guidelines of network motifs research for the biological networks.
Background
Systems biology focuses on the study of complex interactions in biological systems, rather than the study of individual molecules such as DNA, RNA, proteins and metabolites [1]. One of the goals of systems biology is understanding the structures of all molecules and their interactions in a system level. Therefore major challenges are understanding the dynamic structures of small molecules and determining their functions in a living cell. Various types of biological interactions have been expressed in networks, which include transcriptional regulatory networks, signaling pathways, metabolic networks and proteinprotein interaction (PPI) networks. Biological networks share some of structural properties of other complex networks, or have specific features of scalefree and smallworld effect [2]. However, the properties have been questioned by Lacroix et al. [3] with a number of reasons including the incompleteness of networks and inconsistent link generation for the graphs. Therefore, the analysis extends to other network properties such as network clusters and network motifs.
As biological networks are massive and the size is still increasing, dividing the network into a number of clusters helps reveal specific local properties. Network motif, as another concept describing local properties of a network, is defined as a small connected subgraph appearing frequently and uniquely in a network. Similar to a protein sequence motif, network motif is defined as a overrepeated pattern, but it requires much more computation as the process involves isomorphic testing and repeated processes for uniqueness determination. Network alignment [4] and network querying [5] are analogous to network motifs, but while network motifs are defined with only structural information, network alignment and network querying require both of the topological and biological information. Previous network motif discovery algorithms include exact counting and approximation algorithms: Exhaustive recursive search (ERS) [6], enumerate subgraphs (ESU) [7] and compact topological motifs [8] are exact counting algorithms. For efficient detection, several approximation algorithms have been provided including edge sampling (MFINDER) [6], randomized version of ESU from a search tree (RANDESU) [9], and treefiltering search which is NE MO FINDER[10]. Furthermore, parallel search algorithms have been developed to realize feasible exact counting algorithms [11, 12].
Network motifs are used for many applications in biological networks. Feedforwardloop (FFL) and bifan network motifs are identified as the typical patterns in different types of biological networks [13, 14]. Przulj et al. [15] used network motifs as a relative graphlet frequency distance to distinguish different proteinprotein interaction networks. Also motif frequencies are exploited as classifiers for network model selection [16]. Milo et al. [17] studied that networks of different biological and technological domains have been classified into different superfamilies on the basis of motif significance profiles. To predict proteinprotein interactions, Albert I. and Albert R. [18] used network motifs successfully. In the study by Conant and Wagner [19], network motifs in transcriptional regulatory networks are not evolutionary conserved while network motifs in PPI networks are evolutionary related. On the other hand, network motifs are extended to 'motif modes' each of which has a certain topology and a specific functional property [20].
Through a number of network motif applications, however, we notice several problems regarding the biological meanings of network motifs, on top of the computational challenge for the detection. First, the biological quality of network motifs are not validated thoroughly. A network motif is selected only by its structural uniqueness and just small number of instances of the type are biologically exemplified. Second, only small portion of network motif instances are used for applications and others are ignored. Third, nonmotifs, that is, structurally insignificant subgraphs, have not been analyzed in any studies, which are filtered out before applying to any applications. Fourth, it is still questionable what the network motifs really represent in biological networks.
As we believe that the biological quality of network motifs are also significant, we define a biological network motif in this paper. Throughout this paper, we refer a network motif as a structural network motif to distinguish it from a biological network motif. Unlike structural network motifs, biological network motifs are biologically significant small connected subgraphs regardless of the structure. The biological significance is unspecified in the definition, as it will be assigned flexibly by a goal of the application. We introduce EDGE GOBNM, EDGE BETWEENNESSBNM, NMFBNM, NMFGOBNM and VOLTAGEBNM algorithms for efficient discovery of biological network motifs, and design new evaluation measures named, 'motifs included in complex', 'motifs included in functional module' and 'GO term clustering score'. Our algorithms compete with existing algorithms including ESU, RANDESU and MFINDER, and the performance are compared based on the new measures introduced in this paper. The main idea for our algorithms is to reduce the number of subgraphs to search by removing a number of edges from the original network and, at the same time, increase the discovery rate for biological network motifs. Experimental results with a couple of S. cerevisiae PPI networks demonstrate that EDGE GOBNM and EDGE BETWEENNESSBNM algorithms perform better than other algorithms in most of the measures. In addition, we show that all of our algorithms are applicable to the discovery of structural network motifs as well.
The work has three contributions to the study of network motifs: 1)We question biological meanings of network motifs which have not been focused by existing detection algorithms. New motif search algorithms and evaluation measures are developed based on these questions. 2)We design several algorithms combining the topological and biological information in a network. The algorithms further enrich existing algorithms in a biological context. 3)We develop a number of evaluation measures which qualify biological importance of network motifs. As we know of, this is the first time to suggest systematical evaluation measures for network motifs. With these contributions, we hope that our work gives some guidelines for the researches of network motifs in biological networks.
Results and Discussion
In this paper, we define biological network motifs as biological meaningful network motifs and develop EDGE GOBNM,EDGE BETWEENNESSBNM, NMFBNM, NMFGOBNM and VOLTAGEBNM algorithms for an efficient detection of biological network motifs. For clarification, traditional network motifs are referred as structural network motifs throughout this paper. The performance of each algorithm is compared based on three evaluation measures such as 'motifs included in complex', 'motifs included in functional module', 'GO (Gene ontology) term clustering score' which we design to assess biological quality of network motifs. Detail description of algorithms and evaluation measures are described in the "Methods."
Data sets
We test the performance of each algorithm with a couple of PPI of S. cerevisiae (yeast). We download a yeast core data, referred to 'Scere20101010' from DIP database [21] which has 2,130 proteins and 4,434 interactions and call this as DIP Core network. A network of 988 proteins and 2,455 with high confidence level of interactions, introduced as a highthroughput data in [22] and obtained from the authors of [23], is also used in this experiment. As it was conventionally referred to Y2k, it is called Y2k network. Since the increase of network motif size boosts the computational time and the number of motifs exponentially, we set the size of subgraphs as four to five for practical experiments. There are 6 types of isomorphic graphs for undirected 4node subgraphs and 21 types for undirected 5node subgraphs. Undirected 4node subgraph types are labeled using Nauty program [24] as appeared in Figure 1.
Comparison of the algorithms against different evaluation measures
We first enumerate all subgraphs of size four or five with ESU algorithm [7] and evaluate them with the evaluation measures introduced in this paper and name the experiment as an ESU. Then we run EDGE GOBNM, EDGE BETWEENNESSBNM, NMFBNM, NMFGOBNM and VOLTAGEBNM algorithms and measure them with the same evaluation measures. Furthermore, we add experiments with two existing approximation algorithms; RANDESU and MFINDER. RANDESU searches subgraphs in a tree structure and it skips over some of the branches during its search. MFINDER randomly picks edges until it reaches the desired number of subgraphs. ESU algorithm enumerates all subgraphs and all other algorithms produce roughly 30% of total subgraphs by adjusting parameters. Additionally, we run FANMOD [9], which is a software implementing ESU, and investigate the topological properties for each type of subgraph in order to observe the relationships between biological network motifs and structural network motifs. Table 1 compares the performances of 8 different algorithms for 4node biological network motifs from DIP core network, accessed by the following biological measures;'motifs included in complex', 'motifs included in functional module' and 'GO term clustering scores for BP, MF and CC.' The results of ESU, RANDESU and MFINDER algorithms are also provided as well for comparison purpose. The best result for each measure is marked as bolded in the table. EDGE BETWEENNESSBNM algorithm provides highest rates for 'motifs included in complex' measure, but EDGE GOBNM algorithm produces overall the best values compared to others. It is reasonable for the EDGE GOBNM and NMFGOBNM algorithms have good scores for GO term clustering score measures as they include GO term information. However, it is interesting to see that EDGE BETWEENNESSBNM algorithm provides relatively good scores for all of the evaluation measures when this algorithm considers only topological property of the network. This suggests that the structural property helps infer meaningful biological information as well. We provide the results with 5node biological network motifs as well in Table 2. Similar to the results in Table 1, EDGE BETWEENNESBNM algorithm is the best for the 'motifs included in complex' term and EDGEGOBNM is best for the rest of measures.
To see if the results are consistent with other network, we search biological network motifs in the Y2k network as well. The results are shown in Table 3 of 4node subgraph and Table 4 of 5node subgraph. Consistent with DIP core network, EDGE GOBNM algorithm provides overall good scores except 'motifs included in complex' term and 'MF GO term clustering score'. EdGE BETWEENNESSBNM algorithm is superior for the 'motifs included in complex' term too. It is interesting to see that NMFGOBNM shows good scores as well in the Y2k network, which is because that NMF tends to produce better results with smaller data set. It is also appealing that the randomedgeselection algorithm (MFINDER) beats the randomvertexselect algorithm (RANDESU). This implies that edges are more important aspect for explaining its biological meanings.
Relationship between biological and structural network motifs
We also investigate the relationship between structural network motifs and biological network motifs in this work. Table 5 is the table generated by FANMOD [9] to observe the statistical properties of each 4node subgraph type in the DIP core network. The first column is the label for each type generated by Nauty program [24] and Figure 1 shows shape for each label of subgraph. Second column indicates the percentage of each type appears in the DIP Core network and the next two columns show the average frequencies and standard deviation of each type, out of 10, 000 randomized graphs. Last two columns of Zscore and Pvalue show the structural statistics of each type. As a subgraph type of Zscore larger than 2.0 or Pvalue smaller than 0.01 is a network motif, in DIP Core network, the five types of C^, CN, CF, C~, and Cr are network motifs. Figure 2 shows relative frequencies for each subgraph types, where the horizonal axis lists all six types and vertical axis indicates its relative frequency. Each line refers to a result of each algorithm, differentiated by colors. All of the algorithms except ESU reduce the total number of subgraph search to 30%, but the relative frequencies are almost same as those of ESU. In fact, when we plug each of the reduced network, which is the byproduct of each algorithm, in FANMOD, the same five types of subgraphs ( C^, CN, CF, C~, Cr) are detected as network motifs. It proves that our algorithms are applicable to find structural network motifs as well, but more efficiently.
We analyze Y2k network as well to see a relevance of structural network motif and biological network motif. Table 6 generated by FANMOD identifies top three subgraphs as network motifs, labeled C~, C^ and CN. Similar to DIP core network, all of the algorithms preserve relative frequencies for each type as appeared in Figure 3 and FANMOD confirms that the same three types are still the structural network motifs in the reduced Y2k networks as well.
Biological significance for biological network motifs
We provide one example which demonstrates that EDGE GOBNM is especially good for discovering biological network motifs included in protein functional modules. This example also shows that structurally nonmotifs cannot be ignored as many of the instances have biological significance. Table 7 shows the recall value of 4node biological network motifs included in a 'rRNA processing' functional module in yeast, based on different subgraph type and algorithms. We exactly count the numbers of motifs included in 'rRNA processing' with ESU algorithm first. Then all other algorithms are compared with the recall in Equation (1).
In Table 7, the first column lists all the algorithms conducted in this paper, and the other columns show the recall of subgraphs included in 'rRNA processing' functional module according to each subgraph type. The 'rRNA processing' functional module consists of 206 proteins in the yeast. All algorithms except ESU search only 30% of subgraphs out of the total subgraphs searched with ESU algorithm but EDGE GOBNM recovers over 90% of subgraphs included in 'rRNA processing'. Furthermore, we observe that although the Cr, CF, CR are structural network nonmotifs, about 50% of subgraphs included into the 'rRNA processing' are these nonmotifs. This example shows that even nonmotifs also have biological meanings, therefore the structural network motif defined by its structural uniqueness is insufficient to explain biological meanings.
Conclusions
In this paper, we provide new approaches to finding network motifs in biological networks. Structural network motifs are defined as frequently and uniquely repeated small connected subgraph in a network. However, motivated by several issues brought up while a number of network motif applications are investigated, we propose to find biologically meaningful network motifs. Hence, we define biological network motifs as biologically meaningful knode subgraphs, develop a number of algorithms for efficient detection of biological network motifs and introduce new evaluation measures. The algorithms reduce the number of subgraph search and increase the detection rates of biological network motifs at the same time. The algorithms are categorized into two classes: Edgeremoving algorithms and Network clustering algorithms. EDGE GOBNM and EDGE BETWEENNESSBNM are algorithms which remove a number of edges based on GO term and edge betweenness score, respectively. NMFBNM, NMFGOBNM and VOLTAGEBNM algorithms partition the network based on its topological property or GO term relevance. All the algorithms introduced in this paper improve existing algorithms for high quality structural network motif detection.
We also introduce a number of evaluation measures which measure biological significance of each subgraph: 'motifs included in complex', 'motifs included in functional module' and 'GO term clustering score.' Biological meanings of those biological network motifs are assigned based on these evaluation measures. We ran the algorithms on two PPI network of S. cerevisiae, and compared them with our new measures. An existing exhaustive search and other two existing approximation algorithms are also provided to be compared with our algorithms. EDGE GOBNM shows overall good results in all the measures, but EDGE BETWEENNESSBNM is the best in the 'motifs included in complex' measure.
The works in this paper can be studied further. Currently, the parameters of various algorithms in this paper are adjusted only to obtain a desired number of subgraphs. In near future, various impacts of the parameters on the results should be investigated. Besides the parameters, the balance between topological and biological information will be an important factor for a better algorithm. On the other hand, current evaluation measures are limited to PPI networks. Comprehensive evaluation measures should be designed to apply various types of biological networks. Meanwhile, the work should be extended to weighted or direct networks for more comprehensive analysis of biological network motifs.
Methods
Definitions and notations
We assume that a biological network is a graph G = (V, E) where each vertex in V is a molecule and each edge in E is an interaction between vertices. A network motif m is a connected subgraph of size k in a graph, which appears more frequently than usual. The size of network motif, k, ranges from 3 up to 15 or more, but relatively very smaller than the number of vertices in the network, V. The frequency f_{ G }(m) of m is the number of isomorphic graphs to m in G. To determine the uniqueness of m, a number of random graphs, typically more than 10,000 graphs, are generated and the frequencies f_{ R }(m) is recorded for each generated graph R to obtain a Pvalue as in Equation (2) or a Zscore in Equation (3).
Here average(f_{ R }(m)) and std(f_{ R }(m)) refer to the average and standard deviation of frequencies in random networks respectively. Generally, a subgraph m with Pvalue less than 0.01 or Zscore greater than 2.0 is considered as a network motif.
We define a biological network motif g as a small connected subgraph of size k which has topological property as well as biological meanings. For clear understanding, a network motif is referred to structural network motif throughout this paper, and biological network motifs and structural network motifs have manytomany relationships. We emphasize that we do not categorize all of the biological network motifs into some classes like 'motif mode' in the study by Lee and Tzou [25], where the number of motif modes reaches up to millions. Instead, we assume that biological network motifs are application dependent, therefore flexibly categorized according to the applications. For a specific subgraph being a biological network motif, we need some measures which are presented later in this section. From now on, G = (V, E) is a target (original) network, G' = (V, E') is a modified network, n is the number of vertices and m is the number of edges in G.
Description of Algorithm
Structural network motifs are either exactly (exhaustively) or approximately determined. As exhaustive search is infeasible in large networks, approximation algorithms have been used in many applications in practice. In this study, we provide a number of algorithms originally designed to detect biological network motifs, but also improve existing algorithms for high quality structural network motif discovery. Some algorithms use structural information alone or biological information alone, and others combine structural and biological information.
The main idea of the algorithms is to modify the original network so that we can increase the biological network motif detection rates over total number of subgraphs in the original graph. For example, if we remove 23% of edges, then the number of subgraphs are reduced to 30% of the total number. We provide two ways of modifying the original network: 1) removing a number of edges and 2) clustering the network into smaller subnetworks. The two measures provide essentially the same components, a list of removed edges and a number of clusters as shown in Figure 4. When we remove some edges, we obtain a number of clusters as byproducts. When we cluster a network, the edges in between clusters will be listed in the set of removed edges.
EdgeRemoving Algorithms
We present two algorithms to remove 'insignificant' edges based on two different aspects. EDGE GOBNM (EDGE GO for biological network motif) algorithm removes edges based on its related Gene ontology terms. EDGE BETWEENNESSBNM (EDGE BETWEENNESS for biological network motif) algorithm removes edges based on its edge betweenness score. Since EDGE GOBNM algorithm uses Gene ontology (GO) terms associated with the nodes, the algorithm is applicable only to the gene or protein related networks. In EDGE BETWEENNESSBNM algorithm, although the computation of EDGE BETWEENNESS score is existing measure used for network clustering [26], it is the first time used for network motif detection.
EDGEGOBNM algorithm
In this algorithm, we reduce the number of subgraphs to be searched by removing a number of 'biologically insignificant' edges in the original network. Biologically insignificant edges are determined with the Gene ontology (GO) [27] terms associated with its end points. GO terms provide annotations of gene and gene product attributes across species and databases. GO consists of three independent domains: biological process (BP), molecular function (MF) and cellular component (CC). A BP refers to series of events by multiple molecular functions. Examples include cellular physiological process and pyrimidine metabolic process. An MF is a molecular level of activities, such as catalytic activity or binding. A CC is a component of a cell which is part of larger item. Examples are nucleus, ribosome or proteasome. With the three orthogonal aspects as roots, GO is represented as a directed acyclic graph (DAG), a part of which is shown in Figure 5. GO DAG describes each GO term as a node and the relationships as an directed edge with hierarchical structure, where children are more specific than the parents. Each term can have multiple parents as well as multiple children and it is traced backward to the root of depth 0. If a gene ge is annotated with a GO term pe, then ge is annotated with all of the ancestor GO terms of pe.
We define an EdgeGO set as a set of all GO's associated to both of the end points of the edge e and an EdgeGO depth of e is the maximum depth of the GOs in the EdgeGO set. In EDGE GOBNM algorithm, a threshold GO term depth d should be given as a parameter and the edges whose EdgeGO depth is less than d are removed. Algorithm 1 describes detail steps of the EDGE GOBNM algorithm.
Algorithm 1: EDGE GOBNM
input: Graph G = (V, E), d :a GO depth threshold, k :the motif size.
output: a number of subgraphs with size k.
1 RE ← ∅
2 E' ← E
3 for ∀e ∈ E do
4 GO set ← all GO terms associated with both of the endpoints of e
5 D ← maximum depth of GOset
6 if D <d then
7 RE = RE ∪ {e}
8 E' = E'  {e}
9 Let G' = (V, E')
10 Enumerate all ksubgraphs from G'
Line 10 in Algorithm 1 produces all the ksize subgraphs in the reduced graph G', and any existing exact counting algorithm can be used for this task. In EDGE GOBNM algorithm, different depth threshold d results different number of edges to remove and we experimentally determine the threshold depth to get a desired number of subgraphs. More edges are removed as the depth threshold increases, which in turn reduces the number of subgraph searches. This work is motivated by the paper [20] which reveals that different levels of GO terms lead to different modes of motifs. EDGE GOBNM algorithm is deterministic and the whole process except line 10 runs linearly with the number of edges, m. In most cases, this algorithm obtains unbalanced clusters, where a few clusters have most of the vertices and most of the clusters consist of small number of vertices.
EDGEBETWEENNESSBNM algorithm
EDGE BETWEENNESSBNM algorithm uses topological information to remove some of edges. EDGE BETWEENNESS algorithm is initially introduced by Girvan and Newman [26] to produce network clusters using betweenness score of each edge. Network modularization [28] is supported by this measure and many protein modules are successfully discovered with it. EDGE BETWEENNESSBNM algorithm goes through all edges to compute its edge betweenness score, namely, EBScore: The number of shortest paths in all pairs of vertices that run along with the edge e is EBScore(e), then the edge with the highest EBScore is removed. This process is repeated until we get a desired number of edges to remove. The detail procedure of EDGE BETWEENNESSBNM is described in Algorithm 2.
Algorithm 2: EDGE BETWEENNESSBNM
input : Graph G = (V, E), r is the number of edges to remove, k :the motif size.
output: a number of subgraphs with size k.
1 RE ← ∅
2 E' ← E
3 R ← 0
4 while R < r do
5 for all pairs of vertices in V, obtain the shortest path, SP
6 ∀e ∈ E, let EBscore(e) = number of SP's containing e in the path
7 Let ed be the edge with maximum EBscore
8 RE = RE ∪ {ed}
9 E' = E'  {ed}
10 R = R + 1
11 Let G' = (V, E')
12 Enumerate all ksubgraphs from G'
Except line 12 in Algorithm 2, EDGE BETWEENNESSBNM algorithm runs in O(rmn) where r is the number of edges to remove. EDGE BETWEENNESSBNM algorithm produces relatively balanced network clusters and is also a deterministic algorithm.
Clustering Algorithms
Another way of reducing a network is to partition the network into smaller subnetworks and remove the edges between clusters. In this work, we present three clustering algorithms: NMFBNM (Nonnegative matrix factorization for biological network motif), NMFGOBNM (Nonnegative matrix factorization with GO term for biological network motif) and VOLTAGEbnm(Voltage clustering for biological network motif) algorithm. Voltage clustering algorithm has been used for network clustering before, but not for network motif discovery.
NMFBNM algorithm
Nonnegative matrix factorization (NMF) has been used to cluster various data, such as face images, text corpus and gene expression data. Initially used as a dimension reduction technique, NMF is successfully applied to many clustering tasks with additional sparseness constraints [29–31]. In this work, we apply NMF for an efficient detection of biological network motif. Detail process of NMFBNM is described in Algorithm 3.
Algorithm 3: NMF(GO)bnm
input : Graph G = (V, E), c is the number clusters, k :the motif size, (d is GO depth threshold), η
and β for sparse NMF.
output: a number of subgraphs with size k.
1 RE ← ∅
2 E' ← E
3 Let CL_{1}, ⋯, CL_{ c }= ∅.
4 Construct a data matrix A from G.
5 Run sparse NMF to A and get an n × c matrix H
6 for all the columns in H do
7 Let {h}^{j}={\left\{{h}_{1}^{j},\cdot \cdot \cdot ,{h}_{c}^{j}\right\}}^{T} be j th column vector of H.
8 if {h}_{i}^{j}is largest in h^{j}then
9 put the vertex v_{ j }to CL_{ i }.
10 for ∀e ∈ E do
11 if e lies between clusters of CL_{ i }then
12 RE = RE ∪ {e}
13 E' = E'  {e}
14 Let G' = (V, E')
15 Enumerate all ksubgraphs from G'
In NMFBNM, a nonnegative matrix A = (a_{ ij }) of line 4 in Algorithm 3 is topologybased feature data as shown in Equation (4) and sparseness constraints are added for better clustering. In sparse nonnegative matrix factorization (Algorithm 3 line 5), the data matrix A are decomposed into two factor matrices W and H using the objective function in Equation (5).
Here, \left\right.{}_{F}^{2} is the square of the Frobenius norm, \left\right.{}_{1}^{2} of the L_{1} norm, and H(:,j) is the j th column of matrix H. Two parameters, η for sparseness and β for balance between sparseness and correctness, should be given. Intuitively, the matrix H gives clustering information as described in lines 6 to 9. The detail description of sparse NMF is illustrated in the paper [31] by Kim and Park. Except the last step in Algorithm 3, NMFBNM runs linearly with the size of A at each iteration, and it converges to a stable point, not necessarily unique, through a number of iterations.
NMFGOBNM algorithm
NMFGOBNM algorithm differs from NMFBNM only in line 4 of Algorithm 3, where the feature matrix A = (a_{ ij }) combines structural and GO term information of the network as shown in Equation (6). In this algorithm, an additional parameter d, which is a GO term depth threshold, is given. First, all the GO terms associated with the network and whose depth is greater than d are listed. Suppose the list of GO terms is {g_{1}, g_{2}, ⋯, g_{ p }}, then each entry a_{ ij }in the (n + p) × n matrix A is defined as in Equation (6). The rest of process is the same as of the NMFBNM algorithm.
VOLTAGEBNM algorithm
VOLTAGE clustering algorithm is developed by Wu and Huberman [32] to cluster a network based on voltage drops. The algorithm first generates a number of candidate clusters using Kirchhoff equations [33], which tell that total current of each node should sum up to zero. From the candidate clusters, a seed is selected which appears most frequently in the candidate clusters, and the neighbor vertices of this seed are collected to form a cluster. The process is repeated until we get a desired number of clusters. The number of clusters are later adjusted if the seeds are too close. An exact solution for this algorithm requires O(V^{3}), but Wu and Huberman [32] provide an approximation solution in O(V + E). In this paper, we utilize VOLTAGE clustering algorithm to design a VOLTAGEBNM (voltage for biological network motif) algorithm for efficient discovery of biological network motifs as shown in Algorithm 4. We emphasize that VOLTAGEBNM algorithm is easy and fast, but it is nondeterministic algorithm because the randomly selected seeds lead to quite different results every time it runs.
Algorithm 4: VOLTAGEBNM
input : Graph G = (V, E), c is the number clusters, k :the motif size.
output: a number of subgraphs with size k.
1 RE ← ∅
2E' ← E
3 Let CL_{1}, ⋯, CL_{ c }= ∅.
4 m ← 0.
5 while ( m ≤ c) do
//Generate c number of candidate clusters.
6 Pick a vertex pair, source and sink.
7 Compute voltages of each vertex of graph G using source and sink.
8 Group the vertices in two clusters (high/low).
9 Store resulting candidate clusters.
10 m = m + 2
11 l ← 1
12 while l <c do
//generate c  1 clusters
13 Pick one cluster seed s most appearing in candidate clusters.
14 Obtain cooccurrence vertices to the s, and put them to a cluster CL_{ l }.
15 Remove all the cooccurrence vertices and s from candidate clusters.
16 l = l + 1.
17 Remaining unassigned vertices belong to the CL_{ c }cluster.
18 if ∀e ∈ E, e lies between clusters of CL_{i}, then
19 RE = RE ∪ {e}
20 E' = E'  {e}
21 Let G' = (V, E')
22 Enumerate all ksubgraphs from G
Table 8 summarizes the algorithms introduced in this paper. As all of the algorithms have a common step of 'Enumerate all ksubgraphs from G', the time in this table excludes this last step.
Evaluation Measures
Network motif is defined as a frequently and uniquely represented subgraph in a network and is determined through structural uniqueness, measured by Pvalue (9) or Zscore (3). The structural uniqueness, however, is an inappropriate validation for motifs in biological networks. Therefore, we design several biological evaluation measures other than topological uniqueness in this study. These are called 'motifs included in complex', 'motifs included in functional module', 'GO (Gene ontology) term clustering score'. Protein complexes are the groups of proteins interacting with each other at the same time and same place in a cell, whereas functional modules are the groups of proteins binding to participate in different cellular processes at different times. Currently, these evaluation measures are specifically designed for PPI networks. More comprehensive validation measures should be developed in near future.
Motifs included in complex
The first assessment is a match with a protein complex. We consider a subgraph g is included in a complex if a known protein complex contains all the nodes in g. We define motif included in complex measure as the precision of the subgraphs included in protein complexes as shown in Equation (7). Obviously, the algorithm with higher value for this measure performs better in this work.
Motifs included in functional module
Similar to the previous measure, if all components of a subgraph g are included in a known protein functional module, g is included in a functional module. Therefore motif included in a functional module is defined as the precision of the subgraphs included in functional modules as in Equation (8).
In our experiments, the database for protein complexes and functional modules are obtained from MIPS [34] server.
GO term clustering score
We define a Pvalue of a subgraph g as the minimum Pvalue over the union of GO terms of g and lower Pvalue is preferable. Pvalue for a GO term is computed using hypergeometric distribution as in Equation (9), where N is the whole population, M is the population that is annotated by the GO term, n is the subgraph size and x is the number of genes annotated with the GO term in the sample.
To determine if a subgraph g with a Pvalue p is significant, a cutoff value should be predefined. Since Pvalue decreases as the size of g increases, higher cutoff value is necessary for smallsize of subgraph g. For 4node and 5node subgraph, we set the cutoff value as 0.1 and if the Pvalue of g is lower than the cutoff, g is a significant subgraph. A better algorithm should provide more significant subgraphs and lower average pvalue of the subgraphs. In other words, average Pvalue alone, or the number of significant subgraphs alone cannot fairly assess the performance of an algorithm. To evaluate the overall performance of an algorithm, we use the clustering score introduced in the studies of [28, 35] which has measured the quality of clustering algorithms. For a GO term clustering score measure, we use subgraphs instead of clusters in the formula (10),
where min(pi) is the Pvalue of each subgraph, n_{ s }is the number of significant and n_{ i }is the number of insignificant subgraph. A higher GO term clustering score of an algorithm indicates a better algorithm. Since GO term has three independent aspects of BP, MF, CC, we have three types of this measure: BP GO term clustering score; MF GO term clustering score; and CC GO term clustering score.
Abbreviations
 BNM:

Biological Network Motif
 GO:

Gene Ontology
 BP:

Biological Process
 MF:

Molecular Function
 CC:

Cellular Component
 DAG:

Directed Acyclic Graph
 SP:

Shortest Path
 NMF:

Nonnegative Matrix Factorization
 ERS:

Exhaustive Recursive Search
 ESU:

Enumerate SUbgraph
 RANDESU:

Randomized ESU.
References
Kitano H: Foundations of Systems Biology. Cambridge, MA.: The MIT Press; 2001.
Barabasi AL, Oltvai ZN: Network biology: understanding the cell's functional organization. Nat Rev Genet 2004,5(2):101113. 10.1038/nrg1272
Lacroix V, Cottret L, Thebault P, Sagot MF: An Introduction to Metabolic Networks and Their Structural Analysis. IEEE/ACM Trans Comput Biology Bioinform 2008, 594617.
Flannick J, Novak A, Srinivasan BS, McAdams HH, Batzoglou S: Graemlin: General and robust alignment of multiple large interaction networks. Genome Research 2006,16(9):11691181. [http://genome.cshlp.org/content/16/9/1169.abstract] 10.1101/gr.5235706
Yang Q, Sze SH: Path Matching and Graph Matching in Biological Networks. Journal of Computational Biology 2007, 14: 5667. [http://www.liebertonline.com/doi/abs/10.1089/cmb.2006.0076] 10.1089/cmb.2006.0076
Milo R, ShenOrr S, Itzkovitz S, Kashtan N, Chklovskii D, Alon U: Network Motifs: Simple Building Blocks of Complex Networks. Science 2002,298(5594):824827. [http://www.sciencemag.org/cgi/content/abstract/298/5594/824] 10.1126/science.298.5594.824
Wernicke S: Efficient Detection of Network Motifs. IEEE/ACM Trans Comput Biol Bioinformatics 2006,3(4):347359.
Parida L: Discovering Topological Motifs Using a Compact Notation. Journal of Computational Biology 2007,14(3):300323. 10.1089/cmb.2006.0142
Wernicke S, Rasche F: FANMOD: a tool for fast network motif detection. Bioinformatics 2006,22(9):11521153. [http://bioinformatics.oxfordjournals.org/cgi/content/abstract/22/9/1152] 10.1093/bioinformatics/btl038
Chen J, Hsu W, Lee ML, Ng SK: NeMoFinder: dissecting genomewide proteinprotein interactions with mesoscale network motifs. In KDD '06: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. New York, NY, USA: ACM; 2006:106115.
Wang T, Touchman JW, Zhang W, Suh EB, Xue G: A Parallel Algorithm for Extracting Transcription Regulatory Network Motifs. Bioinformatic and Bioengineering, IEEE International Symposium on 2005, 0: 193200.
Schatz M, CooperBalis E, Bazinet A: Parallel Network Motif Finding. Tech. rep., University of Maryland Insitute for Advanced Computer Studies; 2008.
Mangan S, Alon U: Structure and function of the feedforward loop network motif. Proceedings of the National Academy of Sciences of the United States of America 2003,100(21):1198011985. [http://www.pnas.org/content/100/21/11980.abstract] 10.1073/pnas.2133841100
Mangan S, Zaslaver A, Alon U: The Coherent Feedforward Loop Serves as a Signsensitive Delay Element in Transcription Networks. Journal of Molecular Biology 2003,334(2):197204. [http://www.sciencedirect.com/science/article/B6WK749XP57D5/2/e21452290f309dc8622a35f6fa092627] 10.1016/j.jmb.2003.09.049
Przulj N, Corneil DG, Jurisica I: Modeling interactome: scalefree or geometric? Bioinformatics 2004,20(18):35083515. [http://bioinformatics.oxfordjournals.org/cgi/content/abstract/20/18/3508] 10.1093/bioinformatics/bth436
Middendorf M, Ziv E, Wiggins CH: Inferring network mechanisms: The Drosophila melanogaster protein interaction network. Proceedings of the National Academy of Sciences of the United States of America 2005,102(9):31923197. [http://www.pnas.org/content/102/9/3192.abstract] 10.1073/pnas.0409515102
Milo R, Itzkovitz S, Kashtan N, Levitt R, ShenOrr S, Ayzenshtat I, Sheffer M, Alon U: Superfamilies of Evolved and Designed Networks. Science 2004,303(5663):15381542. [http://www.sciencemag.org/cgi/content/abstract/303/5663/1538] 10.1126/science.1089167
Albert I, Albert R: Conserved network motifs allow proteinprotein interaction prediction. Bioinformatics 2004,20(18):33463352. [http://view.ncbi.nlm.nih.gov/pubmed/15247093] 10.1093/bioinformatics/bth402
Conant GC, Wagner A: Convergent evolution of gene circuits. Nature Genetics 2003, 34: 244266. 10.1038/ng0703244
Lee WP, Jeng BC, Pai TW, Tsai CP, Yu CY, Tzou WS: Differential evolutionary conservation of motif modes in the yeast protein interaction network. BMC Genomics 2006, 7: 89. [http://www.biomedcentral.com/14712164/7/89] 10.1186/14712164789
Xenarios I, Rice DW, Salwinski L, Baron MK, Marcotte EM, Eisenberg D: DIP: the Database of Interacting Proteins. Nucleic Acids Research 2000, 28: 289291. [http://nar.oxfordjournals.org/content/28/1/289.abstract] 10.1093/nar/28.1.289
von Mering C, Krause R, Snel B, Cornell M, Oliver SG, Fields S, Bork P: Comparative assessment of largescale data sets of proteiprotein interactions. Nature 2002,417(6887):399403.
Wang J, Li M, Chen J, Pan Y: A Fast Hierarchical Clustering Algorithm for Functional Modules Discovery in Protein Interaction Networks. Computational Biology and Bioinformatics, IEEE/ACM Transactions on 2011,8(3):607620.
McKay B: Nauty User's Guide. Tech. Rep. TRCS9002, Dept. of Computer Science, Australian Nat'l Univ; 1990.
Lee WP, Tzou WS: Fast Revelation of the Motif Mode for a Yeast Protein Interaction Network Through Intelligent AgentBased Distributed Computing. Protein and Peptide Letters 2010,17(11):10911101. [http://www.ingentaconnect.com/content/ben/ppl/2010/00000017/00000009/art00005]
Girvan M, Newman MEJ: Community structure in social and biological networks. Proceedings of the National Academy of Sciences of the United States of America 2002,99(12):78217826. [http://www.pnas.org/content/99/12/7821.abstract] 10.1073/pnas.122653799
Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, IsselTarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nature genetics 2000, 25: 2529. 10.1038/75556
Wang J, Li M, Deng Y, Pan Y: Recent advances in clustering methods for protein interaction networks. BMC Genomics 2010,11(Suppl 3):S10. [http://www.biomedcentral.com/14712164/11/S3/S10] 10.1186/1471216411S3S10
Kim H, Park H: Nonnegative Matrix Factorization Based on Alternating Nonnegativity Constrained Least Squares and Active Set Method. SIAM Journal on Matrix Analysis and Applications 2008,30(2):713730. 10.1137/07069239X
Kim J, Park H: Sparse Nonnegative Matrix Factorization for Clustering. Tech. Rep. GTCSE0801, Computational Science and Engineering, Georgia Institute of Technology; 2008.
Kim H, Park H: Sparse Nonnegative Matrix Factorizations via Alternating Nonnegativityconstrained Least Squares for Microarray Data Analysis. Bioinformatics 2007,23(12):14951502. 10.1093/bioinformatics/btm134
Wu F, Huberman BA: Finding communities in linear time: a physics approach. The European Physical Journal B  Condensed Matter and Complex Systems 2004,38(2):331338. 10.1140/epjb/e200400125x
Kirchhoff G, Hensel K, Planck M: Vorlesungen uber mathematische Physik. B.G. Teubner; 1894.
Mewes HW, Frishman D, Guldener U, Mannhaupt G, Mayer K, Mokrejs M, Morgenstern B, Munsterkotter M, Rudd S, Weil B: MIPS: a database for genomes and protein sequences. Nucleic Acids Research 2002, 30: 3134. [http://nar.oxfordjournals.org/content/30/1/31.abstract] 10.1093/nar/30.1.31
Zhang Y, Zeng E, Li T, Narasimhan G: Weighted Consensus Clustering for Identifying Functional Modules in ProteinProtein Interaction Networks. Proceedings of the 2009 International Conference on Machine Learning and Applications, ICMLA '09, Washington, DC, USA: IEEE Computer Society 2009, 539544.
Acknowledgements
The work of Yi Pan is supported in part by the National Science Foundation Grants CCF0514750, CCF0646102 and CNS0831634. Wooyoung Kim is supported by an MBD Fellowship from Georgia State University. The work of Min Li and Jianxin Wang is supported in part by the National Natural Science Foundation of China under Grant No.61003124 and No.61073036, the Ph.D. Programs Foundation of Ministry of Education of China No.20090162120073, the Freedom Explore Program of Central South University No.201012200124. Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.
This article has been published as part of BMC Systems Biology Volume 5 Supplement 3, 2011: BIOCOMP 2010  The 2010 International Conference on Bioinformatics & Computational Biology: Systems Biology. The full contents of the supplement are available online at http://www.biomedcentral.com/17520509/5?issue=S3.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
The research was conceived and planned by WK, ML and YP. WK designed the algorithms and new evaluation measures. The experiments were performed and analyzed by WK, ML and YP. YP and JW supervised the work and helped to draft the manuscript. All authors read and approved the final manuscript.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Kim, W., Li, M., Wang, J. et al. Biological network motif detection and evaluation. BMC Syst Biol 5 (Suppl 3), S5 (2011). https://doi.org/10.1186/175205095S3S5
Published:
DOI: https://doi.org/10.1186/175205095S3S5
Keywords
 Gene Ontology
 Functional Module
 Biological Network
 Nonnegative Matrix Factorization
 Network Motif