Volume 8 Supplement 3
Selected articles from the IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2013): Systems Biology Approaches to Biomedicine
An novel frequent probability pattern mining algorithm based on circuit simulation method in uncertain biological networks
- Jieyue He^{1}Email author,
- Chunyan Wang^{1},
- Kunpu Qiu^{1} and
- Wei Zhong^{2}
https://doi.org/10.1186/1752-0509-8-S3-S6
© He et al.; licensee BioMed Central Ltd. 2014
Published: 22 October 2014
Abstract
Background
Motif mining has always been a hot research topic in bioinformatics. Most of current research on biological networks focuses on exact motif mining. However, due to the inevitable experimental error and noisy data, biological network data represented as the probability model could better reflect the authenticity and biological significance, therefore, it is more biological meaningful to discover probability motif in uncertain biological networks. One of the key steps in probability motif mining is frequent pattern discovery which is usually based on the possible world model having a relatively high computational complexity.
Methods
In this paper, we present a novel method for detecting frequent probability patterns based on circuit simulation in the uncertain biological networks. First, the partition based efficient search is applied to the non-tree like subgraph mining where the probability of occurrence in random networks is small. Then, an algorithm of probability isomorphic based on circuit simulation is proposed. The probability isomorphic combines the analysis of circuit topology structure with related physical properties of voltage in order to evaluate the probability isomorphism between probability subgraphs. The circuit simulation based probability isomorphic can avoid using traditional possible world model. Finally, based on the algorithm of probability subgraph isomorphism, two-step hierarchical clustering method is used to cluster subgraphs, and discover frequent probability patterns from the clusters.
Results
The experiment results on data sets of the Protein-Protein Interaction (PPI) networks and the transcriptional regulatory networks of E. coli and S. cerevisiae show that the proposed method can efficiently discover the frequent probability subgraphs. The discovered subgraphs in our study contain all probability motifs reported in the experiments published in other related papers.
Conclusions
The algorithm of probability graph isomorphism evaluation based on circuit simulation method excludes most of subgraphs which are not probability isomorphism and reduces the search space of the probability isomorphism subgraphs using the mismatch values in the node voltage set. It is an innovative way to find the frequent probability patterns, which can be efficiently applied to probability motif discovery problems in the further studies.
Background
In the field of bioinformatics, many types of data are present as the topological graph, such as protein interaction network whose nodes represent proteins, and edges represent the interactions between proteins. Milo in 2002 proposed the concept of biological motif [1] on Science, which discussed a substructure that appears in different parts of a network, and appears significantly more frequently than in a random network. Research shows that the motif recognition is important for many biological studies. For example, motif recognition helps to study the biological network structure, function modules and evolutionary process of organisms and so on. So a lot of research on the exact network model was proposed and these researches have made some progress [1–8]. As the life process itself is a dynamic process, the motif of same function may be made up of the subgraphs which may slightly differ in topology, so Berg etc [9] proposed probability motif mining algorithms in the biological network. And Rui etc [10, 11] also discussed science graph data obtained with the inevitable experimental error or noisy data, and some biological network data with probability information. Meanwhile, since biological evolution itself is a mutant selection process, the input of biological networks should also be probabilistic networks. Therefore, it is more intuitively and practically significant to mine probability motif in the probability biological network.
Most research on motif mining mainly focuses on exact graph while fewer papers work on probability motif. In the paper [11], Rui proposed to use the EM algorithm to estimate the relevant parameters for the probability motif. In this algorithm, the uncertain graph is converted to the certain graph. Since this conversion process requires a large amount of computation, this algorithm has low computational efficiency. In 2009, Rui[10] used the Bayesian model and GIBBS sampling strategy to solve the probability mult-motif. But the probability network still needs to be converted into a certain subgraph and randomly certain graph as background. As a result, the computational cost of this algorithm is still very high.
Probability Motif detection in networks consists of two main steps: 1) calculating the number of occurrences of a probability subgraph in the network and 2) evaluating the probability subgraph, which occurs significantly more frequently than in a random network. So, frequent probability pattern recognition in biological networks is an important step in identifying the probability motif. Currently, the research related to mining frequent subgraph in graph data has made a lot of process, such as gSpan [12], FFSM [13], etc...However, these researches mainly pay attention to certain graph, edges or nodes which are represented by the presence or absence. Therefore, existing frequent pattern identification algorithms for certain graph cannot be applied to frequent pattern identification of biological probability network.
On the other hand, in the uncertain data mining field, the research also has made a lot of achievements in recent years, such as uncertain data modelling and management work [14, 15], and paper [16] introduced the latest technology related to uncertain data, but these studies still primarily focus on traditional uncertain data items. Research on uncertain graph has just begun, which include most reliable subgraph discovering [17–19], efficient TOP-K query [20] and other topics in the uncertain graph. Zou[21–23] also proposed some effective algorithms in mining uncertain graph frequent patterns. However, the above mentioned algorithms mainly use the possible world model. Possible world models are widely used to model uncertain data sets, in which probability graph will be converted into the corresponding possible worlds model graph that it infers, and then each probability subgraph is mapped into 2^{n} ( n is the number of edges of probability subgraph) possible graph instances using the topology graph mining algorithm [12, 13, 24, 25]. The enumerated space of probability graph instances may grow exponentially, resulting in very high algorithm complexity. So, Paper [26] firstly ignores the weight of edges in probabilistic networks and carries out the subgraph isomorphism, and then combines the random walk model to find maximal frequent subgraph, however, some of frequent probability graph in this work may be ignored.
Frequent probability pattern mining, a key step in the probability motif identification, is based on the method of probability isomorphic evaluation. Therefore, a novel method for frequent probability pattern mining in biological uncertain networks based on circuit simulation is proposed in this paper. Firstly, the partition based efficient search is applied to non-treelike subgraph mining where the probability of occurrence in random networks is small. In the second step, exact graph isomorphism identification based on circuit simulation [27] is modified to make efficient probability graph isomorphic decision. The probability graph isomorphic decision combines the analysis of circuit topology structure with related physical properties of voltage in order to directly evaluate the probability isomorphism between probability subgraphs. This innovative approach can effectively avoid the traditional method utilizing the possible world model and excludes most of subgraphs which are not probability isomorphism and reduces the search space of the probability isomorphism subgraphs by the mismatch value of node voltage set. Finally, based on the algorithm of probability subgraph isomorphism, two-step hierarchical clustering method is used to cluster subgraphs, and discover frequent probability patterns from the clusters. The experimental results on data sets of the Protein-Protein Interaction (PPI) networks and the transcriptional regulatory networks of E. coli S.cerevisiae show that the method can efficiently discover the frequent probability subgraphs which contain the probability motifs found in other related experiments. And, it is an innovative way to find the frequent probability patterns, which may be efficiently used for discovering probability motifs in the further studies.
- (1).
A new algorithm of probability isomorphic decision based on circuit simulation is proposed. This approach simplifies the process of finding the probability subgraph by converting these graphs into their inferring certain graph based on the possible world model. It is an innovative way to determine the two graph probability isomorphism by comparing their nodes voltages sequence instead of the topological alignment of subgraph isomorphism, and the algorithm reduces the search space of the probability isomorphism subgraphs using the mismatch values of the node voltage set. In the narrowed set of subgraphs, the mismatch values of the subgraphs are calculated by the enumeration method.
- (2).
Traditional certain graph alignment is usually based on Star-alignment which needs to traverse all nodes of graph as the centre graph, resulting in high computational costs. Two-step hierarchical clustering for calculating multi-graph probability alignment is proposed to effectively reduce the computational complexity.
Briefly then, the outline of this paper is as follows. In the method section, probability isomorphic algorithm is described in details and the two-step hierarchical clustering method for discovering frequent probability pattern is introduced. In the result section, the experimental results are presented. Finally, suggestions for future work are made in the conclusion section.
Methods
Problem Definitions
Definition 1 (biological probabilistic networks): Denoted as
g_{ B } = (V, E, Σ, L, p),Where V is the node set of biological probabilistic networks g_{ B }, E ⊆V × V is the set of edges of the graph g_{ B }, Σ is a set of node label, L :V → E is a node labelling function, p : E → (0,1] indicates the probability of edges in biological probabilistic networks.
Generally, the data obtained by biological experiments carry some inevitable noisy data, while biological evolution itself is a variable selection process. As a result, the concept of probability can be introduced in the definition to indicate the uncertainty of biological data.
Definition 2 (Probability graph isomorphism): Set the number of nodes as k of the two probability graph g = (V, E, Σ, L, p), g′ = (V′, E′, Σ', L′, p′), there exists a node mapping sequence <Inje, Inje' >, so that the two graphs have similar topology (does not require identical topology), while the absolute value of the difference between the weights of corresponding edges between nodes |Δ_{ ij }| ≤ α, the sum of all the absolute value of the difference between the weights of the corresponding edges ${\sum}_{i=1,j=1}^{k}\left|{\text{\Delta}}_{ij}\right|\le \theta $, then g and g′ is called probability isomorphic.
- 1)
$\forall i,j\in \left\{1,...,k\right\}{\text{\Delta}}_{ij}=|p\left(Inje\left(i\right),Inje\left(j\right)\right)-{p}^{\prime}\left(Inj{e}^{\prime}\left(i\right),Inj{e}^{\prime}\left(j\right)\right)|\le \alpha $
- 2)
${\sum}_{i=1,j=1}^{k}\left|{\text{\Delta}}_{ij}\right|\le \theta $
Compared to the certain graph, the probability graph requires two graphs' topology approximated. The probability graph also takes into account the degree of weights matching of the corresponding edges between nodes, so the computational complexity of the probability graph is higher than certain graph isomorphism. On the other hand, the probability adjoint matrix can be used to uniquely identify a probability graph, but a different arrangement of the nodes in the probability graph may correspond to multiple probabilistic adjoint matrixes, resulting in high computational complexity to find the probability graph isomorphism.
User-specified minimum support threshold denoted as min_sup, suppose frequent pattern set is F, if $sup\left({g}_{\alpha},{g}_{D}^{k}\right)\ge min\text{\_}sup$, then g_{ α } ∈ F is a frequent pattern. Shang etc. [27] proposed an exact graph isomorphism algorithm based on circuit simulation method, which is mainly used in a directed graph, undirected graph and mixed graph (refers as a mixture of directed graph or undirected graph). Therefore, inspired by the method in [27], the probability graph isomorphism algorithm is proposed. The probability graph isomorphism algorithm uses the innovative construction method based on associated circuit and node voltage sequence alignment algorithm. In order to avoid the high computation caused by the differential calculation of every edge (|Δ_{ ij }| ≤ α) in the adjoint matrix, we introduce threshold ε which is the sum of the corresponding edge difference in associated circuit based on the circuit simulation. Then based on the probability graph isomorphism algorithm, the hierarchical clustering method is adopted to cluster subgraphs to discover frequent probability patterns from the clusters.
So, the method of frequent probability pattern mining in biological uncertain networks based on circuit simulation is defined as the followings (Assume that the node number for mining the frequent probability patterns is k):
(1) Probability subgraph set g_{ D } Since the large numbers of motifs discovered by biological functions are non-tree structure [9], only non-tree subgraphs are necessary to be searched in the biological networks. Therefore, the subgraph search algorithm of non-tree based on the division [28] is used for getting all of candidate probability subgraph set g_{ D } with the size k from the biological probability network.
(2) Probability graph isomorphism evaluation based on the circuit simulation method. Given the mismatch threshold ε of node voltage sequence matrix and the probability mismatch threshold θ of the adjoint matrix, two probability graph distance matrix Dist (N, N′) are obtained using the circuit simulation method. Then the Hungarian Algorithm is used to get the node optimal matching sequence and the mismatch value of node voltage sequence matrix. Based on the mismatch value of node voltages sequence matrix, the node optimal matching sequence and the mismatch value of adjoint matrix, then two probability graphs are evaluated to be probability isomorphic or not.
(3) Frequent probability subgraph discovered by two-step hierarchical clustering. According to the method of probability isomorphic introduced in (2), two-step hierarchical clustering is used to find the probability subgraph isomorphism group, and then get the frequent probability subgraphs.
The next sections will introduce the method of probability graph isomorphism evaluation and the algorithm of two-step hierarchical clustering for discovering frequent probability subgraph.
Probability graph isomorphism judgment based on the circuit simulation method
In this algorithm, the node voltage method [27] of the basic linear circuit analysis method is used.
The basic linear circuit analysis method- node voltage method
The node voltage method is a circuit simulation method based on the principle of conservation current. The principle of conservation current specifies that the current is unlikely to disappear and it is impossible to suddenly increase, so the amount of current inflow is equal to the amount of current outflow in a closed circuit. Based on this principle, the circuit voltage can be calculated.
Where G_{ ii } (i = 1, 2,..., k − 1) is called the self-admittance of node i, whose value is the sum of the admittance of all branches connected to the node i.
G_{ ij } (i = 1, 2,..., k − 1; j = 1, 2,..., k − 1) is called mutual admittance of node i and node j, which is the negative of the sum of all branches' admittance between the node i and node j .
U_{ ij } is the voltage of the node j when node i is selected as reference node.
I_{ si } (i = 1, 2,..., k − 1) is the algebraic sum of the current flow into node i (inflow is positive, outflow is negative).
By solving these equations, we can get the node voltage sequences[U_{41}, U_{42}, U_{43}], when node ④ is the reference point.
In Example 2, we can see that, set a node (e.g. ④) as a reference point, the each node voltage values of the sequence (e.g. U_{41}) is calculated based on the information of topology and edge weight (e.g. when solving U_{41}, take into account the conductance values of G_{1}, G_{2} and G_{3} ,which are adjacent to node ① etc.). From this perspective, to some extent, the node voltage sequences characterize the topology information and edge weight information of the probability adjacency matrix.
Node voltage method for probability graph
Definition 4 (associated circuit of probability graph): For graph g, if the reciprocal of probability (1/ p, p ∈ (0,1]) of each edge is used to represent the resistance value (i.e. when the edge probability value is close to 0, the circuit is disconnected, indicating that the circuit has little effect on the whole graph for node voltages), then we get the circuit N called the associated circuit of graph g.
By the definition, G_{ ij } of equation (1) and (2) is expressed as conductance, the relationship equation between conductance and resistance is G = 1/R for purely resistive circuit. Here set R = 1/p, then G = p, where R represents resistance and p represents the probability value of edges in the probability graph. When p → 1, which means that the circuit is connected with a very small resistance, the circuit is close to zero resistance; when p → 0, which means that the circuit is connected with an infinite resistance, the circuit is close to disconnected.
Definition 5 (similar circuit): Let us define the corresponding topology graph of the circuit N as g and the corresponding topology graph of the circuit N′ as g′. If g and g′ are the approximate isomorphic graph, then the corresponding branches of N and N′ contain similar resistance value elements, and N and N′ is called similar circuit, denoted as N ≈ N′.
Theorem 1: Two of associated circuits based on their probability isomorphism subgraphs are similar circuits, i.e. if g ≈ g′, then N ≈ N′.
Proof: Since the probability isomorphism subgraphs have similar topology g and g′, and each edges of g and g′ are replaced with similar resistance, associated circuit has similar elements corresponding to their branches. Therefore, N and N′ is similar circuit.
Two of associated circuits N and N′ based on their isomorphism probability subgraphs g and g′ are similar circuits. On the contrary, if two of the associated circuit N and N' are similar circuits, it could not be directly concluded that two probability subgraphs g and g′ of these associated circuit are probability isomorphism. Thus, the necessary condition of probability isomorphism for two probability subgraphs is that the associated circuits of probability subgraphs are similar circuits.
Definition 6 (complete excitation [27]): Associated circuit N with k nodes, let node I be a reference node, apply the same current source I_{ s } (the value of the current source I_{ s } is taken as 1A without loss of generality) between node i and the remaining (k-1) nodes, respectively, with the directions of the currents being from node i to the other nodes. This kind of excitation is called a complete excitation of node i.
Definition 7 (Node voltage sequence [27] and node voltage sequence set [27]):
In an associated circuit N, when the node i serves as a reference point, the set of node voltages in an ascending order is obtained based on the complete excitation of node i. This set is called the node voltage sequence of node i, denoted as S_{ i }, i = 1, 2, ..., k (k is the number of nodes in the associated circuit). Furthermore, the node voltage sequences of all the nodes constitute the node voltage sequence set of the circuit N, denoted as S = {S_{1},..., S_{ i }}^{ T }, i = 1, 2, ..., k.
Theorem 2: For two of associated circuits N and N′ based on their probability isomorphism subgraphs graph g and g′, if the corresponding nodes have the same complete excitation, the corresponding nodes' voltage are similar.
Proof: Assume that d and d′ are the adjoint matrix of the probability isomorphic graph g and g′, so d ≈ d′. Construct the associated circuits N and N′ respectively, according to the definition of associated circuits, N and N′ is similar circuit, denoted as N ≈ N′. Let Y_{ b } and ${{Y}_{b}}^{\prime}$ are branch admittance matrixes respectively, then ${Y}_{b}\approx {{Y}_{b}}^{\prime}$.
Where U_{ k } and ${U}_{k}^{\prime}$ are the node voltage sequence for node i and i′ which are the reference point respectively. Because the complete excitation is same i.e. ${I}_{s}={{I}_{s}}^{\prime}$, ${U}_{k}\approx {{U}_{k}}^{\prime}$. The theorem is proved.
Theorem 3: If g and g′ are probability isomorphic, the node voltage sequence set of each of associated circuits N and N′ in the same complete excitation are similar, denoted as S ≈ S′. So that the mismatch value of the two group of node voltage sequence set is less than the threshold value ε ,denoted as |S − S′| <ε.
Proof: If g and g′ are probability isomorphic, the node voltage sequences of the node i and node i′ in each of associated circuits N and N′ in the same complete excitation are correspondingly similar. And if g and g ' are probability isomorphic, according to Definition 2, the absolute value of weight difference of the corresponding edges between nodes is less than or equal to the threshold value, i.e. |Δ_{ ij }| ≤ α. Based on Theorem 2, ${U}_{ij}\approx {{U}_{ij}}^{\prime}$ can be obtained, i.e. $|{U}_{ij}\approx {{U}_{ij}}^{\prime}|$ is less than a threshold value denoted as ε_{ ij } , therefore ${\sum}_{i,j=1}^{k}|{U}_{ij}-{{U}^{\prime}}_{ij}|<{\sum}_{i,j=1}^{k}{\epsilon}_{ij}$, let ${\sum}_{i,j=1}^{k}{\epsilon}_{ij}=\epsilon $, then the mismatch value of two node voltage sequence set is less than the threshold i.e. |S − S′| <ε . The theorem is proved.
Based on the analysis of the circuit simulation method for determining the graph probability isomorphic, we make the conclusion that the mismatch value of two graphs' nodal voltage matrix being less than the probability threshold is the necessary condition of probability isomorphic of two graphs. So, next we will discuss how to get the mismatch value of two graphs' nodal voltage matrix.
Hungarian algorithm for optimal node matching in isomorphic graph decision
Thus, the problem of seeking the optimal node mapping between graphs is converted to the problem of finding the minimum of sum of elements of rows and columns in distance matrix Dist. This problem is a classic bi-graph matching problem, and can be solved by Hungarian algorithm [29] as an assignment problem.
Hungarian algorithm is mainly based on the following facts: if each element of a row (or a column) in the coefficient matrix C = (c_{ ij }) is added or subtracted by the same number to get a new matrix B = (b_{ ij }), the assignment problem with the coefficient matrix C and B has the same optimal assignment.
Definition 8 (node voltage sequence matrix mismatch value VMval): Given probability graph g and g′, and the node voltage sequence matrix S and S′ which are associated circuits N and N′ respectively, according to S and S′, get distance matrix Dist of node voltage sequence and use the Hungarian algorithm to obtain assignment matrix M. In the Dist matrix, the sum of the elements at the corresponding location with the value of "1" in the assignment matrix M is equal to the minimum mismatch of two node voltage sequence matrix, and this value is noted as VMval.
Definition 9 (adjoin matrix mismatch value PMval of probability graph): Given g and g′, according to S and S′ obtain distance matrix Dist of node voltage sequence and use the Hungarian algorithm to obtain assignment matrix M, then get the node mapping sequence <Inje, Inje' > of two probability graph, and the adjoin matrix d and d′ are obtained by <Inje, Inje' >, PMval is equal to the absolute value of the sum of corresponding edge weights difference in the adjoin matrix d and d′ adjusted, i.e. $PMval={\sum}_{i,\phantom{\rule{2.77695pt}{0ex}}j=1}^{k}\left|p\left(Inje\left(i\right),Inje\left(j\right)\right)-{p}^{\prime}\left(Inj{e}^{\prime}\left(i\right),Inj{e}^{\prime}\left(j\right)\right)\right|$
Based on the node mapping relationship <Inje, Inje' > obtained from Hungarian algorithm, then perform elementary transformation for matrix d and d′ respectively, called matrix adjust, where matrix d performed the elementary transformation by Inje , the matrix d′ performed the elementary transformation by Inje′.
Algorithm of probability subgraph isomorphism
The necessary conditions of two probability subgraphs isomorphism is that the mismatch value of their associated circuit node voltage sequence set is less than the threshold ε . So, if the mismatch value VMval of node voltage set exceeds the threshold value ε , g and g′ is not isomorphic. If the mismatch value VMval less than ε ,then according to the Definition 2 of probability graph isomorphism, the mismatch value of the corresponding edge of two probability subgraphs should be less than the threshold value α and the sum of mismatch value of corresponding edges of probability subgraphs should be less than the threshold value θ . Because of high computational cost to evaluate each mismatch value of edges adjoint matrix, we add the mean and variance of node voltage sequences as the additional column in the distance matrix of node voltages sequence set when we calculate the mismatch value VMval. Thus, the mismatch value VMval is somewhat similar to the mismatch value of the corresponding edges.
Assume k is the number of nodes of probability graph. The probability adjoint matrix can be used to uniquely identify a probability graph, but a different arrangement of the nodes in probability graph may correspond to k ! probabilistic adjoint matrix. Since the Hungarian algorithm can get one of optimal assignment matrix M, if PMval> θ based on the M, it illustrates that this mapping relationship may be not correct and two graphs are still probability isomorphic. So, k ! -1kind of elementary matrix transformation for adjusting adjoint matrix d and d′ may be necessary to discover whether two probability graphs are isomorphic or not.
Thus, the main steps of the algorithm to discover the probability subgraph isomorphism are as follows:
• Firstly, according to the probability graph g and g′, get the associated circuit N and N′, then calculate the node voltages sequence matrix S and S′; Next, using the Hungarian algorithm to get the assignment matrix M and the mismatch values VMval. If the mismatch value VMval of node voltage set exceeds the threshold value ε , that is to say, g and g ' are inevitably not isomorphic, otherwise, go to step 2
• According to "1" in the column coordinate of assignment matrix M, generate node mapping relationship, then according to the node mapping relationship <Inje, Inje' > of node voltage sequences set in N and N′, adjust adjoint matrix d and d′. If the mismatch value of adjoint matrix PMval <θ , then g and g′ are probability isomorphic, otherwise, they are possibly isomorphic, go to step 3
• In this case, k!-1 kind of elementary matrix transformation of adjoint matrix d and d′ may be needed to discover whether two probability graph are isomorphic or not. When there is a new mapping satisfying PMval <θ , the two graphs g and g ' are probability isomorphic; on the contrary, they are not isomorphic.
Algorithm of probability graph isomorphism judgment based on circuit simulation.
Algorithm: Isomorphism judgment Algorithm of probability graph IsomorphismCal (g_{ α } , g_{ i } , ε , θ) Input: two probability graph g_{ α } and g_{ i }, the mismatch threshold value ε of the node voltage sequences set, the mismatch threshold value θ of probability adjoint matrix Output: the bool value Iso of two graph isomorphism, the node mapping sequence Inje_{ i }, the mismatch value VMval_{ i } of node voltage sequences matrix |
---|
1. //Generate the node voltage sequence matrix S_{ α } , S_{ i } according to g_{ α } , g_{ i } For each graph in {g_{ α } , g_{ i }} generate associated circuit N_{ α } and N_{ i } End For each graph in {g_{ α } , g_{ i }} For j = 1 to k Calculate the node voltage sequence S ^{ j } while set node_{ j } as reference node; $S={S}^{J}\cup S,S\in \left\{{S}_{\alpha},{S}_{i}\right\}$ End End 2. //calculate distance matrix according to S_{ α } , S_{ i } Calculate Dist(N_{ α }, N_{ i }) according to formula(3); 3. //Get the node mapping relationship Inje_{ i } and the mismatch value of node voltage VMval_{ i } by Hungarian algorithm VMval_{ i } , Inje_{ i } > ← Hungarian(Dist); 4. // Compare VMval_{ i } and ε If VMval_{ i } <= ε g_{ α } and g_{ i } is not probability isomorphic; Continue; Else g_{ α } and g_{ i } maybe probability isomorphic; // g_{ α } and g_{ i } maybe probability isomorphic, and need further deal 5. //Calculate the mismatch value of adjoint matrix PMval _{ i } by adjust the adjoint matrix of g _{ α } and g _{ i } according to nodes mapping sequence If PMval_{ i } <= θ g_{ α } and g_{ i } is probability isomorphic; Iso =True; Return <Iso, Inje_{ i } ,VMval_{ i } > ; Else Return PermuteInjectedSequenceAndTestIso (g_{ α }, g_{ i }, Inje_{ i }, VMval_{ i }, θ); // Enumeration the node mapping relationship for isomorphic judgment End |
The algorithm of probability graph evaluation based on possible world model has O(2^{|E|}) of the best time complexity and O(2^{|E|}* k!) of the worst time complexity (|E| is the number of edges in probability graphs). The algorithm of probability graph isomorphism evaluation based on circuit simulation method excludes most of subgraphs which are not probability isomorphism and reduces the search space of the probability isomorphism subgraphs using the mismatch value VMval of node voltage set. In the narrowed set of subgraphs, the mismatch values of its subgraphs are calculated by the enumeration method. The best time complexity of the algorithm is O(1), i.e. the minimum mismatch sequence of node voltage sequence matrix is the mapping sequence of probability isomorphism, the worst time complexity of which is O(k!), when we need to enumerate all possible nodes mapping relationship.
Frequent probability pattern identifying algorithm
Based on the method of probability subgraph isomorphic, the frequent probability pattern can be identified from the probability subgraph set using graph alignment. Usually, the Star-alignment is adopted for frequent pattern identified in certain graph. It needs to traverse the entire graph set as the centre graph for comparison leading to high complexity. In this paper, the algorithm of two-step hierarchical clustering is proposed for frequent probability pattern identification in order to effectively reduce the computational complexity.
Algorithm of frequent probability pattern by two-step hierarchical clustering.
Algorithm: Two-step Hierarchical Clustering For FPP (G, ε, θ ,freq) Input: All probability subgraphs with k scale Output: frequent probability subgraph g_{ α } |
---|
1. Initilize the n graphs {g_{1},...,g_{n}}as the n leaves of cluster tree ; 2. While Change_label!=0 3. Change_label = 0; // Change_label indicates whether the process of merging clustering operation 4. L_{c} = size(ResidentGraph); //Calculation subgraph number, L_{c} represents the total number of clusters 5. For i= 1 to L_{c} /2 6. <Iso,inje,VMval>=IsomorphismCal(g_{i}, g_{i+ L c /2}, ε, θ); // Determine g_{i}, g_{i+ L c /2}probability isomorphic 7. If Iso= =TRUE 8. g_{i} = union(g_{i}, g_{i+ L c /2}); 9. Change_label ++; 10. ResidentGraph = {ResidentGraph i}; //if isomorphic, retaining only the subgraph label i to ResidentGraph 11. Else ResidentGraph = {ResidentGraph i i+ L_{ c } /2};//if not isomorphic, retaining only the subgraph label i, i+ L_{ c } /2 to ResidentGraph 12. End if 13. End for 14. End while 15. SimpleHierarchicalClusteringForFrequentSubgraphWithPro(ResidentGraph, ε, θ ,freq); //using a simple hierarchical clustering for the remaining probability subgraphs 16. Calculate the probability isomorphic frequency p of the residual clusters g_{r} ; |
The algorithm of frequent probability subgraph discovered by two-step hierarchical clustering takes L_{ c }/2 as each step for the comparison (L_{ c } is the number of cluster), so that the new categories are the most likely to become the two candidate classes for pairwise comparison at next step of clustering. This approach avoids the poor clustering results led by little change of two candidate classes when searching for clustering. The algorithm of frequent probability subgraph discovered by two-step hierarchical clustering takes L_{ c }/2 as each step and each step compares the mismatch value of node voltage sequences matrix VMval with the mismatch value of probability isomorphic of adjoint matrix PMval obtained from g_{ i } and ${g}_{i+{L}_{c}/2}$. When they satisfies the conditions of VMval <ε ∩ PMval <θ, g_{ i } and ${g}_{i+{L}_{c}/2}$ are combined directly. This process is reduced into classical hierarchical clustering until the mismatch value between any of two probability subgraph at interval step L_{ c }/2 are greater than <ε, θ >.
As can be seen from the above analysis, the time complexity of frequent probability subgraph recognition algorithm based on two-step hierarchical clustering is O (n log n) in the best case, and the time complexity in the worst case is O(n^{3}) since the algorithm is reduced to a classical hierarchical clustering. In the space complexity, as a result of using a simple hierarchical clustering and the subgraph index set "ResidentGraph" to reserve and update the clusters of subgraphs, the distance matrix n × n spatial complexity consumption is avoided. However, in this approach, the mismatches of distance between any two subgraphs are required to calculate at each clustering round at the expense of time consumption.
In addition, because the distance between any of two subgraphs in each hierarchical clustering may not the smallest, it reduces the convergence time of clustering and may cause clustering bias. This bias is limited by probability isomorphic threshold, i.e. the greater the probability isomorphic threshold is, faster two-step hierarchical clustering cluster runs with the larger deviation of clusters; Conversely, the smaller the probability isomorphic threshold is, slower hierarchical clustering method runs with less small deviation clustering. Fortunately, the isomorphism probability threshold is defined by the user, so the error caused by the hierarchical clustering is limited within the acceptable range to users. Therefore, compared with the classical hierarchical clustering, the algorithm of frequent probability subgraph discovered by two-step hierarchical clustering has good clustering results with the significantly lower time complexity.
Experimental setup and result analysis
To verify and evaluate the performance of the proposed algorithm in this work, three real-world biological networks are used, including the transcriptional regulatory network of E.coli [30], transcriptional regulatory networks of S.cerevisiae : based on the ChIP-chip data[31, 32] called S.cere^{ 1 } dataset and S.cere^{ 2 } dataset respectively. E.coli dataset having an exact graph with direction contains 423 nodes and 519 edges, S.cere^{ 1 } data set with a probability of network contains 2428 nodes and 4348 edges, and cere^{ 2 } data set, a probability network, contains 3799 nodes and 13155 edges. The algorithm is applied to E.coli data set to validate the correctness and performance of probability isomorphic algorithms, using exact graphs. And the algorithm is applied to S.cere^{ 1 } and S.cere^{ 2 } datasets to verify frequent subgraph mining in probabilistic networks. The verification process is based on whether the generated results in this study contain motifs which were reported in other research works [10, 11].
Demonstration and comparison of probability isomorphism algorithm
The relationship of Non-tree subgraph scale, Number of subgraphs and Number of subgraph isomorphism Classes from E. coli data.
subgraph scale | 3 | 4 | 5 |
---|---|---|---|
number of subgraphs | 42 | 1822 | 57632 |
number of subgraph isomorphism classes | 1 | 3 | 12 |
Verification of frequent probability subgraph by two-step hierarchical clustering
In this experiment, the algorithm of frequent probability subgraph by two-step hierarchical clustering was tested on S.cere^{ 1 } and S.cere^{ 2 }. In order to be compared with the result in the paper [10, 11], frequent probability subgraph with 3-4 scale nodes and 5 scale nodes were identified in S.cere^{ 1 } and S.cere^{ 2 } separately.
- (1)
N = 3: ε -table = θ − table = {1.2,1.0, 0.8, 0.6, 0.4, 0.2} ;
- (2)
N = 4 : ε -table = θ − table = {2.5, 2.0,1.5,1.2} ;
As can be seen from the Figure 7, Figure 8 and 9, discovered frequent probability subgraph contain motifs which were published in others research works [10, 11], and the mismatch value with motif are small. Experimental results also indicate that as the clustering threshold mismatch decreases, the number of clustered subgraphs increases, and the frequency of frequent probability pattern similar to motif was gradually reduced, the time of recognizing frequent probability subgraph was increasing. In addition, we found that the discovered frequent probability pattern similar to motif didn't make positive or negative changes with the mismatch value of clustering. The probability subgraph with the highest frequent degree does not necessarily correspond to the smallest mismatch value of motif. Which also proved that motif is not necessarily the most frequent subgraph in the original probabilistic networks, but the subgraph in a original probability with much greater frequency than that in a random network. Therefore, in the probability motif recognizing problem, we also need to have further calculations to get frequency of subgraph in random networks, and then to evaluate whether it is a probability motif.
Conclusions
With the rapid development of biotechnology, especially in high-throughput technologies, a large number of biological network graph data has been produced. It has become a hot topic of current research to identify network substructures associated with a specific function module from this kind of biological networks with intertwined topology and complex functions. Since biological network data carries inevitably experimental error and noisy data, the mining of probability motif in biological probabilistic network will become more practically significant. A key step of identifying probability motif is the mining of frequent probability pattern. This paper presents a probability frequent subgraph mining algorithm in biological probabilistic networks based on the circuit simulation method. A probability frequent subgraph mining algorithm includes the circuit simulation method to evaluate probability isomorphism and two-step hierarchical clustering to recognize frequent probability pattern. Instead of using the possible world model with the exponential time complex, probability isomorphism judgment method combines circuit topology structure and related physical properties of voltage to directly evaluate the probability isomorphism between probability subgraphs. The algorithm of probability graph evaluation based on circuit simulation method excludes most of subgraphs which are not probability isomorphism and reduces the search space of the probability isomorphism subgraphs by the mismatch value of node voltage set. In the narrowed set of subgraphs, the mismatch values of its subgraphs are calculated by the enumeration method.
Furthermore, a frequent probability pattern recognition algorithm based on two-step hierarchical clustering was also proposed for better recognition performance. Experimental results show that the proposed method can produce the satisfactory results, which are consistent with the relevant algorithms. In the future research, the effective approach to solve the problem of symmetrical graph will be further studied because there are several possible mapping sequences for the symmetrical graph, and it will take long time if only enumeration method is used to obtain mapping sequence matches for node adjoint matrix during the calculation.
Declarations
Acknowledgements
The authors would like to thank Jiang R, Chen T, Sun F, Tu Z, S Shen-Orr, Lee and Harbison for their sharing the datasets, to McKay and Brendan D for their publicity of Nauty. The authors are also thankful to Huiliang Shang for his kindly sharing the exact graph isomorphism algorithm, and Dejing Zhao for his kindly sharing the source code of the non-treelike subgraph mining algorithm.
An earlier version of this article was published for the IEEE International Conference on Bioinformatics and Biomedicine (BIBM) held on December 18-21, 2013 [34]. The authors also thank the anonymous reviewers for their helpful and constructive suggestions.
Declarations
Publication for this article has been funded by the Natural Science Foundation of Jiangsu Province under Grant No. BK2012742.
This article has been published as part of BMC Systems Biology Volume 8 Supplement 3, 2014: IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2013): Systems Biology Approaches to Biomedicine. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcsystbiol/supplements/8/S3.
Authors’ Affiliations
References
- Milo R, Shen-Orr S, Itzkovitz S: Network motifs: simple building blocks of complex networks. Science Signaling. 2002, 298 (5594): 824-Google Scholar
- Choobdar S, Ribeiro P, Silva F: Motif Mining in Weighted Networks. Data Mining Workshops (ICDMW), 2012 IEEE 12th International Conference on.IEEE. 2012, 210-217.View ArticleGoogle Scholar
- Liu K, Cheung W K, Liu J: Stochastic network motif detection in social media. Data Mining Workshops (ICDMW), 2011 IEEE 11th International Conference on.IEEE. 2011, 949-956.View ArticleGoogle Scholar
- Zhang Y, Xuan J, de Los Reyes BG: Network motif-based identification of breast cancer susceptibility genes. Engineering in Medicine and Biology Society, 2008 EMBS 2008 30th Annual International Conference of the IEEE. 2008, 5696-5699.View ArticleGoogle Scholar
- Albert N: Conserved network motifs allow protein--protein interaction prediction. Bioinformatics. 2004, 20 (18): 3346-3352. 10.1093/bioinformatics/bth402.View ArticlePubMedGoogle Scholar
- Mazurie A, Bottani S, Vergassola M: An evolutionary and functional assessment of regulatory network motifs. Genome Biol. 2005, 6 (4): R35-10.1186/gb-2005-6-4-r35.PubMed CentralView ArticlePubMedGoogle Scholar
- Qin G, Gao L: An algorithm for network motif discovery in biological networks. International journal of data mining and bioinformatics. 2012, 6 (1): 1-16. 10.1504/IJDMB.2012.045533.View ArticlePubMedGoogle Scholar
- Liu K, Cheung W K, Liu J: Detecting multiple stochastic network motifs in network data. Advances in Knowledge Discovery and Data Mining, Springer. 2012, 205-217.View ArticleGoogle Scholar
- Berg J, Lässig M: Local graph alignment and motif search in biological networks. Proceedings of the National Academy of Sciences of the United States of America. 2004, 101 (41): 14689-14694. 10.1073/pnas.0305199101.PubMed CentralView ArticlePubMedGoogle Scholar
- Jiang R, Chen T, Sun F: Bayesian models and Gibbs sampling strategies for local graph alignment and motif identification in stochastic biological networks. Communications in Information & Systems. 2009, 9 (4): 347-370. 10.4310/CIS.2009.v9.n4.a3.View ArticleGoogle Scholar
- Jiang R, Tu Z, Chen T: Network motif identification in stochastic networks. Proceedings of the National Academy of Sciences. 2006, 103 (25): 9404-9409. 10.1073/pnas.0507841103.View ArticleGoogle Scholar
- Yan X, Han J: gSpan: Graph-Based Substructure Pattern Mining. Proceedings of the 2002 IEEE International Conference on Data Mining. 2002, IEEE Computer Society, 721-Google Scholar
- Huan J, Wang W, Prins J: Efficient Mining of Frequent Subgraphs in the Presence of Isomorphism. Proceedings of the Third IEEE International Conference on Data Mining.IEEE Computer Society. 2003, 549-View ArticleGoogle Scholar
- Sarma AD, Benjelloun O, Halevy A: Working Models for Uncertain Data. Proceedings of the 22nd International Conference on Data Engineering.IEEE Computer Society. 2006, 7-Google Scholar
- Sen P, Deshpande A: Representing and Querying Correlated Tuples in Probabilistic Databases. Data Engineering, 2007 ICDE 2007 IEEE 23rd International Conference on. 2007, 596-605.View ArticleGoogle Scholar
- Ao-Ying Zhou, Che-Qing Jin, Guo-Ren Wang: A Survey on the Management of Uncertain Data. Chinese Journal of Computers. 2009, 1-16. 01Google Scholar
- Hintsanen P: The Most Reliable Subgraph Problem. Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases. 2007, Warsaw, Poland: Springer-Verlag, 471-478.Google Scholar
- Hintsanen P, Toivonen H: Finding reliable subgraphs from large probabilistic graphs. Data Min Knowl Discov. 2008, 17 (1): 3-23. 10.1007/s10618-008-0106-1.View ArticleGoogle Scholar
- Jin R, Liu L, Aggarwal CC: Discovering highly reliable subgraphs in uncertain graphs. Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining.ACM. 2011, 992-Google Scholar
- Zhang S, Gao H, Li J: Efficient Query Processing on Uncertain Graph Databases. Chinese Journal of Computers. 2009, 10: 2066-2079.Google Scholar
- Zou Z, Gao H, Li J: Discovering frequent subgraphs over uncertain graph databases under probabilistic semantics. Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining ACM. 2010, 633-642.View ArticleGoogle Scholar
- Zou Z, Li J, Gao H: Finding top-k maximal cliques in an uncertain graph. Data Engineering (ICDE), 2010 IEEE 26th International Conference on.IEEE. 2010, 649-652.View ArticleGoogle Scholar
- Zou Z, Li J, Gao H: Mining frequent subgraph patterns from uncertain graph data. Knowledge and Data Engineering, IEEE Transactions on. 2010, 22 (9): 1203-1218.View ArticleGoogle Scholar
- Inokuchi A, Washio T, Motoda H: An apriori-based algorithm for mining frequent substructures from graph data. Principles of Data Mining and Knowledge Discovery. 2000, Springer, 13-23.View ArticleGoogle Scholar
- Tian Y, Hankins RA, Patel JM: Efficient aggregation for graph summarization. Proceedings of the 2008 ACM SIGMOD international conference on Management of data ACM. 2008, 567-580.View ArticleGoogle Scholar
- Han M, Zhang W, Li J: RAKING: An Efficient K-Maximal Frequent Pattern Mining Algorithm on Uncertain Graph Database. Chinese Journal of Computers. 2010, 9: 1387-1395.View ArticleGoogle Scholar
- Huiliang Shang: A new method of graph isomorphism identification-- circuit simulation method. 2009, Fudan UniversityGoogle Scholar
- Jieyue He, Dejing Zhao: An efficient algorithm for discovering probability motifs in biological networks. Journal of Southeast University(Natural Science Edition). 2012, 35-39. 01Google Scholar
- Mills-Tettey GA, Stentz A, Dias MB: The dynamic hungarian algorithm for the assignment problem with changing costs. 2007Google Scholar
- Shen-Orr S: E. coli transcription network. 2002, [http://www.weizmann.ac.il/mcb/UriAlon/coliData.html]Google Scholar
- Lee : Transcriptional Regulatory Networks in Saccharomyces cerevisiae (S.cere^{1}). 2002, [http://younglab.wi.mit.edu/cgibin/young_public/navframe.cgi?s=17#x0026;f=downloaddata]Google Scholar
- Harbison : Transcriptional Regulatory Code of a Eukaryotic Genome(S.cere^{2}). 2004, [http://younglab.wi.mit.edu/regulatory_code/GWLD.html]Google Scholar
- Brendan D: Practical graph isomorphism. 1981, Department of Computer Science, Vanderbilt UniversityGoogle Scholar
- Wang C, Qiu K, Zhong W, He J: School of Computer Science and Engineering, MOE Key Laboratory of Computer Network and Information Integration, Southeast University, Nanjing 210096, China. Bioinformatics and Biomedicine (BIBM), 2013 IEEE International Conference on IEEE. 2013, 619-619. DecemberView ArticleGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.