- Software
- Open Access
- Published:

*GraphAlignment*: Bayesian pairwise alignment of biological networks

*BMC Systems Biology*
**volume 6**, Article number: 144 (2012)

## Abstract

### Background

With increased experimental availability and accuracy of bio-molecular networks, tools for their comparative and evolutionary analysis are needed. A key component for such studies is the alignment of networks.

### Results

We introduce the Bioconductor package *GraphAlignment* for pairwise alignment of bio-molecular networks. The alignment incorporates information both from network vertices and network edges and is based on an explicit evolutionary model, allowing inference of all scoring parameters directly from empirical data. We compare the performance of our algorithm to an alternative algorithm, *Græmlin 2.0*.

On simulated data, *GraphAlignment* outperforms *Græmlin 2.0* in several benchmarks except for computational complexity. When there is little or no noise in the data, *GraphAlignment* is slower than *Græmlin 2.0*. It is faster than *Græmlin 2.0* when processing noisy data containing spurious vertex associations. Its typical case complexity grows approximately as$\mathcal{O}\left({N}^{2.6}\right)$.

On empirical bacterial protein-protein interaction networks (PIN) and gene co-expression networks, *GraphAlignment* outperforms *Græmlin 2.0* with respect to coverage and specificity, albeit by a small margin. On large eukaryotic PIN, *Græmlin 2.0* outperforms *GraphAlignment*.

### Conclusions

The *GraphAlignment* algorithm is robust to spurious vertex associations, correctly resolves paralogs, and shows very good performance in identification of homologous vertices defined by high vertex and/or interaction similarity. The simplicity and generality of *GraphAlignment* edge scoring makes the algorithm an appropriate choice for global alignment of networks.

## Background

The advent of high-throughput techniques has generated new types of large-scale molecular interaction data, conveniently represented by graphs or networks. Examples include metabolic networks formed by enzymes and metabolites[1], gene co-expression networks with edges between pairs of genes indicating a certain correlation between their expression levels[2], residue contact maps as representations of protein structures[3, 4], and protein-protein interaction networks, where edges between vertices indicate a physical interaction between proteins[5]. For an introduction, see reference[6].

Cross-species analysis of bio-molecular networks aims to identify sub-networks which are evolutionarily conserved as well as network parts that have evolved rapidly. Similarly to comparison of biological sequences[7], alignment of biological networks is an important tool for quantitative evolutionary studies[2, 8–16]. However, such alignment poses a challenging computational problem, which goes beyond the well-established concepts and methods of sequence alignment and of subgraph matching (isomorphism)[17]. It involves an evolutionary process in which a pair of networks derives from a common ancestor (which accounts for a certain degree of similarity), and each network has since evolved independently (which results in edge changes, vertex changes, and vertices losing their alignment partner).

Here, we define the alignment of two graphs as an injective one-to-one mapping from a subset of vertices of one graph to vertices of the other graph, see Figure1a. An alignment of vertices also induces the alignment of edges; the edge in one network is said to be aligned to the edge in the other network if the vertices they connect are aligned to one another. The aim of a *graph alignment* is to align vertices that descend from a common ancestor.

Several graph alignment methods have been proposed towards this goal, based on three main ideas: The alignment can be based on the similarity of vertices, and map vertices onto each other that, e.g., share a certain sequence similarity (if vertices represent genes or proteins) or if aligned enzymes catalyze the same reaction (if vertices represent enzymes in a metabolic network). This approach allows identification of ancestral networks[14], network parts enriched in conserved edges[10, 12, 16], or selection between paralogous genes[13].

A second and complementary approach focuses on the topology of the graphs and disregards sequence information or other properties of the vertices. It searches for similar topological structures in two graphs, for instance by maximizing the number of aligned edges. This approach has been used, for example, to detect common regulatory motives in gene regulatory networks[18, 19] or to perform global network alignment[20].

A third strategy relies *both* on information encoded in vertices and in edges. This “hybrid” and more comprehensive approach compares graphs based on the evolution of both vertices and edges. The key problem is the relative weight given to the similarity of vertices and to the similarity of edges when constructing the alignment. Several algorithms have been proposed[11, 21–27], which generally use ad hoc scoring parameters. Two exceptions are *GraphAlignment*[28] and *Græmlin 2.0* (hereafter *Græmlin*,[22]), which use parameters inferred from a training set or from an initial alignment of high-fidelity vertices (*Græmlin, GraphAlignment*), or in an iterative scheme (*GraphAlignment*). Here we describe a software package implementing the GraphAlignment algorithm.

The scoring parameters may indeed be inferred from a training dataset formed by a library of known orthologous genes and their interactions. This approach would be conceptually similar to the inference of the BLOSUM matrices[29] used for biological sequence comparison. As bio-molecular networks differ in many aspects, including experimental techniques and post-processing methods, no such parametrisation is available for their comparison. The parameters, however, can be also inferred from the actual data being aligned, similarly to the inference of the optimal affine gap penalties from the sequences being compared[30, 31]. The ability to infer principled scoring parameters directly from the data is essential.

Further methods are developed that incorporate additional information resources to perform network alignment. The global network alignment method PINALOG[32] incorporates functional annotation of proteins in addition to their sequence and network topology. DOMAIN algorithm uses protein domains, rather than proteins, to form the interaction network[33]. Several above mentioned methods perform also multiple-species alignment and either use or infer phylogeny (e.g.,[20, 22, 34]). Methods for querying large networks for small subgraphs, e.g, pathways or protein complexes, have been also developed[35–37], reviewed in[38].

*GraphAlignment* differs from the above approaches[11, 21–27] by two key features: (a) An explicit model of network evolution is used to infer alignment parameters from the data. (b) Based on this evolutionary model, networks are aligned using a probabilistic scoring system. We compare our software and *Græmlin* as the only algorithms that can automatically score both sequence and network information. To that end we perform the simplest task, pairwise alignment.

For case studies applying our approach to mammalian gene co-expression networks and to herpesviral protein-protein-interaction networks, see[28] and[31]. An overview of related methods for probabilistic network analysis is given in ref.[39].

## Implementation

The input of the algorithm are two networks, and mutual similarities of their vertices. The algorithm treats the networks *G* and *G*^{′} symmetrically, thus comparison of *G* with *G*^{′} will result in the same alignment as comparison of *G*^{′} with *G*. Each network *G* is represented by an adjacency matrix **A**, whose entries *A* specify the edge between vertices i and j: The entries of the adjacency matrix may be binary, with *A*_{
ij
} = 1 indicating the presence of an edge between i and j, and *A*_{
ij
} = 0 its absence. They may be continuous, e.g., to describe weighted edges in gene co-expression networks. Adjacency matrices may be symmetric, thus describing undirected networks (e.g., gene co-expression networks), or asymmetric for directed networks (e.g., metabolic networks). The mutual similarity between vertices in the two networks is specified by matrix **Θ**, whose entries${\theta}_{i{i}^{\prime}}$ quantify, for example, the overall sequence similarity between the gene represented by vertex *i* in one network and the gene represented by vertex i^{′} in the other. Any other measure of the vertex similarity is possible and may be given in arbitrary units (Figure1b). The algorithm will infer appropriate scoring automatically based on available data.

The alignment scoring is based on an explicit model which incorporates evolutionary dynamics of both edges and vertices. We first focus on the evolutionary dynamics of the edges. Consider a pair of vertices *i,j* in one network and its orthologs *i*^{′},*j*^{′} in the second network. At speciation, the edge states a ≡ *A*_{
ij
} and${a}^{\prime}\equiv {A}_{{i}^{\prime}{j}^{\prime}}^{\prime}$ in the two networks take on the same value. Subsequently, their correlation will decay and the joint probability Q_{τ}(a,a^{′}) will tend to a product of independent probabilities P(a)P^{′}(a^{′}) in the limit of large times τ. (See[28] for an explicit model based on the Fokker-Planck equation.) The corresponding log-likelihood score contribution from the pair of edges

tends to zero in the limit$\tau \to \infty $, as then the edge states carry no information on their shared ancestry, and, hence, the edges states *a* and *a*^{′} carry no information on whether *i* should be aligned with *i*^{′}and *j* with *j*^{′}.

Analogous considerations for the evolutionary dynamics of the similarity of vertices leads to a scoring function for vertex similarity[28, 31]: at speciation, vertex *i* in one network and its ortholog *i*^{′} in the second network do not differ. With increasing time τ since speciation, their vertex similarity *θ* will decrease and the distribution function${Q}_{\tau}^{o}\left(\theta \right)$ will approach some background distribution P(*θ*). Likewise, with divergence of the two networks, the distribution function${Q}_{\tau}^{u}\left(\theta \right)$ of the similarities${\theta}_{i{j}^{\prime}}$ between unrelated vertices *i* and *j*^{′}will approach P(*θ*). As$\tau \to \infty $, the corresponding log-likelihood scores

which reflects vertex similarity of the orthologs *i* and *i*^{′}, and

with j^{′} ≠ i^{′}, which weighs the presence of vertex similar pairs that are not orthologous, tend to zero, and the vertex similarities${\theta}_{i{i}^{\prime}}$ and${\theta}_{i{j}^{\prime}}$ convey no information on alignment of *i* and *i*^{′}. The background distribution P(*θ*) may be obtained as the distribution of vertex similarities between vertices that emerged or disappeared in one of the networks after the speciation. The similarity of vertices itself may be evaluated as sequence similarity for vertices representing genes or proteins (in gene co-expression networks and protein-protein interaction networks, respectively) or by the measure of functional similarity for vertices representing enzymes (in metabolic networks).

Given an alignment$\mathcal{A}$, the total alignment score$S\left(\mathcal{A}\right)={S}_{e}\left(\mathcal{A}\right)+{S}_{v}\left(\mathcal{A}\right)$ is formed by contributions from all aligned vertices and edges. The edge score${S}_{e}\left(\mathcal{A}\right)$ sums contribution of aligned edges:

The vertex score${S}_{v}\left(\mathcal{A}\right)$ sums contributions from the aligned vertices and the contributions from the pairs of vertices that are not aligned[28, 31]:

The parameters of the scoring function, i.e, s_{edge}, s_{aligned} and s_{not-aligned}, depend on the evolutionary dynamics of both edges and vertices since speciation. To infer these parameters from the data, we use a simple iterative approach[28]: Starting with an initial alignment, parameters are estimated so that the likelihood of the alignment is maximised. The algorithm then iterates the steps of (i) aligning the graphs using the estimated parameters and (ii) estimating the maximum likelihood parameters until convergence. Upon convergence, the algorithm returns both the optimal scoring parameters and the corresponding best alignment of the networks. The package GraphAlignment features built-in functions that establish the maximum-likelihood scoring parameters according to this scheme. The ability to find the appropriate scoring parameters from the studied graphs is unique to GraphAlignment, with a notable exception of Græmlin[22].

To find high-scoring graph alignments in step (i), we use an iterative heuristic described in[28]. This procedure is based on mapping to the quadratic assignment problem, solved iteratively by calls to a linear assignment solver, with added noise to help the alignment to escape from local score maxima, as in simulated annealing[40].

## Results and discussion

In Berg and Lässig[28] and Kolář et al.[31], our algorithm has been applied to gene co-expression networks and small protein-protein interaction networks. Here, we concentrate on evaluation of the computational complexity of the algorithm and comparison of its accuracy to the Græmlin algorithm[22], which is the only other algorithm able to infer principled scoring parameters automatically. We use both simulated and empirical bio-molecular data.

### Alignment of simulated networks

While experimental data provide the ultimate test set for the algorithms, and we will use them in the following section, we do not know the true evolutionary history of the networks and thus, we cannot assess the accuracy of the aligners fully. To that end we use simulated data. In the numerical experiment, pairs of orthologous vertices (orthologs) are assigned from the outset and, depending on the level of divergence, may have retained their vertex similarity (vertex homologs), interaction similarity (topological homologs or analogs) or both.

GraphAlignment and Græmlin are able to infer the scoring parameters either from a training set of known orthologous genes and their interactions or from some valid initial alignment of the actual network data being aligned. Here, we concentrate on the latter option. Both algorithms are given the same initial alignment of the networks that is formed by vertices with high vertex and topological similarity, and the parameters are inferred from this initial alignment.

We assess the computational cost and accuracy in three different scenarios which test three different aspects of the algorithms. In all the scenarios, we construct pairs of networks which contain 80% of orthologous vertices and 50% of all possible edges present. In scenario (i) we compare two networks with a substantial proportion of vertex homologs and a smaller set of analogous vertices, i.e., vertices that do not have any vertex similarity, yet they are, by their interactions, well anchored to the subnetworks consisting of vertex-orthologous vertices. Thus this scenario tests the ability of the algorithm to identify analogous vertices by properly evaluating the edge (interaction) similarity. We implement the scenario (i) by networks with 60%-interaction similarity between the orthologous pairs and with 62.5% of the orthologous pairs (50% of all vertices) having also a high vertex similarity. The interaction terms are randomly chosen from a uniform distribution and may be interpreted as edge weights or probabilities of the edge existence. We also assessed the scenario (i) with interaction terms selected from a normal distribution and obtain similar results (Additional file1). An example of the corresponding Θ(i,i^{′}) matrix of vertex similarities and correlation matrix of interaction similarities is given in Additional file1: Figure S3(i, ia).

In scenario (ii), we test whether the algorithm is able to decide on an ortholog between two paralogous vertices. Specifically, we ask whether the algorithm is able to decide between two vertices in G^{′} with equal vertex similarity to i in G, one of which has also interaction similarity with i (the true ortholog) and the other shares no interactions (the spurious ortholog). We implement this scenario similarly to scenario (i) with 12.5% of the orthologs (10% of all vertices) having a paralog with no topological similarity. An example of the corresponding similarity structures is given in Additional file1: Figure S3(ii).

Scenario (iii) derives from scenario (ii) but adds spurious weak vertex similarity between randomly chosen pairs of vertices. Thus, this scenario tests the robustness of the algorithms to intrinsic noise in the biological data. An example of the corresponding similarity structures is given in Figure2.

#### Computational complexity

To evaluate the typical computational costs of *GraphAlignment* and *Græmlin*, we generate pairs of symmetric random networks of the same size, *N*∈[50,10^{4}], and the corresponding similarity structures. Then, we test the two algorithms on the same dataset and measure the total CPU time used to fit the scoring parameters and to find the optimal graph alignment. Both algorithms are run on a Linux box with Intel Xeon at 3GHz with standard parameters (*GraphAlignment*: Scoring parameters are estimated by built-in functions from the initial alignment of the orthologs with high vertex similarity and the algorithm is run with standard settings. *Græmlin 2.0*: Scoring parameters are estimated according to the README file using the same set of vertices as in *GraphAlignment*. The algorithm is run with standard settings. For the code used, see Additional file1: Figures S1 and S2). The results are summarised in Figure3. In scenarios (i) and (ii) *Græmlin*’s computational costs scale roughly quadratically ($\mathcal{O}\left({N}^{1.97\pm 0.02}\right)$) with the network size *N*, while *GraphAlignment*’s costs grow as$\mathcal{O}\left({N}^{2.45\pm 0.05}\right))$ and$\mathcal{O}\left({N}^{2.61\pm 0.04}\right)$, respectively. The algorithms finish the calculations of networks with the size *N* = 500 within the same time period, with *Græmlin* being faster on larger networks and *GraphAlignment* on smaller ones. However, addition of the spurious weak vertex similarities in scenario (iii) severely compromises *Græmlin*’s performance by changing its typical-case complexity to$\mathcal{O}\left({N}^{2.63\pm 0.07}\right)$, so that a calculation for networks of size *N* = 10^{4} has not been concluded in two weeks. The performance of *GraphAlignment* remains good, with all calculations finished within a week of CPU time.

The typical-case computational cost of *GraphAlignment* is smaller than its theoretical worst-case complexity, which is dominated by the computational costs of the linear assignment solver[41] and by conversion of the edge score to an instance of the linear assignment problem. The overall worst-case complexity of the algorithm is$\mathcal{O}\left({N}^{3}\right)$.

#### Accuracy

Both algorithms studied here rely on the initial alignment of high-fidelity vertices, which in our numerical experiment are represented by the orthologs with high vertex and topological similarity, and on inference of the scoring parameters from this initial alignment. Thus, it is not surprising that both algorithms correctly identified these orthologs in virtually all cases (corresponding to green diagonals in Figure2). The algorithms differ, however, in their ability to align analogs (orthologs with no vertex similarity and high topological similarity in scenarios (i-iii)) and to decide on the true ortholog between two paralogs in scenarios (ii) and (iii).

While *GraphAlignment* performs pairwise alignment of the networks and its results are straightforwardly interpretable, *Græmlin* groups the vertices from both networks into equivalence classes which may contain several vertices from each network. When interpreting *Græmlin*’s results, there are two options to consider the vertices correctly aligned. We can consider the matching vertices of the two networks to be correctly aligned when they are in the same equivalence class *a* nd there is no other vertex in the class (*the strict rule*), or we can consider them correctly aligned whenever they are in the same equivalence class (*the relaxed rule*). It is worth noting that in scenarios (ii) and (iii) the relaxed rule will consider the vertex correctly aligned even if the equivalence class contains both its homologous paralogs and the alignment actually does not decide on the correct partner. A vertex is considered misaligned when it is in an equivalence class (of size greater than 1) where its matching vertex is not present. If the class contains vertices from a single graph only, these are not considered misaligned.

In scenario (i), there are only three types of vertex pairs: pairs with strong vertex and topological similarity, pairs with topological similarity only and pairs with no similarity between the networks. The first two groups, the orthologs, can be aligned thanks to the information stored in the similarity matrix **Θ** and the correlations of the adjacency matrices *A* and *A*^{′}, see Additional file1: Figure S3. Thus we call them *alignable* vertices. It is not possible to align the other vertices as there is no information available on those vertices. Figure4 shows the accuracy of the algorithms in scenario (i): *Græmlin*, according to both strict and relaxed rules, aligns only orthologs with both vertex and topological similarity and no other vertices. *GraphAlignment* aligns a large proportion of the analogous vertices and in the case of networks of size greater than 500, all of them. None of the algorithms misaligns any vertices.

Paralogous vertices in scenario (ii) can be considered an easier task to resolve, as among *N* possible alignment partners, there are only two partners with some vertex similarity and, of them, just one also shares topological similarity with its ortholog. *GraphAlignment* aligns the matching vertices in virtually all tested instances of the problem. On the other hand, *Græmlin* correctly forms equivalence classes for the three vertex-similar vertices, as revealed by perfect performance according to the relaxed rule; however, it does not decide between the paralogous vertices as in the equivalence classes all three vertices are always present, Figure5(ii). Also in the second scenario *GraphAlignment* does not misalign any vertex, Figure6(ii), while *Græmlin* misaligns 5% of the vertices due to unresolved paralogous vertices.

Addition of the spurious terms into the vertex similarity matrix *θ* in scenario (iii) does not influence the accuracy of *GraphAlignment* but decreases accuracy of the *Græmlin* algorithm, which is not able to form the equivalence classes correctly anymore and misaligns many vertices, see Figures5(iii) and6(iii).

### Alignment of empirical bio-molecular networks

To compare the performance of *GraphAlignment* and *Græmlin* on diverse bio-molecular networks, we have downloaded publicly available datasets of bacterial and eukaryotic protein-protein interaction networks (PIN) and gene co-expression networks. We let the algorithms compare PIN of proteobacteria *Escherichia coli*, *Caulobacter crescentus* and *Campylobacter jejuni*, and of yeast *Saccharomyces cerevisiae*, mouse and human. Next, we employ the algorithms to compare gene co-expression networks of gamma-proteobacteria *Escherichia coli*, *Salmonella enterica* and *Shewanella oneidensis* and a firmicute, *Bacillus subtilis*. The specificity and coverage of the resultant alignments are tested against the orthologous groups defined in the eggNOG database v3.0[42].

Protein sequences of all species have been downloaded from the eggNOG database. PIN of the bacterial species have been downloaded from the STRING database v9.0[43]. Human and murine PIN have been obtained from the IntAct database v3.1 ([44], accessed on August 6, 2012). Only high-confidence experimental interactions are kept (STRING: score ≥ 0*.* 7, IntAct: miscore ≥ 0*.* 35, no spoke-expanded interactions). To diversify the entering data, the PIN and protein sequences of human have been downloaded from the Additional file of the reference[45], and the yeast PIN and protein sequences from the Additional file of the reference[46] and the Saccharomyces genome database (http://www.yeastgenome.org,, accessed on August 8, 2012)[47], respectively.

To create the gene co-expression networks, we have downloaded large gene expression compendia of *Escherichia coli*, *Salmonella enterica* and *Bacillus subtilis* from the Colombos database ([48], accessed on August 31, 2012). The database contains 2369, 925, and 397 carefully normalised expression profiles, respectively. Further, we use gene expression compendia of *Escherichia coli* and *Shewanella oneidensis* downloaded from the Many Microbe Microarrays Database (*M*^{3D},[49], accessed on September 6, 2012), which contain 907 and 245 expression profiles, respectively. Gene–gene co-expression levels are estimated by absolute Spearman rank correlation. Values lower than 0.5 are hard-thresholded to 0, except for the datasets from *M*^{3D}, which are thresholded at 0.8 and 0.85, respectively. All final correlation coefficients are statistically significant (Storey’s *q* < 0*.* 001). Only the genes detected in at least 75% of the profiles are evaluated.

The sequence similarity is estimated for each comparison by a pairwise local sequence alignment of protein sequences using BLAST[50]. All hits with e-value lower than 10^{−10} are considered. The BLAST scores are used as the measure of vertex similarity **Θ** provided to *GraphAlignment* and *Græmlin*. The orphan proteins/genes that both have no BLAST hit in the other species and are not connected in the bio-molecular network are not considered in the analysis. Table1 summarizes the resultant networks.

#### Computational complexity

We evaluate the overall CPU time used by the algorithms to fit the scoring parameters and to perform the actual alignment. To define the training set for the parameter estimation, we find the eggNOG orthologous groups present in both aligned species. From these groups we randomly select one half. The proteins belonging to the selected orthologous groups and the interactions between them are then used as the training set. Both algorithms are allotted the same set and the scoring parameters are estimated by standard routines, as in case of the simulated networks. To align the networks, the algorithms run with standard settings, see Additional file1: Figures S1 and S2. Figure7 summarizes the computational complexity of the computations: As in the case of the simulated networks (scenarios (i) and (ii)), *Græmlin*’s computational costs scale roughly quadratically ($\mathcal{O}\left({N}^{1.8\pm 0.2}\right)$), while ** GraphAlignment**’s costs grow rather cubically as$\mathcal{O}\left({N}^{3.0\pm 0.2)}\right)$. The algorithms finish the calculations on small bacterial networks within comparable intervals;

*Græmlin*is significantly faster on larger eukaryotic networks.

#### Accuracy

To determine the quality of the resultant alignments, we estimate their sensitivity and coverage. As there is no gold standard with which to compare the results, we define *sensitivity* as the fraction of the aligned pairs, or *Græmlin* equivalence classes, which share the eggNOG orthologous group among all aligned pairs or classes. This measure of sensitivity is intrinsically biased, as the eggNOG orthologous groups are based on sequence comparison. Thus, the vertices which are orthologous, yet their sequences have diverged beyond recognition by the methods used to construct the eggNOG orthologous groups, do not contribute to this measure. We define *coverage* as the fraction of the eggNOG orthologous groups shared by the two species and correctly identified by the network alignment. Specifically, for *GraphAlignment*, let *NA* be the number of aligned pairs and *NC* be the number of the correctly aligned pairs in which the vertices (proteins or genes) belong to the same orthologous group as defined by eggNOG. Let *NO* be the total number of orthologous groups shared by the vertices of the networks being compared. Then, we define the sensitivity as *NC*/*NA* and coverage as *NC*/*NO*. For *Græmlin*, we define *NA* as the number of equivalence classes in which both species are represented. As in case of the simulated networks, we consider two rules for counting the number of correctly aligned equivalence classes *NC*: an equivalence class is correctly aligned either when all vertices are in the same eggNOG orthologous group *and* there is no vertex belonging to a different orthologous group in the class (*the strict rule*), or we consider the class correctly aligned whenever any two vertices belong to the same orthologous group (*the relaxed rule*). As the relaxed rule cannot decide between protein families, we will concentrate on the strict rule. Definition of the sensitivity and coverage remain the same.

We summarize the results on PIN in Table2: On the bacterial networks *GraphAlignment* slightly outperforms *Græmlin* both in sensitivity and coverage, considering the strict rule. Both algorithms reach sensitivity of more than 65% and coverage of more than 90%. While comparing the eukaryotic PIN, *Græmlin* outperforms *GraphAlignment* on the IntAct-derived human and murine networks. Further, *GraphAlignment* significantly lags behind *Græmlin* comparing the human and yeast literature-based networks. Considering the contributions of the edge and node score, see Table2, we see that the alignment provided by *GraphAlignment* is in that case dominantly driven by the edge score. This contrasts with the situation in comparing the other PIN networks, where the contributions are either even or dominated by the node score. The algorithm clearly overestimates the edge conservation rate between vertices with low sequence homology, which is inferred from the edge conservation rate between the orthologous vertices in the training set. That may have two reasons: Either the protein interaction data are biased in a way that is not compatible with the *GraphAlignment* Bayesian model, or different rates of interaction divergence occur between high-confidence orthologs (the training set) and proteins with low sequence similarity. Different rates of protein-protein interaction conservation depending on sequence similarity have indeed been documented recently[51]. The situation does not appear in the alignment produced by *Græmlin*, which places more weight on vertex similarity, as we saw in the previous section.

When considering the gene co-expression networks, we observe very similar performance of *GraphAlignment* and *Græmlin*. The former algorithm provides better coverage (by at least 5%), while the latter shows slightly better sensitivity, with the exception of the comparison of *Escherichia coli* and *Salmonella enterica*, in which *GraphAlignment* has both better coverage and sensitivity. See Table3 and Additional file1: Table S1 for the summary of the results.

## Conclusions

Here we describe a software package for alignment of biomolecular networks based on a hybrid method developed in[28], *GraphAlignment*, and compare it to the algorithm *Græmlin 2.0*. We find advantages on both sides: the standalone *Græmlin* is able to perform multiple network comparisons and provides additional functionalities, e.g., clustering. As revealed on simulated data, ** GraphAlignment** outperforms

*Græmlin*in the use of interaction information for network alignment. We attribute the observed differences to the full use of interaction information: when an edge between a pair of aligned nodes is absent in both networks,

*GraphAlignment*will typically reward the alignment of the nodes by a small score;

*Græmlin*does not consider this piece of information. Consequently,

*Græmlin*tends to align dense conserved clusters. This behaviour is advantageous for detection of such clusters, but may not be optimal in global alignment of sparse networks.

Comparison of empirical bacterial protein-protein interaction networks shows that *GraphAlignment* performs slightly better than *Græmlin* considering both sensitivity and coverage. Comparing the interaction networks of human and mouse based on the IntAct database, the situation is reversed. Moreover, we have observed limitations of the *GraphAlignment* algorithm in comparison of yeast and human protein-protein interaction networks, where the performance of the algorithm is decreased, most probably because the Bayesian scheme cannot deal with biased data or with the heterogenous rate of edge dynamics. On bacterial gene co-expression networks, *GraphAlignment* provides better coverage than *Græmlin*, while the sensitivity of both algorithms is similar. Considering the computational complexity, *GraphAlignment* is as efficient as *Græmlin* on small bacterial networks, while it lags significantly on large eukaryotic networks.

The simplicity and generality of *GraphAlignment* edge scoring makes this algorithm an appropriate choice for global alignment of networks. The underlying model is independent of the interpretation of edge weights, i.e., whether these weights represent probabilities of interaction between adjacent vertices or measure interaction strength. Since the algorithm is based on a well-defined evolutionary model, its parameters can be optimized by Bayesian methods. The *GraphAlignment* procedure of data input, estimation of scoring parameters and alignment of the networks is thoroughly documented in the package vignette, which also contains example sessions. Furthermore, we have shown that *GraphAlignment* is more robust to noise, an intrinsic factor of biological data, which is represented in our simulated data by spurious vertex similarities.

## Availability and requirements

The *GraphAlignment* algorithm is provided as an R package available from Bioconductorhttp://www.bioconductor.org and runs on all major platforms. Computationally intensive routines are coded in C. The software package can be used freely and with no restrictions for non-commercial purposes. It contains a code implementing the Jonker-Volgenant algorithm[41] to solve linear assignment problems. The code was written by Roy Jonker, MagicLogic Optimization Inc. and is copyrighted, 2003 MagicLogic Systems Inc., Canada. The code may be used freely for non-commercial purposes. For full details see the package vignette, the web pagehttp://www.thp.uni-koeln.de/∼berg/GraphAlignment and the case studies[28, 31].

## References

- 1.
Ogata H, Goto S, Sato K, Fujibuchi W, Bono H, Kanehisa M: KEGG: Kyoto Encyclopedia of Genes and Genomes. Nucleic Acids Res. 1999, 27: 29-34. 10.1093/nar/27.1.29.http://nar.oxfordjournals.org/content/27/1/29.abstract, 10.1093/nar/27.1.29

- 2.
Stuart JM, Segal E, Koller D, Kim SK: A gene-coexpression network for global discovery of conserved genetic modules. Science. 2003, 302 (5643): 249-255. 10.1126/science.1087447. [http://www.sciencemag.org/cgi/content/abstract/302/5643/249] 10.1126/science.1087447

- 3.
Phillips DC: The development of crystallographic enzymology. British Biochemistry, Past and Present. Edited by: Goodwin TW. 1970), (Academic Press, London,, pp. 11-28.

- 4.
Amitai G, Shemesh A, Sitbon E, Shklar M, Netanely D, Venger I, Pietrokovski S: Network Analysis of Protein Structures Identifies Functional Residues. J Mol Biol. 2004, 344 (4): 1135-1146. 10.1016/j.jmb.2004.10.055. [http://www.sciencedirect.com/science/article/pii/S0022283604013592] 10.1016/j.jmb.2004.10.055

- 5.
Uetz P, Dong YA, Zeretzke C, Atzler C, Baiker A, Berger B, Rajagopala S, Roupelieva M, Rose D, Fossum E, Haas J: Herpesviral protein networks and their interaction with the human proteome. Science. 2006, 311: 239-242. 10.1126/science.1116804.

- 6.
Képès F: Biological networks. 2007), (World Scientific, Singapore

- 7.
Pevsner J: Bioinformatics and Functional Genomics. 2009), (John Wiley & Sons, New Jersey

- 8.
Wagner A: How the global structure of protein interaction networks evolves. Proc R Soc London. Series B: Biol Sci. 2003, 270 (1514): 457-466. 10.1098/rspb.2002.2269.http://rspb.royalsocietypublishing.org/content/270/1514/457.abstract, 10.1098/rspb.2002.2269

- 9.
Wuchty S, Oltvai ZN, Barabási AL: Evolutionary conservation of motif constituents in the yeast protein interaction network. Nat Genet. 2003, 35: 176-179. 10.1038/ng1242.

- 10.
Kelley B, Sharan R, Karp R, Sittler T, Root D, Stockwell B, Ideker T: Conserved pathways within Bacteria and Yeast as revealed by global protein network alignment. Proc Natl Acad Sci USA. 2003, 100 (20): 11394-11399. 10.1073/pnas.1534710100.

- 11.
Pinter R, Rokhlenko O, Yeger-Lotem E, Ziv-Ukelson M: Alignment of metabolic pathways. Bioinformatics. 2005, 21: 3401-3408. 10.1093/bioinformatics/bti554.

- 12.
Sharan R, Suthram S, Kelley R, Kuhn T, McCuine S, Uetz P, Sittler T, Karp R, Ideker T: Conserved patterns of protein interaction in multiple species. Proc Natl Acad Sci USA. 2005, 102 (6): 1974-1979. 10.1073/pnas.0409522102.

- 13.
Bandyopadhyay S, Sharan R, Ideker T: Systematic identification of functional orthologs based on protein network comparison. Genome Res. 2006, 16: 428-435. 10.1101/gr.4526006.

- 14.
Pinney JW, Amoutzias GD, Rattray M, Robertson DL: Reconstruction of ancestral protein interaction networks for the bZIP transcription factors. Proc Nat Acad Sci. 2007, 104 (51): 20449-20453. 10.1073/pnas.0706339104. [http://www.pnas.org/content/104/51/20449.abstract] 10.1073/pnas.0706339104

- 15.
Beltrao P, Serrano L: Specificity and evolvability in eukaryotic protein interaction networks. PLoS Comput Biol. 2007, 3 (2): e25. 10.1371/journal.pcbi.0030025.

- 16.
Cootes A, Muggleton S, Sternberg M: The identification of similarities between biological networks: application to the metabolome and interactome. J Mol Biol. 2007, 369 (4): 1126-1139. 10.1016/j.jmb.2007.03.013.

- 17.
Papadimitriou CH, Steiglitz K: Combinatorial optimization: algorithms and complexity. 1998), (Dover Publications, Mineola, USA

- 18.
Kuchaiev O, Milenković T, Memišević V, Hayes W, Pržulj N: Topological network alignment uncovers biological function and phylogeny. J R Soc Interface. 2010, 7 (50): 1341-1354. 10.1098/rsif.2010.0063. [http://rsif.royalsocietypublishing.org/content/7/50/1341.abstract] 10.1098/rsif.2010.0063

- 19.
Trusina A, Sneppen K, Dodd I, Shearwin K, Egan J: Functional alignment of regulatory networks: a study of temperate phages. PLoS Comput Biol. 2005, 1 (7): e74. 10.1371/journal.pcbi.0010074.

- 20.
Kuchaiev O, Pržulj N: Integrative network alignment reveals large regions of global network similarity in yeast and human. Bioinformatics. 2011, 27: 1390-1396. 10.1093/bioinformatics/btr127.

- 21.
Bradde S, Braunstein A, Mahmoudi H, Tria F, Weigt M, Zecchina R: Aligning graphs and finding substructures by a cavity approach. EPL (Europhys Lett). 2010, 89 (3): 37009. 10.1209/0295-5075/89/37009. [http://stacks.iop.org/0295-5075/89/i=3/a=37009] 10.1209/0295-5075/89/37009

- 22.
Flannick J, Novak A, Do CB, Srinivasan BS, Batzoglou S: Automatic Parameter Learning for Multiple Local Network Alignment. J Comput Biol. 2009, 16 (8): 1001-1022. 10.1089/cmb.2009.0099.[PMID:19645599]http://www.liebertonline.com/doi/abs/10.1089/cmb.2009.0099, 10.1089/cmb.2009.0099

- 23.
Kalaev M, Bafna V, Sharan R: Fast and Accurate Alignment of Multiple Protein Networks. J Comput Biol. 2009, 16 (8): 989-999. 10.1089/cmb.2009.0136. http://www.liebertonline.com/doi/abs/10.1089/cmb.2009.0136 [PMID: 19624266] 10.1089/cmb.2009.0136

- 24.
Klau G: A new graph-based method for pairwise global network alignment. BMC Bioinf. 2009, 10 (Suppl 1): S59. 10.1186/1471-2105-10-S1-S59. [http://www.biomedcentral.com/1471-2105/10/S1/S59]

- 25.
Li Z, Zhang S, Wang Y, Zhang XS, Chen L: Alignment of molecular networks by integer quadratic programming. Bioinformatics. 2007, 23: 1631-1639. 10.1093/bioinformatics/btm156.

- 26.
Liao CS, Lu K, Baym M, Singh R, Berger B: IsoRankN: spectral methods for global alignment of multiple protein networks. Bioinformatics. 2009, 25 (12): i253—i258 [http://bioinformatics.oxfordjournals.org/content/25/12/i253.abstract]

- 27.
Zaslavskiy M, Bach F, Vert JP: Global alignment of protein–protein interaction networks by graph matching methods. Bioinformatics. 2009, 25 (12): i259—1267-[http://bioinformatics.oxfordjournals.org/content/25/12/i259.abstract]

- 28.
Berg J, Lässig M: Cross-species analysis of biological networks by Bayesian alignment. Proc Natl Acad Sci USA. 2006, 103 (29): 10967-10972. 10.1073/pnas.0602294103.

- 29.
Henikoff S, Henikoff JG: Amino acid substitution matrices from protein blocks. Proc Natl Acad Sci USA. 1992, 89: 10915-10919. 10.1073/pnas.89.22.10915.

- 30.
Yu YK, Hwa T: Statistical significance of probabilistic sequence alignment and related local Hidden Markov Models. J Comput Biol. 2001, 8: 249-282. 10.1089/10665270152530845.

- 31.
Kolář M, Berg J, Lässig M: From protein interactions to functional annotation: Graph alignment in Herpes. BMC Syst Biol. 2008, 2: 90. 10.1186/1752-0509-2-90. [http://www.biomedcentral.com/1752-0509/2/90] 10.1186/1752-0509-2-90

- 32.
Phan HTT, Sternberg MJE: PINALOG: a novel approach to align protein interaction networks—implications for complex detection and function prediction. Bioinformatics. 2012, 28: 1239-1245. 10.1093/bioinformatics/bts119.

- 33.
Guo X, Hartemink AJ: Domain-oriented edge-based alignment of protein interaction networks. Bioinformatics. 2009, 25 (12): i240—1246-[http://bioinformatics.oxfordjournals.org/content/25/12/i240.abstract]

- 34.
Singh R, Xu J, Berger B: Pairwise global alignment of protein interaction networks by matching neighborhood topology. Proc the 11th Annu Int Conference Res Comput Mol Biol (2007): Lecture Notes Comput Sci. 2007, 4453: 16-31. 10.1007/978-3-540-71681-5_2.

- 35.
Kelley BP, Yuan B, Lewitter F, Sharan R, Stockwell BR, Ideker T: PathBLAST: a tool for alignment of protein interaction networks. Nucleic Acids Res. 2004, 32: W83-W88. 10.1093/nar/gkh411.

- 36.
Shlomi T, Segal D, Ruppin E, Sharan R: QPath: a method for querying pathways in a protein-protein interaction network. BMC Bioinf. 2006, 7: 199. 10.1186/1471-2105-7-199.

- 37.
Pache RA, Céol A, Aloy P: NetAligner—a network alignment server to compare complexes, pathways and whole interactomes. Nucleic Acids Res. 2012, 40: W157—W161-

- 38.
Fionda V, Palopoli L: Biological Network Querying Techniques: Analysis and Comparison. J comput biol. 2011, 18: 595-625. 10.1089/cmb.2009.0144.

- 39.
Berg J, Lässig M: Bayesian analysis of biological networks: Clusters, motifs, cross-species correlations. Statistical and evolutionary analysis of biological networks. Edited by: Stumpf MPH, Wiuf C. 2009), (Imperial College Press, London, pp. 65-84.

- 40.
Kirkpatrick S, Gelatt CJ, Vecchi M: Optimization by Simulated Annealing. Science. 1983, 220: 671-680. 10.1126/science.220.4598.671.

- 41.
Jonker R, Volgenant A: A shortest augmenting path algorithm for dense and sparse linear assignment problems. Computing. 1987, 38: 325-340. 10.1007/BF02278710.

- 42.
Powell S, Szklarczyk D, Trachana K, Roth A, Kuhn M, Muller J, Arnold R, Rattei T, Letunic I, Doerks T, Jensen LJ, von Mering C, Bork P: eggNOG v3.0: orthologous groups covering 1133 organisms at 41 different taxonomic ranges. Nucleic Acids Res. 2012, 40: D284—9-

- 43.
Szklarczyk D, Franceschini A, Kuhn M, Simonovic M, Roth A, Minguez P, Doerks T, Stark M, Muller J, Bork P, Jensen LJ, von Mering C: The STRING database in 2011: functional interaction networks of proteins, globally integrated and scored. Nucleic Acids Res. 2011, 39 (Database issue): D561—8-

- 44.
Kerrien S, Aranda B, Breuza L, Bridge A, Broackes-Carter F, Chen C, Duesbury M, Dumousseau M, Feuermann M, Hinz U, Jandrasits C, Jimenez RC, Khadake J, Mahadevan U, Masson P, Pedruzzi I, Pfeiffenberger E, Porras P, Raghunath A, Roechert B, Orchard S, Hermjakob H: The IntAct molecular interaction database in 2012. Nucleic Acids Res. 2012, 40 (D1): D841—D846-[http://nar.oxfordjournals.org/content/40/D1/D841.abstract]

- 45.
Radivojac P, Peng K, Clark WT, Peters BJ, Mohan A, Boyle SM, Mooney SD: An integrated approach to inferring gene–disease associations in humans. Proteins: Struct, Funct, and Bioinf. 2008, 72: 1030-1037. 10.1002/prot.21989.

- 46.
Collins SR, Kemmeren P, Zhao XC, Greenblatt JF, Spencer F, Holstege FCP, Weissman JS, Krogana NJ: Toward a Comprehensive Atlas of the Physical Interactome of Saccharomyces cerevisiae. Mol and Cell Proteomics. 2007, 6: 439-450.

- 47.
Cherry JM, Hong EL, Amundsen C, Balakrishnan R, Binkley G, Chan ET, Christie KR, Costanzo MC, Dwight SS, Engel SR, Fisk DG, Hirschman JE, Hitz BC, Karra K, Krieger CJ, Miyasato SR, Nash RS, Park J, Skrzypek MS, Simison M, Weng S, Wong ED: Saccharomyces Genome Database: the genomics resource of budding yeast. Nucleic Acids Res. 2012, 40: D700—5-

- 48.
Engelen K, Fu Q, Meysman P, Sanchez-Rodriguez A, De Smet, Lemmens K, Fierro A, Marchal K: COLOMBOS: access port for cross-platform bacterial expression compendia. PLoS ONE. 2011, 6: e20938. 10.1371/journal.pone.0020938.

- 49.
Faith JJ, Driscoll ME, Fusaro VA, Cosgrove EJ, Hayete B, Juhn FS, Schneider SJ, Gardner TS: Many Microbe Microarrays Database: uniformly normalized Affymetrix compendia with structured experimental metadata. Nucleic Acids Res. 2008, 36 (suppl 1): D866—D870-[http://nar.oxfordjournals.org/content/36/suppl_1/D866.abstract]

- 50.
Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ: Basic local alignment search tool. J Mol Biol. 1990, 215 (3): 403-410. [http://www.sciencedirect.com/science/article/pii/S0022283605803602]

- 51.
Lewis ACF, Jones NS, Porter MA, Deane CM: What Evidence Is There for the Homology of Protein-Protein Interactions?. PLoS Comput Biol. 2012, 8 (9): e1002645. 10.1371.

## Acknowledgements

This work was supported by Deutsche Forschungsgemeinschaft [grants SFB 680, SFB-TR12, and BE 2478/2-1]; and by the Academy of Sciences of the Czech Republic [grant AV0Z50520514 to MK].

## Author information

### Affiliations

### Corresponding author

## Additional information

### Competing interests

Authors declare no competing interests.

### Authors’ contributions

All authors contributed equally to the work. All authors read and approved the final manuscript.

## Electronic supplementary material

**The Additional file 1 contains the codes used to generate the network instances and to find the optimal alignment by**

Additional file 1: *GraphAlignment***and** *Græmlin 2.0***, Figures S1 and S2.** Further, it contains Figure S3 with the matrix of vertex similarities *Θ*(*i*,*i*^{′})and the matrix of correlations between the edge weights of vertices *i* in *G* and *i*^{′} in *G*^{′} for the scenarios (i) and (ii). Figures S4 and S5 give the computational complexity and accuracy of the *GraphAlignment* and *Gæmlin* algorithms in scenario (ia) with the edge weights drawn from the normal distribution. Finally, Table S1 compares the *GraphAlignment* and *Græmlin* performance on empirical gene co-expression networks. (PDF 2 MB)

## Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

## Rights and permissions

**Open Access**
This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License (
https://creativecommons.org/licenses/by/2.0
), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

## About this article

### Cite this article

Kolář, M., Meier, J., Mustonen, V. *et al.* *GraphAlignment*: Bayesian pairwise alignment of biological networks.
*BMC Syst Biol* **6, **144 (2012). https://doi.org/10.1186/1752-0509-6-144

Received:

Accepted:

Published:

### Keywords

- Graph alignment
- Biological networks
- Parameter estimation
- Bioconductor