 Research
 Open Access
 Published:
An integrative approach for measuring semantic similarities using gene ontology
BMC Systems Biology volume 8, Article number: S8 (2014)
Abstract
Background
Gene Ontology (GO) provides rich information and a convenient way to study gene functional similarity, which has been successfully used in various applications. However, the existing GO based similarity measurements have limited functions for only a subset of GO information is considered in each measure. An appropriate integration of the existing measures to take into account more information in GO is demanding.
Results
We propose a novel integrative measure called InteGO 2 to automatically select appropriate seed measures and then to integrate them using a metaheuristic search method. The experiment results show that InteGO 2 significantly improves the performance of gene similarity in human, Arabidopsis and yeast on both molecular function and biological process GO categories.
Conclusions
InteGO 2 computes genetogene similarities more accurately than tested existing measures and has high robustness. The supplementary document and software are available at http://mlg.hit.edu.cn:8082/.
Background
The Gene Ontology (GO) provides a representation of biological knowledge through structured, controlled vocabulary of terms, which are interrelated forming a directed acyclic graph (DAG) for describing the functional information of gene products [1, 2]. GO consists of three categories that shared by all organisms: molecular function (MF), biological process (BP) and cellular component (CC) [1]. As a widely used bioinformatics resource, GO provides rich information and a convenient way to study gene functional similarity, which has been successfully used in various aspects including predicting gene functional associations [3], homology analysis [4], assessing target gene functions [5], and predicting subcellular localization [6].
Since GO was released, various computational measurements have been developed to compute gene functional similarities by comparing GO terms with which the genes are annotated [7–23]. These term comparison measurements can be classified into three categories based on the types of knowledge in GO that they used: edgebased, nodebased, and hybrid [18].
The measures in the edgebased category take the structure of GO into account [11, 12, 22]. By using the topological information of GO directed acyclic graph (DAG), a recently designed method Relative Specificity Similarity (RSS) models both the distance of given term pair to its closest leaf terms and the distance to their most recent common ancestor (MRCA) [22]. The edgebased measures, however, are still fully dependent on the topology of GO DAG, and it is inappropriate to simply equalize the terms at the same topological level [18].
In the nodebased category, methods originally designed for natural language processing [24–26] are utilized for term comparisons. In the earlier developed measures, the similarity of two GO terms is defined as the information content of their most informative common ancestor (MICA), indicating its specificity. It was further advanced by modeling the distance between a given term pair to its MICA [13]. The results show strong correlations with yeast gene coexpressions and protein sequence similarities [24, 27]. However, the nodebased measures only consider the annotations and common ancestors, neglecting the complex topology of the GO DAG.
Hybrid measurements have been recently proposed to consider the more complete information in GO. [15] utilizes all of the parent terms of the target terms, which takes the topology of the GO DAG into account. Hybrid Relative Specificity Similarity (HRSS) employs the concepts of information content, adapting topology, annotations and MICA [22]. The experiment results show that both Wang and HRSS measures perform better than the traditional nodebased measures [15, 22]. However, these measures still only focus on several types of information in GO but neglect others.
Since none of the existing measure can employ all the information in GO, an integrative approach to unite all the strength of existing measures is preferred. In this direction, [23] proposed a rankbased gene semantic similarity measure called InteGO by synergistically integrating multiple similarity measures (called seed measures) to take into account more aspects of GO (structure, annotation, MICA, MRCA, all of the common parent, etc). InteGO first selects measures based on an evaluation set, and then integrates the selected measures using one of four straightforward methods (maximum, minimum, average and median). The experiment results showed that InteGO performs significant better than the seed measures [23]. However, the performance of InteGO is still limited, because it is vulnerable to the selection of low performance measures, and its fixed integration strategy may not be suitable for all gene pairs.
In this paper, we aimed to present a new integrative measure called InteGO 2, by choosing the most appropriate seed measures for each gene pair from a pool of candidate measures using a grouping method, and by integrating the selected seed measures using a metaheuristic search method. The major contributions are:

* Our new integrative measure not only takes into account the stateoftheart GO based measures, but also selects the most appropriate seed measures for each gene pair.

* A metaheuristic search method is presented in InteGO 2 to flexibly integrate multiple seed measures.
Method
The framework of InteGO 2 is shown in Figure 1. The whole process includes two parts: 1) model training (right), in which the parameters of InteGO 2 are obtained using a training set T , and 2) genetogene similarity calculation (left) for the input gene set G. In InteGO 2, we solve two key problems, i.e, to select the most appropriate seed measures for each gene pair from all the candidate measures and to appropriately integrate the seed measures.
InteGO 2 has three steps. First, we calculate all the similarity scores using all the candidate measures and then rank them, resulting in a ranked matrix M_{ r } . Second, a grouping process is applied on M_{ r } to identify the common features of all the ranked results, with which we define a set of seed measures for each gene pair saved in S_{ seed }. Third, we integrate all the measures in S_{ seed } with an addition model, in which the parameter of each component is estimated by applying a learning process on training set T . We will introduce the three steps of InteGO 2 in the following text.
Step 1. Computing similarities using all measures
The similarity scores of all the gene pairs in a given gene set GS are calculated using all the candidate measures S_{ all }. And then for each measure, all the gene pairs are sorted incrementally according to their similarity scores, resulting in a ranked matrix M_{ r } , in which each row is a gene pair and each column is a measure, and M_{ r } (i, j) is the rank of gene pair i in measure j. Subsequently, the ranked gene similarity score RankSim(g_{1}g_{2}, m) for genes g_{1} and g_{2} in GS is calculated as:
where g_{1} and g_{2} are two target genes, m is a candidate measure in S_{ all }, GS is the number of genes in gene set GS, which according to Figure 1, is the input gene set G or the training set T . RankSim(g_{1}g_{2}, m) ∈ [0, 1]. RankSim(g_{1}g_{2}, m) indicates how similar g_{1} and g_{2} is, compared with all of the gene pairs in GS. Note that although the similarities using each measure may at a different scale or have a different distribution, the ranked results are comparable. Therefore, the integration of all the ranked results may better reflect functional similarity.
Step 2. Selecting seed measures
Since different similarity measures use different types of information in GO, or model data in different ways, one measure may perform the best on certain functional categories but not on the others. Alternatively, the integration of suitable measures makes it possible to calculate the overall similarity score by considering all the aspects of GO. A key problem here is to select the most appropriate measures (called seed measures) for every gene pair from a pool of candidate measures.
In this paper, we present a solution to this problem based on only one principle that the final ranked score should be the score that all the seed measures agree. To this end, a grouping algorithm to select the most appropriate seed measures for each gene pair is proposed as follows. Let RankSim(g_{1}, g_{2}, m_{1}), RankSim(g_{1}, g_{2}, m_{2}), …, RankSim(g_{1}, g_{2}, m_{ n }) be the ranked similarity scores of n candidate measures for g_{1} and g_{2}, and m_{ x } ∈ S_{ all }. By putting them on a number axis, we group all the candidate measures agglomeratively based on their distances on the axis, forming a dendrogram D(g_{1}g_{2}). And then we gradually reduce the distance threshold d in D(g_{1}g_{2}) to iteratively find the isolated measures and remove them until a core group of measures is leftover  which is called the seed measure group (see examples in Figure 2). Mathematically, a seed measure group is the largest group with at least c measures, where c is a predefined value (c = 3 in our settings; more detail about the choice of c is shown in Additional file 1). And the distance between genes in the seed measure group is not larger than ${d}^{\prime}$, where ${d}^{\prime}$ is a predefined value (${d}^{\prime}=0.10$in our settings; more detail about the choice of ${d}^{\prime}$ is shown in Additional file 2).For g_{1}g_{2}, only the measures in the seed measure group are considered as seed measures, saved in S_{ seed }.
An illustration example of the seed measure group is shown in Figure 2(a). In the figure, with the decrease of d from d_{1} to ${d}^{\prime}$, the isolated measures are in the order of m_{1}, m_{3}, m_{4}, and m_{5}, and the the seed measure group include m_{2}, m_{6}, m_{7}, and m_{8}.
It is clear that a seed measure group can be labeled as as high, low, or mix according to its distribution in the number axis. Mathematically, we define the label of a seed measure group using the highest number of the isolated measures in the leftmost, middle or rightmost of the number axis. For example, the seed measure group in Figure 2(a) is high, in Figure 2(b) is low, and in Figure 2(c) is mix. We label the seed measure groups, because the integration strategy could be different for different seed measure group types.
Step 3. Integrating seed measures
In order to integrate the selected seed measures, we adopt an addition model which is one of the best known method for integrating a number of alternatives [28]. Given a gene pair, we have learned its seed measures and the type of seed measure group from the previous step. For different types of seed measure groups, we build an addition model as shown in Eq. 2:
where type is the type of seed measure group; i is a seed measure in the seed measure group; RankSim(i) is the similarity of given gene pair calculated with measure i (Eq. 1); X_{ i } is the parameter of seed measure i, where X is H, M or L; max, min and ave represent the maximum, minimum and average of all the RankSim values for g_{1} and g_{2} using all the seed measures; and X_{ α }, X_{ β } , X_{γ} are their parameters respectively. We include maximum, minimum and average in the Eq. 2, because the experiment results in [23] show that maximal, minimal and average values are better than individual measure in the tested conditions.
In order to use Eq. 2 for seed measure integration, the parameters, e.g. X_{ α }, X_{ β } , X_{γ} , needs to be assigned. Instead of leaving the difficult job to the end users, we estimate these parameters using a training data T . Specifically, we adopt a metaheuristic search method to gradually update the parameters in Eq. 2 to maximize the score of an objective function in T .
There are a wide variety of metaheuristics, including simulated annealing, tabu search, iterated local search, variable neighborhood search, and greedy randomized adaptive search. It also includes a learning component to the search, such as ant colony optimization, evolutionary computation, and genetic algorithm. In this paper, we adopt the tabu search method. Comparing with a simple local search procedure, tabu search carefully explores the neighborhood of each solution through the use of memory structures (tabu list) to avoid sticking in the poorscoring areas or areas where scores plateau [29]. Specifically, given the training set T , we use the EC number (Enzyme Commission) to explain molecular function with the criteria that the molecular functions of a group of genes are similar if they have the same EC numbers [15, 30, 31]. Therefore, we can locate the best candidates of solutions for next move in the searching process.
Given all the genes in T grouped by their EC numbers, we compute both the intraEC gene similarities and the interEC gene similarities using Eq. 2 starting with a set of random parameters. We then gradually update the parameters to increase the difference between the intra and interEC similarities. Quantitatively, we utilize the logged fold change (LogFC) measure which has been widely used in the gene expression studies [32]. The LogFC score of EC number e_{ i }is defined in Eq. 3:
where G(e_{ i }) is set of all of genes which are assigned to e_{ i }; EC is a set of ECs which do not have any overlapped genes with e_{ i } (G(e_{ j } ) ∩ G(e_{ i }) = ∅) in the training set T ; and diff_{ g } (e_{ i }, e_{ j } ) is calculated as:
where c is a constant small positive number, as a Laplacian smoothing parameter; G(e_{ i }) is the set of all of the genes which EC number is e_{ i } except gene g; G(e_{ j } ) is the set of all of the genes which EC number is e_{ j } ; g is a gene assigned to e_{ i }. Sim(g, g^{′}, t) and Sim(g, g^{∗}, t) are defined in Eq. 2. In Eq. 4, the numerator and denominator represent the interEC distance and intraEC distance respectively. The higher the diff_{ g } (e_{ i }, e_{ j } ) is, the more obvious the positive difference between interEC difference and intraEC difference is.
Finally, given training set T grouped by a set of EC numbers, the optimization function for each tabu search move is the average LogFC score of all the involved EC numbers in the training set T :
Subsequently, we estimate the parameters in Eq. 2 using the following tabu search process (Figure 3):

1.
Initialize TL as the empty tabu list, and a set of random parameters in Eq. 2 as current solution s (starting point) satisfying ∑_{i∈MG}X_{ i } + X_{ α } + X_{ β } + X_{γ} = 1.0, where X is H, M , or L. The initial best solution is bs = s.

2.
Calculate the neighborhood solutions of s by increasing or decreasing one or multiple parameters in s. Note that we learn one group of parameters at a time. For example, while learning parameters for H_{ x }, the other two groups L_{ x } and M_{ x } are fixed.

3.
The best solution for next move s′ is selected from the neighborhood solutions of s using the optimization function (Eq. 5).

4.
If s′ > bs, let s′ be the current solution, update TL and bs = s′.

5.
If s′ ≤ bs, we still let current best solution s = s′ and update TL if s′ ∉ TL. Otherwise, we delete s′ from the neighborhood solutions and go back to step 3.

6.
Repeat step 2 to 5 till bs is stable.

7.
To avoid bias, we repeat step 1 to 6 multiple times and choose the best result.
Results
We evaluate InteGO 2 on three model organisms (human, Arabidopsis and Yeast) with different levels of GO annotation scale and complexity [33]. For each of them, we use EC numbers and pathways as independent biological evidences for molecular function and biological process category in GO respectively. Finally, we test the robustness of InteGO 2 by gradually removing seed measures with best performance.
Data preparation
The GO annotation and structure data were downloaded from the GO website (http://www.geneontology.org/GO.downloads.shtml). The EC number and pathway information of human, Arabidopsis and Yeast were downloaded from the HumanCyc (http://humancyc.org), PlantCyc (http://ftp.plantcyc.org/Pathways) and Saccharomyces genome database (http://www.yeastgenome.org/downloaddata/curation) respectively. InteGO 2 was implemented with Python 2.7 with NetworkX package (http://networkx.github.io).
Performance evaluation on molecular function
Proteins sharing the same EC numbers are considered to have similar molecular functions. For every manually curated pathway in human, Arabidopsis and yeast, we grouped the genes based on their EC numbers (full four digits) and tested the difference between the inter and intragroup genegene similarities. There are in total 125, 205 and 32 EC groups with least three genes in human, Arabidopsis and yeast respectively.
In the experiments, we chose seven widely used measures in all the three categories as candidate measures. We also added a fake measure to simulate the situation where a wrong measure was included to test the robustness of InteGO 2. Among the seven measures, SimUI [34] and TO [35] measure use the GO annotations information directly; Resnik [24], Schlicker [13] and SimGIC [36] measure use annotation information to calculate the information content of GO terms; Wang [15] measure considers the complex topology of GO; HRSS [22] considers the shared path based on information content. More detail description is shown in Additional file 3. In the fake measure, a random half of the similarity scores were computed with Resnik measure, and the other half were 1 or 0, such that the similarity of two genes with the same EC is 0, otherwise it is 1 (the reversed values ensure that the fake measure has low quality).
In order to evaluate InteGO 2 systematically, we adopted the crossvalidation strategy by randomly selecting 1/ 5 of human ECs as the testing set (200 genes involved) and the other 4/ 5 of human ECs being the training set (823 genes involved). The same training set was used for Arabidopsis and yeast (1151 and 121 genes involved respectively). Using the training set, the parameters in Eq. 2 were estimated, which were directly applied on the testing set to compute the ECbased LogFC scores using Eq. 5.
We found that the parameters for the three types of seed measure groups (high, low and mix) are significantly different, reflecting different integration strategies. The highest parameter in the high seed measure groups is maximum, in the low seed measure groups is minimum, and in the mix seed measure groups is simUI measure.
We compared the performance of InteGO 2 with all the candidate measures, the average value of them and InteGO. Figure 4 shows that InteGO 2 performed the best among all the measures in all the three species. For example, the median, 75th and 25th percentile of LogFC scores of InteGO 2 on human were 5.9, 6.9 and 4.5, significantly higher than the seed measures it integrated (Figure 4(a) and supplementary table S1 in Additional file 4). Interestingly, the performance of InteGO 2 was significantly higher than our previous measure InteGO, indicating that adding a weak measure has almost negligible effect to InteGO 2, but can significantly affect InteGO. Comparing the LogFC scores on every EC group using InteGO 2, InteGO and Wang measure (the best seed measure), we found that InteGO 2 performed the best in all 25 ECs in the testing set, while InteGO and Wang measure were being the best in 2 or 1 ECs only (Figure 5(a)). Similarly, the median of LogFC scores of InteGO 2 in Arabidopsis is 4.6, which is 1.5fold higher than InteGO (Figure 4(b) and supplementary table S2 in Additional file 4). InteGO 2 performed the best in 186 of 205 ECs, while Wang performed the best in 61 ECs (Figure 5(b)). We also evaluated InteGO 2 on yeast which has richer information in GO than human and Arabidopsis. InteGO 2 performed the best with the median LogFC score being 6.2 (Figure 4(c) and supplementary table S3 in Additional file 4). it was the best in 31 out of 32 total EC groups (Figure 5(c)).
Statistics analysis was carried out to test the significance of InteGO2 results. The pvalues of ttest indicate that the results of InteGO2 are significantly different with the results of other measures except simGIC, simUI and Wang measure on Arabidopsis and yeast (TTest, supplementary Table S4 in Additional file 4).
Performance evaluation on biological process
Given that genes annotated to the similar biological process may be involved in the same manually curated pathway, we grouped genes based on the pathway information, and on these gene groups we evaluated InteGO 2. There are in total 258, 154 and 141 pathways with at least two genes in humanCyc, PlantCyc and Saccharomyces genome database respectively.
The same LogFC method (Eq. 3) were used in the performance test. In human and Arabidopsis, the median and 75th percentile of LogFC scores of LogFC scores were higher than other measures (Figure 6(a), (b) and supplementary table S5 and S6 in Additional file 4), indicating that integrating multiple gene similarity measures with InteGO 2 could increase the overall performance. Comparing the LogFC scores from the InteGO 2, InteGO and Wang measure for each pathway, Figure 7(a) and (b) show that InteGO 2 performs best in 204 of 258 pathways and 81 of 154 pathways on human and Arabidopsis respectively. In yeast, the performance of InteGO 2 is still the best. The median, 75th percentile and 25th percentile of LogFC scores are 3.9, 5.0 and 2.3, which are significant higher than the secondbest measure InteGO (Figure 6(c) and supplementary table S7 in Additional file 4). In addition, InteGO 2 performs best in 132 of 141 (93.6%) yeast pathways (Figure 7(c)). Although InteGO 2 perform well in most datasets, its performance on Arabidopsis is not good enough (the median of LogFC score is around 1). The reason may be that all the result of seed measures are not good and very close to each other. Therefore, the grouping process (see subsection 2.2) in InteGO 2 cannot select the appropriate seed measures from the seed measure. Even though, InteGO 2 also increase the performance of the similarity measures.
Statistics analysis was carried out to test the significance of InteGO2 results. The pvalues of ttest indicate that the results of InteGO2 are significantly different with the results of other measures except simGIC, simUI and Wang measure on Arabidopsis (TTest, supplementary Table S8 in Additional file 4).
The results indicate that InteGO 2 successfully utilizes the GO information by integrating seed measures appropriately to better deliver functional similarities better genes.
Robustness of InteGO 2
To test the robustness of InteGO 2, we gradually removed a candidate measure (Wang, Schlicker, Resnik, simUI) and then compute the logFC score. Figure 8 shows that the performance reduced slowly by removing the first two measures (supplementary table S9 in Additional file 4). The median of LogFC decreased less than 1.0 after removing three best measures. This is because InteGO 2 can select the most appropriate seed measures for each gene pair, since no measurement is suitable for every gene pair. To analysis the contribution of the different measures to the overall similarity, we applied leaveoneout measure on InteGO2. The result shows that InteGO2 is overall robust to remove any integrated measure (Additional file 5). The performance of InteGO2 decreases most after Resnik measure is removed.
Performance evaluation on protein sequences
In addition to use the logFC score as the evaluation criteria, we used protein sequence similarity as an independent evidence for further performance evaluation on the molecular function category [18]. In this experiment, the same human gene set in subsection "Performance evaluation on molecular function" was used, and the sequence similarity scores (ln(BitScore)) were calculated with BLAST [37]. Figure 9 shows that among all the GO based semantic similarity measures, InteGO 2 has the highest correlation score with the sequence based similarity with RSquared 0.96 (polynomial model; Supplementary Table S10 in Additional file 4).
Generating functional association maps
Since InteGO 2 computes genetogene similarities more accurately than the tested existing measures, we computed the gene similarity scores for all the human, Arabidopsis and yeast genes on both molecular function and biological process GO categories, and generated a functional association map for each organism. As a demonstration, the human P540 [38] gene functional association map (Sim(g 1g 2) = 1.0) with 42 genes and 145 edges consists a tightly connected subgraph and several small or large but sparsely connected subgraphs (see Figure 10). These networks provide a new platform for more advanced biomedical researches which could be beneficial in medical diagnostics.
Conclusions
The calculation of GObased gene functional similarity has already been widely applied [3–6]. However, since the existing measurements only use a subset of the GO information (e.g., topology of DAG, annotations, MICA, edge length and all the parents term), the demand to integrate these measurements is compelling.
In this paper, we proposed a new integrative measure called InteGO 2 by automatically selecting the most appropriate seed measures and by integrating the seed measures using an addition model. First, we calculate the ranked similarity scores using all the measures. Second, seed measures are selected using a grouping process. Third, the parameters of the addition model are estimated by optimizing an objective function on a training data. Experimental results using ECs and pathways show that InteGO 2 performs the best among all the measures. It also shows that InteGO 2 is robust against the unavailability of candidate measures. Note that we have proposed InteGO in the previous work to unify different measures [23], which can be considered as a simplified case of InteGO 2.
To demonstrate the advantages of InteGO 2, we computed the gene similarity scores for all the human, Arabidopsis and yeast genes on both molecular function and biological process GO categories, and generated a functional association map for each organism. The new functional association maps, together with the existing biological networks, can be beneficial in medical diagnostics, and they also may provide more biological insights into gene function and regulation. In the future, we will apply InteGO2 to more organisms, data sets (such as proteinfamilybased index) and compare the new functional association maps with the existing biological network (such as proteinprotein network and genetic interaction network) to predict protein or genetic interaction based on the GO similarity scores.
References
 1.
Consortium GO: Gene Ontology annotations and resources. Nucleic acids research. 2013, 41: D530D535.
 2.
Blake J: Ten quick tips for using the gene ontology. PLoS computational biology. 2013, 9: e100334310.1371/journal.pcbi.1003343.
 3.
Vafaee F, Rosu D, BroackesCarter F, Jurisica I: Novel semantic similarity measure improves an integrative approach to predicting gene functional associations. BMC systems biology. 2013, 7: 2210.1186/17520509722.
 4.
Nehrt N, Clark W, Radivojac P, Hahn M: Testing the ortholog conjecture with comparative functional genomic data from mammals. PLoS computational biology. 2011, 7: e100207310.1371/journal.pcbi.1002073.
 5.
Lewis B, Shih I, JonesRhoades M, Bartel D, Burge C: Prediction of mammalian microRNA targets. Cell. 2003, 115: 787798. 10.1016/S00928674(03)010183.
 6.
Lu Z, Hunter L: GO molecular function terms are predictive of subcellular localization. PSB. 151
 7.
Lord P, Stevens R, Brass A, Goble C: Investigating semantic similarity measures across the Gene Ontology: the relationship between sequence and annotation. Bioinformatics. 2003, 19: 12751283. 10.1093/bioinformatics/btg153.
 8.
Cheng J, Cline M, Martin J, Finkelstein D, Awad T, Kulp D, SianiRose M: A knowledgebased clustering algorithm driven by gene ontology. Journal of biopharmaceutical statistics. 2004, 14: 687700. 10.1081/BIP200025659.
 9.
Couto F, Silva M, Coutinho P: Semantic similarity over the gene ontology: family correlation and selecting disjunctive ancestors. CIKM. 2005, 343344.
 10.
Bodenreider O, Aubry M, Burgun A: Nonlexical approaches to identifying associative relations in the gene ontology. PSB. 2005, 91
 11.
Wu H, Su Z, Mao F, Olman V, Xu Y: Prediction of functional modules based on comparative genome analysis and Gene Ontology application. Nucleic acids research. 2005, 33: 28222837. 10.1093/nar/gki573.
 12.
Yu H, Gao L, Tu K, Guo Z: Broadly predicting specific gene functions with expression similarity and taxonomy similarity. Gene. 2005, 352: 7581.
 13.
Schlicker A, Domingues F, Rahnenfhrer J, Lengauer T: A new measure for functional similarity of gene products based on Gene Ontology. BMC bioinformatics. 2006, 7: 30210.1186/147121057302.
 14.
Riensche R, Baddeley B, Sanfilippo A, Posse C, Gopalan B: Xoa: Webenabled crossontological analytics. IEEE Congress on Services. 2007, 99105.
 15.
Wang J, Du Z, Payattakool R, Philip S, Chen C: A new method to measure the semantic similarity of GO terms. Bioinformatics. 2007, 23: 12741281. 10.1093/bioinformatics/btm087.
 16.
Yu H, Jansen R, Stolovitzky G, Gerstein M: Total ancestry measure: quantifying the similarity in tree like classification, with genomic applications. Bioinformatics. 2007, 23: 21632173. 10.1093/bioinformatics/btm291.
 17.
del Pozo A, Pazos F, Valencia A: Defining functional distances over Gene Ontology. BMC bioinformatics. 2008, 9: 5010.1186/14712105950.
 18.
Pesquita C, Faria D, Falcao A, Lord P, Couto F: Semantic similarity in biomedical ontologies. PLoS computational biology. 2009, 5: e100044310.1371/journal.pcbi.1000443.
 19.
Othman R, Deris S, Illias R: A genetic similarity algorithm for searching the Gene Ontology terms and annotating anonymous protein sequences. Journal of biomedical informatics. 2008, 41: 6581. 10.1016/j.jbi.2007.05.010.
 20.
Yang H, Nepusz T, Paccanaro A: Improving GO semantic similarity measures by exploring the ontology beneath the terms and modelling uncertainty. Bioinformatics. 2012, 28: 13831389. 10.1093/bioinformatics/bts129.
 21.
Teng Z, Guo M, Liu X, Dai Q, Wang C, Xuan P: Measuring gene functional similarity based on group wise comparison of GO terms. Bioinformatics. 2013, 29: 14241432. 10.1093/bioinformatics/btt160.
 22.
Wu X, Pang E, Lin K, Pei Z: Improving the measurement of semantic similarity between gene ontology terms and gene products: Insights from an edgeand icbased hybrid method. PloS one. 2013, 8: e6674510.1371/journal.pone.0066745.
 23.
Peng J, Wang Y, Chen J: Towards integrative gene functional similarity measurement. BMC bioinformatics. 2014, 15: S5
 24.
Resnik P: Semantic similarity in a taxonomy: An informationbased measure and its application to problems of ambiguity in natural language. Journal of Artificial Intelligence Research. 1999, 11: 95130.
 25.
Jiang J, Conrath D: Semantic similarity based on corpus statistics and lexical taxonomy. ROCLING. 1997, 9008
 26.
Lin D: An informationtheoretic definition of similarity. CM. 1998, 98: 296304.
 27.
Sevilla J, Segura V, Podhorski A, Guruceaga E, Mato J, MartinezCruz L, Rubio A: Correlation between gene expression and GO semantic similarity. Computational Biology and Bioinformatics, IEEE/ACM Transactions on. 2005, 2: 330338. 10.1109/TCBB.2005.50.
 28.
Marler R, Arora J: The weighted sum method for multiobjective optimization: new insights. Structural and multidisciplinary optimization. 2010, 41: 853862. 10.1007/s0015800904607.
 29.
Glover F: Future paths for integer programming and links to artificial intelligence. Computers & Operations Research. 1986, 13: 533549. 10.1016/03050548(86)900481.
 30.
Karp P: Call for an enzyme genomics initiative. Genome biology. 2004, 5: 40110.1186/gb200458401.
 31.
DíazMejía J, PérezRueda E, Segovia L: A network perspective on the evolution of metabolism by gene duplication. Genome biology. 2007, 8: R2610.1186/gb200782r26.
 32.
Allison D, Cui X, Page G, Sabripour M: Microarray data analysis: from disarray to consolidation and consensus. Nature Reviews Genetics. 2006, 7: 5565. 10.1038/nrg1749.
 33.
Rhee S, Wood V, Dolinski K, Draghici S: Use and misuse of the gene ontology annotations. Nature Reviews Genetics. 2008, 9: 509515. 10.1038/nrg2363.
 34.
Gentleman R: Visualizing and distances using GO URL. [http://www.bioconductor.org/docs/vignettes.html]
 35.
Lee H, Hsu A, Sajdak J, Qin J, Pavlidis P: Coexpression analysis of human genes across many microarray data sets. Genome research. 2004, 14: 10851094. 10.1101/gr.1910904.
 36.
Pesquita C, Faria D, Bastos H, Falcao A, Couto F: Evaluating GObased semantic similarity measures. Annual BioOntologies Meeting. 2007, 3740.
 37.
Altschul S, Gish W, Miller W, Myers E, Lipman D: Basic local alignment search tool. Journal of molecular biology. 1990, 215: 403410. 10.1016/S00222836(05)803602.
 38.
Guengerich F: Cytochrome p450 and chemical toxicology. Chemical research in toxicology. 2007, 21: 7083.
Acknowledgements
This project has been funded by the U.S. Department of Energy, grant no. DEFG0291ER20021 to J.C; the National High Technology Research and Development Program of China grant (no. 2012AA020404 and 2012AA02A602) and the National Natural Science Foundation of China grant (no. 61173085) to Y. W.
Declarations
The publication costs for this article were funded by the corresponding author's institution.
This article has been published as part of BMC systems Biology Volume 8 Supplement 5, 2014: Proceedings of the 25th International Conference on Genome Informatics (GIW/ISCBAsia): Systems Biology. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcsystbiol/supplements/8/S5.
Author information
Affiliations
Corresponding authors
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
JC and YW designed the algorithm and experiments. JP and HL implemented the algorithm and finished the experiments. QJ helped to design the algorithm to find the seed measure group.
Jiajie Peng, Hongxiang Li contributed equally to this work.
Electronic supplementary material
12918_2014_1407_MOESM1_ESM.jpg
Additional file 1: The effect of varying the least size of the seed measure group on InteGO2 performance. The xaxis is the least size of the seed measure group. The yaxis is the LogFC scores. The top and bottom of the boxes represent 75th and 25th percentiles, red lines are the median, top and bottom whiskers represent greatest and lowest values except outliers. Cross nodes represent outliers that are larger than the sum of 75th and 1.5 interquartile range. (JPG 353 KB)
12918_2014_1407_MOESM2_ESM.jpg
Additional file 2: The effect of varying the threshold of the distance between genes in the seed measure group on InteGO2 performance. The xaxis is the threshold of the distance between genes in the seed measure group. The yaxis is the LogFC scores. The top and bottom of the boxes represent 75th and 25th percentiles, red lines are the median, top and bottom whiskers represent greatest and lowest values except outliers. Cross nodes represent outliers that are larger than the sum of 75th and 1.5 interquartile range. (JPG 332 KB)
12918_2014_1407_MOESM3_ESM.pdf
Additional file 3: The description of the integrated measures. Seven individual measures are described in this file. The reference papers of these measures are also listed. (PDF 201 KB)
12918_2014_1407_MOESM4_ESM.pdf
Additional file 4: Supplementary tables. All the supplementary tables (ten tables in total) are included in this file. (PDF 64 KB)
12918_2014_1407_MOESM5_ESM.jpg
Additional file 5: The effect of removing single integrated measure on InteGO2 performance. The xaxis is the individual measure removed. The yaxis is the LogFC scores. The top and bottom of the boxes represent 75th and 25th percentiles, red lines are the median, top and bottom whiskers represent greatest and lowest values except outliers. Cross nodes represent outliers that are larger than the sum of 75th and 1.5 interquartile range. (JPG 435 KB)
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.
The Creative Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Peng, J., Li, H., Jiang, Q. et al. An integrative approach for measuring semantic similarities using gene ontology. BMC Syst Biol 8, S8 (2014). https://doi.org/10.1186/175205098S5S8
Published:
Keywords
 Gene ontology
 Semantic similarity
 Integrative approach