Skip to main content

Advertisement

Volume 12 Supplement 7

From Genomics to Systems Biology

A hotspots analysis-relation discovery representation model for revealing diabetes mellitus and obesity

Article metrics

  • 731 Accesses

Abstract

Background

Nowadays, because of the huge economic burden on society causing by obesity and diabetes, they turn into the most serious public health challenges in the world. To reveal the close and complex relationships between diabetes, obesity and other diseases, search the effective treatment for them, a novel model named as representative latent Dirichlet allocation (RLDA) topic model is presented.

Results

RLDA was applied to a corpus of more than 337,000 literatures of diabetes and obesity which were published from 2007 to 2016. To unveil those meaningful relationships between diabetes mellitus, obesity and other diseases, we performed an explicit analysis on the output of our model with a series of visualization tools. Then, with the clinical reports which were not used in the training data to show the credibility of our discoveries, we find that a sufficient number of these records are matched directly. Our results illustrate that in the last 10 years, for obesity accompanying diseases, scientists and researchers mainly focus on 17 of them, such as asthma, gastric disease, heart disease and so on; for the study of diabetes mellitus, it features a more broad scope of 26 diseases, such as Alzheimer’s disease, heart disease and so forth; for both of them, there are 15 accompanying diseases, listed as following: adrenal disease, anxiety, cardiovascular disease, depression, heart disease, hepatitis, hypertension, hypothalamic disease, respiratory disease, myocardial infarction, OSAS, liver disease, lung disease, schizophrenia, tuberculosis. In addition, tumor necrosis factor, tumor, adolescent obesity or diabetes, inflammation, hypertension and cell are going be the hot topics related to diabetes mellitus and obesity in the next few years.

Conclusions

With the help of RLDA, the hotspots analysis-relation discovery results on diabetes and obesity were achieved. We extracted the significant relationships between them and other diseases such as Alzheimer’s disease, heart disease and tumor. It is believed that the new proposed representation learning algorithm can help biomedical researchers better focus their attention and optimize their research direction.

Background

In today’s era of obesity, contributing to the increasing risk of many chronic diseases, such as diabetes, cancer, and cardiovascular diseases, it is quickly becoming one of the greatest public health challenges [1, 2]. From 1980 to 2013, it provides a 41% increase in the population of overweight [3]. Of all the obesity co-morbidities, diabetes account for the strongest correlation [4]. Meanwhile, both obesity and diabetes impose large economic burdens on society [5]. Therefore, researches on diabetes and obesity are becoming more and more important to human health and biomedical research. They have become the worldwide prevalent and harmful metabolic diseases, which bring the pain to patients and stimulate the researchers and clinicians constantly. In 2007, with a genome-wide association (GWA) study conducted by Frayling, the rs9939609 polymorphism, located in the first intron of the FTO gene, was proved strongly associated with type 2 diabetes mellitus and obesity [6]. This discovery explains the reason of the co-occurring nature of diabetes mellitus and obesity. Moreover, due to their genetic characteristics, diabetes and obesity occur along with other diseases, such as cardiovascular diseases and metabolic syndrome, is also found in clinical medicine [7]. Although some papers have discussed about which diseases are associated with diabetes and obesity [8,9,10], there is no quantitative analysis of the relationships between diabetes, obesity, and other diseases. Moreover, to the best of our knowledge, there is also a lack of artificial intelligence tool to pick out the hotspots for the diabetes and obesity research of each year.

With the fast development of biotechnology and genome research [11, 12], a huge amount of biomedical literatures and data are published in digital libraries such as National Center for Biotechnology Information and The Cancer Genome Atlas. Especially for diabetes and obesity study, hundreds of thousands papers were published in the last 10 years. For example, in 2016, 49,804 papers or reports about diabetes and obesity were published in PubMed. However, facing the increasing massive biomedical literature, it will cost plenty of time and human efforts to read and understand them. It is a challenge for clinician or biological researchers to quickly obtain the cutting-edge information and research problems from such massive literature with effective techniques. To solve this problem efficiently, machine-learning technologies provides us effective ways [13]. For example, conditional random fields (CRFs) is proven to be effective in named entity recognition [14], latent Dirichlet allocation (LDA) has been applied in sentiment analysis [15], and Native Bayes methods excellently performed on large amount of text classification [16]. However, there is no representation learning approach is designed for diabetes mellitus and obesity topics modeling.

In this paper, to discover meaningful relationships from the large collections of literature, more than 300,000 abstracts and titles of diabetes mellitus and obesity literatures in the past 10 years (2007~ 2016) from PubMed have been collected. These data contain the most valuable information for hotspots revealing. Therefore, a novel model named as representative latent Dirichlet allocation (RLDA) is designed to discover the important relationships between diabetes mellitus, obesity and other diseases and search significant topics for them. Furthermore, by analyzing the trend of research based on the past decade, the hotspots in the near future can also be identified.

Results

Firstly, we introduce the experiment dataset and show the prepossessing steps such as data collection and name entity selection. Then, based on experiment results, we performed an explicit analysis to find the relationships between diabetes mellitus, obesity and other diseases. Furthermore, we achieved proofs from the clinical reports, which were exclusive in RLDA training process. In addition, the inference results of diabetes mellitus and obesity research hotspots expected in the near future are shown.

Titles and abstracts of literature about diabetes or obesity published in the past 10 years (2007~ 2016) were downloaded from PubMed. The entity names “diabetes” and “obesity” as well as their synonyms are shown in Fig. 1b. We input all the synonyms of diabetes into the search form of PubMed to build a query for research literature about diabetes, as shown in Fig. 2. The same method was used for obesity. The amounts of literature for each year are shown in Fig. 1a. After text segmentation, lemmatization, and stop words removing we input the pre-processed data into our proposed representative latent Dirichlet allocation topic model (RLDA). To get a deeper understanding, we need an effective tool, which can visualize the RLDA results. Word cloud is employed to display different size of words, the higher the word weight is, the bigger the word is. The bigger one word is, the more important role it plays. Taking the result of 2008 as an example, RLDA model produces nine clusters, and the central topic words are summarized as “depression”, “tuberculosis”, “cell”, “gastric”, “treatment”, “obesity”, “pancreatitis”, “retinopathy”, and “stroke” as shown in Fig. 3. In the word cloud diagram of our results, every word represents the core of the topics’ cluster, and each cluster indicates the related research about diabetes mellitus or obesity. In Fig. 3a, depression is the central word that can represent the whole clu ster of diabetes and obesity topics. The other obvious words such as mental, anxiety, and psychological also exactly associate with depression. Therefore, we reached the conclusion that there is a non-ignorable relationship between psychological or mental diseases such as depression and anxiety and obesity and diabetes mellitus. Hereinto, depression topic is a hotspot on diabetes in 2008. However, not all the word cloud diagrams are help to our analysis. We cannot obtain any relationship between diabetes mellitus, obesity and other diseases from some figures in 2008, such as Fig. 3c, e, f.

Fig. 1
figure1

a shows the amounts of literature about obesity and diabetes from 2007 to 2016. The amounts increase year by year, and the total amount of ten years is 337,881. b shows the synonyms of diabetes and obesity. Diabetes has 6 synonyms, such as MODY, DM2, T2D, mellitus, urophthisis and glycuresis. Obesity has 9 synonyms, such as obese, obesitas, adiposity, adipositas, adiposis, corpulence, corpulency, fatness and polysarcia

Fig. 2
figure2

A query builder of PubMed for diabetes is shown as an example. We input all the synonyms of diabetes into the query builder at once. The condition logic is “OR” and the search field is “Title/Abstract”

Fig. 3
figure3

The word cloud results of 2008. The representative central topic words can be separately summarized as “depression”, “tuberculosis”, “cell”, “gastric”, “treatment”, “obesity”, “pancreatitis”, “retinopathy” and “stroke”. From these figures, we can reach the result that pancreatitis, retinopathy, cataract and stroke usually appear with diabetes in the research papers of diabetes mellitus; gastric disease often appear with obesity; tuberculosis, psychological or mental disease like depression and anxiety appear with both diabetes and obesity frequently

We made the analysis on other clusters of 2008 in the same way, and more discoveries were achieved. The new findings unveiled that pancreatitis, retinopathy, cataract, and stroke are closely asscociated with diabetes. Gastric disease is related with obesity. Moreover, hypertension, myocardial infarction and tuberculosis are closely asscociated with both diabetes mellitus and obesity. More word cloud results of other years are shown in Additional file 1. Figure S1.

For the last decade data, we found more interesting associations between diabetes mellitus, obesity and some other diseases. In Fig. 4, to show the experiment results vividly, we draw a direct chord diagram based on the 10 years’ discoveries. In Fig. 4, the two longer segments are diabetes mellitus and obesity; the 24 shorter segments indicate 24 related diseases; and the ribbons define the relationship between the two diseases. Each short piece is linked to at least one long segment when there is a relationship between them, e.g. the segment labeled “Tumor” is linked to “Diabetes” to show tumor is associated with diabetes. Several short segments such as hypertension and heart disease include two parts, which connect both “Diabetes” and “Obesity”. It means that these segments have relationships with both diabetes mellitus and obesity. In the last 10 years, obesity study is mainly focused on 17 accompanying diseases, adrenal disease, anxiety, asthma, cardiovascular disease, depression, gastric disease, heart disease, hepatitis, hypertension, hypothalamic disease, liver disease, lung disease, tuberculosis, myocardial-infarction, OSAS (obstructive sleep apnea syndrome), respiratory disease and schizophrenia. For diabetes, a large scope including 26 diseases from adrenal disease, Alzheimer’s disease, anxiety, cardiovascular disease, cataract, cystic disease, depression, heart disease, hepatitis, hypertension, hypothalamic disease, inflammation, liver disease, neuropathy, OSAS, pancreatitis, periodontitis, respiratory disease, retinopathy, schizophrenia, skin ulcer, stroke, tuberculosis, lung disease, myocardial infarction, and tumor. Furthermore, there are 15 diseases having relationships with both of diabetes and obesity, i.e. adrenal disease, anxiety, cardiovascular disease, depression, heart disease, hepatitis, hypertension, hypothalamic disease, myocardial infarction, liver disease, lung disease, OSAS, respiratory disease, schizophrenia and tuberculosis.

Fig. 4
figure4

The chord diagram of relationships between diabetes, obesity and other diseases is shown in this figure. Each segment represents a disease and each ribbon represents that there is a relationship between the two diseases which are linked by the ribbon. We can clearly see that 26 diseases which have relationships with diabetes, 17 with obesity and 15 with both (Adapted with permission from [44])

Results proof

As Ananiadou warned, although using widely applied algorithms, in our case latent Dirichlet allocation, Word2vec and affinity propagation, and the large-scale text collections, how to estimate the correctness of the results is still a critical problem [17]. For our experiments results, we demand that they can be proved with strong evidences. Therefore, we employ the authoritative clinical reports about diabetes and obesity in recent years, such as Standards of Medical Care in Diabetes - 2016 [18] and The State of Obesity: 2016 [19]. They were excluded in our dataset. The solid research reports will prove our discovered relationships are correct and significant for clinical researches and RLDA is effective for discovery searching from massive literatures. With the activation of these results, this model can also benefit those researchers who continuously devote themselves to study diabetes mellitus and obesity.

For diseases significant associated with diabetes mellitus, take depression, myocardial infarction, retinopathy, cataract, stroke, hypertension, hepatitis and heart disease as examples, the details of the diseases, quotes, and clinical reports are shown in Table.1. Other relationships and proofs are shown in Additional file 1.Table S2. For obesity study, take asthma, heart disease, hypertension and liver disease as examples, their proofs for our discoveries (i.e.significant relationships) are shown in Table.2 and Additional file 1.Table S3.

Table 1 Clinical Report Proofs on the Discoveries about Diabetes and Other Diseases (Reproduced with permission from [45])
Table 2 Clinical Report Proofs on the Discoveries about Obesity and Other Diseases (Adapted with permission from [45])

Methods

To reveal relationships and extract research hotspots, a novel model named as representation latent Dirichlet allocation (RLDA) based on LDA topic model, word2vec and affinity propagation clustering. Its flowchart is shown as Fig. 5.

Fig. 5
figure5

Representation latent Dirichlet allocation (RLDA) model

Pre-processing

Because the raw biomedical literatures contain noisy information (such as stop words) that has little contribution to the result and even be harmful, before revealing relationships, we applied word segmentation, lemmatization, part-of-speech tagging and stop words removing to pre-process the biomedical texts, and finally got clean corpus.

Word segmentation can separate the text into several tokens by punctuations. After the segmentation, lemmatization is to transform various forms of one word into prototype. For example, “men” is the plural form of “man”, lemmatization can change the plural of a noun into its singular form. Another example, “walked” and “walking” should be restored to their prototype “walk”. Then, part-of-speech tagging was applied to assign every word a tag and the tags are shown in Table 3. As nouns and adjectives are often considered overweigh other words in topical semantics [20], we extracted nouns and adjectives as our corpora. However, there are still a lot of meaningless words in raw data such as “is”, “and”, “the”, “at” and so on which have no influence on the semantic of the sentences. Finally, stop words removing is applied which is also a common step in pre-processing [21, 22]. It removed the useless words from text collection, including coordinating conjunctions, cardinal numbers, prepositions, pronouns and so on except nouns and adjectives.

Table 3 Part-of-speech Tags in Pre-processing

LDA topic model

Recently, probabilistic topic models have been extensively developed. It turns out that these models have a very excellent performance on text mining. The classical topic model, latent Dirichlet allocation which was proposed by David M. Blei in 2003 is an unsupervised topic model based on probability and statistics [23]. LDA is an extremely effective topic model which can be applied to large-scale and complex text data to mine meaningful latent topic information [24, 25]. From the moment that LDA was proposed, it was continuously developed and has been widely applied to document summarization [26], sentiment analysis [27], thematic structure revealing [28] and so on.

LDA is a Bayesian statistical model and involves three structures, words, topics and documents. It supposes that each word of a document is selected from a topic with a certain probability and this topic is also chosen from this document with a certain probability [29]. A topic is a distribution of terms over the vocabulary, which allows each document to be represented as a distribution over topics. It can be expressed by the Eq. (1). Let d be a document, w indicate a word, t be a topic.

$$ P\left(w\left|d\right.\right)=P\left(w\left|t\right.\right)\times P\left(t\left|d\right.\right) $$
(1)

LDA assembles a document collection D = {dm}m{1…M} with a fixed vocabulary W. Let φk indicate the distribution of probabilities that all words belong to topic tk, and θm indicate the distribution of probabilities that all topics belong to document dm. Therefore, the distribution of topic k over vocabulary is defined as Φ = {φk}, k{1,…,K}, and the distribution of the mth document over all K topics is defined as Θ = {θm}, m{1,…,M}. For document m, the distribution of document over topics θm and the distribution of topics over vocabulary Φ are sampled from prior α and β, respectively. The topic assignment z for each word is generated from θm; the accurate words w are got according to their respective topic assignment z and the distribution of topics over Φ. The joint distribution of this model can be simply expressed by Eq. (2) which describes its generative process. Nm is the length of document m, and zm,n is the generating topic in document m.

$$ p\left({w}_m,{z}_m,{\theta}_m,\Phi \left|\alpha, \beta \right.\right)=\prod \limits_{n=1}^{N_m}p\left(\Phi \left|\beta \right.\right)p\left({\theta}_m\left|\alpha \right.\right)p\left({z}_{m,n}\left|{\theta}_m\right.\right)p\left({w}_{m,n}\left|\Phi, {z}_{m,n}\right.\right) $$
(2)

To solve the priori probability problem, we use Gibbs sampling, a random sampling method, to estimate LDA model and infer the result [30].

In this work, we applied LDA model to each year’s data. With several adjustments, we set the topic number t = 100, hyper-parameters α = 0.05 which commonly equals 5/t, β = 0.01 which the same as [20], and the iteration i = 500. The output matrix of LDA contains 100 rows and 20 columns. Each row represents a topic, each column is a word and its probability in this topic. In each topic, we took the top 20 words which are sorted by their probabilities in descending order. The probability represents how much this word belongs to the topic, the same word may have different probabilities in different topics. Thus, we can’t directly use the matrix of probability to measure the similarities between each pair of topics.

Word2vec

Word2vec is a group of versatile distributed representation learning models based on a three-layer neural network, which is first proposed by Mikolov [31]. It can project text data to a k-dimensional vector space and represent words as word embeddings. The closer semantics the corresponding words have, the more similar the two vectors are [32]. Recently, plenty of NLP tasks, such as knowledge graph completion and text mining have introduced word2vec model [33,34,35].

By exploiting word2vec, the word embeddings and semantic relationships among words are learned from large amount of text corpus. This method is derived from neural probabilistic language model [36]. It contains two neural architectures: Skip-gram and continuous bag of words (CBOW) models [32]. They employ two different training techniques: hierarchical softmax and negative sampling [37]. Both of these two models have three layers: input, projection and output layer. The CBOW architecture predicts the current word based on the context, and the Skip-gram predicts surrounding words by the given current word. The optimizing process is done using stochastic gradient descent (SGD) method. Recently, word2vec has significantly outperformed traditional language models in many research areas, such as sentiment analysis [38], text classification [39] and semantic analysis [40]. Furthermore, Word2vec is an unsupervised model which doesn’t need labels, and given enough text corpus, it can produce meaningful representations of words. In our experiments, we used Skip-gram model and training method.

We train word2vec model on the data of each year respectively. Word2vec model mapped all the words to word embeddings in the same semantic space. Afterwards, we replaced every word’s probability in the LDA result with its corresponding word embedding, thus each topic became a matrix, and the result of LDA model became a three-dimensional tensor.

Affinity propagation clustering algorithm

Affinity propagation (AP) algorithm is a widely-used clustering model based on “message passing” among data points. Different from K-means or K-medoids, AP algorithm does not require the exact number of clusters before clustering. AP finds “exemplars”, which are real samples of the input, as the representatives of clusters [41]. It has been used in image processing [42], gene detecting [43], text mining [44] and so on.

This algorithm supposes a sample set X = {x1, x2, … xn} without inner structure between sample points. Let S be the similarity matrix of samples, for example, s(i, j) indicate the similarity of point xi and xj. The similarity can be set different metrics according to different applications. In our experiment, the similarity between two topics matrices (Xi, Xj) is the negative reciprocal of cosine similarity corresponding to Eq.(3). To avoid the case that cosθ equals zero, we add a minimal value x to it. We calculated the weighted average of the rows the in two matrices for computing the cosθ to Eq.(4) and the weights are the probabilities of the words in topics.

$$ S=\left\{\begin{array}{c}-\frac{1}{\cos \theta },\cos \theta \ne 0\\ {}-\frac{1}{\cos \theta +x},\cos \theta =0\end{array}\right. $$
(3)
$$ \cos \theta =\frac{\sum_{k=1}^l\left({x}_{ik}\times {x}_{jk}\right)}{\sqrt{\sum_{k=1}^l{x}_{ik}^2}\times \sqrt{\sum_{k=1}^l{x}_{jk}^2}} $$
(4)

AP clustering algorithm defines two matrices, one of which is responsibility matrix R (r[i, k]) representing the degree of sample k suitable as the cluster center of sample i, and another is availability matrix A (a[i, k]) representing the degree of sample i choosing sample k as its cluster center. The matrix R will be constantly updated according to Eq.(5), and the matrix A according to Eq.(6) and Eq.(7) [41].

$$ \mathrm{r}\left(i,k\right)=s\left(i,k\right)-\underset{k\hbox{'}\ne k}{\max}\left\{a\left(i,{k}^{\hbox{'}}\right)+s\left(i,{k}^{\hbox{'}}\right)\right\} $$
(5)
$$ \mathrm{a}\left(i,k\right)=\min \left(0,r\left(k,k\right)+\sum \limits_{i\hbox{'}\notin \left\{i,k\right\}}\max \left\{0,r\left({i}^{\hbox{'}},k\right)\right\}\right),i\ne k $$
(6)
$$ \mathrm{a}\left(k,k\right)=\sum \limits_{i\hbox{'}\ne k}\max \left\{0,r\left({i}^{\hbox{'}},k\right)\right\} $$
(7)

To avoid numerical oscillations, the algorithm introduces an damping factor λ (λ (0,1)) when updating the two matrices corresponding to Eq.(8) and Eq.(9).

$$ {r}_t\left(i,k\right)\leftarrow \left(1-\lambda \right){r}_t\left(i,k\right)+\lambda {r}_{t-1}\left(i,k\right) $$
(8)
$$ {a}_t\left(i,k\right)\leftarrow \left(1-\lambda \right){a}_t\left(i,k\right)+\lambda {a}_{t-1}\left(i,k\right) $$
(9)

We applied AP algorithm to each year’s topics to get the “exemplars” as the centers of clusters. Every cluster is our analysis target to discover relationships between diabetes, obesity and other diseases.

Discussion

The hotspots on diabetes mellitus and obesity research are evolving for each year. However, there are some latent tendencies under them. Detecting the research trend is one of our aims, which is significant for researchers to easily focus and adjust their future research.

Research Trend detection

To visualize the words of cluster centers, we applied word cloud charts. To capture the research hotspots for each year, we merge all the central topics of the whole year into a super word cloud. Taking the data of 2007 as an example, the visualization result is shown Fig. 6. From this figure, we can get that with their high frequencies, tumor, adolescent, tnf, inflammation, cell, adrenal, interleukin and visceral are the most conspicuous words. These eight words are considered as the 2007 research hotspots. The other hotspots figures of 2008 ~ 2016 are shown in Additional file 1.Figure S4.

Fig. 6
figure6

The word cloud figure of research hotspots in 2007 shows that the most conspicuous words, such as “adolescent”, “tumor”, “inflammation”, “tnf”, “cell”, “adrenal”, “interleukin” and “visceral”, are research hotspots about diabetes and obesity in 2007 due to their highest frequencies of appearing in literature

In Fig. 7, the cluster central topics for all 10 years are shown, which are identified as the research hotspots for each year. The central topical words are ranked by their appearance frequencies to unveil the underlying tendency. The result is shown in Table.4 in which we put the semantically similar words together and several findings can be clearly achieved as follows:

  1. 1)

    “Tnf” has the maximum times of appearance, and is the hotspot almost every year.

  2. 2)

    “Tumor”, “inflammation”, “hypertension”, “adolescent” and “cell” appeared three times in the last 10 years. Moreover, they are hotspots in the latest 3 years (2014~ 2015).

  3. 3)

    The other hotspots appear changeably, and the times of appearances are less than three.

Fig. 7
figure7

Research hotspots of every year from 2007 to 2016 are summarized in this figure. The words which appear more than thrice are marked by red, those appear thrice are marked by orange, those appear twice are marked by blue, and those appear only once are marked by black. (Adapted with permission from [44])

Table 4 Hotspots of Diabetes Mellitus and Obesity Research for the Past Decade (Adapted with permission from [45])

Therefore, with their contribution to diabetes mellitus and obesity research for the past decade, we can find that tnf, tumor, adolescent obesity or diabetes, inflammation, hypertension and cell are potentially going to be the hot topics in the very near future.

Conclusions

To reveal the hotspots of diabetes mellitus and obesity research and find out the significant relationships between these two diseases and others, we proposed a novel model representative latent Dirichlet allocation topic model (RLDA). It is a reasonable combination of several effective models containing LDA, word2vec and AP. Massive bio-medical published literature in the past decade (2007~ 2016) is downloaded from PubMed with key words of these two diseases as well as their synonyms. We applied RLDA to extract the topical words of each cluster and discover the diseases that are closely associated with diabetes and obesity. From the 10 years’ data, we totally discovered 26 diseases are significantly associated with diabetes, 17 with obesity and 15 with both. To prove the discoveries and the effectiveness, we achieved related research proofs from recent years’ clinical reports which are not included in our training data. In addition, we studied the research hotspots of via a visualization method to find the regularity, and give a revelation of the research hotspots on diabetes mellitus and obesity in the very near future. The results show that RLDA using massive text data is significant and helpful to researchers. We are going to apply RLDA to other complex diseases such as cancer.

Abbreviations

AP:

Affinity Propagation

CBOW:

Continuous bag of words

CRFs:

Conditional random fields

GWA:

Genome-wide association study

LDA:

Latent Dirichlet allocation

OSAS:

Obstructive sleep apnea syndrome

RLDA:

Representative latent Dirichlet allocation topic model

SGD:

Stochastic gradient descent

Tnf:

Tumor necrosis factor

References

  1. 1.

    Yen YF, Hu HY, Lee YL, et al. Obesity/overweight reduces the risk of active tuberculosis: a nationwide population-based cohort study in Taiwan. Int J Obes. 2017;41(6):971–5.

  2. 2.

    Swinburn BA, Sacks G, Hall KD, et al. The global obesity pandemic: shaped by global drivers and local environments. Lancet. 2011;378(9793):804–14.

  3. 3.

    Ng M, Fleming T, Robinson M, et al. Global, regional, and national prevalence of overweight and obesity in children and adults during 1980–2013: a systematic analysis for the global burden of disease study 2013. Lancet. 2014;384(9945):766–81.

  4. 4.

    Hossain P, Kawar B, El Nahas M. Obesity and diabetes in the developing world—a growing challenge. N Engl J Med. 2007;356(3):213–5.

  5. 5.

    Leung MYM, Carlsson NP, Colditz GA, et al. The burden of obesity on diabetes in the United States: medical expenditure panel survey, 2008 to 2012. Value Health. 2017;20(1):77–84.

  6. 6.

    Frayling TM, Timpson NJ, Weedon MN, et al. A common variant in the FTO gene is associated with body mass index and predisposes to childhood and adult obesity. Science. 2007;316(5826):889–94.

  7. 7.

    Guh DP, Zhang W, Bansback N, et al. The incidence of co-morbidities related to obesity and overweight: a systematic review and meta-analysis. BMC Public Health. 2009;9(1):88.

  8. 8.

    Gallagher EJ, LeRoith D. Obesity and diabetes: the increased risk of cancer and cancer-related mortality. Physiol Rev. 2015;95(3):727–48.

  9. 9.

    Chew EY, Davis MD, Danis RP, et al. The effects of medical management on the progression of diabetic retinopathy in persons with type 2 diabetes: the action to control cardiovascular risk in diabetes (ACCORD) eye study. Ophthalmology. 2014;121(12):2443–51.

  10. 10.

    Colosia AD, Palencia R, Khan S. Prevalence of hypertension and obesity in patients with type 2 diabetes mellitus in observational studies: a systematic literature review. Diabetes Metab Syndr Obes. 2013;6:327.

  11. 11.

    Lander ES, Linton LM, Birren B, et al. Initial sequencing and analysis of the human genome. Nature. 2001;6822(2001):860–921.

  12. 12.

    Venter JC, Adams MD, Myers EW, et al. The sequence of the human genome. Science. 2001;291(5507):1304–51.

  13. 13.

    Rebholz-Schuhmann D, Oellrich A, Hoehndorf R. Text-mining solutions for biomedical research: enabling integrative biology. Nat Rev Genet. 2012;13(12):829–39.

  14. 14.

    Wang X, Yang C. Guan R. a comparative study for biomedical named entity recognition. Int J Mach Learn Cybern. 2018;9(3):373–82.

  15. 15.

    Fu X, Liu G, Guo Y, et al. Multi-aspect blog sentiment analysis based on LDA topic model and hownet lexicon. Web Inf Syst Mining. 2011;6988:131–8.

  16. 16.

    Jiang L, Li C, Wang S, et al. Deep feature weighting for naive Bayes and its application to text classification. Eng Appl Artif Intell. 2016;52:26–39.

  17. 17.

    Ananiadou S, Kell DB, Tsujii J. Text mining and its potential applications in systems biology. Trends Biotechnol. 2006;24(12):571–9.

  18. 18.

    American Diabetes Association. Standards of medical care in diabetes-2016. Diabetes Care. 2016;39(1):S1–S112.

  19. 19.

    Trust for America’s Health. The State of Obesity: 2016. Robert Wood Johnson Foundation, Washington, USA, 2016;1–143.

  20. 20.

    Brill E. A simple rule-based part of speech tagger. ANLC'92 Proceedings of third conference on Applied natural language processing. 1992;152–5.

  21. 21.

    Griffiths TL, Steyvers M. Finding scientific topics. Proc Natl Acad Sci. 2004;101(suppl 1):5228–35.

  22. 22.

    Hu Y, Boyd-Graber J, Satinoff B, et al. Interactive topic modeling. Mach Learn. 2014;95(3):423–69.

  23. 23.

    Blei DM, Ng AY, Jordan MI. Latent dirichlet allocation. J Mach Learn Res. 2003;3(Jan):993–1022.

  24. 24.

    Wei X, Croft WB. LDA-based document models for ad-hoc retrieval. Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval: ACM; 2006. p. 178–85.

  25. 25.

    Hennig L, Labor DAI. Topic-based multi-document summarization with probabilistic latent semantic analysis. RANLP. Borovets, Bulgaria. 2009;144–9.

  26. 26.

    Arora R, Ravindran B. Latent Dirichlet allocation based multi-document summarization. Proceedings of the second workshop on Analytics for noisy unstructured text data ACM. 2008:91–7.

  27. 27.

    Li F, Huang M, Zhu X. Sentiment analysis with global topics and local dependency. AAAI. 2010;3:1371–6.

  28. 28.

    Blei DM, Lafferty JD. A correlated topic model of science. The Annals of Applied Statistics. 2007:17–35.

  29. 29.

    Blei DM. Probabilistic topic models. Commun ACM. 2012;55(4):77–84.

  30. 30.

    George EI, McCulloch RE. Variable selection via Gibbs sampling. J Am Stat Assoc. 1993;88(423):881–9.

  31. 31.

    Mikolov T, Sutskever I, Chen K, et al. Distributed representations of words and phrases and their compositionality. Adv Neural Inf Proces Syst. 2013:3111–9.

  32. 32.

    Mikolov T, Chen K, Corrado G, et al. Efficient estimation of word representations in vector space. arXiv Computation and language. 2013;1301.3781.

  33. 33.

    Kim Y. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882, 2014.

  34. 34.

    Song Y, Roth D. Unsupervised sparse vector densification for short text similarity. HLT-NAACL. 2015:1275–80.

  35. 35.

    Wang Z, Zhang J, Feng J, et al. Knowledge graph and text jointly embedding. EMNLP. 2014;14:1591–1601.

  36. 36.

    Bengio Y, Ducharme R, Vincent P, et al. A neural probabilistic language model. J Mach Learn Res. 2003;3(Feb):1137–55.

  37. 37.

    Zhou G, He T, Zhao J, et al. Learning continuous word embedding with metadata for question retrieval in community question answering. ACL. 2015;1:250–9.

  38. 38.

    Zhang D, Xu H, Su Z, et al. Chinese comments sentiment classification based on word2vec and SVM. Expert Syst Appl. 2015;42(4):1857–63.

  39. 39.

    Lilleberg J, Zhu Y, Zhang Y. Support vector machines and word2vec for text classification with semantic features. IEEE 14th International Conference on Cognitive Informatics & Cognitive Computing (ICCICC). 2015:136–40.

  40. 40.

    Wolf L, Hanani Y, Bar K, et al. Joint word2vec networks for bilingual semantic representations. Int J Comput Linguistics Appl. 2014;5(1):27–42.

  41. 41.

    Frey BJ, Dueck D. Clustering by passing messages between data points. Science. 2007;315(5814):972–6.

  42. 42.

    Yang C, Bruzzone L, Sun F, et al. A fuzzy-statistics-based affinity propagation technique for clustering in multispectral images. IEEE Trans Geosci Remote Sens. 2010;48(6):2647–59.

  43. 43.

    Leone M, Weigt M. Clustering by soft-constraint affinity propagation: applications to gene-expression data. Bioinformatics. 2007;23(20):2708–15.

  44. 44.

    Guan R, Shi X, Marchese M, et al. Text clustering with seeds affinity propagation. IEEE Trans Knowl Data Eng. 2011;23(4):627–37.

  45. 45.

    He G, et al. Relation discovery and hotspots analysis on diabetes mellitus and obesity with representation model. IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (2017). 2017:952–7.

Download references

Acknowledgements

Not applicable.

Funding

The publication of this article was funded by the National Natural Science Foundation of China (Nos. 61572228, 61472158, 61300147, 61602207), United States National Institutes of Health (NIH) Academic Research Enhancement Award (No. 1R15GM114739), the Science Technology Development Project from Jilin Province (No. 20160101247JC), Zhuhai Premier-Discipline Enhancement Scheme and Guangdong Premier Key-Discipline Enhancement Scheme. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Availability of data and materials

All data generated or analyzed during this study are included in this published article and supplementary material.

About this supplement

This article has been published as part of BMC Systems Biology Volume 12 Supplement 7, 2018: From Genomics to Systems Biology. The full contents of the supplement are available online at https://bmcsystbiol.biomedcentral.com/articles/supplements/volume-12-supplement-7.

Author information

This study was conceived by RCG. GNH performed experiments. GNH, YC and RCG analyzed the data. GNH and RCG drafted the manuscript. GNH, YCL, YC, MQY and JSL revised the manuscript and approved the final manuscript. All authors read and approved the final manuscript.

Correspondence to Renchu Guan.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Word cloud results of ten years and clinical report proofs on relationships between diabetes, obesity and other diseases. (PDF 10960 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Representative latent Dirichlet allocation
  • Diabetes mellitus
  • Obesity