Many mathematical models characterizing mechanisms of cell fate decisions have been constructed recently. Their further study may be impossible without development of methods of model composition, which is complicated by the fact that several models describing the same processes could use different reaction chains or incomparable sets of parameters. Detailed models not supported by sufficient volume of experimental data suffer from non-unique choice of parameter values, non-reproducible results, and difficulty of analysis. Thus, it is necessary to reduce existing models to identify key elements determining their dynamics, and it is also required to design the methods allowing us to combine them.
Here we propose a new approach to model composition, based on reducing several models to the same level of complexity and subsequent combining them together. Firstly, we suggest a set of model reduction tools that can be systematically applied to a given model. Secondly, we suggest a notion of a minimal complexity model. This model is the simplest one that can be obtained from the original model using these tools and still able to approximate experimental data. Thirdly, we propose a strategy for composing the reduced models together. Connection with the detailed model is preserved, which can be advantageous in some applications. A toolbox for model reduction and composition has been implemented as part of the BioUML software and tested on the example of integrating two previously published models of the CD95 (APO-1/Fas) signaling pathways. We show that the reduced models lead to the same dynamical behavior of observable species and the same predictions as in the precursor models. The composite model is able to recapitulate several experimental datasets which were used by the authors of the original models to calibrate them separately, but also has new dynamical properties.
Model complexity should be comparable to the complexity of the data used to train the model. Systematic application of model reduction methods allows implementing this modeling principle and finding models of minimal complexity compatible with the data. Combining such models is much easier than of precursor models and leads to new model properties and predictions.
Systems biology aims to study complex interactions in living systems and focuses on analysis and modeling their properties. Mathematical modeling provides several ways to describe biological processes based on experimental information of different kind. However, creation of detailed models not supported by enough experimental data often makes their analysis and interpretation difficult . Several aspects of the same process can be modeled using different levels of abstraction involving different reaction chains, chemical kinetics, and incomparable sets of parameters. Such models are difficult to merge. Meanwhile, merging is an important approach for creation of complex models. Thus, development of efficient methods and software, allowing us to combine models, is the object of intense study in systems biology. In our work, we focused on the fact that, generally, complexity of models is not comparable to the volume of experimental data used to adjust their parameters. Due to this fact, we turn to the methods of model reduction allowing us to minimize model’s complexity without affecting the model simulation dynamics.
Model reduction is a well-established technique in many fields of biochemical research and engineering. It has been used for many years in chemical kinetics (for reviews, see [2–4]) and has already found multiple applications in systems biology, including discrete modeling  and modeling of metabolic pathways [6, 7]. The principles of this technique have been applied in computational biology  and implemented as a part of widely used pathway simulators such as BioUML , BIOCHAM , COPASI , and GINsim . Model reduction led to new insights in mechanisms of translation regulation by microRNAs [13, 14] and was applied for analysis of such signaling pathways as JAK-STAT , NF-κB , and EGFR .
In our investigation, we used the principles of model reduction to construct reasonably accurate minimal size approximations of two different models describing the CD95 signaling pathways [18, 19]. The first model explores pro-apoptotic properties of CD95 after stimulation by its natural ligand CD95L or by agonistic antibodies anti-CD95 implying formation of the death-inducing signaling complex (DISC) [18, 20]. DISC consists of oligomerized CD95, death domain-containing adaptor FAS-associated molecule (FADD), procaspases-8 and −10, and two isoforms of cellular FLIP (CFLAR) protein (cFLIP long and cFLIP short). Caspase-8 leads to activation of effector caspase-3 directly (type I cells) or via stimulation of cytochrome C release from the mitochondria (type II cells) . The latter step requires formation of the apoptosome complex and activation of caspase-9. Once activated, caspase-3 cleaves poly(ADP-ribose) polymerase (PARP), thereby making the apoptotic process irreversible. The second model describes the state when CD95 not only activates the pro-apoptotic pathway, but also induces transcription factor NF-κB that is an important regulator of cell survival functioning . This is possible due to cFLIPL cleavage in the DISC complex. The cleaved p43-FLIP directly interacts with the IKK complex and activates it. The activated IKK performs phosphorylation of the IκB protein and thereby frees NF-κB.
The authors of the models have evaluated concentration changes of major apoptotic molecules by Western blot analysis and represented them as relative values at given time points. Using the systematic methodology  implemented in the BioUML software, we reduced the models so that they still satisfy these data. This allowed us to simplify the overlapping components of the models and find a way for their composition.
Mathematical modeling of biological processes based on the classical theory of chemical kinetics assumes that a model consists of a set of species S = (S1,…,Sm) associated with a set of variables C(t) = (C1(t), …, Cm(t)) depending on time t ∈ [0, T], T ∈ R+ and representing their concentrations, and a set of biochemical reactions with rates v(t) = (v1(t), …, vn(t)) depending on a set of kinetic constants K. Reaction rates are modeled by mass-action or Michaelis-Menten kinetics. A system of ordinary differential equations (ODE) representing a linear combination of reaction rates is used to describe the model behavior over time:
Here N is a stoichiometric matrix of n by m. We say that CSS is a steady state of the system (1) if
Model reduction implies transformation of the ODE system to another one with smaller number of equations without affecting dynamics of variables C1(t), …, Cs(t), which is fixed by a set of experimental points
Ciexp(tij) at given times tij, j = 1, …, ri, where ri is number of such points for the concentration Ci(t), i = 1, …,s. To check dynamics preservation in the course of model reduction, we consider the function of deviations defined as a normalized sum of squared differences :
where weights are calculated as mean squared values of experimental concentrations for each variable and the normalizing factor ωmin/ωi is used to make all concentration trajectories to have similar importance.
Reducing kinetic model is possible when some quantities are much smaller than other quantities and can be neglected. Usually, this implies some qualitative relations (much bigger, much smaller) between model parameters. When these relations satisfy certain rules, we can approximate the detailed model by a simpler one. If the parameters are (approximately) determined, as in our case, we find an approximation specific for a region of the parameter space. However, if we want to investigate the model behavior for the entire space, we need to decompose it into regions characterized by asymptotically different behaviors of the dynamical systems. Afterwards, a specific reduction should be performed for each region (Figure 1).
We define the minimal complexity model as a reduced model with the minimal number of elements (species and reactions) so that the deviation function value (3) calculated for the reduced model is different from the original model no more than 20%. Such threshold is explained by the fact that in this work we considered experimental data obtained by Bentele et al. and Neumann et al. using Western blot technology with the standard deviation 15-20%.
Reduction of mathematical model complexity is achievable by different methods . Description of the methods directly used in our work is provided below.
(MR1)Removal of slow reactions. We say that reaction r1 is much slower than reaction if , where k=10-2. When such reactions do not affect experimental dynamics of species, we neglect them. Note, that in some cases, it is sufficient to consider k = 10−1 or even k = 1.
(MR2)Quasi-steady-state approximation assumes that all variables C(t) of the model are split in two groups: basic variables Cs(t) and quasi-stationary variables Cf(t) for which we could write:
where ɛ is small parameter. We consider the approximation ɛ → 0 resulting in the equation Nf · vf(C, K, t) = 0. Thus, the chain of reactions S → I → P with a quasi-stationary species I can be reduced to the form S → P.
(MR3)Lumping analysis refers to reducing the number of model variables by grouping some species. In particular, this can be illustrated by reactions
with kinetic rates and . If k1 = k2 and , then the system (4) can be replaced by a single reaction
where , and k = k1 = k2. Note, that in this example lumped variables , and , are linearly dependent: however, this is not required in general case. For conditions on lumpability in monomolecular reaction networks, see .
(MR4)Removal of approximately linearly dependent variables. If variables A(t) and B(t) (species concentrations or reaction rates of the model) are approximately linearly dependent:
then we can replace one of them with another in all kinetic laws of the model.
(MR5)Simplification of the Michaelis-Menten kinetics. Consider a reaction r of the form S –E → P, where an enzyme E converts a substrate S into product P. Reaction rate of such reaction is frequently defined by the Michaelis-Menten formula
where the enzyme concentration is a dynamic variable allowing to use the same kinetics in different regions of the phase space. If Km ≫ CS(t), then we can reduce this formula to the form: . On the other hand, if CS(t) ≫ Km, then (5) can be replaced by the equation vr(t) = k · CE(t).
(MR6)Simplification of equations based on the law of mass action when one reactant dominates others. Consider a reaction r of the form S1 + S2 → P with the kinetic law
When for t ∈ [0, T], the formula (6) can be replaced by the linear equation . The time T of validity of such pseudo-lineary approximation is defined as a period during which the relative change of does not exceed some ε, i.e. .
One way to perform the model reduction is to apply the foregoing methods in the numerical order (Figure 2). Note that the methods MR5 and MR6 are of the same type, so it does not matter which one to use first. This way assumes that we calculate the value of the distance function (3) at each reduction step to test whether approximation of the experimental data is still within allowable limit or not.
Model analysis and comparison
Model comparison using Akaike information criterion (AIC). This criterion  defines the relative complexity of a model based on the goodness of experimental data fit and the number of model parameters |K| (initial concentrations of species are not considered):
The function χ2 is defined by the formula (3) with weights 1/
σij2 (instead of ωmin/ωi) , where mean deviations σij of experimental values Ciexp(tij) are calculated using smoothing spline :
For j + k < 0 and j + k > ri we assumed Ci(ti,j+k) = Ciexp(ti,j+k) = 0.
Models can be compared using the Akaike criterion, if they approximate the same experimental data. When the AIC value of one model is less than of others, we say that this model is simpler in terms of this criterion.
Model comparison with the mean AIC. When we want to compare models approximating different sets of experimental data, we could calculate the mean AIC coefficients by the formula
where nexp determines the number of experimental points.
Steady-state analysis finds values of species concentrations according to the rules (2). It is desirable to reduce a model so that steady-state concentrations of all experimentally measured chemical species have not changed significantly.
Sensitivity analysis reveals steady-state concentrations response to parameter perturbations. The local sensitivities Ciss, i = 1, …, m, for all parameters pj, j = 1, …, |K|, are calculated via finite difference approximations:
It is useful to compute the mean log sensitivity for all fitted species:
where np is the number of all parameters |K| or the number of parameters retained after the model reduction.
Considering the mathematical models of CD95 signaling pathways [18, 19], we decomposed them into functional modules. This step allowed us to identify overlapping components of the models and simplify their analysis. We defined a module as a submodel (including several species, reactions and parameters of the model) with input, output and contact ports. The first two types of ports characterized variables calculated in one module and passed to another through a directed connection. The contact ports declared common variables of modules via undirected connections (for more details of modular modeling, see ).
Preliminary analysis, problems and inconsistencies in the precursor models
The mathematical model by Bentele et al. (Figure 3A) consists of 43 species including a virtual variable xaa intended for quantification of “apoptotic activity” caused by active caspases-3, -6 and -7 and calculated by the formula
where k36act, k7act, Km367act ∈ K. The variable xaa specifies a process of degradation in the model introduced as an exponential decay function fdegr(xaa). This function is defined by the formula kd · xaa2 + kds with kd,kds ∈ K for all active caspases and complexes containing their cleaved products, and by the formula kd · xaa2 for all other molecules besides cPARP (cleaved PARP), where fdegr(xaa) is constant. All species in the model are degraded with the exception of cytochrome C and Smac stored in the mitochondria, whose concentrations are constant.
In total, the model contains 80 reactions (Table 1) including 24 reactions based on mass action kinetics, 12 reactions taken with kinetics of Michaelis-Menten, 41 reactions of degradation, the reaction of xaa production specified above and two reactions of cytochrome C and Smac release from the mitochondria modeled using a discrete event. The latter implies complete cytochrome C and Smac release within 7 minutes as soon as tBid reaches a certain level in comparison to Bcl-2/Bcl-XL. Since the authors did not provide exact form of the release function, we proposed the sigmoid function which has the expected behavior:
where ttrigger is the time when tBid concentration reaches a value of Bcl-2/Bcl-XL, trelease is the start time of release and kcontr is the contraction coefficient.
Summary of reactions from the original model by Benteleet al.and the reduced model
Activation of caspase-8 induced by CD95
CD95L + CD95R → СD95R:СD95L (MA)
CD95L → DISC (kLR · CCD95R · CCD95L, CCD95R is determined by the formula (14))
Prototypes of parameter notations in the original Bentele’s model are listed in Additional file 1: Table 1S. Abbreviations used in the table represent МA – mass action kinetics and M-M – Michaelis-Menten kinetics. The column with rates includes rate orders for the fast/reduced activation scenarios.
The model comprises 43 species (including xaa) and 45 kinetic parameters, which the authors estimated based on the experimental data obtained by Western blot analysis for the human cell line SKW 6.4. Cells were stimulated by 5 μg/ml and 200 ng/ml of anti-CD95 (fast and reduced activation scenarios, respectively) and dynamics of several proteins (Bid, tBid, PARP, cPARP, procaspases-2, -3, -7, -8, -9, cleaved product of procaspase-8 p43/p41, and caspases-8) were measured.
We could not reproduce the dynamics of the original model using the parameter values provided by the authors. In particular, there was too rapid consumption of procaspases-2, -3, -7, -8 in the case of 5 μg/ml of anti-CD95 and procaspases-2, -9 in the case of 200 ng/ml. Degradation rates of procaspase-8 and caspases-8 was insufficient for both activation scenarios. Thus, we had to make several modifications of the original model to obtain the same dynamics as described in the original paper. Namely, we multiplied the rate constants of all the bimolecular reactions by the value 5∙ 10-5 and specified kd equal to 3.56 min-1 and 0.62 min-1 (instead of 0.891 min-1 and 0.184 min-1) for fast and reduced activation scenarios, respectively.
The model by Neumann et al. includes 23 species, 23 reactions constructed according to the law of mass action, and 17 kinetic parameters (Figure 4A). It reproduces experimental measurements of 8 entities (total amount of procaspase-8, its cleaved product p43/p41, caspase-8, procaspase-3, caspase-3, IκB-α, phosphorylated IκB-α and cleaved p43-FLIP) obtained using Western blot technology for HeLa cells stably overexpressing CD95–GFP and treated with three different concentrations of agonistic anti-CD95 antibodies (1500, 500 and 250 ng/ml). This is the reduced model suggested by the authors for description of the CD95-mediated pathways of cell death and NF-κB activation. Model reduction was based on intuition about what is important in the biochemical mechanisms. It was performed as long as the parameter estimation procedure (repeated after each step of the reduction) was able to provide a good fit of the experimental data. Particularly, the details of some complex formations were omitted as well as some non-measured species were removed. The authors submitted the model to the BioModels database . Thus, we had no problems reproducing it.
Reduction of the CD95-signaling model
We started the Bentele’s model reduction by excluding the direct dependence of the virtual species xaa on caspases-6 and -7. For this purpose, we approximated the amount of caspases-7 by the linear function of caspase-3 concentration:
where a = 0.18 for both activation scenarios. In addition, we considered inequalities holding for the parameters in the formula (10):
and simplified it:
After that we decomposed the model into modules (Figure 3B) corresponding to three biological steps: activation of caspase-8, cytochrome C-induced activation of caspase-9 and PARP cleavage down-regulated by these caspases.
Below we provide detailed description of the reduction process of all modules. The process is based on the flow chart represented in the Figure 2. If it is enough for a reader to have a general idea of model reduction without going into full details, we suggest to go directly to the last two paragraphs of this section, where you find the summary of the model reduction procedure.
Caspase-8 activation module includes 20 species and 14 reactions (besides the reactions of degradation), which could be divided into three groups: cleavage of procaspase-8 at the DISC complex, its activation triggered by caspase-3, and inhibition of complexes containing DISC by cFLIPL and cFLIPS (Table 1, Figure 3A, reactions br1-br14).
Firstly, we eliminated slow reactions br12 and br13 according to the method MR1. Next, we applied the quasi-steady-state analysis (MR2) to the module and removed quasi-stationary intermediates CD95R:CD95L, DISC:pro8, DISC:pro82, DISC:p43/p41 and DISC:cFLIPL. Thus, in particular, we got two main reactions instead of br1-br6: fast formation of the DISC complex (Table 1, Figure 3B, br1*) and slower activation of caspase-8 in this complex (br2*).
Further, we noticed that the consumptions of cFLIPL and cFLIPS satisfied the same kinetic laws. Therefore, these species could be lumped (MR3) resulting in the reaction br4*:
cFLIP + 2∙ DISC + pro8 → cFLIP:DISC:pro8,
where cFLIP indicated two isoforms cFLIPL and cFLIPS so that CcFLIP = CcFLIPL = CcFLIPS.
We approximated the concentration of caspase-6 by the linear function b · Ccasp3, b = 0.145 (MR4), and merged reactions br7 and br8 of caspases-8 activation induced by caspases-3 and mediated by caspases-6 into one reaction br3*:
pro8 –casp3 → casp8.
Since the reaction br8 followed the Michaelis-Menten kinetics with the constants k68 and Km68, then the reaction rate of br3* was provided by the kinetic law
where k38 = 0.145 · k68 and Km38 = Km68. Analysis of this kinetic law for low level of CD95L ensured that Cpro8 ≫ Km38. In addition, in the case of the fast activation scenario the value of vbr3* was much lower than the rate of caspase-8 activation mediated by CD95. Thus, we established vbr3* = k38·Ccasp3 without significant changes in the results of the model simulation (MR1, MR5).
Complementing the above reduction steps, we removed the elements that were unnecessary to fit the experimental dynamics provided by Bentele et al. These elements were degradation reactions of CD95L, CD95R and FLIP, and the blocked DISC complex (inactivated DISC). As a result, we introduced the conservation law:
where L0 and R0 denote initial concentrations of the ligand and receptor, respectively. Solving the differential equation
we obtained the analytical function for the receptor concentration:
The module of caspase-9 activation consisted of 19 species and 14 reactions (besides the reactions of degradation) including activation of caspase-9 triggered by cytochrome C, cleavage/activation of Bid by caspases-2 and -8, IAP inhibition of caspase-9 activity and binding of inhibitors by Smac (br15-br26, br35, br38). Based on the method MR1, we eliminated the last two reversible reactions, as well as the slow reaction br20 of the apoptosome complex dissociation. Further, since this complex was a quasi-stationary intermediate and the rate of br15 was linearly dependent on a difference of br16 and br17 rates, we reduced the chain of procaspase-9 activation (br15-br20), using the methods MR2 and MR4, to the form:
Accordingly to Bentele et al., we have the following rule of cytochrome C release from mitochondria:
Here frelease(t) satisfies the formula (11). Taking into account (15) and ignoring degradation of the complex Cyt C:Apaf-1, we got
where c = 0.59 was the coefficient of linearity.
Then, we noticed that the experimental measurements of procaspase-9 concentration were presented by Bentele and his colleagues only for 200 ng/ml of anti-CD95. In this case, degradation of procaspase-9 was insignificant. Thus, neglecting it and considering the kinetic law kApop·Cpro9·CCytC:Apaf-1 of the second reaction in (15), we obtained the differential equation of procaspase-9 dynamics:
Solving it, we found:
Finally, analyzing reactions of Bid activation (br21-br23), we removed the slower reaction mediated by caspase-2. The similar reaction involving caspase-8 followed the Michaelis-Menten kinetics with the constant Km28Bid ≫ CBid. Therefore, we redefined the kinetics of this reaction based on the law of mass action (MR5):
The module of PARP inactivation contained 13 species (including the virtual species xaa) and 11 reactions (excepting reactions of degradation). Six reactions (activation of caspases-3 and -7 by caspases-8 and -9, and cleavage/inactivation of PARP) were based on the Michaelis-Menten kinetics (br27-br32), four reactions reproduced the reversible inhibition of caspases-3 and -7 based on the law of mass action (br33, br34, br36, br37), and one corresponded to the production of xaa (br38), simplification of which was discussed above.
We deleted slow reactions of casp3:IAP and casp7:IAP complexes dissociation and ignored slow degradation of procaspase-7 and IAP. Then analyzing the cleavage of procaspases-3 and -7, we eliminated reactions triggered by caspase-9, which were slower in comparison to the similar reactions induced by caspase-8. For the same reason we ignored the reaction of PARP inactivation by caspase-3 (MR1).
Considering the remaining reactions with the Michaelis-Menten kinetics (br29, br32), we used the following inequalities Km78 ≫ Cpro7 and Km376act ≫ CPARP, which, in combination with MR5 and (12), led to the following kinetic laws:
where k3act = 0.18 · k7act
Thus, the CD95-signaling model consisting of 43 species (including one virtual species), 80 reactions and 45 kinetic parameters was approximated by a model with 18 species, 26 reactions and 25 parameters, except the constant concentration of Cytochrome C (Figure 3C). Figure 5 shows the comparison of simulated concentrations of these models with experimental dynamics obtained by Bentele et al. for the 11 species mentioned above. Since this dynamics was expressed in arbitrary units, we uniquely translated it into precise values for all proteins with non-zero initial values. However, for such molecules as caspase-8, p43/p41, tBid and cPARP, precise values directly depended on the concentration levels at the end or in the middle of time series. Accordingly, we computed these levels during the model reduction and recalculated experimental dots if necessary.
Species without experimental evidence (CD95L, DISC, cFLIP, DISC:pro8:cFLIP, IAP, caspase-3 and virtual species xaa) and reactions br1*-br13* directly affect the simulated dynamics of the experimentally measured concentrations (Table 2). Thus, further reduction of the model by removing these elements is impossible. Regarding the degradation process, we agree with Bentele et al. that experimental data cannot be matched if this process is fully ignored. Actually, if we remove any of the retained reactions of degradation, then excepted concentration dynamics will be impaired. Thus, we found the minimal complexity approximation of the original model.
The role of species and reactions in the apoptotic process described by the reduced model
The role in the apoptosis process
Triggering the apoptosis process.
Activation of caspase-8 in the DISC complex. In the case of a high ligand concentration, DISC is a slow species, so reactions br1* and br2* cannot be combined.
Activation of caspase-8 via the negative-feedback loop. When the concentration of CD95L is reduced, the rate of br3* is an order of magnitude higher than the rate of br2*. Thus, activation of caspase-8 is mainly caused by caspase-3.
Cleavage/activation of procaspase-2 is confirmed by the experimental data.
Caspase-3 activation plays a crucial role in the cleavage of procaspases-2, -8 and PARP.
PARP inactivation is confirmed by the experimental measurements of PARP and cPARP concentrations.
Inhibition of the DISC complex. cFLIP blocks the activity of DISC preventing a significant increase of caspase-8 concentration. This conclusion is consistent with the observations by Bentele et al. asserting that down-regulation of cFLIP resulted in cell death occurring already upon low concentration of anti-CD95 (1 ng/ml).
Production of blocked p43/p41, whose concentration is detected by the experimental data.
br6*, br7*, br10*
Activation of Bid and cleavage of procaspases-7 and −9. These reactions determine dynamics of the mentioned species in agreement with the experimental data.
Inhibition of caspase-3. In the case of the reduced activation scenario, IAP prevents caspase-3 from reaching a significant level and, therefore, blocks significant increase of caspase-8 due to br3*.
The virtual variable xaa specifies the process of degradation.
“Experimental data” in this table refers to the data obtained by Bentele et al..
Reduction of the CD95-mediated and NF-κB signaling model
As was mentioned above, Neumann et al. simplified their model in order to reduce the large number of free parameters. The authors noted that further simplification of the model was not possible because the model fit significantly decreased. However, we removed slow reactions (nr4, nr11-nr13, Figure 4A) using the method MR1, and removed the reaction of NF-κB degradation (nr23), which was not significant for reproducing the experimental data of the original model. Note that we retained the slow reactions nr6 and nr7, the former of which regulates apoptosis inhibition in the case of high levels of cFLIPL and procaspase-8 in accordance with the precursor model prediction (see the analysis of the predictions below), and the latter of which will be required to combine this model with the Bentele’s model hereafter.
Based on the method MR6, we also took into account the inequality CIKK ≫ Cp43−FLIP and simplified the kinetic law
of the reaction nr19 to the form
Therefore, we reduced the number of model species from 23 to 20, the number of reactions from 23 to 18 and the number of kinetic parameters from 17 to 15 (besides the constant concentration of IKK). These modifications did not change the fit to the experimental data provided by Neumann et al. (Figure 6).
Analysis of the reduced models based on the Akaike criterion (7) confirmed that they had lower complexity than the original models (Table 3). The difference between the mean AIC coefficients (8) of the models decreased by 60%, relative to the initial value. In addition, the reduced Neumann’s model better approximated experimental data. Therefore, we used it as the basis for the model composition.
Comparison of the investigated models according to Akaike’s information criterion (AIC)
Bentele et al.
Neumann et al.
We took into account that the considered experimental data were obtained with SKW 6.4  and HeLa  cells, which were shown to behave as type I  and type II  cells, respectively. In this regard, we assumed that:
initial species concentrations could vary for different cell lines;
kinetic parameters of all reactions (besides the degradation rate modeled as the function kd · xaa2) have the same values for both cell lines, whereas the value of kd could be regulated by various entities and, moreover, is dependent on the initial concentration of anti-CD95 ;
type I and type II cells conform to different reaction chains of caspases-3 activation .
We constructed the composite model of CD95 and NF-κB signaling in the following way. Firstly, according to the assumption (C), we replaced reaction nr15 in the Neumann’s model by a chain of three reactions:
The first reaction of this chain had the same kinetic law as br7*. The other reactions represented br6* and nr15 with kinetics modified using the law of mass action. Such modification of br6* was necessary to get the slow increase of caspase-3 concentration experimentally described by Neumann et al.. Modification of nr15 consisted in substitution of Ccasp9 for Ccasp8 .
Secondly, we supplemented the Neumann’s model with reaction of caspase-3 inhibition by IAP and evaluated parameters in this reaction together with parameters in (17) using the corresponding data by Neumann et al. and optimization tools of BioUML .
Thirdly, we analyzed the changes of the initial concentrations and parameters of the derived model required to reproduce the Bentele’s experimental data fixing levels of procaspases-3, -8, cleaved product p43/p41, and caspase-8 (Table 4). All the changes, except step 4, agreed with assumptions (A) and (B). To reproduce the species dynamics, we had to increase the initial concentration of procaspase-3 in the case of HeLa cells by an order of magnitude.
Modifications of the reduced Neumann’s model to reproduce the experimental data by Benteleet al
Changed parameters and concentrations
Initial values, modifications
Ranges and initial values of fitting
91.266 nM, increase
Case: anti-CD95 = 5 μg/ml Procaspase-8 is cleaved in about 30 minutes. This is possible only if DISC concentration reaches a level sufficient to accelerate the reaction nr2.
[102, 103], 442.821, Bentele et al.
64.477 nM, increase
Case: anti-CD95 = 5 μg/ml The concentration of caspase-8 should reach its maxim value in about 20 minutes.
[102, 103], 442.821, Bentele et al.
5.084 nM, increase
Case: anti-CD95 = 200 ng/ml As mentioned in Table 2, activation of caspase-8 is mainly caused by caspase-3 and, therefore, is delayed approximately for 30 minutes. Since reactions nr2 and nr5 have the same rates, we cannot observe the delay, but when we reduce the rate of nr5, we can. The latter is achieved by upregulation of the DISC:pro8 complex inhibition.
[101, 102], 65.021, Bentele et al.
0.121 nM-1min-1, decrease by an order of magnitude
Case: anti-CD95 = 200 ng/ml Preventing a rapid growth of caspase-8 concentration.
1.443 nM, refitting
Case: anti-CD95 = 5 μg/ml Improving approximation of the experimental data by Bentele et al.
[100, 101], 1.443, Neumann et al.
5.003 nM, 2.909 nM, replacement by Bentele’s values
Case: anti-CD95 = 200 ng/ml Reproducing the experimental dynamics of procaspase-9.
231.760 (Bid), 245.101 (pro-9), Bentele et al.
Finally, we combined the modules of caspase-8 and NF-κB activation with the modules of caspase-9 activation and PARP inactivation (Figure 7). For this purpose, we modified the last two modules based on (17) and refitted their parameters as well as the concentrations mentioned in Table 4, using experimental data by Bentele et al. For better fit we also supplemented the model by degradation reactions of some species (procaspase-9, caspase-9, DISC:pro8 and DISC:pro8:FLIPS).
The resulting composite model (Figure 8) consists of 30 species (including one virtual species), 38 reactions (including 15 reactions of the species degradation) and 30 kinetic parameters, except for the constant concentration of IKK (Additional file 1: Table 2S, Additional file 1: Table3S, Additional file 1: Table4S). The model showed a good fit between the simulation results and the experimental data (Figures 5 and 6).
Calculation of the mean AIC coefficient for this model revealed that it has the same level of complexity as the reduced models (Table 3). We also noted that reduction of both models did not significantly alter the steady-state concentrations (Additional file 1: Table 5S, Additional file 1: Table6S). However, the composite model has different steady-states, which are more stable according to the mean sensitivities (9) in the cases of SKW 6.4 cells and HeLa cells stimulated with 250 ng/ml of anti-CD95 (Additional file 1: Table 7S).
The reduced models are equivalent to the precursor models with respect to their biological predictions
Analyzing the models constructed by Neumann et al. and Bentele et al., we divided predictions made by them into two groups: qualitative and quantitative. The first group concerned the model network and described mechanisms of the protein-protein interactions. It is this group to which we assigned the experimentally validated Neumann's predictions that processed caspases are not required for NF-κB activation, as well as that pro-apoptotic and NF-κB pathways diverge already at DISC. The corresponding network of reactions was preserved in the reduced model. Thus, the prediction remained valid.
The second group of predictions characterized behavior of the models after changing concentrations of some species, such as CD95L, CD95R, procaspase-8, and inhibitors cFLIPL, cFLIPS, and IAP. Analyzing the predictions of the models by Neumann et al. and Bentele et al. listed in the Tables 5 and 6 respectively, we concluded that the reduction of the first of them did not alter the species dynamics (Additional file 1: Table 8S). For the second reduced model, we detected some minor changes in the predictions. However, in general, the model behavior remained in a good agreement with the Bentele's experiments (Additional file 1: Table 9S).
Analysis of predictions regarding apoptosis in HeLa cells as formulated by Neumannet al
The composite model behavior
Predictions by Neumann et al.
The concentration of anti-CD95 required for the apoptosis induction (the apoptotic threshold), is within the range of 30–100 ng/ml. This range remains the same for CD95 decreased by about 12-fold. The simulation time, which we used to reproduce this prediction, was 60 hours.
The decreased receptor number results in impairment of both CD95- and NF-κB-signaling pathways. To test this prediction, Neumann et al. considered levels of caspases-8 cleavage and IκB-α degradation for the original (solid lines) amount of CD95 and the amount decreased by about 12-fold (dashed lines). The concentration of anti-CD95 was 500 ng/ml.
Along with increasing the concentration of anti-CD95 from 500 ng/ml to 1500 ng/ml, p43/p41 peaks earlier, while there is almost no difference for p43-FLIP.
Increased concentrations of cFLIPS inhibit both apoptotic and NF-κB pathways, although p43-FLIP generation is inhibited at a lower threshold than p43/p41 generation.
Increasing the concentration of cFLIPL leads to a steep increase in p43-FLIP generation until it reaches a maximum, after which the curve drops. Lowered levels of cFLIPL result in very little p43-FLIP but almost unchanged levels of p43/p41.
At very high concentrations of cFLIPL no p43-FLIP is generated. This drop-off was not observed experimentally by the authors.
Only an intermediate level of cFLIPL promotes NF-kB activation. Decreased levels of procaspase-8 lead to a significantly lower amount of p43-FLIP and, subsequently, NF-κB. The figures show of logarithmic dependence of the maximal NF-κB concentration on the initial values of procaspase-8 and cFLIPL
High cFLIPL or low procaspase-8 concentrations cause suppression of apoptosis. The figures show the same dependence as considered in the previous prediction, but with caspases-3 instead of NF-κB.
All the predictions marked with an asterisk were experimentally tested by Neumann et al. and confirmed, unless otherwise noted. The simulation time in predictions 3–7 was 360 min. The concentration of anti-CD95 considered by the authors in predictions 4–7 was 1000 ng/ml.
Predictions of the models for SKW 6.4 cells
The models behavior
Experimental observations by Bentele et al. and predictions of the models
Experiments by Benteleet al.:
− for 1 ng/ml of anti-CD95, PARP cleavage was not observed;
− the measured death rate for 10 ng/ml of anti-CD95 was 20-30%.
Original model (red):
− the apoptotic threshold is 1.9 ng/ml;
− cPARP concentration rises dramatically within an extremely narrow interval of anti-CD95 levels overcoming the apoptotic threshold.
Composite model (blue):
− the apoptotic threshold is 3.5 ng/ml;
− cPARP concentration rises in a smooth manner along with the increase of anti-CD95 level.
Experiments by Benteleet al.: down-regulation of cFLIP in SKW 6.4 cells by addition of cyclohexamide resulted in cell death (40% for 1 day) already upon 1 ng/ml of anti-CD95. The level of cFLIP was decreased to 70%.
Original (red) and composite (blue) models:
− the apoptotic threshold is highly sensitive to the concentration of cFLIP;
− decreasing the initial concentration of cFLIP by more than 51% and 49% for the original and composite models, respectively, leads to cell death upon stimulation by 1 ng/ml of anti-CD95.
Experiments by Benteleet al.: in the 10 ng/ml activation scenario, a significant increase of caspase-8 was observed after more than 4 hours.
Original (red) and composite (blue) models: anti-CD95 concentrations which are slightly above the apoptotic threshold result in caspase-8 activation after a delay of many hours.
The figure shows peak times of caspase-8 concentration exceeding 0.1% of the initial procaspase-8 level.
− low concentrations of IAP (less than 1 nM) result in complete cell death;
− high concentrations of IAP prevent a significant increase of caspase-3 even for high concentrations of the ligand.
− low concentrations of IAP (less than 1 nM) block apoptosis for CD95L less than 0.3 nM;
− high concentrations of CD95L lead to cell death.
The figures show logarithmic dependence of the maximal caspases-3 concentration on initial values of IAP and CD95L.
The simulation time was 2880 min (2 days) in all predictions. The apoptotic threshold in the prediction 1 is the concentration of anti-CD95 after which cPARP amount exceeds 10% of the initial PARP level.
Model composition modifies some properties of the precursor models and leads to new predictions
Considering the predictive ability of the composite model, we found that in the case of HeLa cells it was completely preserved (Table 5).
In the case of SKW 6.4 cell line, we estimated the value of degradation rate parameter kd based on the experimental observations by Bentele et al. for 1–10 ng/ml of anti-CD95 (Table 6). When performing simulation experiments of the model for this cell line, we used three different values of kd depending on whether the initial concentration of CD95L was within the range 1–100 ng/ml, within the range 100–1000 ng/ml or greater than 1000 ng/ml (Additional file 1: Table 3S).
Analyzing the model predictions, we detected differences in the behavior of the Bentele’s and the composite models (Table 6). The first of them describes a threshold mechanism for CD95-induced apoptosis implying that this process is completely stopped when CD95L concentration is below the critical value. However, the model predicts a sharp increase of cPARP immediately when the level of CD95L exceeds the threshold (Table 6, № 1). In contrast, the composite model shows a gradual increase of cPARP with increase of the ligand level. To determine the apoptotic threshold in this case, we found concentration of CD95L for which cPARP ratio is equal to 10% of the initial PARP amount . As in the original model, this concentration was in the range of 1–10 ng/ml. Additionally, the models revealed sensitivity of the threshold to the concentration of cFLIP (Table 6, № 2). Both of them predicted the cell death phenotype upon stimulation by 1 ng/ml anti-CD95 and the level of cFLIP decreased by ~50%.
The next prediction, which we observed for SKW 6.4 cells, considers a delay of caspase-8 activation caused by low concentrations of anti-CD95 (Table 6, № 3). The maximal delay predicted by the Bentele’s model was about 2500 min, whereas the composite model detected a much lower value (700–800 min). Analysis of dependence of caspase-3 concentration on initial values of IAP and CD95L (Table 6, № 4) also demonstrated differences in the models’ predictions. Thus, low level of IAP (less than 1 nM) in the original model results in complete cell death. However, under the same condition the composite model shows a smooth increase of caspase-3 levels with CD95L changing from 0.3 nM to 1000 nM. If the amount of the ligand is less than 0.3 nM, IAP blocks apoptosis completely. In addition, the Bentele’s model predicts that high concentration of IAP prevents a significant increase of caspase-3 even for high levels of the ligand, whereas in the composite model high concentration of CD95L leads to cell death.
Limitations of the composite model
We analyzed a set of parametric constraints which allowed us to reduce the precursor models (Additional file 1: Table 10S). Following them, we can recover a detailed description of the investigated process. Connection of the composite model with the original model by Neumann et al. was preserved, whereas with the original model by Bentele et al. it was partially lost since the chains of species interactions were changed for the sake of combining the models together. In particular, the pathway of caspase-8 activation in DISC was derived from the Neumann’s model as well as the reaction chain of procaspase-9 cleavage was modified. However, following the constraints of Additional file 1: Table 10S, we can complete the composite model with such reactions as Bid truncation by caspase-2 and PARP cleavage triggered by caspase-7. We can also recover the details of caspase-9 activation mediated by cytochrome C and Smac release from mitochondria but with altered kinetics of release. For now, the question of admissibility of such modifications as well as extension of the composite model based on other apoptosis models remains open and is a challenge for further research.
In this paper, we considered two approaches to development of mathematical models of cell fate decisions. The first concerns the methodology of model reduction and involves approximation of one model by another one of lower dimension without affecting dynamics of experimentally measured species. The second implies composition of the models and aims at reproducing experimental dynamics of all precursor models.
There are many advantages of working with low-dimensional models . In particular, the researcher has a clear vision of the most important biochemical reactions taking place in the modeled system as well as better understanding of them. Low-dimensional models are easier to analyze and faster to simulate. This helps to save time and enhances productivity. The main limitation of model reduction consists in loss of biological information. However, it should be noted that even if some information (for example, about very slow biochemical reactions) may be lost, it can result in a more clear understanding of the most important interactions and allows focusing on the decisive processes in the model, predictive ability of which is reasonably preserved. Hence, this limitation can be transformed into an advantage.
Model composition aiming at getting a single model from several ones is useful because in such a case a computational biologist is able to investigate the composite model behavior under different conditions that cannot be performed in the precursor models separately. For example, our model allows studying the role of p43-FLIP or IAP in the type I SKW 6.4 or type II HeLa cells, respectively, that might become a task for the future work. In other words, we constructed the model that describes pro- and anti-apoptotic signal transduction in different cell types with reasonable accuracy instead of a couple of different models. Whenever necessary, some reaction chains and parameters can be switched off giving opportunity to simulate a certain type of cells. In addition, the composite model covers experimental data obtained from all precursor models, each of which separately satisfies its own data only.
Model composition sometimes causes modification of some properties of the initial models, resulting in new testable predictions. In our case, such predictions were related to SKW 6.4 cells, and some simulation results were different from the corresponding results of the original Bentele’s model. Nonetheless, the composite model behavior remained in good agreement with experimental data used in modeling by Bentele et al. Thus, the question of what model (original or composite) is more realistic requires further experimental investigation.
One of the questions that can be asked concerns the need of reducing models in order to combine them. An attempt to construct the composite modular model of apoptosis was made in . This attempt revealed multiple conceptual and methodological difficulties. The main obvious obstacles included:
choice of elements in the overlapping parts of different models;
incomparable sets of parameters;
the lack of experimental data, as well as inability to use the data obtained for different cell lines or in different ways (e.g. single-cell or cell culture measurements);
inability to make accurate predictions.
Model reduction allows solving some of these problems. In particular, reducing the number of model elements, we reduce the overlapping parts as well. This may be essential for direct combining of models. In addition, the complexity of the reduced model become comparable with the complexity of available experimental data. Therefore, the risk of model overfitting is decreased.
In the case when two models are directly related (for example, one model was emerged from the other), their composition may be significantly easier in comparison to composition of quite different models. In our work, the models by Bentele et al. and Neumann et al. are not directly related, as it could be expected as these models were constructed in the same research group. For example, they use different reaction chains of caspase-8 activation and different values of kinetic parameters in the overlapping reactions.
Another quite useful principle that we used in modeling was modular structure of the developed model. This principle provides flexibility for future extensions. Thus, we are planning to extend the composite model and supply it with modules and data from studies of TRAIL [31–33] and TNF-α [34, 35] signaling, apoptosome-dependent caspase activation  and p53 oscillation system . It is noteworthy that the model by Laussmann et al., describing TRAIL-induced activation of caspase-8, emerged from the original study by Bentele et al.. This fact may help us in our future work.
Characterising the models used in our work, we can say that we saved our time working with the model by Neumann et al. derived from the BioModels database , and spent a lot of time to reproduce the model by Bentele et al. that had not existed in a ready-to-use format. Thus, we would like to emphasize that for the common benefit, the systematic application of biological standards in modeling (e.g. SBML  and SBGN ) and depositing the working models in public databases (e.g. BioModels ) would significantly facilitate analysis of existing biomathematical models and using them as the base for development of new composite systems.
Finally, we believe that the composite model itself may be useful for further investigation of apoptosis.
Mathematical modeling provides a powerful tool for studying the properties of biological processes. Methods of model reduction allowed us to take a first step towards validation of the modular model of apoptosis . Using these methods, we composed two models describing pathways of CD95- and NF-κB-signaling in one without affecting the fit to the experimentally measured dynamics and model predictions. For the model reduction and composition, we used the BioUML software that was extended by the required methods of analysis.
This work was supported by FP6 grant 037590 "Net2Drug", FP7 grant 090107 "LipidomicNet", EU FP7 (project APO-SYS) and Agence Nationale de la Recherche (project ANR-08-SYSC-003 CALAMAR). AZ is a member of the team “Systems Biology of Cancer,” Equipe labellisée par la Ligue Nationale Contre le Cancer.
Institute of Systems Biology, Ltd
Design Technological Institute of Digital Techniques, The Siberian Branch of The Russian Academy of Sciences
Institute of Cytology and Genetics, The Siberian Branch of The Russian Academy of Sciences
Radulescu O, Gorban AN, Zinovyev A, Noel V: Reduction of dynamical biochemical reactions networks in computational biology.Frontiers in genetics 2012, 3:131.PubMedView Article
Kolpakov FA, Valeev IT, Tolstyh NI, Kisele I, Kondrakhin YV, Kutumova EO, Yevshin IS: BIoUML - open source Integrated platform for building virtual cell and virtual physiological 1human.Virtual Biology in press, DOl: 10.127041vb1e12
Calzone L, Fages F, Soliman S: BIOCHAM: an environment for modeling biological systems and formalizing experimental knowledge.Bioinformatics 2006,22(14):1805–1807.PubMedView Article
Hoops S, Sahle S, Gauges R, Lee C, Pahle J, Simus N, Singhal M, Xu L, Mendes P, Kummer U: COPASI — a COmplex PAthway SImulator.Bioinformatics 2006, 22:3067–3074.PubMedView Article
Naldi A, Berenguier D, Fauré A, Lopez F, Thieffry D, Chaouiya C: Logical modelling of regulatory networks with GINsim 2.3.Biosystems 2009,97(2):134–13.PubMedView Article
Zinovyev A, Morozova N, Nonne N, Barillot E, Harel-Bellan A, Gorban AN: Dynamical modeling of microRNA action on the protein translation process.BMC Syst Biol 2010, 4:13.PubMedView Article
Morozova N, Zinovyev A, Nonne N, Pritchard L-L, Gorban AN, Harel-Bellan A: Kinetic signatures of microRNA modes of action.RNA 2012,18(9):1635–1655.PubMedView Article
Quaiser T, Dittrich A, Schaper F, Mönnigmann M: A simple workflow for biologically inspired model reduction – application to early JAK-STAT signaling.BMC Syst Biol 2011, 5:30.PubMedView Article
Radulescu O, Gorban AN, Zinovyev A, Lilienbaum A: Robust simplifications of multiscale biochemical networks.BMC Syst Biol 2008, 2:86.PubMedView Article
Conzelmann H, Saez-Rodriguez J, Sauter T, Bullinger E, Allgöwer F, Gilles ED: Reduction of mathematical models of signal transduction networks: simulation-based approach applied to EGF receptor signalling.Syst Biol 2004,1(1):159–169.View Article
Bentele M, Lavrik I, Ulrich M, Stößer S, Heermann DW, Kalthoff H, Krammer PH, Eils R: Mathematical modeling reveals threshold mechanism in CD95-induced apoptosis.J Cell Biol 2004,166(9):839–851.PubMedView Article
Neumann L, Pforr C, Beaudouin J, Pappa A, Fricker N, Krammer PH, Lavrik IN, Eils R: Dynamics within the CD95 death-inducing signaling complex decide life and death of cells.Mol Syst Biol 2010, 6:352.PubMedView Article
Krammer PH, Rüdiger A, Lavrik IN: Life and death in peripheral T cells.Nat Rev Immunol 2007, 7:532–542.PubMedView Article
Scaffidi C, Fulda S, Srinivasan A, Friesen C, Li F, Tomaselli KJ, Debatin K-M, Krammer PH, Peter ME: Two CD95 (APO-1/Fas) signaling pathways.EMBO J 1998,17(6):1675–1687.PubMedView Article
Choi J, Yang KW, Lee TY, Lee SY: New time-scale criteria for model simplification of bio-reaction systems.BMC Bioinformatics 2008, 9:338.PubMedView Article
Wei J, Kuo JC: A lumping analysis in monomolecular reaction systems: Analysis of the exactly lumpable system.Ind Eng Chem Fundam 1969, 8:114–123.View Article
Akaike H: A new look at the statistical model identification.IEEE Transactions on Automatic Control 1974,19(6):716–723.View Article
Kutumova EO, Kiselev IN, Sharipov RN, Lavrik IN, Kolpakov FA: A modular model of the apoptosis machinery.Adv Exp Med Biol 2012,736(2):235–245.PubMedView Article
Le Novère N, Bornstein B, Broicher A, Courtot M, Donizelli M, Dharuri H, Li L, Sauro H, Schilstra M, Shapiro B, Snoep JL, Hucka M: BioModels Database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems.Nucleic Acids Res 2006, 34:D689-D691.PubMedView Article
Engels IH, Stepczynska A, Stroh C, Lauber K, Berg C, Schwenzer R, Wajant H, Jänicke RU, Porter AG, Belka C, Gregor M, Schulze-Ostho K, Wesselborg K: Caspase-8/FLICE functions as an executioner caspase in anticancer drug-induced apoptosis.Oncogene 2000, 19:4563–4573.PubMedView Article
Kutumova EO, Ryabova AS, Valeev TF, Kolpakov FA: BI0UML plug-in for nonlinear parameter estimation using multiple experimental data.Virtual Biology1: in press. DOl: 10.127041vb1e10
Gaudet S, Spencer SL, Chen WW, Sorger PK: Exploring the contextual sensitivity of factors that determine cell-to-cell variability in receptor-mediated apoptosis.PLoS Comput Biol 2012,8(4):e1002482.PubMedView Article
Albeck JG, Burke JM, Aldridge BB, Zhang M, Lauffenburger DA, Sorger PK: Quantitative analysis of pathways controlling extrinsic apoptosis in single cells.Mol Cell 2008,30(1):11–25.PubMedView Article
Laussmann MA, Passante E, Hellwig CT, Tomiczek B, Flanagan L, Prehn JH, Huber HJ, Rehm M: Proteasome inhibition can impair caspase-8 activation upon submaximal stimulation of apoptotic tumor necrosis factor-related apoptosis inducing ligand (TRAIL) signaling.J Biol Chem 2012,287(18):14402–14411.PubMedView Article
Rangamani P, Sirovich L: Survival and apoptotic pathways initiated by TNF-alpha: modeling and predictions.Biotechnol Bioeng 2007,97(5):1216–1229.PubMedView Article
Cho K-H, Shin S-Y, Lee H-W, Wolkenhauer O: Investigations into the analysis and modeling of the TNFα-mediated NF-κB-signaling pathway.Genome Res 2003, 13:2413–2422.PubMedView Article
Rehm M, Huber HJ, Dussmann H, Prehn JH: Systems analysis of effector caspase activation and its control by X-linked inhibitor of apoptosis protein.EMBO J 2006,25(18):4338–4349.PubMedView Article
Hamada H, Tashima Y, Kisaka Y, Iwamoto K, Hanai T, Eguchi Y, Okamoto M: Sophisticated framework between cell cycle arrest and apoptosis induction based on p53 dynamics.PLoS One 2008,4(3):e4795.View Article
Hucka M, Finney A, Sauro HM, Bolouri H, Doyle JC, Kitano H, Arkin AP, Bornstein BJ, Bray D, Cornish-Bowden A, Cuellar AA, Dronov S, Gilles ED, Ginkel M, Gor V, Goryanin II, Hedley WJ, Hodgman TC, Hofmeyr JH, Hunter PJ, Juty NS, Kasberger JL, Kremling A, Kummer U, Le Novère N, Loew LM, Lucio D, Mendes P, Minch E, Mjolsness ED: The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models.Bioinformatics 2003,19(4):524–531.PubMedView Article
Le Novère N, Hucka M, Mi H, Moodie S, Schreiber F, Sorokin A, Demir E, Wegner K, Aladjem MI, Wimalaratne SM, Bergman FT, Gauges R, Ghazal P, Kawaji H, Li L, Matsuoka Y, Villéger A, Boyd SE, Calzone L, Courtot M, Dogrusoz U, Freeman TC, Funahashi A, Ghosh S, Jouraku A, Kim S, Kolpakov F, Luna A, Sahle S, Schmidt E: The Systems Biology Graphical Notation.Nat Biotechnol 2009,27(8):735–741.PubMedView Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.