# Stochastic adaptation and fold-change detection: from single-cell to population behavior

- Tatiana T Marquez-Lago
^{1}Email author and - André Leier
^{1}Email author

**5**:22

**DOI: **10.1186/1752-0509-5-22

© Marquez-Lago and Leier; licensee BioMed Central Ltd. 2011

**Received: **26 September 2010

**Accepted: **3 February 2011

**Published: **3 February 2011

## Abstract

### Background

In cell signaling terminology, adaptation refers to a system's capability of returning to its equilibrium upon a transient response. To achieve this, a network has to be both sensitive and precise. Namely, the system must display a significant output response upon stimulation, and later on return to pre-stimulation levels. If the system settles at the exact same equilibrium, adaptation is said to be 'perfect'. Examples of adaptation mechanisms include temperature regulation, calcium regulation and bacterial chemotaxis.

### Results

We present models of the simplest adaptation architecture, a two-state protein system, in a stochastic setting. Furthermore, we consider differences between individual and collective adaptive behavior, and show how our system displays fold-change detection properties. Our analysis and simulations highlight why adaptation needs to be understood in terms of probability, and not in strict numbers of molecules. Most importantly, selection of appropriate parameters in this simple linear setting may yield populations of cells displaying adaptation, while single cells do not.

### Conclusions

Single cell behavior cannot be inferred from population measurements and, sometimes, collective behavior cannot be determined from the individuals. By consequence, adaptation can many times be considered a purely emergent property of the collective system. This is a clear example where biological ergodicity cannot be assumed, just as is also the case when cell replication rates are not homogeneous, or depend on the cell state. Our analysis shows, for the first time, how ergodicity cannot be taken for granted in simple linear examples either. The latter holds even when cells are considered isolated and devoid of replication capabilities (cell-cycle arrested). We also show how a simple linear adaptation scheme displays fold-change detection properties, and how rupture of ergodicity prevails in scenarios where transitions between protein states are mediated by other molecular species in the system, such as phosphatases and kinases.

## Background

Chemical reactions inside cells have long been correctly described as both discrete and stochastic [1–3], often entailing acute spatial patterns or dependencies [4–6]. Despite the intrinsic uncertainty in the occurrence of these chemical events, and basically against all odds, cells prevail as efficient decision makers. Not only are their fate decisions influenced by stochastic events and embedded within widely fluctuating environments, but they are stochastic themselves [7], the underlying mechanisms of which remain widely unknown.

So, one cannot help but wonder: how do cells process widely varying information from their environment, control their own chemical 'noise', and still manage to produce appropriate responses? The key to this question lies in signal transduction pathways, a series of interconnected chemical events that lead to highly specific cell responses. One such mechanism is adaptation, a common term used to represent sets of chemical reactions that generate a transient response in the presence of a sustained stimulus [8]. These transient responses have been shown to affect gene expression and regulatory processes, where the cell decision is determined by the strength and duration of the input signal [9].

Adaptive behavior can result from three basic signaling motifs: integral control, negative feedback, and feed-forward regulation [8]. The first is an abstraction of an engineering principle, where regulation is achieved by integrating the differences between a desired response and the state of the system. A cellular system may proceed in a similar fashion, by comparing 'actual' to 'desired' conditions, as has been found to be the case in bacterial chemotaxis [10–13] or calcium homeostasis [14].

Integral control can be achieved through appropriate combination of negative feedback loops, the latter of which are ubiquitous elements of signaling pathways, allowing for myriads of types of physiological homeostasis. In a self-regulating gene, a transcriptional repressor negatively regulates its own expression and, within certain network architectures and ranges of feedback strength, noise can be effectively reduced. In this sense, negative feedback allows a system to respond by decreasing the magnitude of any input perturbation, generally resulting in stabilization of the input signal. However, while the latter is true in a deterministic setting, several types of non-classic behavior can be observed once considering discrete signals and stochasticity [15].

In contrast, feed-forward architectures let the system respond to known cues (input signals) in a predetermined way, independently of the system's response. This is the essential difference from feedback mechanisms, where the output influences ('feeds back') the system to create a new response. For feed-forward to produce adaptation, two signal-dependent pathways must affect a third component, in opposite ways, otherwise known as 'incoherent' feed-forward loops [16].

Several exhaustive studies have shown that negative feedback regulation rarely yields perfect adaptation, whereas integral control and feed-forward regularly do so [8, 10, 11, 17]. Nevertheless, it should be noted that negative feedback can produce adaptation states close to 'perfect', and basically indistinguishable in terms of biological functions [8]. By perfect adaptation it is generally understood that the system will return to the exact state where it was before the input signal was introduced, provided the system was already in equilibrium.

Furthermore, in order to consider a system adaptive, certain eligibility criteria in terms of amplitude and duration of the system response have to be met. It should be noted that no homogeneous criteria exist in the literature, and comparison between different adaptation models can become a daunting task. Quite generally, though, amplitude has been assessed in terms of sensitivity and precision, namely, the difference between maximal response and pre-stimulation values, and the difference between equilibrium values before and after stimulation, respectively [18, 19].

Recently, some types of adaptive systems (such as the incoherent feed-forward loop) have been shown to display fold-change detection (FCD) properties. Namely, that the system generates a response to fold-changes in the input signal, rather than absolute levels [20, 21]. The latter is related to Weber's law, which describes the relationship between a stimulus and its perceived intensity, a widely used concept in perception studies.

In this respect, some experimental studies have shown how important transduction mechanisms (such as ERK2 translocation [22] or Wnt signaling [23]) display robust fold-change responses. From these studies, several hypotheses have already arisen, such as whether cells detect and process information in relative rather than absolute terms, or whether fold-change detection facilitates the production of adjustable noise filters. Proving such hypotheses would greatly aid our understanding of cell signaling pathways, as FCD could rescale meaningful signal changes with respect to the background noise.

With all these points in mind, and in response to some of the open questions posed in [18], we study the effects of stochasticity in a minimalistic adaptation architecture, a 'two-state protein' scheme [24, 25]. For such, we wanted to analyze how stochastic profiles in a single-cell system propagate to population behavior, and what this actually entails in terms of system predictability. Surprisingly, our preliminary simulations highlighted how single cell and population behavior can be completely different, adaptation largely being an emergent property of a large ensemble. This led us to analyze adaptation in an exact stochastic setting, and understand why one should think of adaptation processes in probability space, rather than in numbers of molecules.

Until now, no one had noticed how ergodicity breaks down in simple linear scenarios devoid of cell growth and replication properties. Hence, our results provide key novel insights that need to be considered in any future study of adaptation, as well as any study where biological ergodicity is readily assumed. An example of the latter is linear and nonlinear signaling pathway studies.

Additionally, we also respond to some of the open questions in [21] and show how the simple linear 'two-state protein' scheme in a stochastic setting displays fold-change detection properties, both for consecutive stimulation inputs and separate fold-stimulations. This is the first study of FCD under stochasticity, the importance of which extrapolates to any cell signaling study.

Lastly, we discuss how extensions of the 'two-state protein' scheme (by considering discrete mediators, e.g. kinases and phosphatases) retain many of the properties observed in the purely linear system, including rupture of ergodicity.

## Results

*P*and

*P*

_{ m }, respectively. The switch between the two states of the protein has basal rates

*k*

_{ f }and

*k*

_{ r }, and is additionally influenced by an input signal A with rate

*k*

_{ a }. Moreover, the total protein concentration is allowed to vary in time, and neither the synthesis of the unmodified protein (

*k*

_{ s }), nor the distinct degradation of the two states of the protein (

*d*

_{ P }and ${d}_{{P}_{m}}$), depend directly on the input signal (Figure 1A).

The analysis in [25] highlights several key issues. First, the steady state values of the protein states are proportional to the input signal, one being inversely proportional, the other being directly proportional. Second, when either protein degradation rate is close to zero (or much smaller than the other), the steady state concentration of the other protein is (nearly) independent of the signal. Such independence hints at the potential adaptation to changes in the input signal, a feature that can be readily observed when considering several parameter combinations. Furthermore, the choice of parameters will determine the sensitivity with respect to repeated stimulation. Namely, whether the system responds and adapts to consecutive input signals, or not.

The key questions here are: (1) which of the above mentioned properties hold when discreteness and stochasticity are taken into account, (2) do these properties only hold at the single-cell level, or extend to multi-cell schemes implying a kind of biological ergodicity, and lastly (3) does this system display fold-change detection properties?

### Adaptation in a stochastic setting

The chemical master equation (CME) describes the time evolution of the probability *P*(*X*, *t*), for having x= [*x*_{1},...*x*_{
N
} ] molecules at time *t* in a system with *R* elementary reactions, *N* molecular species, and volume Ω. Namely, it describes the evolution of all possible states of a chemical system in probability space.

*n*(

*m*) in

*P*

_{ n.m }denotes the number of proteins in state

*P*(

*P*

_{ m }). Additionally, we prescribe an input signal following the step function

*A*=

*S*·

*F*

_{ i }, where

*S*is in units of

*μM*

the factor *F*_{
i
} is the i^{th} signal scale parameter of *F* = (0.01,0.1,1,10,100), and the macroscopic reaction rate constants are set as follows: *k*_{
s
} = 0.01, *k*_{
a
} = 1, *k*_{
f
} = 1, *k*_{
r
} = 10, *d*_{
P
} = 0.01, ${d}_{{P}_{m}}=1$. As is usual in a stochastic analysis, concentrations and 0^{th}/2^{nd} order reaction rates have to be scaled by the factor *V*·*A*_{
v
} , where *V* is the volume and *A*_{
v
} denotes Avogadro's constant (approximately 6.02214179 × 10^{23} molecules^{-1}). Here, we consider a volume of 1 femtoliter and selected initial values close to equilibrium. Namely *P* = 0.1 and *P*_{
m
} = 0.01 *μM*, corresponding to 60 and 6 molecules, respectively.

Now, stochastic processes can be studied by trajectory based approaches or by obtaining their underlying probability distribution function (PDF), which tracks how the probability of having specific numbers of molecules in the system changes over time. This is a daunting - many times unfeasible - task, given the combinatorial explosion of the number of coupled differential equations to consider, corresponding to increasing numbers of possible states of the system.

In fact, whenever a system is solely composed of 0^{th}/1^{st} order reactions, exact analytical PDF solutions can be obtained [26, 27]. Thus, exact analytical expressions can be derived for the first two moments, which have been shown to match the solution of the system translated to a stochastic differential equation (SDE) problem [28]. Moreover, in such linear cases the first moment of the SDE solution will converge to the ODE solution, a consequence of the linearity in the drift term.

*P*

_{ m }in the exact PDF solution, it comes as no surprise that all solutions nicely match (Figure 2). As had been previously reported, the time evolution of

*P*

_{ m }can show near-perfect adaptation when ${d}_{P}\ll {d}_{{P}_{m}}$, while

*d*

_{ P }= 0 yields perfect adaptation. However, and quite intriguingly, if we focus on individual SSA trajectories, no adaptive behavior can be inferred from single trajectories for certain values of the input signal (e.g. Figure 3C, corresponding to

*F*

_{ i }= 1). The key behind this issue lies in what the solution of the CME really entails: a set of time dependent values in probability space. In this sense, computing the expected value masks how often discrepancies from this mean can happen, as well as their potential magnitude, possibly leading to entirely different dynamics. Hence, a more appropriate description of the system lies in describing the evolution of the probability, and not the expectation, in time.

To analyze this further, let us focus on perfect adaptation systems considering *F*_{
i
} = 1, *P* ∈ [0,110] and *P*_{
m
} ∈ [0,30], for which we will obtain exact PDF solutions of the CME by using finite state projections [29]. This implies the solution of the CME will be both exact and complete whenever these ranges cover all possible reachable states, portraying the full probability space instead of solely describing single exact trajectories.

*P*

_{ m }. If we now track the evolution of the probability (i.e. the exact solution of the CME) in three separate sets: 0 to 4, 5 to 6, and 7 to 30 molecules of

*P*

_{ m }it can be observed there is indeed sensitivity to the input signal and relaxation to pre-stimulus values, albeit in a probabilistic context (Figure 4). To understand what this entails, let us first focus on the system at time

*t*= 50 Here, the probability of all states containing 0-6 molecules of

*P*

_{ m }will decrease once the signal is introduced (Figure 4A), as would be expected by the sudden shift of

*P*

_{ m }to higher values in the deterministic setting. In contrast, as we approach

*t*= 100, the probability of all states containing 5-30 molecules of

*P*

_{ m }decreases (Figure 4C). However, one should notice that, at

*t*= 100 (and any other end of each stimulation interval), the system will revolve around states with 5 to 6 molecules of

*P*

_{ m }with a probability of occurrence of roughly 32% (Figure 4B). This leaves 'a lot of room' (the remaining ~68%) for the system to be located elsewhere, as can be readily observed from single cell simulations (e.g. Figure 3C). Furthermore, of these 32%, only half belong to having 6 molecules of

*P*

_{ m }in the system, which is closest to the deterministic solution. Most importantly, differences in equilibrium values entail wide variations for initial conditions of the next simulation interval, yielding the observed heterogeneity in single cell behavior.

The description above highlights a property of any stochastic description: a system cannot be guaranteed to be in any state, and probabilistic bounds are the maximal level of information. However, one should notice the signal in this example is at least 2 orders of magnitude larger than any other component of the system. Hence, the 'two-state protein' scheme provides for a counter-intuitive example where local noise overrides the effect of a strong external signal, and adaptation behavior can become an emergent property only attained at the (mean) population level. Moreover, as could be expected from the deterministic solution, the probability profile also portrays loss of sensitivity with repeated stimulation.

**P** opulation behavior

Ensemble measurements (such as those obtained from flow cytometry) display cell characteristics as distributions of values calculated over large samples of cells and, many times, distributions of cells at certain stationary states are used to infer the stochastic behavior of a single cell. By doing so, a biological version of ergodicity is necessarily implied: the percentage of the cell population in a particular state is identical to the probability to find a single cell in that state [30].

Mathematically, the ergodicity of a stochastic process is guaranteed if (i) the stochastic process is a finite-state Markov process and (ii) the stochastic process converges to a stationary state for any initial condition [1]. However, such assumptions have many times been relaxed or misinterpreted and, in such cases, erroneous conclusions with respect to single cell behavior could have been derived from population data [30].

Recently, many studies in the literature have addressed this issue. Population distributions have been based on chemical Langevin equations [3, 31, 32], and clever solution methods have been developed by noticing a Sturm-Liouville operator. For instance, the authors in [31] highlight the potential bias of population measures when cell replication rates are not homogeneous, or depend on the cell state. Similarly, the authors in [30] support the latter findings and further discuss how ergodicity breaks down whenever there are chemical interactions between cells, and when single cells display 'complicated' behavior (such as bistability).

Our exact solution of the two- state protein system shows how ergodicity cannot even be assumed in minimalistic linear examples. Our linear system underlies a finite-state Markov process, is expected to relax to a stationary state, and is devoid of possible effects via cell replication and chemical interactions between cells. However, for certain input signal strengths, biological ergodicity still breaks down. In a nutshell, when the signal tuning parameter is set as *F*_{
i
} < 1, no adaptive behavior is observed in either single cells or populations. In contrast, when considering *F*_{
i
} > 1, both single cells and populations exhibit adaptation. However, when *F*_{
i
} = 1, single cells need not display any apparent sensitivity to the input signal, while both sensitivity and adaptive behavior can be observed at the population level (Figure 3C and 3H).

*t*> 0 [27]. Our results are entirely consistent with the theory (Figure 6). Hence, an adequate sample size and any other implications of the model have to be inferred from the underlying properties of this distribution (or else be thought as independent Binomial trials, the limit of which is the Poisson distribution).

Lastly, it should be noted there exist analytic results for 'open' and 'closed' systems of first order reactions, with arbitrary initial probability distributions. Hence, one can benefit from extracting an adequate sample size (or other properties) for arbitrary applications, provided all underlying reactions are unimolecular. In such cases, an appropriate PDF can be derived by the convolution of Poisson and Multinomial distributions, for any time *t* > 0 [27].

### Fold-change detection properties

Recent studies have highlighted the peculiar capability of certain systems to respond to fold-changes in the input signal, rather than to absolute differences in numbers of molecules [20, 21]. This is the essence of Weber-Fechner's law, which states that the maximal response to a change in signal is inversely proportional to the background signal or, in other words, that the ratio of the smallest increment and the background intensity of a signal is constant. This can be better understood by quoting an analogy used in [33]: while it is easy to understand whispered voices (increment signal) inside a quiet room (background signal), it is very hard to notice someone shouting in our ear during a Rock concert.

The recently coined term fold-change detection (FCD) implies both Weber's law and perfect adaptation. However, simultaneous application of Weber's law and perfect adaptation do not necessarily yield FCD [20], and sufficient conditions have been presented to obtain it. Namely, if a system can be described by $\dot{x}=f(x,y,u)$ and $\dot{y}=g(x,y,u)$, where *y* corresponds to the output, *u* to the input signal, and *x* to the remaining chemical species, FCD can be achieved if the system is stable, shows perfect adaptation, and for *λ* > 0 it can be shown that *f*(*λx, y, λu*) = *λf*(*x, y, u*) and *g*(*λx, y, λu*) = *g*(*x, y, u*) [20].

Perhaps more intuitively, strict FCD properties could not be expected, since the 'two-state protein' scheme shows remarkable loss of sensitivity to repeated stimuli. Nevertheless, the criteria posed in [20] is only sufficient, and not necessary, so two questions are worth considering. First, to how many repetitions of the stimulus does FCD refer to? And second, to what extent are consecutive relaxations to a steady state expected to match?

_{1}= [2

^{0}2

^{1}... 2

^{10}] and A

_{2}= 2*A

_{1}introduced at identical time points, FCD properties hold in two perspectives (Figure 7).

_{2}are within 10% of the amplitude of those obtained with A

_{1}(Figure 8 and 9). Most importantly, these results hold in the deterministic regime, and the first moment of the stochastic system.

## Discussion

Our study of the 'two-state protein' in a stochastic setting lead us to simple yet illustrative examples on how biological ergodicity may be invalid, even in simple linear settings devoid of cell replication properties. A follow-up question could be: what would happen if the transitions between protein states were mediated by other molecular species in the system? In this case, one could consider discrete mediators (activators and deactivators, e.g. kinases and phosphatases) switching back and forth between the two protein states, as depicted in Figure 1B. Here, signal changes could refer to varying concentrations of the kinase and/or phosphatase.

*μM*) and single parameter values $({k}_{{a}_{2}},{k}_{{d}_{1}},{k}_{{d}_{3}}\in [0.1,10,{10}^{3}])$. The same holds for simultaneous variations of $({k}_{{d}_{1}},{k}_{{d}_{3}})$ or $({k}_{{a}_{1}},{k}_{{a}_{2}})$ while, interestingly, a completely different profile is obtained by simultaneous key variations of $({k}_{{a}_{1}},{k}_{{a}_{2}},{k}_{{a}_{3}})$. For instance, if we set these parameter values to (10

^{3}, 0.1, 0.1) a response that correlates negatively with changes in the signal is obtained (Figure 12). The latter can be explained by the high value of the ratio ${k}_{{a}_{1}}/{k}_{{a}_{2}}$, effectively 'trapping'

*P*molecules in a bound configuration with the kinase, hence decreasing the numbers of molecules of both

*P*and

*P*

_{ m }temporarily.

As can be intuitively expected, a similar effect in *P*_{
m
} can be obtained by considering key variations of parameters $({k}_{{d}_{1}},{k}_{{d}_{2}},{k}_{{d}_{3}})$ with a varying phosphatase 'signal' (data not shown). Nonetheless, the profile of *P* will differ from the previous case, as the reaction set is not symmetric (Figure 1B), while it should be kept in mind a separation of timescales in the protein degradation rates was necessary to achieve adaptation. Additionally, changes in the kinase/phosphatase signal are not equivalent to the minimalistic 'two-state protein' system, since these discrete mediators are treated as molecular species and, as such, their numbers can fluctuate in time. Moreover, changes to the signal intensity only refer to unbound signal molecules and, in contrast to the linear case, the total number of signal molecules within the system can accumulate in time. The latter can be readily observed in distinct chemical scenarios (such as Figure 12) where a considerable number of kinase/phosphatase molecules can be 'trapped' in a bound configuration, the molecules of which remain within the system irrespective of changes in the signal.

In our kinase/phosphatase mediated adaptation example, obtaining an exact PDF solution of the CME would be computationally expensive, if not unfeasible, given the explosion in the number of reachable states. In this case a finite state projection using Krylov subspaces, such as [34] would be preferable. Alternatively, if the mediators are highly concentrated, one could 'decouple' them from the rest of the molecular species, yielding sets of unimolecular reactions, which in turn allows for obtaining an analytic closed solution. We will leave such analysis for a separate publication, given the high discrepancy of parameter values so far encountered and the significant deviation from the main focus of this work. However, considerations such as this, or deriving alternative closure of moments of the CME to account for non-linear terms, will greatly enhance future adaptation studies.

## Conclusions

In this paper, we have studied the effects of stochasticity in a 'two-state protein' scheme, providing an explanation of what adaptation means and entails in a stochastic setting. Namely, that an adaptation profile can be achieved by calculating the first moment of the CME, but that the underlying probability distribution might be wide enough to prevent one from making definite quick-and-dirty assertions going from a single cell to the population level, or the other way around.

In this sense, adaptation can many times be considered an emergent property of the collective system, restricting modelers/experimentalists to obtain large samples of time courses in order to infer properties of the system as a whole. The characteristics of such samples (e.g. a minimum number of single cells to depict population behavior), are necessarily described by the underlying probability distribution corresponding to the solution of the chemical master equation. Here, we have presented the overlap of an exact solution (the CME solved in matrix form), an analytical solution (the convolution of Poisson and Multinomial distributions, which is reduced to solely the Poisson distribution in our case), as well as trajectorial and deterministic solutions. Our analysis highlights the source of variability in single-cell scenarios, explaining the cause for rupture in ergodicity in a simple linear reaction network. We have also provided a clear perspective on how systems analysis with varying inputs can be addressed.

Additionally, we have shown how the minimalistic 'two- state protein' scheme displays fold-change detection properties in a stochastic setting. The latter refers to consecutive stimulation inputs and independent stimulations, and extends FCD properties to a system with near-perfect adaptation. Moreover, repeated stimulation preserved fold-change detection properties, despite loss of sensitivity to the input signal.

Lastly, we discussed extensions of the 'two-state protein' scheme by the consideration of discrete mediators (e.g. kinases and phosphatases). Our preliminary simulations show how such extensions retain many of the properties observed in the purely linear system, including loss of ergodicity.

To the best of our knowledge, this is the first time biological ergodicity has been shown to break down in a minimalistic linear architecture. The latter had been readily observed when cell replication rates are not homogeneous, or depend on the cell state, but never before in cell-cycle arrested scenarios composed of solely linear non-delayed terms. Furthermore, this is the first time fold-change detection properties have been studied in a stochastic setting.

## Methods

### Brief explanation of the Finite State Projection (FSP) method

For the purposes of this paper, the models are both bounded and finite, so we restrict our notation to N dimensions. If we define a vector p∈ ℝ ^{
n
} such that each entry corresponds to the probability *P(x;t)* for each reachable state x, we can think of its time evolution as $\dot{\mathit{p}}(t)=A\mathit{p}(t)$, where the matrix A = [a_{ij}] contains the propensities and *a*_{
jj
} = −Σ _{
i≠j
}*a*_{
ij
} , which basically means that each row of the matrix sums up to zero and the probability is conserved. Given an initial distribution p(0), the solution at time t is p(*t*) = exp(*t* A ) p(0), where the matrix exponential is generally defined through its Taylor series expansion. If the reachable state space is large it may come in handy to consider a finite state projection [29], in which matrix A is replaced by A_{
k
}, a k × k submatrix of the true operator A, the corresponding indexed system states form the finite state projection and p(*t*_{
f
} ) ≈ exp(*t*_{
f
} A_{
k
} ) p_{
k
}(0) is the approximation to p(*t*) = exp(*t* A ) p(0) at time *t*_{
f
} . An approximation can be gradually improved by adding reachable states up to a pre-specified tolerance level.

*P, P*

_{ m }), and corresponds to the enumerated state of the system

*j*(

*M*

_{ P }+ 1) +

*i*+ 1.

*M*

_{ P }is the maximum number of molecules of

*P*considered in the finite projection.

### Single cell vs. population measurements, from the simulation perspective

### Solution methods and equilibrium values for the two-state protein model

where *A* = *A*(*t*), and in this case *A*(*t*) is piecewise constant. The latter allowed us to use finite state projections in time intervals where *A*(*t*) = *c*, *c* ∈ ℛ.

and if ${d}_{{P}_{m}}=0$, then *P* *= *k*_{
s
} /*d*_{
P
} and *P*_{
m
} * = *k*_{
s
} (*k*_{
f
} + *k*_{
a
}*A*)/(*d*_{
P
}*k*_{
r
} ). Similarly, if *d*_{
P
} = 0 we have ${P}^{*}={k}_{s}({k}_{r}+{d}_{{P}_{m}})/{d}_{{P}_{m}}({k}_{f}+{k}_{a}A)$ and ${P}_{m}^{*}={k}_{s}/{d}_{{P}_{m}}$. As can be readily observed, when one of the degradation rates is equal to zero, the steady state solution of one molecular species is independent of the input signal.

*b*=

*g*(

*t*):

*t*) for the homogeneous problem $\left(\dot{P}=A(t)\cdot P,P({t}_{0})={P}_{0}\right)$ has been obtained, we can use the method of variation of parameters to construct a particular solution:

and given the drift term is linear, the first moment of the SDE system will be identical to the ODE solution.

if matrix a_{
1
}(*t*) commutes for all times *t*_{1} and *t*_{2} such that *t*_{1} ≠ *t*_{2} . Otherwise, methods such as the Magnus expansion (or Fer, symmetric Fer, Cayley, etc.) can be used to obtain a fundamental solution.

## Declarations

### Acknowledgements

Both authors would like to thank Stanly Steinberg, Kevin Burrage and Pablo Padilla for helpful comments and suggestions on the manuscript. The authors declare no funding sources for research and preparation of this manuscript.

## Authors’ Affiliations

## References

- Gardiner C:
*Stochastic Methods. A Handbook for the Natural and Social Sciences*. 4th edition. Springer; 2009. - Gillespie D:
**A General Method for Numerically Simulating the Stochastic Time-Evolution of Coupled Chemical Reactions.***J Comput Phys*1976,**22:**403-434. 10.1016/0021-9991(76)90041-3View Article - van Kampen NG:
*Stochastic Processes in Physics and Chemistry*. Elsevier; 2007. - Andrews SS, Bray D:
**Stochastic simulation of chemical reactions with spatial-resolution and single molecule detail.***Phys Biol*2004,**1:**137-151. 10.1088/1478-3967/1/3/001View ArticlePubMed - Takahashi K, Arjunan SN, Tomita M:
**Space in systems biology of signaling-pathways--towards intracellular molecular crowding in silico.***FEBS Lett*2005,**579:**1783-1788. 10.1016/j.febslet.2005.01.072View ArticlePubMed - Turner TE, Schnell S, Burrage K:
**Stochastic approaches for modelling in vivo-reactions.***Comput Biol Chem*2004,**28:**165-178. 10.1016/j.compbiolchem.2004.05.001View ArticlePubMed - Perkins TJ, Swain PS:
**Strategies for cellular decision-making.***Mol Syst Biol*2009,**5:**326. 10.1038/msb.2009.83PubMed CentralView ArticlePubMed - Behar M, Hao N, Dohlman HG, Elston TC:
**Mathematical and computational-analysis of adaptation via feedback inhibition in signal transduction pathways.***Biophys J*2007,**93:**806-821. 10.1529/biophysj.107.107516PubMed CentralView ArticlePubMed - Hao N, Behar M, Elston TC, Dohlman HG:
**Systems biology analysis of G protein-and MAP kinase signaling in yeast.***Oncogene*2007,**26:**3254-3266. 10.1038/sj.onc.1210416View ArticlePubMed - Ni XY, Drengstig T, Ruoff P:
**The control of the controller: molecular mechanisms-for robust perfect adaptation and temperature compensation.***Biophys J*2009,**97:**1244-1253. 10.1016/j.bpj.2009.06.030PubMed CentralView ArticlePubMed - Yi TM, Huang Y, Simon MI, Doyle J:
**Robust perfect adaptation in bacterial-chemotaxis through integral feedback control.***Proc Natl Acad Sci USA*2000,**97:**4649-4653. 10.1073/pnas.97.9.4649PubMed CentralView ArticlePubMed - Alon U, Surette MG, Barkai N, Leibler S:
**Robustness in bacterial chemotaxis.***Nature*1999,**397:**168-171. 10.1038/16483View ArticlePubMed - Barkai N, Leibler S:
**Robustness in simple biochemical networks.***Nature*1997,**387:**913-917. 10.1038/43199View ArticlePubMed - El-Samad H, Goff JP, Khammash M:
**Calcium homeostasis and parturient-hypocalcemia: an integral feedback perspective.***J Theor Biol*2002,**214:**17-29. 10.1006/jtbi.2001.2422View ArticlePubMed - Marquez-Lago T, Stelling J:
**Counter-intuitive stochastic behavior of simple gene-circuits with negative feedback.***Biophys J*2010,**98:**1-9. 10.1016/j.bpj.2010.01.018View Article - Levchenko A, Iglesias PA:
**Models of eukaryotic gradient sensing: application to-chemotaxis of amoebae and neutrophils.***Biophys J*2002,**82:**50-63. 10.1016/S0006-3495(02)75373-3PubMed CentralView ArticlePubMed - Muzzey D, Gomez-Uribe CA, Mettetal JT, van Oudenaarden A:
**A systems-level-analysis of perfect adaptation in yeast osmoregulation.***Cell*2009,**138:**160-171. 10.1016/j.cell.2009.04.047PubMed CentralView ArticlePubMed - Artyukhin AB, Wu LF, Altschuler SJ:
**Only two ways to achieve perfection.***Cell*2009,**138:**619-621. 10.1016/j.cell.2009.08.010View ArticlePubMed - Ma W, Trusina A, El-Samad H, Lim WA, Tang C:
**Defining network topologies that-can achieve biochemical adaptation.***Cell*2009,**138:**760-773. 10.1016/j.cell.2009.06.013PubMed CentralView ArticlePubMed - Shoval O, Goentoro L, Hart Y, Mayo A, Sontag E, Alon U:
**Fold-change detection-and scalar symmetry of sensory input fields.***Proc Natl Acad Sci USA*2010. - Goentoro L, Shoval O, Kirschner MW, Alon U:
**The incoherent feedforward loop-can provide fold-change detection in gene regulation.***Mol Cell*2009,**36:**894-899. 10.1016/j.molcel.2009.11.018PubMed CentralView ArticlePubMed - Cohen-Saidon C, Cohen AA, Sigal A, Liron Y, Alon U:
**Dynamics and variability of-ERK2 response to EGF in individual living cells.***Mol Cell*2009,**36:**885-893. 10.1016/j.molcel.2009.11.025View ArticlePubMed - Goentoro L, Kirschner MW:
**Evidence that fold-change, and not absolute level, of-beta-catenin dictates Wnt signaling.***Mol Cell*2009,**36:**872-884. 10.1016/j.molcel.2009.11.017PubMed CentralView ArticlePubMed - Csikasz-Nagy A, Soyer OS:
**Adaptive dynamics with a single two-state protein.***J-R Soc Interface*2008,**5**(Suppl 1):S41-47. 10.1098/rsif.2008.0099.focusPubMed CentralView ArticlePubMed - Soyer OS, Kuwahara H, Csikasz-Nagy A:
**Regulating the total level of a signaling-protein can vary its dynamics in a range from switch like ultrasensitivity to adaptive responses.***FEBS J*2009,**276:**3290-3298. 10.1111/j.1742-4658.2009.07054.xView ArticlePubMed - Gadgil C, Lee CH, Othmer HG:
**A stochastic analysis of first-order reaction-networks.***Bull Math Biol*2005,**67:**901-946. 10.1016/j.bulm.2004.09.009View ArticlePubMed - Jahnke T, Huisinga W:
**Solving the chemical master equation for monomolecular-reaction systems analytically.***J Math Biol*2007,**54:**1-26. 10.1007/s00285-006-0034-xView ArticlePubMed - Khanin R, Higham DJ:
**Chemical Master Equation and Langevin regimes for a-gene transcription model.***Theoretical Computer Science*2008,**408:**31-40. 10.1016/j.tcs.2008.07.007View Article - Munsky B, Khammash M:
**The finite state projection algorithm for the solution of-the chemical master equation.***J Chem Phys*2006,**124:**044104. 10.1063/1.2145882View ArticlePubMed - Tozaki H, Kobayashi TJ, Okano H, Yamamoto R, Aihara K, Kimura H:
**Reconstructing the single-cell-level behavior of a toggle switch from population-level measurements.***FEBS Lett*2008,**582:**1067-1072. 10.1016/j.febslet.2008.02.057View ArticlePubMed - Sato K, Kaneko K:
**On the distribution of state values of reproducing cells.***Phys-Biol*2006,**3:**74-82. 10.1088/1478-3975/3/1/008View ArticlePubMed - Friedman N, Cai L, Xie XS:
**Linking stochastic dynamics to population-distribution: an analytical framework of gene expression.***Phys Rev Lett*2006,**97:**168302. 10.1103/PhysRevLett.97.168302View ArticlePubMed - Ferrell JE Jr:
**Signaling motifs and Weber's law.***Mol Cell*2009,**36:**724-727. 10.1016/j.molcel.2009.11.032View ArticlePubMed - Macnamara S, Bersani AM, Burrage K, Sidje RB:
**Stochastic chemical kinetics and-the total quasi-steady-state assumption: application to the stochastic simulation algorithm and chemical master equation.***J Chem Phys*2008,**129:**095105. 10.1063/1.2971036View ArticlePubMed

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.