# The slow-scale linear noise approximation: an accurate, reduced stochastic description of biochemical networks under timescale separation conditions

- Philipp Thomas
^{1, 2, 3}, - Arthur V Straube
^{1}and - Ramon Grima
^{2, 3}Email author

**6**:39

**DOI: **10.1186/1752-0509-6-39

© Thomas et al.; licensee BioMed Central Ltd. 2012

**Received: **28 November 2011

**Accepted: **13 March 2012

**Published: **14 May 2012

## Abstract

### Background

It is well known that the deterministic dynamics of biochemical reaction networks can be more easily studied if timescale separation conditions are invoked (the quasi-steady-state assumption). In this case the deterministic dynamics of a large network of elementary reactions are well described by the dynamics of a smaller network of effective reactions. Each of the latter represents a group of elementary reactions in the large network and has associated with it an effective macroscopic rate law. A popular method to achieve model reduction in the presence of intrinsic noise consists of using the effective macroscopic rate laws to heuristically deduce effective probabilities for the effective reactions which then enables simulation via the stochastic simulation algorithm (SSA). The validity of this heuristic SSA method is *a priori* doubtful because the reaction probabilities for the SSA have only been rigorously derived from microscopic physics arguments for elementary reactions.

### Results

We here obtain, by rigorous means and in closed-form, a reduced linear Langevin equation description of the stochastic dynamics of monostable biochemical networks in conditions characterized by small intrinsic noise and timescale separation. The slow-scale linear noise approximation (ssLNA), as the new method is called, is used to calculate the intrinsic noise statistics of enzyme and gene networks. The results agree very well with SSA simulations of the non-reduced network of elementary reactions. In contrast the conventional heuristic SSA is shown to overestimate the size of noise for Michaelis-Menten kinetics, considerably under-estimate the size of noise for Hill-type kinetics and in some cases even miss the prediction of noise-induced oscillations.

### Conclusions

A new general method, the ssLNA, is derived and shown to correctly describe the statistics of intrinsic noise about the macroscopic concentrations under timescale separation conditions. The ssLNA provides a simple and accurate means of performing stochastic model reduction and hence it is expected to be of widespread utility in studying the dynamics of large noisy reaction networks, as is common in computational and systems biology.

## Background

Biochemical pathways or networks are typically very large. A well-characterized example is the protein-protein interaction network of the yeast *Saccharomyces cerevisiae* with approximately a thousand putative interactions involving an approximate equal number of proteins[1]. It is also a fact that a significant number of species are found in low copy numbers in both prokaryotic and eukaryotic cells[2, 3]. Recent mass spectrometry-based studies have, for example, shown that 75% of the proteins in the cytosol of the bacterium *Escherichia coli* appear in copy numbers below 250 and the median copy number of all identified proteins is approximately 500[3]. This means that simulation methods intended to realistically capture the inner workings of a cell have to (i) be stochastic to take into account the significant intrinsic noise associated with low copy number conditions; (ii) be able to simulate fairly large networks in a reasonable amount of time. The stochastic simulation algorithm (SSA)[4] has been and still is the algorithm of choice for a large number of studies exploring the role of noise in biology. The advantage of the algorithm is that it is exact, i.e., it exactly samples the trajectories of the stochastic process described by the chemical master equation (CME), the accepted mesoscopic description of chemical kinetics. Its disadvantage is that it simulates every reaction event and hence is not particularly suited for the study of large networks[5]. This problem is an outstanding challenge in the fields of computational and systems biology.

A common way of circumventing the problem is to simulate a network of species which is much smaller than the size of the full network but which nevertheless captures the essential dynamics. For example, the three elementary (unimolecular or bimolecular) reactions which describe the enzyme-assisted catalysis of substrate *S* into product *P* via the Michaelis-Menten reaction,$S\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}+\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}E\phantom{\rule{0.3em}{0ex}}\underset{{k}_{1}}{\overset{{k}_{0}}{\rightleftharpoons}}\phantom{\rule{0.3em}{0ex}}C\stackrel{{k}_{2}}{\to}E\phantom{\rule{0.3em}{0ex}}+\phantom{\rule{0.3em}{0ex}}P$, can be replaced by a single effective reaction$S\stackrel{{k}^{\prime}}{\to}P$. Note that here *E* and *C* denote the free enzyme species and the enzyme-substrate complex species, respectively. The latter first-order reaction is non-elementary, i.e., it can be broken down into a set of fundamental elementary reactions. The implicit assumption in this lumping or coarse-graining method is that the transients in the average concentrations of some species decay over much longer timescales than those of the rest of the species. Hence, one can argue that the relevant network to be simulated is that involving the slowly varying species only. In the Michaelis-Menten example, the fast species were the enzyme and the complex and the slow species are the substrate and product. The dynamics of this reduced network are of course only a faithful approximation of those of the full network, the Michaelis-Menten reaction, whenever the rate constants guarantee reasonable timescale separation.

On the macroscopic level, where molecule numbers are so large that intrinsic noise can be ignored, there is a well-known practical recipe for obtaining this reduced or coarse-grained network from the full network of elementary reactions. One writes down the rate equations (REs) for each species, decides which species are fast and slow, sets the time derivative of the concentration of the fast species to zero, solves for the steady-state concentrations of the fast species and finally substitutes these concentrations into the equations for the slow species. This procedure is the deterministic quasi-steady-state assumption (QSSA). The result is a set of new REs for the slow species only; corresponding to these reduced equations is the coarse-grained network, i.e., the network of reactions between slow species whose macroscopic rate laws are dictated by the new REs. Generally, all coarse-grained networks will have at least one reaction which is non-elementary; however those reactions involving the interaction of only slow species in the full network will naturally also remain elementary in the coarse-grained network. The deterministic QSSA presents a rigorous method of achieving a coarse-grained macroscopic description based on the deterministic REs[6]. Its major shortcoming is that it ignores the inherent stochasticity of the system.

On the mesoscopic level, or, in other words, whenever the size of intrinsic noise becomes comparable with the average molecule numbers, the description of chemical kinetics is given by the CME. One would hope that under conditions of timescale separation, just as one can write effective REs for a coarse-grained network starting from the REs of the full network, in a similar manner one can obtain an effective (or reduced) CME for the coarse-grained network starting from the CME of the full network. The effective REs have information about the macroscopic concentrations of the slow species only, while the effective CME has information about the fluctuations of the slow species only. This line of reasoning has led to a stochastic formulation of the QSSA which is in widespread use. In what follows we concisely review the CME formulation of stochastic kinetics and point out compelling reasons which cast doubt on the validity of the popular stochastic QSSA.

*N*of distinct chemical species interacting via

*R*elementary or non-elementary chemical reactions of the type

*j*is an index running from 1 to

*R*,

*X*

_{ i }denotes chemical species

*i*,

*s*

_{ ij }and

*r*

_{ ij }are the stoichiometric coefficients and

*k*

_{ j }is the macroscopic rate coefficient of the reaction. If reaction scheme (1) describes the full network with

*N*

_{ s }number of slow species and

*N*

_{ f }=

*N*−

*N*

_{ s }number of fast species, then we adopt the convention that

*X*

_{1}to$\left(\right)close="">{X}_{{N}_{s}}$ denote the slow species, while$\left(\right)close="">{X}_{{N}_{s}+1}$ to

*X*

_{ N }label the fast species. Let

*n*

_{ i }denote the absolute number of molecules of the

*i*th species; then, at any point in time, the system is described by the state vector$\overrightarrow{n}={({n}_{1},\dots ,{n}_{N})}^{T}$. When the

*j*th reaction occurs, the system jumps from state$\left(\right)close="">\overrightarrow{n}$ to a new state$\overrightarrow{n}+{\overrightarrow{\mu}}_{j}$, where${\overrightarrow{\mu}}_{j}=\left({r}_{1j}-{s}_{1j},\mathrm{...},{r}_{\mathrm{Nj}}-{s}_{\mathrm{Nj}}\right)$. Furthermore, one defines a propensity function

*a*

_{ j }for the

*j*th reaction such that${a}_{j}\left(\overrightarrow{n}\right)\mathrm{dt}$ is the probability that the

*j*th reaction occurs in the next infinitesimal time interval$\left[t,t+\mathrm{dt}\right)$. Using these definitions and the laws of probability, one can then deduce that the general form of the CME is[5]

*f*

_{ j }, i.e., the rate of reaction according to the deterministic REs, is also shown alongside the microscopic rate functions. Note that$\left[{X}_{i}\right]$ in the macroscopic rate functions denotes the macroscopic concentration of species

*i*.

If we are modeling the full network, then the constituent reactions have to be all elementary. For such reactions, the propensity and microscopic rate functions have been derived from molecular physics[7] and hence the CME for the full network is fundamentally correct. Now say that we are modeling a coarse-grained network in which case some reactions are non-elementary. Microscopic considerations do not tell us anything about the form of the propensity functions for such reactions. Rather the propensities and the microscopic rate functions are a heuristic extrapolation of the macroscopic reaction rates at the heart of the effective REs for the non-elementary reactions:$\left(\right)close="">\widehat{f}$ is obtained by performing the substitution$\left[{X}_{i}\right]\to {n}_{i}/\mathrm{\Omega}$ on *f* .

*Hence it follows that the CME for the coarse-grained network is not rigorously derived from that of the full network under conditions of timescale separation but rather is heuristic and hence its validity is a priori doubtful*. Janssen was the first to investigate this question by means of an analytical approach applied to a simple chemical example, the dissociation of *N*_{2}*O*_{5}; he showed that “the master equation for a complex chemical reaction cannot always be reduced to a simpler master equation, even if there are fast and slow individual reaction steps”[8]. This suggests that even if the molecules numbers are quite large, the conditions for timescale separation required for the validity of the deterministic QSSA are not generally enough to guarantee the validity of the heuristic CME, a hypothesis which has been recently verified in the context of the Michaelis-Menten reaction with substrate input[9]. In other words, *the heuristic CME is not the legitimate stochastic equivalent of the deterministic QSSA, in the sense that it does not correctly describe the statistics of the intrinsic noise about the macroscopic concentrations as given by the reduced REs of the coarse-grained network*.

Notwithstanding the fundamental objections of Janssen, and frequently in the name of pragmatism, many studies[10–13] have employed the heuristic CME to obtain a coarse-grained stochastic description of various complex networks. A number of studies[14–17] have reported good agreement between the results of stochastic simulations of the full and coarse-grained networks for enzyme reactions and circadian oscillators which has enhanced faith in the heuristic approach of stochastic modeling of networks with non-elementary reactions and given it the status of a mainstream methodology.

In this article we seek to derive a rigorous alternative to the heuristic approach. Given the CME of the full network of elementary reactions, we derive a reduced linear Fokker-Planck equation (FPE) which describes the noise statistics of the same network when the molecule numbers are not too small and under the same conditions of timescale separation imposed by the deterministic QSSA. This new FPE is the legitimate mesoscopic description of intrinsic noise about the macroscopic concentrations of the coarse-grained network as obtained by the deterministic QSSA. The noise statistics from this approach are compared with stochastic simulations of the full network and with simulations of the coarse-grained network using the conventional heuristic approach. In all cases our approach agrees very well with the full network results. In contrast, we show how the size of intrinsic noise as predicted by the conventional approach can be different by more than an order of magnitude than the actual value and how in some instances this approach even misses the existence of noise-induced oscillations. We also show using our method how one can obtain the regions of parameter space where the conventional approach qualitatively fails and where it fares well.

The article is organized as follows. In the Results section, we discuss in general terms the procedure of obtaining a rigorous mesoscopic description under conditions of timescale separation akin to those of the deterministic QSSA. We then apply this novel method to two different examples: an enzyme mechanism capable of displaying both Michaelis-Menten and Hill-type kinetics and a gene network with a single negative feedback loop. The results from our method are contrasted and compared with stochastic simulations of the full network and with those of the coarse-grained network using the conventional heuristic method. We finish by a discussion. Detailed derivations concerning results and applications can be found in the Methods section.

## Results

*i*in the CME, equation (2), as

where$\left[{X}_{i}\right]$ is the macroscopic concentration of species *i* and *ε*_{
i
}is proportional to the noise about this concentration. This substitution leads to an infinite expansion of the master equation. The first term, that proportional to Ω^{1/2}, leads to the deterministic equations for the mean concentrations as predicted by the CME in the macroscopic limit of large volumes (or equivalently large molecule numbers). The rest of the terms give a time-evolution equation for the probability density function of the fluctuations,$\Pi (\overrightarrow{\epsilon},t)$. This partial differential equation is an infinite series in powers of the inverse square root of the volume (see[22] for the general form of this equation). Truncating this series to include only the first term, i.e., that which is proportional to Ω^{0}, leads to a second-order partial differential equation, also called the linear Fokker-Planck equation or the linear noise approximation (LNA)[21, 23, 24]. The solution of the latter equation is a multivariate Gaussian probability distribution and hence expressions for the statistics of intrinsic noise about the macroscopic concentrations, e.g., the variance of fluctuations, can be obtained straightforwardly from this formalism, a distinctive advantage over the CME. The restrictions which must be kept in mind are that this method only provides a reliable approximation to the CME if the molecule numbers are sufficiently large (small intrinsic noise) and the chemical network is monostable (see also the Discussion and conclusion section).

Hence we can now formulate two questions to precisely determine the validity of the heuristic CME in timescale separation conditions: (i) in the macroscopic limit, are the mean concentrations of the heuristic CME exactly given by the reduced REs obtained from the deterministic QSSA? (ii) are the noise statistics about these mean concentrations, as given by the LNA applied on the heuristic CME, equal to the noise statistics obtained from applying the LNA on the CME of the full network? If the heuristic CME is correct then the answer to both these questions should be yes.

The first question can be answered straightforwardly. The deterministic equations for the mean concentrations of the heuristic CME, in the macroscopic limit of infinite volumes, necessarily only depend on the macroscopic limit of the heuristic microscopic rate functions in the heuristic CME. More specifically, consideration of the first term of the system-size expansion leads to a deterministic set of equations of the form$d\overrightarrow{\left[X\right]}/\mathrm{dt}=\mathrm{S}\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\overrightarrow{\widehat{f}}{|}_{\mathrm{\Omega}\to \infty}$, where S is the stoichiometric matrix with elements *S*_{
ij
}=*r*_{
ij
}−*s*_{
ij
}[23]. As discussed in the Introduction, the vector of heuristic microscopic rate functions for the heuristic CME,$\left(\right)close="">\overrightarrow{\widehat{f}}$, is constructed from the macroscopic rate function vector,$\overrightarrow{f}$, of the reduced REs by performing the substitution$\left[{X}_{i}\right]\to {n}_{i}/\mathrm{\Omega}$ on$\overrightarrow{f}$. Given the ansatz, equation (3), we can see that the heuristic method guarantees, by construction, that$\overrightarrow{\widehat{f}}{|}_{\mathrm{\Omega}\to \infty}=\overrightarrow{f}$. This implies that the first term of the system-size expansion applied to the heuristic CME leads to a deterministic set of equations of the form$d\overrightarrow{\left[X\right]}/\mathrm{dt}=\mathrm{S}\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\overrightarrow{f}$, which indeed are the reduced REs obtained from the deterministic QSSA. Hence, we can conclusively state that in the macroscopic limit, the heuristic CME does reproduce the correct mean concentrations for timescale separation conditions.

The second question, regarding agreement in noise statistics not simply in the means, has not been considered before and presents a considerably more difficult challenge. In what follows we briefly review the LNA applied to the heuristic CME of the coarse-grained network which we shall call the hLNA and we derive the LNA applied to the full network under conditions of timescale separation, a novel method which we refer to as the slow-scale LNA (ssLNA).

### The LNA applied to the heuristic CME

The application of the LNA to the heuristic CME has been the subject of a number of studies[23, 25–30]. For a step-by-step guide to implementing the LNA we refer the reader to the supplementary material of Ref.[9]. Here we simply state the well known results. We shall use the underline notation to denote a matrix throughout the rest of the article.

Given the coarse-grained network, reaction scheme (1), one can construct the stoichiometric matrix S with elements *S*_{
ij
}=*r*_{
ij
}−*s*_{
ij
} and the macroscopic rate vector with entries${f}_{j}={k}_{j}\prod _{m=1}^{N}{\left[{X}_{m}\right]}^{{s}_{\mathrm{mj}}}$. Note that the latter, as discussed in the Introduction, encapsulates the macroscopic rate law for each individual reaction composing the network. Note also that the *k’s* for a coarse-grained network are generally functions of the macroscopic concentrations and not constants as for a full network (of elementary reactions). The reduced REs are then given by$d\overrightarrow{\left[X\right]}/\mathrm{dt}=\mathrm{S}\phantom{\rule{2.77695pt}{0ex}}\phantom{\rule{0.3em}{0ex}}\overrightarrow{f}$ and consequently the Jacobian matrix J has elements${J}_{\mathrm{ij}}={\partial}_{j}{\left(\phantom{\rule{0.3em}{0ex}}\mathrm{S}\phantom{\rule{2.77695pt}{0ex}}\phantom{\rule{0.3em}{0ex}}\overrightarrow{f}\right)}_{i}$, where *∂*_{
j
} denotes the partial derivative with respect to$\left[{X}_{j}\right]$, the concentration of species *j*.

*s*denotes slow species). Here we have instead chosen to write the FPE for${\overrightarrow{\eta}}_{s}={\mathrm{\Omega}}^{-1/2}{\overrightarrow{\epsilon}}_{s}$ since$\overrightarrow{\eta}$ is the true measure of fluctuations about the mean concentrations. The operator ∇

_{ s }denotes the vector of derivatives with respect to components of the vector${\overrightarrow{\eta}}_{s}$. The matrix D

_{ h }is the diffusion matrix which is given by the following formula

where F is a diagonal matrix whose non-zero diagonal entries are the elements of the macroscopic rate function vector$\overrightarrow{f}$, i.e.,$\mathrm{F}=\text{diag}\phantom{\rule{0.3em}{0ex}}\left(\overrightarrow{f}\right)$.

*H*

_{ ij }=〈

*η*

_{s,i}

*η*

_{s,j}〉. The variance of the fluctuations of species

*j*is hence given by the

*j*th diagonal element of H. The power spectrum of the concentration fluctuations of the

*j*th species is given by

where I is the identity matrix, *i* is the imaginary unit number and *ω* is the frequency.

Note that we have chosen to compute the variance and power spectrum as our noise statistics for the following reasons. The variance can be used to calculate the Fano factor (variance of fluctuations divided by the mean concentration) and the coefficient of variation (standard deviation of fluctuations divided by the mean concentration)[32]. The coefficient of variation provides a non-dimensional measure of the size of intrinsic noise, and is a particularly natural measure when the probability distribution solution of the CME is approximately Gaussian. The Fano factor multiplied by the volume provides another non-dimensional measure of the noise level: it gives the size of the fluctuations in the molecule numbers relative to that of a Poissonian distribution with the same mean number of molecules. Generally these measures provide different but complementary information and both have been reported in recent experiments[33, 34]. Hence in this article we calculate both measures. We also calculate the power spectrum which gives the intensity of fluctuations at a given frequency; a peak in the spectrum indicates noise-induced oscillations[35], a phenomenon which is of importance in biochemical networks responsible for biological rhythms such as circadian clocks[36].

### The LNA applied to the full network under conditions of timescale separation

where$\overrightarrow{\eta}=\left({\overrightarrow{\eta}}_{s},{\overrightarrow{\eta}}_{f}\right)$ and${\overrightarrow{\eta}}_{s}$ and${\overrightarrow{\eta}}_{f}$ are, respectively, the vectors of concentration fluctuations about the macroscopic concentrations of the slow and fast species. The operator ∇ denotes the vector of derivatives with respect to components of$\overrightarrow{\eta}$. The matrix J_{
F
} is the Jacobian of the REs of the full network, while the diffusion matrix D_{
F
} is given by equation (5) with S and F now equal to the stoichiometric matrix and the diagonal matrix of the macroscopic rate function vector for the full network, respectively.

Note that while equation (4) is based on the heuristic CME and therefore inherits all its problems, equation (8) has no such problems: it is derived from the CME of the full network of elementary reactions, which is fundamentally correct. Hence, ideally, we would obtain the multivariate Gaussian solution of the two linear FPEs, compare and then decide upon the validity of the heuristic CME. Unfortunately, this direct comparison is impossible because equation (4) gives a joint probability distribution function for the slow species only, whereas equation (8) leads to a joint probability density function for both slow and fast species.

_{ ss }is generally different than D

_{ h }, which indeed proves the non-validity of the heuristic CME as a stochastic description of the coarse-grained network. We show that the new diffusion matrix is given by

where S and J_{
F
} are the stoichiometric and Jacobian matrices of the full network and F is the diagonal matrix of the macroscopic rate function vector of the full network with the macroscopic concentrations of the fast species expressed in terms of the macroscopic concentrations of the slow ones. The matrices S and J_{
F
} are partitioned into sub-matrices of the following sizes: S_{
s
} is an *N*_{
s
}×*R* matrix, S_{
f
} is an *N*_{
f
}×*R* matrix, J_{
s
} is an *N*_{
s
}×*N*_{
s
} matrix, J_{
sf
} is an *N*_{
s
}×*N*_{
f
} matrix, J_{
fs
} is an *N*_{
f
}×*N*_{
s
} matrix and J_{
f
} is an *N*_{
f
}×*N*_{
f
} matrix. Note that *N*_{
s
}and *N*_{
f
} are the number of slow and fast species respectively. Note also that the fact that the new diffusion matrix can be written in the form of equation (10) immediately implies that it is symmetric and positive semi-definite, two crucial properties of the diffusion matrices for all FPEs[21]. It also follows that the variance and power spectrum of the slow species according to the ssLNA can be calculated from equations (6) and (7) with D_{h} replaced by D_{ss}.

*although the existence of an effective CME for a coarse-grained network under conditions of timescale separation cannot be generally guaranteed (as proved by Janssen), it is always possible to write down a effective linear FPE for the coarse-grained network.*We now also have a viable strategy to compare the heuristic and full CMEs under conditions of timescale separation: one obtains the noise statistics from the hLNA and the ssLNA and compares them for rate constants such that the deterministic QSSA is a valid approximation (for an illustration of the comparison method, see Figure2). Furthermore, the ssLNA provides us not only with a new method to analytically obtain the noise statistics of a coarse-grained network but also with a new simulation tool which replaces conventional SSA simulations with heuristic propensities. The new simulation method consists in numerically solving the set of stochastic differential equations (Langevin equations) which exactly correspond to equation (9)[37]

*R*dimensional vector$\overrightarrow{\mathrm{\Gamma}}\left(t\right)$ is white Gaussian noise defined by 〈 Γ

_{ i }(

*t*)〉=0and$\u3008{\mathrm{\Gamma}}_{i}\left(t\right){\mathrm{\Gamma}}_{j}\left({t}^{\prime}\right)\u3009\phantom{\rule{0.3em}{0ex}}=\phantom{\rule{0.3em}{0ex}}{\delta}_{i,j}\delta (t\phantom{\rule{0.3em}{0ex}}-\phantom{\rule{0.3em}{0ex}}{t}^{\prime})$.

Such a reaction scheme is compatible with the reduced REs: defining$\left[{\overrightarrow{X}}_{s}\right]$ as the macroscopic concentration vector of the slow species, we have$d\left[{\overrightarrow{X}}_{s}\right]/dt={\mathrm{S}}^{\prime}\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\overrightarrow{f}\left(\right[{\overrightarrow{X}}_{s}\left]\right)={\mathrm{S}}_{s}\overrightarrow{f}\left(\right[{\overrightarrow{X}}_{s}\left]\right)$ since${\mathrm{S}}_{f}\overrightarrow{f}=0$ as required by the deterministic QSSA. Note that while S’ is not the only stoichiometric matrix which is compatible with the reduced REs (any matrix of the form${\mathrm{S}}_{s}+\mathrm{A}{\mathrm{S}}_{f}$ where A is some general matrix will do), it is the matrix which is uniquely selected by adiabatic elimination of the concentration fluctuations of the fast species. Of course this reduced reaction scheme characterized by S’ is only physically meaningful if its entries are time-independent and integer-valued. Under timescale separation, this condition is not generally fulfilled. Rather this constitutes an additional, stronger condition. Hence it follows that generally a reduced CME description does not exist under timescale separation conditions, though a reduced Langevin equation description, i.e., the ssLNA, always exists.

In the rest of this article, we apply the systematic comparison method developed in the Results section to two examples of biological importance: enzyme-facilitated catalysis of substrate into product by cooperative and non-cooperative mechanisms and a genetic network with a negative feedback loop. For each of these, we shall obtain the noise properties of the coarse-grained versions of the circuits in the limit of large molecule numbers using the ssLNA and the hLNA. Because the expressions for the noise statistics from these two are quite simple, we shall be able to readily identify the regions of parameter space where the hLNA, and hence the heuristic CME, is correct and where it gives misleading results. The theoretical results are confirmed by stochastic simulations based on the CME of the full network and on the heuristic CME of the coarse-grained network.

### Application I: Cooperative and non-cooperative catalytic mechanisms

Substrate *S* is input into the compartment where the reaction is occurring, it reversibly binds with an enzyme *EE* which has two free binding sites to form the first complex *EES* with one binding site occupied by a substrate molecule. This complex either decays into the original enzyme *EE* and a product molecule or else it can reversibly bind to another substrate molecule leading to a second complex *SEES* with both binding sites occupied by substrate molecules. Finally, this last complex decays into the first complex and product *P*. Note that reaction scheme (14) is the considered full network, since only elementary reactions are involved.

#### Deterministic analysis and network coarse-graining

*S*is the instantaneous substrate concentration and

*k*

^{ ′ }is an effective first-order rate coefficient. The Michaelis-Menten constants are${K}_{m1}=\left({k}_{-1}+{k}_{3}\right)/{k}_{1}$ and${K}_{m2}=\left({k}_{-2}+{k}_{4}\right)/{k}_{2}$ and the total enzyme concentration is denoted as$\left[E{E}_{T}\right]$, which is a constant at all times and equal to$\left[E{E}_{T}\right]=\left[\mathrm{EE}\right]+\left[\mathrm{EES}\right]+\left[\mathrm{SEES}\right]$, the sum of the concentrations of free enzyme and of the two complexed forms. Hence, the coarse-grained version of the full network (14) is simply

Note that throughout the rest of this article, the notation [*X*] will generally denote the steady-state concentration of species *X*, unless it appears in the context of a differential equation as in equation (15) where then it necessarily refers to the instantaneous concentration.

#### Stochastic analysis of the coarse-grained network: ssLNA and hLNA methods

*η*

_{ s }(

*t*) about the steady-state macroscopic substrate concentration of the coarse-grained network, i.e., the steady-state solution [

*S*] of equation (15). The derivation leading to the Langevin equation can be found in the Methods section. The result is

*J*is the Jacobian of the reduced RE, equation (15), and the functions

*q*

_{1}and

*q*

_{2}are defined as

_{ i }(

*t*)denotes the contribution to the intrinsic noise in the steady-state substrate concentration due to the

*i*th elementary reaction of the full network of which there are 7 in total. It is clear that Γ

_{1}(

*t*) is the noise from the input reaction since it has a pre-factor of

*k*

_{ in }, Γ

_{2}(

*t*)is the noise from the binding of substrate and free enzyme since it has a pre-factor of

*k*

_{1}and so on for the rest of the noise terms. Hence, we see that according to the ssLNA,

*under conditions of timescale separation, all elementary reactions in the full network contribute to the intrinsic noise in the substrate concentration*. The variance of the intrinsic noise described by the Langevin equation, equation (18), can be calculated according to the recipe described in the Results section (see also the Methods section) and is found to be given by

A comparison of equations (21) and (24) leads one to the observation that the latter can be obtained from the former by setting *q*_{1}=*q*_{2}=0. Substituting these conditions in the Langevin equation, equation (18), we obtain physical insight into the shortcomings of the conventional heuristic method. This method rests on the incorrect implicit assumption that *under conditions of timescale separation, the reversible elementary reactions involving the fast species do not contribute to the intrinsic noise in the substrate concentration*.

#### Stochastic Michaelis-Menten and Hill-type kinetics

*k*

_{2}→0,

*K*

_{m 2}→

*∞*; (ii)

*k*

_{2}→

*∞*,

*K*

_{m 2}→0 at constant${K}_{m1}{K}_{m2}={K}_{m}^{2}$. These limits applied to the reduced RE, equations (15), lead to the two simplified REs, respectively,

Hence, the first case leads to Michaelis-Menten (MM) kinetics (non-cooperative kinetics) and the second to Hill-type kinetics with a Hill coefficient of two (cooperative kinetics).

Comparison of equations (27) and (28) shows that the *heuristic CME description of the coarse-grained network overestimates the size of intrinsic noise whenever the deterministic kinetics are Michaelis-Menten*. Interestingly, comparison of equations (29) and (30) shows the opposite *for Hill-type kinetics: the size of noise predicted by the heuristic CME underestimates the true value*. Note also that for both types of kinetics, the heuristic CME predicts the correct noise statistics in the limit of very small and very large substrate concentrations (which correspond to very large and very small free enzyme concentrations in steady-state conditions, respectively). The predictions for the Michaelis-Menten case agree with those reported by a recent simulation-based study[17] and a study using the LNA applied to the full network[9]. Indeed, this agreement is an important benchmark for the ssLNA. To our knowledge, the results for the Hill-type kinetics have not been obtained before.

_{S}and the Fano factor FF

_{S}of the substrate concentration fluctuations (as predicted by equations (29) and (30)) versus the non-dimensional fraction$\Theta ={k}_{\mathrm{in}}/{k}_{4}\left[E{E}_{T}\right]$. From equation (26) it can be deduced that${\left[S\right]}^{2}={K}_{m}^{2}\Theta /(1-\Theta )$; hence, the physical meaning of

*Θ*is that it is a measure of enzyme saturation since as it increases, the substrate concentration increases as well, and consequently the free enzyme concentration decreases. The values of rate constants are chosen such that timescale separation is guaranteed, i.e., there is very good agreement between the concentration of the slow species as predicted by the REs of the full network and the reduced REs obtained using the deterministic QSSA (see Figure5).

The following observations can be made from Figures4a and4b. The ssLNA quantitatively agrees with the results of stochastic simulations of the full network for a large enough volume Ω. In contrast, the heuristic approach, hLNA, and stochastic simulations based on the corresponding heuristic CME, are generally in quantitative disagreement with the results of the ssLNA and of stochastic simulations of the full network, even if the volume is very large. For example, for the case *k*_{1}=5×10^{−7} and *Θ*=1/2, the CV_{S} and FF_{S} from the hLNA are approximately 11 and 112 times smaller, respectively, than the prediction of the ssLNA. In Figure4c we also illustrate the large differences which these statistics imply, by showing sample paths (trajectories) of the CME of the full network, of the heuristic CME and of the Langevin equation given by the ssLNA, equation (18). This confirms that: (i) the hLNA and, hence, the heuristic CME on which it is based, predicts the correct mean concentrations but incorrect noise statistics even if the molecule numbers are considerably large; (ii) the Langevin equation obtained from the ssLNA is a viable accurate simulation alternative to SSA simulations based on the heuristic CME.

Besides quantitative disagreement we also note that the qualitative dependence of the FF_{S} and the CV_{S} with *Θ* as predicted by the heuristic approach is also very different than the predictions of the ssLNA and stochastic simulations with the full network. For example, for the case *k*_{1}=5×10^{−7}, according to stochastic simulations of the full network and the ssLNA, the FF_{S} reaches a maximum at *Θ*=1/2, whereas the heuristic approach predicts a monotonic increase of the FF_{S}with *Θ*. The case *Θ*<0.5is particularly interesting because the ssLNA and stochastic simulations of the full network lead to ΩFF_{S}which is much greater than 1, whereas the heuristic approach predicts ΩFF_{S} which is below 1. Hence, for *Θ*<0.5, the ssLNA correctly predicts the fluctuations to be super-Poissonian, i.e., the size of the fluctuations is larger than those of a Poissonian with the same mean number of substrate molecules, whereas the hLNA incorrectly predicts the opposite case of sub-Poissonian fluctuations.

The power spectrum for the substrate fluctuations has also been calculated (see the Methods section). Although there is some quantitative disagreement between the predictions of the ssLNA and hLNA both are in qualitative agreement: the spectrum is monotonic in the frequency and hence no noise-induced oscillations are possible by this mechanism. More generally, it can be shown that the spectra of the hLNA and ssLNA are in qualitative agreement for all full networks with at most one slow species because as can be deduced from equation (7), for such networks, the spectrum for a single species chemical system is invariably monotonic in the frequency.

### Application II: A gene network with negative feedback

Finally, we study an example of a gene network with autoregulatory negative feedback. Such a feedback mechanism is ubiquitous in biology appearing in such diverse contexts as metabolism[40], signaling[41], somitogenesis[42] and circadian clocks[43]. Two reasons hypothesized for its widespread occurance are that (i) it supresses the size of intrinsic noise[44, 45] thereby providing enhanced stability and (ii) it can lead to concentration oscillations or rhythms which are crucial to the control of several aspects of cell physiology[36].

*M*, is produced by transcription from a single gene

*G*, and it is translated into protein

*P*which subsequently is degraded via an enzymatic reaction catalyzed by enzyme

*E*. The mRNA can furthermore decay into an inactive form spontaneously. In addition, we have a negative feedback loop described by the reactions

Note that the gene with two bound proteins is inactive, in the sense that it does not lead to mRNA production. This implies that sudden increases in protein concentration lead to a decrease in mRNA transcription which eventually results in a lowered protein concentration; this is the negative feedback or auto-inhibitory mechanism. The reaction network as given by reaction schemes (31) and (32) is our full network for this example. Note that the first two reactions in reaction scheme (31) are not in reality elementary chemical reactions but they are the simplest accepted forms of modeling the complex processes of transcription and translation and hence it is in this spirit that we include them in our full network description.

#### Deterministic analysis and coarse-grained network

*E*, the enzyme complex,

*EP*, and the gene species in its various non-complexed and complexed forms

*G*,

*GP*and

*G*

*P*

_{2}. The slow species are the mRNA,

*M*, and the protein,

*P*. Furthermore, we also impose the limit

*k*

_{2}→

*∞*,

*k*

_{1}→0 at constant

*k*

_{2}

*k*

_{1}; this enforces cooperative behavior since the binding of

*P*to

*G*is quite slow but once it occurs the next binding of

*P*to the complex

*GP*is very quick. The resultant reduced REs are given by

*K*

^{2}=

*k*

_{−1}

*k*

_{−2}/

*k*

_{1}

*k*

_{2},${K}_{M}=\left({k}_{-3}+{k}_{4}\right)/{k}_{3}$,$\left[{E}_{T}\right]$ is the total enzyme concentration and$\left[{G}_{T}\right]$ is the total gene concentration. The model reduction process just described is illustrated in Figure6.

#### Stochastic analysis of the coarse-grained network: ssLNA and hLNA methods

*η*

_{s,1}and

*η*

_{s,2}as the fluctuations about the concentrations of mRNA and of protein, respectively. The ssLNA leads to reduced Langevin equations of the form

_{ i }(

*t*) is the noise contributed by reaction number

*i*and the reactions are numbered according to the order:

*G*→

*G*+

*M*,

*GP*→

*GP*+

*M*,

*P*+

*G*→

*GP*,

*GP*→

*P*+

*G*,

*P*+

*GP*→

*G*

*P*

_{2},

*G*

*P*

_{2}→

*P*+

*GP*,

*M*→∅,

*M*→

*M*+

*P*,

*P*+

*E*→

*EP*,

*EP*→

*P*+

*E*, and

*EP*→

*E*. The element

*J*

_{ ij }denotes the

*i*-

*j*entry of the Jacobian J of the reduced REs (33). Furthermore, the parameters

*p*

_{1}and

*q*are given by

where *K*_{3}=*k*_{−3}/*k*_{3}. Note that the coupled Langevin equations (34) imply that the fluctuations in the mRNA and protein concentrations are affected by noise from all of the 11 constituent reactions of the full network (reaction schemes (31) and (32)) except from those of the reversible reaction *P* + *GP⇌G* *P*_{2}. As shown in the Methods section, the noise from this reaction becomes zero due to the imposition of cooperative behavior in the feedback loop.

_{ h }replaced by D

_{ ss }, which is given by

_{ h }given by

A comparison of equation (37) and equation (38) shows that the ssLNA and hLNA are generally different except in the limits of *p*_{1}→0 and *q*→1. From the Langevin equations (34) we see that setting *p*_{1}=0 implies ignoring the noise due to the reversible reaction *P* + *G⇌GP*, while setting *q*=1 is equivalent to ignoring the noise from the reversible reaction *P* + *E⇌EP*. Hence, as for the previous example of enzyme kinetics, we can state that the hLNA and the heuristic CME upon which it rests, implicitly (and incorrectly) assume that *under conditions of timescale separation, the reversible reactions involving the fast species do not contribute to the intrinsic noise in the slow species*.

Furthermore, by the comparison of equations (37) and (38), one can also deduce that the heuristic CME provides a statistically correct description when the protein concentration [*P*] is either very small or very large, in other words the case of very weak or very strong transcriptional repression (and corresponding non-saturated and saturated degrading enzyme conditions).

#### Detailed comparison of the noise statistics from the ssLNA and hLNA

*k*

_{0}. These are obtained by solving the two Lyapunov equations mentioned in the previous subsection for the covariance matrix; the variances are then the diagonal elements of this matrix, from which one finally calculates the Fano factors and the coefficients of variation. The values of rate constants are chosen such that we have timescale separation conditions (see Figure8). From Figure7 we can see that under such conditions, the ssLNA predictions agree very well with the stochastic simulations of the full network but the hLNA exhibits considerable quantitative and qualitative differences compared to the latter simulations. In particular, note that for

*k*

_{3}=1 and

*k*

_{0}>50, the predictions of the ssLNA are approximately 3 orders of magnitude larger than those of the hLNA (and of stochastic simulations using the heuristic CME).

_{ h }given by equation (38). For the ssLNA this is given by equation (7) with Jacobian being equal to that of the reduced REs, equation (33), and diffusion matrix D

_{ h }replaced by D

_{ ss }, which is given by equation (37). Since the two diffusion matrices D

_{ h }and D

_{ ss }are not generally equal to each other we expect the spectra calculated according to the ssLNA and hLNA to differ. Indeed we find 3 possible scenarios: both spectra do not have a peak in frequency (no noise-induced oscillations), both spectra have a peak in frequency (noise-induced oscillations) and the most interesting case where the ssLNA spectrum exhibits a peak but the hLNA does not predict one. The results are summarized in Figure9, where we show the regions of parameter space in which each of these scenarios occur and a comparison of the power spectra as predicted by the hLNA and ssLNA in these regions. Note that in all cases the hLNA (purple dashed lines) agrees with stochastic simulations of the coarse-grained network using the heuristic CME (purple open circles), while the ssLNA (solid blue lines) agrees with stochastic simulations of the full network (blue solid circles) under conditions of timescale separation. The hLNA and ssLNA spectra are only in good quantitative agreement in a very small region of parameter space (shown in black in Figure9a), where both do predict noise-induced oscillations.

We emphasize that the main message brought by our analysis is that there are significantly large regions of parameter space (blue region in Figure9a), where the hLNA (and the heuristic CME) does not predict noise-induced oscillations but such oscillations are obtained from stochastic simulations of the full network as well as being captured by the ssLNA.

Qualitative discrepancies in the prediction of noise-induced oscillations arise because the hLNA does not correctly take into account the fluctuations stemming from the rate limiting step of the cooperative binding mechanism. The latter involves the slow binding reaction between a protein molecule *P* and a gene *G* leading to a complex *GP*. The reason for this is the hLNA’s tacit assumption that the fast species are not involved in slow reactions. This rate limiting reaction is at the heart of the negative feedback loop that is responsible for concentration oscillations in many biological networks such as circadian clocks[36] and hence why we speculate that the hLNA misses the occurrence of noise-induced oscillations in certain regions of parameter space.

## Discussion and conclusion

Concluding, in this article we have rigorously derived in closed-form, linear Langevin equations which describe the noise statistics of the fluctuations about the deterministic concentrations as predicted by the reduced REs obtained from the deterministic QSSA. Equivalently, the ssLNA, as the method was called, is the statistically correct description of biochemical networks under conditions of timescale separation and sufficiently large molecule numbers. We note that our method provides an accurate means of performing stochastic simulation in such conditions. This is particularly relevant since it has been proven that there is generally no reduced CME description in such cases[8]. Another advantage of the ssLNA is that it enables quick computation of noise statistics through the solution of a set of simultaneous, deterministic linear algebraic equations. By applying the ssLNA to two biologically relevant networks, we showed that this procedure can lead to particularly simple and compact expressions for the noise statistics, which are in very good numerical agreement with stochastic simulations of the CME of the full network under the above conditions. This is in contrast to the heuristic CME, which generally performed with poor accuracy and in some instances even missed the prediction of noise-induced oscillations.

The limitations of the ssLNA are precisely those of the conventional LNA on which it is based. Namely, if the system is composed of at least one bimolecular reaction, then it is valid for large enough molecule numbers (or, equivalently, large volumes) and provided the biochemical network is monostable. If the system is purely composed of first-order reactions and if one is only interested in variance and power spectra, then the only requirement is that of monostability. This is since in such a case it is well known that the first and second moments are exactly given by the LNA. For monostable systems with bimolecular reactions, the finite-volume corrections to the LNA can be considerable when the network has implicit conservation laws, when bursty phenomena are at play and when steady-states are characterized by few tens or hundreds of molecules[24, 47–49]. These problems probably become exacerbated when the network is bistable or possesses absorbing states[50]. Hence, it is clear that although the ssLNA presented in this article is valid for a considerable number of biologically interesting cases, it cannot be homogeneously applied to all intracellular reaction networks of interest. These require the development of methods beyond those presented in this article and hence present an interesting research challenge for the future.

A necessary and sufficient condition for timescale separation is that the timescales governing the decay of the transients in the average concentrations are well separated. Fast species are those whose transients decay on fast timescales while the slow species are those whose transients decay on slow timescales. At the microscopic level, there are several different scenarios which can lead to timescale separation. Grouping chemical reactions as fast or slow according to the relative size of their associated timescales, Pahlajani *et al.*[51] obtain timescale separation by defining fast species as those which are involved in fast reactions only and slow species as those involved in slow reactions only. Zeron and Santillan[52] use a similar but less restrictive approach whereby the fast species are involved in fast reactions only and the slow species can participate in both fast and slow reactions. Another method is that due to Cao *et al.*[53] who define slow species as those involved in slow reactions only and fast species as those participating in at least one fast reaction and any number of slow reactions. While the three aforementioned scenarios will lead to timescale separation, it must be emphasized that they only constitute a subset of the possible scenarios leading to such conditions. The derivation behind the ssLNA is not based on any particular microscopic scenario, rather it simply requires that the timescales of the transients in the average macroscopic concentrations are well separated. Hence it follows that in the limit of large molecule numbers, the methods developed in[51–53] cover only a sub-space of the parameter space over which timescale separation is valid. In the Methods section we indeed show that Pahlajani’s approach[51] leads to a reduced linear Langevin equation which is a special case of the ssLNA, the case where the matrix B in equation (10) can be neglected. The approaches of Zeron and Santillan[52] and of Cao *et al.*[53] lead to a reduced CME description. As we have shown in the Results section, under conditions of timescale separation and for small intrinsic noise, there always exists a reduced linear Langevin description of monostable stochastic reaction networks (the ssLNA) but there is generally not a physically meaningful reduced master equation description. The latter is only obtained if one imposes stronger conditions.

These results are in line with those of Mastny *et al.*[54] which show that for the Michaelis-Menten reaction without substrate input, the sQSPA method, a rigorous singular-perturbation approach, leads to a reduced master equation whenever the free enzyme or complex concentrations are very small (see Table II of Ref.[54]). This equation has the same form as the heuristic CME. This implies that for such conditions the error in the predictions of the heuristic CME should be zero, a result which is reproduced by the ssLNA (see Application I in the Results section). However, note that though these concentration conditions can be compatible with the deterministic QSSA they are not synonymous with it. Generally, the sQSPA methods do not lead to a reduced stochastic description consistent with the deterministic QSSA over the whole parameter space, whereas the ssLNA does, albeit within the constraints that molecule numbers should not be too small and that the network is monostable.

Finally we consider the approach of Shahrezaei and Swain[55], who derived the probability distribution for a linear two-stage model of gene expression under conditions of timescale separation. Their method rests on an exact solution of the generating function equation corresponding to the CME in the limit that the protein lifetime is much greater than that of the mRNA. In the Methods section we show that the ssLNA applied to their example leads to the same variance as obtained from their reduced probability distribution. The upside of their method over the ssLNA is that they obtain the full probability distribution valid for all molecule numbers. The downside of their method is that the generating function equation can only be solved exactly for networks composed of first-order processes (as in the gene example presented by Shahrezaei and Swain) or very simple bimolecular reactions[19] and hence the method has a restricted range of applicability compared to the ssLNA.

While the stochastic simulation algorithm explicitly simulates every individual reaction event, the Langevin approach yields approximate stochastic differential equations for the molecular populations. This is computationally advantageous whenever the reactant populations are quite large[5]. This reasoning can be deduced from the relationship between the propensities and the microscopic rate functions as given by${a}_{j}=\mathrm{\Omega}{\widehat{f}}_{j}(\overrightarrow{n}/\mathrm{\Omega})$. It is well known that in the large population number limit, the vector$\overrightarrow{n}/\mathrm{\Omega}$ is approximately equal to the vector of macroscopic concentrations and hence the magnitude of the propensities increases with the reaction volume or equivalently with molecule numbers. In particular, this implies that the time between consecutive reaction events, given by$\tau =-{\left(\sum _{j}{a}_{j}\right)}^{-1}\mathrm{ln}\left(r\right)$ where *r*∈(0,1) is a uniform random number, decreases with increasing reaction volume. This means that the time spent by the stochastic simulation algorithm increases with increasing volume because more reaction events have to be resolved within the same time window. Given this reasoning we can compare the discussed methods in terms of speed and accuracy. The computation time of the Langevin methods, hLNA and ssLNA, is independent of the volume and hence if the molecule numbers are not too small, both methods are much quicker than simulating any reduced CME of the coarse-grained network or the CME of the full network. However the ssLNA enjoys the additional advantage that under conditions of timescale separation, it is as accurate as the CME of the full network. The same argument does not generally hold for the hLNA.

We emphasize that besides deriving the ssLNA method, in this paper we have used it to determine the range of validity of the conventional heuristic CME approach and the size of errors in its predictions. To our knowledge, this is the first study which attempts to answer these important and timely questions via a rigorous, systematic theoretical approach.

Our main message is that, the “conventional wisdom” that the heuristic CME is generally a good approximation to the CME of the full network under conditions of timescale separation is incorrect, if one is interested in intrinsic noise statistics and the prediction of noise-induced oscillations.

## Methods

### Derivation of the ssLNA

The linear FPE describing the full network is given by equation (8). It is well known that with every FPE one can associate a set of Langevin equations (stochastic differential equations)[37]. Note that the Langevin and FPE formalisms are exactly equivalent but as we show now, the Langevin description is ideal for deriving a reduced description in timescale separation conditions.

*τ*

_{ f }, is much smaller than the correlation time of slow fluctuations,

*τ*

_{ s }. We wish to obtain a reduced description for the fast fluctuations, i.e., for equation (39), on timescales larger than

*τ*

_{ f }but much smaller than

*τ*

_{ s }. On such timescales, transients in the macroscopic concentrations of fast species have decayed, a quasi-steady-state is achieved and by the deterministic QSSA, we know that the fast-species concentrations can be expressed in terms of those of the slow-species concentrations. Now the latter concentrations vary very slowly over timescales much smaller than

*τ*

_{ s }implying that for all intents and purposes they can be considered constant. Hence the matrices in equation (39) can be considered time-independent. It then follows that the solution to the latter equation is approximately given by

*t*

_{0}→−

*∞*. To make further analytical progress, we switch to Fourier space. First we derive the following result which will prove very useful. Given a vector$\overrightarrow{f}\left(t\right)$, we have

*τ*

_{ f }, i.e., for fluctuations of frequency$\omega \ll {\tau}_{f}^{-1}$, then the above equation further reduces to

This Langevin equation is the ssLNA: it is an effective stochastic description of the intrinsic noise in the slow variables in timescale separation conditions. Using standard methods[37] it can be shown that the FPE which is equivalent to this effective Langevin equation is equation (9). The ssLNA can also be derived more rigorously using the projection operator formalism as shown in[57].

#### A note on the reduced Jacobian of the ssLNA

Hence the Jacobian in the ssLNA equations (9) and (12) is the same as the Jacobian of the reduced REs.

Note that equations (48) are formally the same as obtained by taking the average of the LNA equations (39) and (40) (this general agreement between the LNA and linear stability analysis is discussed in[21]). This implies that the timescales of the fast and slow variables in the ssLNA (and hence of the CME under timescale separation conditions and in the macroscopic limit) is the same as the timescales obtained from the REs.

### Details of the derivations for the two-subunit enzyme network

#### The ssLNA recipe: Langevin equation and noise statistics

*X*

_{1}=

*S*,

*X*

_{2}=

*EE*,

*X*

_{3}=

*EES*and

*X*

_{4}=

*SEES*and by labeling the input reaction as reaction 1, the binding of

*S*to

*EE*as reaction 2, the decay of

*EES*to

*S*and

*EE*as reaction 3, the decay of

*EES*to

*EE*and

*P*as reaction 4, the binding of

*S*to

*EES*as reaction 5, the decay of

*SEES*into

*EES*and

*S*as reaction 6 and finally the decay of

*SEES*into

*EES*and

*P*as reaction 7. Note that the reaction number labeling is arbitrary but the labeling of the species is not: according to the convention set out in the Introduction, we have to choose the substrate as the first species because it is the slow variable, while the rest of the species are the fast ones. Given the chosen order of the species and the reactions, the stoichiometric matrix and the macroscopic rate function vector (see definitions in the Background section and the description of the ssLNA in the Results section) are given by

Note that the row number of the stoichiometric matrix reflects the species number, while the column number reflects the reaction number. The order of the entries in the macroscopic rate function vector reflects the reaction number.

*EE*,

*EES*and

*SEES*and hence we have the conservation law,$\left[E{E}_{T}\right]=\left[\mathrm{EE}\right]+\left[\mathrm{EES}\right]+\left[\mathrm{SEES}\right]$, where [

*E*

*E*

_{ T }] is the total enzyme concentration, which is a time-independent constant. Hence, we are free to remove information from the stoichiometric matrix about one of the enzyme forms; we choose to remove information about

*EE*, and therefore, we eliminate the second row from the stoichiometric matrix, leading to

*q*

_{1}and

*q*

_{2}are as defined in the main text by equations (19) and (20). Furthermore, the Jacobian of the reduced RE, equation (15) in the main text, is given by

*D*

_{ ss }and then substituting the latter together with the new Jacobian equation (55) in the Lyapunov equation, equation (6), with

*D*

_{ h }replaced by

*D*

_{ ss }. Note that in this example because we have only one slow species, the Lyapunov equation is not a matrix equation but simply a single linear algebraic equation for the variance. For the same reason we have a diffusion scalar rather than a diffusion matrix. The power spectrum can be obtained by substituting the new Jacobian and diffusion scalar in equation (7) (with

*D*

_{ h }replaced by

*D*

_{ ss }), leading to

The power decays monotonically with frequency, which implies no noise-induced oscillation; this statement is generally true for all networks (full or coarse-grained) which have just one slow species.

#### The hLNA recipe: Langevin equation and noise statistics

*k*

^{ ′ }is defined in the main text, equation (16). The diffusion scalar

*D*

_{ h }of the linear FPE approximating the heuristic master equation for this process can be constructed from the stoichiometric and macroscopic rate function matrices using equation (5), which leads to${D}_{h}={\mathrm{\Omega}}^{-1}\left({k}_{\mathrm{in}}+{k}^{\prime}\left[S\right]\right)={\mathrm{\Omega}}^{-1}\left({k}_{\mathrm{in}}+{k}_{3}\left[\mathrm{EES}\right]+{k}_{4}\left[\mathrm{SEES}\right]\right)$. Note that here we have a diffusion scalar rather than a matrix because we have only one slow variable. Finally, from equations (6) and (7), the variance and the power spectrum are obtained from the diffusion scalar and the Jacobian,

*J*, of the effective rate equation, equation (15), leading to

In the Results section, it was shown that a reduced CME description becomes possible whenever the effective stoichiometric matrix S’ as given by equation (13) evaluates to integer values. For the reaction scheme under consideration, it can be shown that${\mathrm{S}}^{\prime}=\left(1,-{q}_{1},{q}_{1},-\left(1-{q}_{1}\right),-{q}_{2},{q}_{2},-\left(1-{q}_{2}\right)\right)$, where *q*_{1}and *q*_{2} are given by equations (19) and (20). The latter two quantities are generally real values and time-dependent and hence a reduced CME description is not generally possible. A simple choice which makes S’ integer-valued is the null choice, *q*_{1}=*q*_{2}=0, and indeed it is for these values that in the main text we show that the hLNA (and hence the heuristic CME) is a valid description of stochastic kinetics under timescale separation conditions.

### Details of the derivations for the gene network example

#### Reduced rate equations

*G*,

*GP*,

*G*

*P*

_{2}and the enzyme species

*E*and

*EP*. There are two conservation laws,$\left[{G}_{T}\right]=\left[G\right]+\left[\mathrm{GP}\right]+\left[G{P}_{2}\right]$ for the gene species and$\left[{E}_{T}\right]=\left[E\right]+\left[\mathrm{EP}\right]$ for the enzyme species and hence we need to apply the deterministic QSSA only to two of the gene species and to one of the enzyme species. The QSSA applied to the latter is the standard Briggs-Haldane approximation, which is well known[38], and hence here we restrict our presentation to the QSSA on the negative feedback loop. The macroscopic rate equations for the gene species

*GP*and

*G*

*P*

_{2}read

*K*

_{1}=

*k*

_{−1}/

*k*

_{1},

*K*

_{2}=

*k*

_{−2}/

*k*

_{2}and

*K*

^{2}=

*K*

_{1}

*K*

_{2}. Since only the ternary complex (one with 3 molecules, i.e.,

*G*

*P*

_{2}) does not lead to mRNA production, the active gene fraction is given by

*K*

_{2}→0 at constant

*K*(or equivalently

*k*

_{2}→

*∞*,

*k*

_{1}→0 at constant

*k*

_{1}

*k*

_{2}). It follows that the REs for the slow variables of mRNA and protein concentrations are then given by

where${K}_{M}=\left({k}_{-3}+{k}_{4}\right)/{k}_{3}$ is the Michaelis-Menten constant of the enzyme which degrades the protein species.

#### Derivation of the ssLNA results

We cast the species in the full network (as given by reaction schemes (31) and (32)) into the form required by the convention set in the Introduction. We denote the slow species by *X*_{1}=*M* and *X*_{2}=*P* and the fast species by *X*_{3}=*GP*, *X*_{4}=*G* *P*_{2} and *X*_{5}=*EP*. Note that the form of the gene with no bound protein (*G*) as well as the free enzyme species (*E*) do not appear explicitly in our description due to the two inherent conservation laws (same as shown in the previous section for the enzyme example except that here we immediately remove the extra species). The eleven constituent reactions are numbered in the following order: *G*→*G* + *M*, *GP*→*GP* + *M*, *P* + *G*→*GP*, *GP*→*P* + *G*, *P* + *GP*→*G* *P*_{2}, *G* *P*_{2}→*P* + *GP*, *M*→∅, *M*→*M* + *P*, *P* + *E*→*EP*, *EP*→*P* + *E*, and *EP*→*E*.

Note that the columns of S reflect the reaction number, while the rows reflect the species number. Similarly, the reaction number is reflected in the entries of the macroscopic rate function vector$\overrightarrow{f}$.

*K*

_{3}=

*k*

_{−3}/

*k*

_{3}. The Jacobian can be obtained from the reduced REs, equation (64), and is given by

Note that we have drawn the limit of cooperative binding on *p*_{1}, *p*_{2}, *q* and J.

_{ ss }. Using equation (72) and the definition (10), it can be readily shown that the diffusion matrix takes the diagonal form

_{ h }replaced by D

_{ ss }. Note that unlike the enzyme kinetics example, in the gene network example, we have two slow species, and hence the Lyapunov equation is a matrix equation involving the simultaneous solution of two linear equations. The explicit equations for the variances of the mRNA and protein fluctuations about the macroscopic steady-state concentrations are the diagonal elements of the covariance matrix H, which are found to be

_{ h }replaced by D

_{ ss }), leading to

#### Derivation of the hLNA results

The covariance matrix and the spectra can be obtained as for the ssLNA. The variances and spectra are given by equation (78) and equation (79) with *D*_{
M
}replaced by *D*_{h,M}, and *D*_{
P
} replaced by *D*_{h,P}.

In the main text, we show that the hLNA (and hence the heuristic CME) is the correct stochastic description under timescale separation when *p*_{1}=0and *q*=1. Indeed one finds that this choice satisfies the condition derived in the Methods section, which is necessary to have a reduced CME description under timescale separation conditions. Namely the choice *p*_{1}=0 and *q*=1 forces the effective stoichiometric matrix S’ given by equation (13) to assume strictly integer values.

### Comparison with other stochastic model reduction methods

In this section, we compare the predictions of the ssLNA with the predictions of other stochastic model reduction techniques in the literature. Specifically, we compare with the recent methods of Pahlajani *et al.*[51] and of Shahrezaei and Swain[55].

where the parameter *b*=*k*_{
s
}/*k*_{dM}has been interpreted as the burst size (the average number of proteins synthesized per mRNA transcript)[56]. This is the deterministic QSSA.

The steady state variance predicted by the above Langevin equation is given by equation (87). The same result has also been previously obtained by Paulsson[32] by applying the LNA to the full network given by (83) and subsequently taking the limit of timescale separation. Hence, the result obtained from the ssLNA agrees with the exact method of Shahrezaei and Swain. The advantage of the ssLNA is that it is generally applicable to arbitrarily complex biochemical networks, whereas the generating function method of solving CMEs is typically restricted to networks composed of at most first-order reactions or very simple bimolecular reactions[18, 19].

_{ f }is of order

*γ*

^{−1}and

*γ*is a large parameter under timescale separation conditions. This leads to a FPE for the slow variables with reduced Jacobian and diffusion matrices given by

The variance of fluctuations predicted by the above Langevin equation is given by equation (87) with *b*≪1. Hence, it is clear that the method of Pahlajani *et al.* cannot capture the fluctuations about the steady-state concentrations for all choices of rate constants which are compatible with the deterministic QSSA. Rather their assumption regarding the form of the diffusion matrix limits their analysis to a subset of the parameter space over which the deterministic QSSA and consequently the ssLNA are valid. Indeed, the fact that the method by Pahlajani *et al.* is generally a special case of the ssLNA can also be seen by direct comparison of the diffusion matrices of the two methods, namely, equations (91) and (10).

## Declarations

### Acknowledgements

This work was supported by the German Research Foundation (DFG project No. STR 1021/1-2) and by SULSA (Scottish Universities Life Science Alliance), both of which are gratefully acknowledged.

## Authors’ Affiliations

## References

- Schwikowski B, Uetz P, Fields S, et al.:
**A network of protein-protein interactions in yeast.***Nat Biotechnol*2000,**18**(12):1257-1261.View Article - Ghaemmaghami S, Huh W, Bower K, Howson R, Belle A, Dephoure N, O’Shea E, Weissman J:
**Global analysis of protein expression in yeast.***Nature*2003,**425**(6959):737-741.View Article - Ishihama Y, Schmidt T, Rappsilber J, Mann M, Hartl F, Kerner M, Frishman D:
**Protein abundance profiling of the Escherichia coli cytosol.***BMC Genomics*2008,**9:**102.View Article - Gillespie D:
**Exact stochastic simulation of coupled chemical reactions.***J Phys Chem*1977,**81**(25):2340-2361.View Article - Gillespie D:
**Stochastic simulation of chemical kinetics.***Annu Rev Phys Chem*2007,**58:**35-55.View Article - Segel L, Slemrod M:
**The quasi-steady-state assumption: a case study in perturbation.***SIAM Rev*1989,**31**(3):446-477.View Article - Gillespie D:
**A rigorous derivation of the chemical master equation.***Physica A: Stat Mech Appl*1992,**188**(1-3):404-425.View Article - Janssen J:
**The elimination of fast variables in complex chemical reactions. III. Mesoscopic level (irreducible case).***J Stat Phys*1989,**57:**187-198.View Article - Thomas P, Straube A, Grima R:
**Limitations of the stochastic quasi-steady-state approximation in open biochemical reaction networks.***J Chem Phys*2011,**135:**181103.View Article - Maienschein-Cline M, Warmflash A, Dinner A:
**Defining cooperativity in gene regulation locally through intrinsic noise.***Syst Biol, IET*2010,**4**(6):379-392.View Article - Assaf M, Roberts E, Luthey-Schulten Z:
**Determining the stability of genetic switches: explicitly accounting for mRNA noise.***Phys Rev Lett*2011,**106**(24):248102.View Article - Gonze D, Hafner M:
**Positive feedbacks contribute to the robustness of the cell cycle with respect to molecular noise.***Lecture Notes Control Inf Sci***407:**283-295. [http://www.springerlink.com/content/w46v57t746564270/] - Giampieri E, Remondini D, de Oliveira L, Castellani G, Lió P:
**Stochastic analysis of a miRNA–protein toggle switch.***Mol BioSyst*2011,**7**(10):2796-2803.View Article - Rao C, Arkin A:
**Stochastic chemical kinetics and the quasi-steady-state assumption: application to the Gillespie algorithm.***J Chem Phys*2003,**118:**4999.View Article - Gonze D, Halloy J, Goldbeter A:
**Deterministic versus stochastic models for circadian rhythms.***J Biol Phys*2002,**28**(4):637-653.View Article - Gonze D, Abou-Jaoudé W, Ouattara D, Halloy J:
**How molecular should your molecular model be? On the level of molecular detail required to simulate biological networks in systems and synthetic biology.***Methods Enzymol*2011,**487:**171-215.View Article - Sanft K, Gillespie D, Petzold L:
**Legitimacy of the stochastic Michaelis-Menten approximation.***Syst Biol, IET*2011,**5:**58-69.View Article - McQuarrie D:
**Stochastic approach to chemical kinetics.***J Appl Probability*1967,**4**(3):413-478.View Article - Darvey IG, Ninham BW, Staff PJ:
**Stochastic models for second order chemical reaction kinetics.***The Equilibrium State J Chem Phys*1966,**45:**2145. - Laurenzi I:
**An analytical solution of the stochastic master equation for reversible bimolecular reaction kinetics.***J Chem Phys*2000,**113:**3315.View Article - Van Kampen N:
*Stochastic Processes in Physics and Chemistry*. Elsevier Science & Technology, Amsterdam; 2007. - Grima R:
**Construction and accuracy of partial differential equation approximations to the chemical master equation.***Phys Rev E*2011,**84:**056109.View Article - Elf J, Ehrenberg M:
**Fast evaluation of fluctuations in biochemical networks with the linear noise approximation.***Genome Res*2003,**13**(11):2475-2484.View Article - Grima R:
**An effective rate equation approach to reaction kinetics in small volumes: Theory and application to biochemical reactions in nonequilibrium steady-state conditions.***J Chem Phys*2010,**133:**035101.View Article - Paulsson J:
**Summing up the noise in gene networks.***Nature*2004,**427**(6973):415-418.View Article - Tao Y, Jia Y, Dewey T:
**Stochastic fluctuations in gene expression far from equilibrium: Ω expansion and linear noise approximation.***J Chem Phys*2005,**122:**124108.View Article - Elf J, Ehrenberg M:
**Near-critical behavior of aminoacyl-tRNA pools in E. coli at rate-limiting supply of amino acids.***Biophys J*2005,**88:**132-146.View Article - Ziv E, Nemenman I, Wiggins C:
**Optimal signal processing in small stochastic biochemical networks.***PLoS One*2007,**2**(10):e1077.View Article - Komorowski M, Finkenstädt B, Harper C, Rand D:
**Bayesian inference of biochemical kinetic parameters using the linear noise approximation.***BMC Bioinf*2009,**10:**343.View Article - Martínez M, Soriano J, Tlusty T, Pilpel Y, Furman I:
**Messenger RNA fluctuations and regulatory RNAs shape the dynamics of a negative feedback loop.***Phys Rev E*2010,**81**(3):031924.View Article - Keizer J:
*Statistical Thermodynamics of Nonequilibrium Processes*. Springer, Berlin; 1987.View Article - Paulsson J:
**Models of stochastic gene expression.***Phys Life Rev*2005,**2**(2):157-175.View Article - Bar-Even A, Paulsson J, Maheshri N, Carmi M, O’Shea E, Pilpel Y, Barkai N:
**Noise in protein expression scales with natural protein abundance.***Nat Genet*2006,**38**(6):636-643.View Article - Taniguchi Y, Choi PJ, Li GW, Chen H, Babu M, Hearn J, Emili A, Xie X:
**Quantifying E. Coli Proteome and Transcriptome with Single-Molecule Sensitivity in Single Cells.***Science*2010,**329**(5991):533-538.View Article - McKane A, Nagy J, Newman T, Stefanini M:
**Amplified biochemical oscillations in cellular systems.***J Stat Phys*2007,**128:**165-191.View Article - Novak B, Tyson J:
**Design principles of biochemical oscillators.***Nat Rev Mol Cell Biol*2008,**9**(12):981-991.View Article - Gardiner CW:
*Stochastic Methods: A Handbook for the Natural and Social Sciences*. Springer, Berlin; 2009. - Fersht A:
*Structure and Mechanism in Protein Science*. W.H. Freeman, New York; 1999. - Fall C, Marland E, Wagner J, Tyson J:
*Computational Cell Biology*. Springer, Berlin; 2002. - Selkov E:
**Self-oscillations in glycolysis. 1. A simple kinetic model.***Eur J Biochem*1968,**4:**79-86.View Article - Goldbeter A:
**Mechanism for oscillatory synthesis of cyclic AMP in Dictyostelium discoideum.***Nature*1975,**253:**540-542.View Article - Lewis J:
**Autoinhibition with transcriptional delay: A simple mechanism for the zebrafish somitogenesis oscillator.***Curr Biol*2003,**13**(16):1398-1408.View Article - Tyson J, Hong C, Dennis Thron C, Novak B:
**A simple model of circadian rhythms based on dimerization and proteolysis of PER and TIM.***Biophys J*1999,**77**(5):2411-2417.View Article - Rao C, Wolf D, Arkin A:
**Control, exploitation and tolerance of intracellular noise.***Nature*2002,**420**(6912):231-237.View Article - Becskei A, Serrano L:
**Engineering stability in gene networks by autoregulation.***Nature*2000,**405**(6786):590-593.View Article - McKane A, Newman T:
**Predator-prey cycles from resonant amplification of demographic stochasticity.***Phys Rev Lett*2005,**94**(21):218102.View Article - Grima R:
**Noise-induced breakdown of the Michaelis-Menten equation in steady-state conditions.***Phys Rev Lett*2009,**102**(21):218103.View Article - Grima R:
**Investigating the robustness of the classical enzyme kinetic equations in small intracellular compartments.***BMC Syst Biol*2009,**3:**101.View Article - Thomas P, Straube A, Grima R:
**Stochastic theory of large-scale enzyme-reaction networks: Finite copy number corrections to rate equation models.***J Chem Phys*2010,**133:**195101.View Article - Horsthemke W, Brenig L:
**Non-linear Fokker-Planck equation as an asymptotic representation of the master equation.***Zeitschrift für Physik B: Condensed Matter*1977,**27**(4):341-348.View Article - Pahlajani CD, Atzberger P, Khammash M:
**Stochastic reduction method for biological chemical kinetics using time-scale separation.***J Theor Biol*2011,**272:**96-112.View Article - Zeron ES, Santillan M:
**Distributions for negative-feedback-regulated stochastic gene expression: Dimension reduction and numerical solution of the chemical master equation.***J Theor Biol*2010,**264**(2):377-385.View Article - Cao Y, Gillespie DT, Petzold L:
**The slow-scale stochastic simulation algorithm.***J Chem Phys*2005,**122:**014116.View Article - Mastny E, Haseltine E, Rawlings J:
**Two classes of quasi-steady-state model reductions for stochastic kinetics.***J Chem Phys*2007,**127:**094106.View Article - Shahrezaei V, Swain P:
**Analytical distributions for stochastic gene expression.***Proc Natl Acad Sci*2008,**105**(45):17256-17261.View Article - Ozbudak E, Thattai M, Kurtser I, Grossman A, van Oudenaarden A:
**Regulation of noise in the expression of a single gene.***Nat Genet*2002,**31:**69-73.View Article - Thomas P Grima R Straube AV:
**Rigorous elimination of fast stochastic variables from the linear noise approximation using projection operators.***Phys Rev E*2012,**86**(4):041110.View Article

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.