- Research article
- Open Access
Noise propagation through extracellular signaling leads to fluctuations in gene expression
BMC Systems Biologyvolume 7, Article number: 94 (2013)
Cell-to-cell variability in mRNA and proteins has been observed in many biological systems, including the human innate immune response to viral infection. Most of these studies have focused on variability that arises from (a) intrinsic stochastic fluctuations in gene expression and (b) extrinsic sources (e.g. fluctuations in transcription factors). The main focus of our study is the effect of extracellular signaling on enhancing intrinsic stochastic fluctuations. As a new source of noise, the communication between cells with fluctuating numbers of components has received little attention. We use agent-based modeling to study this contribution to noise in a system of human dendritic cells responding to viral infection.
Our results, validated by single-cell experiments, show that in the transient state cell-to-cell variability in an interferon-stimulated gene (DDX58) arises from the interplay between the spatial randomness of the cellular sources of the interferon and the temporal stochasticity of its own production. The numerical simulations give insight into the time scales on which autocrine and paracrine signaling act in a heterogeneous population of dendritic cells upon viral infection. We study the effect of different factors that influence the magnitude of the cell-to-cell-variability of the induced gene, including the cell density, multiplicity of infection, and the time scale over which the cellular sources begin producing the cytokine.
We propose a mechanism of noise propagation through extracellular communication and establish conditions under which the mechanism is operative. The cellular stochasticity of gene induction, which we investigate, is not limited to the specific interferon-induced gene we have studied; a broad distribution of copy numbers across cells is to be expected for other interferon-stimulated genes. This can lead to functional consequences for the system-level response to a viral challenge.
Cell-to-cell variability in the expression levels of mRNA and proteins has been studied extensively [1–8]. This variability has been shown to arise (a) from the intrinsic stochastic fluctuations in biochemical reactions such as those that regulate the expression of genes  as well as (b) from extrinsic sources such as cell-to-cell fluctuations of the number of limiting transcription factors or (c) from extracellular, environmental diversity. A variety of functional roles have been suggested for cellular noise : the heterogeneity in expression levels can determine phenotypic behavior of the cell  or affect the timing of events and responses to stimuli. It has been suggested that the noisiness of human dendritic cells’ interferon response to infection may help avoid a cytokine storm . Also, heterogeneity in the numbers of Tat proteins has been suggested as an explanation for the latency of HIV .
In the field of gene expression noise, both in experimental investigations and theoretical analyses, most of the attention has been restricted to intracellular noise in simple systems, such as genetic circuits [12, 13] or a connected set of cellular reactions . Noise has been studied experimentally in a variety of cells, ranging from bacteria [3, 15] to mammalian cells [10, 16]. A significant contribution  was the distinction between two sources of noise, intrinsic (due to stochasticity of the underlying biochemical process) and extrinsic (due to variability in cellular components that affect gene expression), which could be separately measured. In contrast, in many situations, cells communicate with each other through extracellular signaling and do not act independently. In this theoretical study, we study spatially-distributed sources of induced gene noise arising from extracellular communication through paracrine and autocrine signaling. The focus is therefore not on single cells evolving independently, but on a collection of cells that interact with each other to create cell-to-cell variability in the expression levels of induced genes. Our investigation is motivated by our previous experimental work on the innate immune response of dendritic cells (DCs) to viral infection, which showed large cell-to-cell variability of IFN-β mRNA  as well as of DDX58 , a gene induced as a result of interferon secretion and cognate receptor binding. The question arises whether the broad, non-Poisson experimental distribution of DDX58 is related to the temporally sporadic IFN-β production. At first glance this seems unlikely, because in the extracellular medium, homogenization of secreted cytokines is expected to occur. This is indeed the case, but can happen many hours after viral infection. Our work shows that there is a period of approximately 10 hours where the spatial heterogeneity of infection (only a fraction of cells is infected) and the temporal stochasticity of interferon induction create an environment where genes induced by interferon signaling are very noisy as well.
For our simulations, we use a recently developed multi-scale, stochastic simulation method [18, 19] coupling extracellular diffusion with intracellular reactions for many cells. We use a simplified model to account for the various intracellular processes and to demonstrate the possibility of robust early activation of a subset of cells in agreement with experimental results. In this earlier agent-based model, the excluded elements were: the noise due to the enhanceosome assembly in interferon induction and the impact of transcriptional noise in the induced gene (due to bursting) on cell-to-cell variability. This is incorporated explicitly in a more detailed model that focuses on the way intra-cellular noise in cytokine production is transmitted and re-shaped by a cascade of processes, including spatial diffusion and noisy downstream intracellular reactions. Our quantitative description allows us to identify the time scales over which different aspects of cell-to-cell variability occur. Furthermore, the mechanistic understanding of the different processes makes it possible to predict the effect of changing experimental conditions such as the density of cells, the level of infection, or the varying rates of biochemical reactions for different viruses. Our proposed mechanism leads to the prediction that under the conditions posited in the simulation, similar broad distributions should occur for other stimulated genes in infectious and similar biological situations.
We describe the results of our simulation of the effect of extracellular signaling on noise with reference to the experimental measurements in Newcastle disease virus (NDV) infected DCs [18, 20]. Comparison with experiment helps in setting model parameter values and the time scales over which cell-to-cell variability develops. There is substantial evidence that cell-to-cell heterogeneity is cellular in origin [18, 21–23]. It is the stochastic production of the IFN-β mRNA, observed experimentally and reproduced in silico, that drives the proposed extracellular mechanism and is the source of the broad distribution of interferon-induced genes (such as DDX58) through autocrine and paracrine signaling. We demonstrate the spatially-induced character of the observed noise, demonstrate its dependence on cellular rate constants, and present results for how cell-to-cell variability progresses from initial intracellular noise through extracellular fluctuations to intracellular noise induced by the latter.
Spatial heterogeneity of extracellular cytokine density decreases as time evolves
The initial response to viral infection leads to population-wide interferon induction that is spatially and temporally heterogeneous. The subsequent export of the cytokine gives rise to a spatially heterogeneous cytokine density profile. Interferon induction in infected cells is stochastic and shows considerable temporal and spatial heterogeneity, as demonstrated in Figures 1 and 2 respectively.
Only infected calls can express IFN-β and at any given time only a fraction of the infected cells have a fully assembled enhanceosome required for IFN-β induction. We determine the fraction of infected cells with nonzero IFN-β mRNA number. Figure 1 shows the fraction of infected cells that contain IFN-β mRNA. It takes 3 to 4 hours before some infected cells produce IFN-β mRNA. Thereafter, the fraction of infected cells expressing interferon rises, with a doubling of percentage from 6 to 9 hours, reaching 50% by 11 hours. The slow increase demonstrates a controlled response of the cell population to viral infection. The numbers are illustrative and depend on the rate constants of the model; they are consistent with the low fractions of infected murine fibroblast cells expressing IFNB1. The time scales of our simulations differ since our rate constants were chosen to fit the data for human monocyte-derived DCs.
The stochastic assembly of the IFN-β enhanceosome and the bursting production [24, 25] lead to temporal fluctuations in IFN-β mRNA number and spatial heterogeneity at all simulation times. As an example we show in Figure 2 the spatial distribution of cells at 11 hours (labeled in color to represent their number of IFN-β transcripts). As described in the figure caption, the copy numbers range from small (black squares) to large (red squares), through intermediate values (green and orange squares). The colored square distribution is quite heterogeneous, though at 11 hours it is less so than at earlier times where fewer cells contain IFN-β mRNA (see Figure 1). While the IFN-β mRNA distribution is spatially heterogeneous at all simulation times, the IFN-β protein distribution conversely becomes spatially homogeneous at later times (approximately 11 hours post-infection), as described below.
The spatially heterogeneous export of IFN-β protein from different infected cells with the IFNB1 gene activated at different times leads to a diffusion problem with sources that are distributed non-uniformly in space and turned on over a range of times. The secreted cytokine diffuses in the extracellular medium; this is a relatively fast process with a diffusion constant of 10 μm2 s-1 (see Methods) and it takes less than one minute for a secreted cytokine to diffuse to a nearby cell on the average. We study the time evolution of the spatial cytokine density profile. The inhomogeneous sources lead to an initially spatially inhomogeneous distribution of the cytokine that becomes more homogeneous as time progresses. This is displayed in Figure 3. Each square shows the location of a DC; we have color-coded the number of unbound IFN-β protein in its vicinity (only IFN-β within a square box containing a cell can bind to a free Interferon-α/β receptor (IFNAR) on the cell membrane). More than 80% of cells have a small number of cytokines (black squares, Figure 3A) in the same box at 6 hours post-infection because the IFNB1 gene has not been turned on in most infected cells; this number declines to zero by 9 hours (Figure 3B). By 11 hours 97% of the boxes contain many cytokines (red squares, Figure 3C). Following the initial secretion of IFN-β it takes 3 to 5 hours for the homogenization of the cytokine density. The homogenization of the cytokine density on the scale of a few hours allows the system to develop a more coherent response to viral infection, despite the large stochasticity in the induction of the key sentinel molecule IFN-β [10, 22].
Effect of autocrine and paracrine signaling on the spatio-temporal distribution of bound interferon receptors
A broad spatial distribution of the fraction of bound IFNAR arises due to the spatio-temporal distribution of secreted IFN-β, and is enhanced by early autocrine effects. We present results for the distribution of the number of bound IFNAR across the cells as a function of time; we divide the cells into an activated group consisting of infected cells with nonzero IFN-β expression and another group consisting of both uninfected cells and infected cells with zero IFN-β expression. In the former group, the bound receptors arise from a combination of autocrine and paracrine signaling while for the latter group, only paracrine signaling is present. We are able to evaluate the relative importance of autocrine and paracrine signaling.
In Figure 4 we display a histogram of a fraction of cells that correspond to a specified range of bound IFNAR numbers. Figures 4(A) and (B) correspond respectively to the distributions at 6 hours for cells with and without IFN-β mRNA. While the number of activated cells is much smaller at early times, a large fraction shows bound receptor numbers above 200. In contrast, very few cells without IFN-β mRNA have as many bound receptors. This clearly demonstrates the significant effect of autocrine signaling at early times (4 – 6 hours post-infection). By 11 hours (see Figures 4(C) and (D)) both the activated and inactivated cells distributions are essentially the same, showing the increasing influence of paracrine signaling as more infected cells are activated, an effect that underlies homogenization.
We quantify the greater importance of autocrine signaling at times immediately after interferon induction and illustrate this in Additional file 1: Figure S1. At around 4 hours post-infection (which is approximately the first time interferon induction begins in a small fraction of the infected cells) we find that the positive feedback from autocrine signaling increases the IFN-β production in those cells, thus magnifying the heterogeneity. The early autocrine signaling enhances the production of the interferon cytokine in early responders (the cells that produce IFN-β earliest) causing a decrease in the probability for attachment of the IFN-β protein to IFNAR receptors on the early responders, which leads to increased paracrine signaling. At approximately 6 hours post-infection the paracrine loop begins to prime the uninfected cells (the fraction of bound receptors on them increases sufficiently to robustly activate internal signaling cascades). For times greater than around 8 hours post-infection, paracrine signaling dominates and the system starts to respond coherently to the viral infection.
The bound IFNAR on both infected and uninfected cells activate the JAK/STAT pathway, leading to the induction of interferon-induced genes [26–28]. We choose rate constants such that the DDX58 production rate reaches half maximum when the number of bound receptors is 475 out of a total 1000. We study the spatial distribution of bound IFANR as a function of time in our in silico experiments. In Additional file 1: Figure S2 the distribution is shown as a spatial heat plot at different times. This follows the behavior of the homogenization of the IFN-β cytokine profile. These results demonstrate the importance of autocrine signaling at early times (4 – 6 hours post-infection, which enhances the spatial heterogeneity of bound receptors) and the importance of paracrine signaling in quenching the spatial heterogeneity at later times (> 8 hours post-infection).
Large cell-to-cell variability of interferon-induced gene
IFNAR bound by IFN-β phosphorylate the STAT proteins that associate with IRF9 to form the pleiotropic transcription factor ISGF3. ISGF3 binds to the interferon-stimulated response element (ISRE) of many inducible genes. We choose to model DDX58 that codes for RIG-I as an example of an interferon-induced gene since it has been studied experimentally  and shows a very broad distribution of mRNA number at 11 hours. We incorporate into our simulation the induction of the DDX58 gene with a simple, coarse-grained model. The gene has two states, one with a basal production level in the absence of ISGF3, and one with an activated production rate with the transition between the gene states occurring at a rate proportional to (B/475)2 where B is the number of bound receptors (the value 475 corresponds to the threshold value of bound receptors). The cell-to-cell variability in DDX58 number arises from the promoter switching between states with basal and enhanced transcription rates. The rate of switching depends indirectly on the number of bound receptors and is itself time-dependent.
This stochastic switching between a low (basal) and enhanced (promoted by ISGF3) production rate of DDX58 leads to bursts of high and low mRNA production and thus to a broad distribution of DDX58 mRNA, in agreement with experimental results. This behavior is also reflected in the distribution of the protein RIG-I that it encodes, which is displayed in Additional file 1: Figure S3. A simple quantification of the mRNA distribution is obtained by calculating the Fano factor (= Variance/Mean) averaged over all cells as a function of time. Our results are shown in Figure 5. In the absence of infection, the steady-state number of DDX58 follows a Poisson distribution with a Fano factor of 1. After infection, once the cytokines are released, the DDX58 gene can make a transition to the state with the higher induction rate. The Fano factor of the DDX58 mRNA distribution increases rapidly from unity in the basal state to values larger than 50. Interferon induction starts around 4 hours post-infection, as can be seen in Figure 1. The signaling is slightly biased towards paracrine signaling by seven hours post-infection (roughly three hours after interferon induction starts), as is evident from Additional file 1: Figure S1; by this time the Fano factor exceeds 50. After reaching a plateau, the Fano factor declines gradually, as most of the cells have activated JAK/STAT pathways, and the DDX58 gene approaches a steady state, toggling between the two states of induction. The experimentally-observed Fano factor at 11 hours is around 100, in agreement with our in silico study. As to the 6-hour experimental data, given the small number of cells, the statistics are insufficient to make a precise comparison.
The Fano factor increases in Figure 5 in a time interval when the majority of cells have the number of bound receptors in a range around the threshold value. The effect of the bound receptors on the average rate of DDX58 induction is shown in Additional file 1: Figure S4A. The effect of spatial inhomogeneity in bound IFNAR manifests itself most strongly when the majority of DCs have bound receptors in a range (200 to 600) around the threshold value of 475. In Additional file 1: Figure S4B we plot the fraction of DCs with bound IFNAR in the specified range, showing that it has a broad distribution. This corresponds to the range of time in Figure 5 over which the Fano factor for DDX58 is increasing.
In addition to the Fano factor, which is a single number characterizing the non-Poisson nature of the DDX58 distribution across cells, we study the full distribution. Experimentally, a surprisingly broad DDX58 distribution across the cell population is found at 11 hours post-infection . We compare the DDX58 distribution obtained in our model with the published experimental results. We re-plot the data in Figure 4B of  as a histogram in Figure 6A at 11 hours. The simulation results at 11 hours are plotted in Figure 6B. The agreement is good considering the fact that there are only 200 cells in the experiment, and provides support to our hypothesis that cell-to-cell variability in IFN-β gene induction leads to large cell-to-cell variability in DDX58. This validates our proposed mechanism of intracellular stochasticity leading (via extracellular signaling) to noise in induced gene expression.
To sharpen the point concerning the role of spatial heterogeneity and stochasticity of secreted cytokines, we complete a simple simulation in which we take all the cells to be uninfected and at 6 hours a uniform density of cytokines (1200 per cell) is introduced. This is the analog of pre-treatment in experiments except there is no subsequent viral infection. The Fano factor as a function of time is shown in Figure 7 and it shows a substantially smaller value of the Fano factor compared to Figure 5. At large times the Fano factor settles to the steady-state value for a bursting model that toggles between the enhanced and basal production rates. This provides a quantitative measure of the influence of the spatial heterogeneity of the cytokine sources due to viral infection and stochastic induction.
Noise due to spatial heterogeneity depends on cell density and multiplicity of infection
Experimentally, the spatial heterogeneity of the cytokine sources depends on the density and the multiplicity of infection. When these increase from the values used in our simulations, we expect the behavior of the Fano factor (used as a measure of the broadness of the distribution) to be closer to the result for the homogeneous excitation by cytokine stimulus only. When the density of cells is high, spatial homogenization occurs more rapidly and the noise may be difficult to observe. The variation of the Fano factor with time for different densities is displayed in Figure 8A. With a density reduced by a factor of four (green circles) from that used in the reported results, the induced noise is considerably enhanced and the Fano factor maximum occurs roughly two to three hours later. When the density is increased by a factor of four (red circles), the maximum in the Fano factor occurs slightly earlier and decays more rapidly.
We illustrate the effects of varying MOI (multiplicity of infection) in Figure 8B. Increasing MOI from 0.5 to 2.0 increases the fraction of infected cells that can express the IFN-β gene from 40% to 86%. This substantially reduces the initial spatial heterogeneity and attenuates the noise and the duration over which the induction is noisy, as seen in Figure 8B. This simulation is performed with a much lower value of the threshold fraction of bound IFNAR (10%) for both MOIs in comparison with the bulk of the simulations. These results establish the significant role played by cell density and MOI value in influencing the role of spatial heterogeneity and show how they affect the time scales and width of the noise distribution of interferon-induced genes.
Induced intracellular noise depends on the threshold fraction of bound receptors and temporal fluctuations in cytokine secretion
Under what conditions is the propagation of noise via extracellular signaling significant? The results of our model simulations in Figure 9 show how the mechanism we have proposed for spatial heterogeneity-induced noise depends on some important cell rate constants.
One of the key cell parameters that determine the effects under discussion is the value of the threshold fraction of bound receptors at which the enhancement of the induced gene DDX58’s production rate reaches half its maximum value. If the threshold value is low, the secreted cytokine density reaches a value sufficient to activate the JAK/STAT pathway in most cells rapidly attenuating cell-to-cell variability in induced gene expression. This is shown in Figure 9A where we use a threshold fraction of 5% and 10% in comparison to the 47.5% used elsewhere in our simulations. These changes not only decrease the magnitude of the Fano factor but also affect the time scales, the duration and the time of occurrence of noisy induction. Thus as the threshold fraction of bound receptors increases, the amount of noise increases; however, if the threshold fraction of bound receptors gets close to unity, noise in the induced genes can again be suppressed (by the time the cytokine density is large enough to bind enough receptors, it can become spatially homogeneous).
Suppressing temporal fluctuations in the production of cytokines reduces the noise in downstream genes but does not eliminate it, confirming the importance of the spatial source of the heterogeneity. There is remnant noise in the induced gene expression due to initial spatial fluctuations. The initial spatial inhomogeneity arises from the fact we use an MOI=0.5, as in the experiment, leading to about 40% of the cells being infected at random spatial locations. In addition to the initial spatial fluctuations, there is a contribution from the intrinsic noise in DDX58 induction. The result for the Fano factor when the IFN-β proteins are secreted simultaneously contrasts in Figure 9B with the result of the main simulations where temporal stochasticity in IFN-β secretion plays an important role. The time scale over which the system becomes homogeneous is clearly considerably shortened and the maximum amplitude of the Fano factor decreases by a factor close to 3. Nevertheless, the induced gene expression level is still noisy because of the spatial heterogeneity. These results delineate how the threshold fraction of bound receptors and temporal fluctuations in cytokine secretion affect induced noise behavior.
We propose and investigate using numerical simulations a mechanism of the transmission of noise to cytokine-induced genes that arises due to spatial and temporal heterogeneity of the sources of cytokine production. The secreted cytokines diffuse and bind to the cellular receptors where signaling pathways are activated. The initial spatial heterogeneity of the cytokine induces downstream intracellular noise through extracellular signaling. We compare and validate our results with experimental single cell data for a population of dendritic cells infected by a virus.
Our model is a spatially-extended agent-based model of dendritic cells in two dimensions with intracellular processes representing the following: IFN-β induction, IFN-β export, extracellular diffusion of the cytokines, and binding of the cytokines to IFNAR. We include as an illustrative example a coarse-grained model of induced gene expression with DDX58. The spatial inhomogeneity of the cytokine leads to a broad distribution of bound receptors on the membranes of infected and uninfected cells. When this distribution spans the fraction of bound receptors needed for significant activation of the JAK/STAT pathway, considerable cell-to-cell variability occurs in the copy numbers of interferon-induced genes. This leads us to propose a general mechanism whereby temporal noise in cytokine production can cascade through extracellular diffusion to downstream-induced genes.
Another example of an interferon-induced gene (that is activated by means of the JAK/STAT pathway like DDX58) is MxA, which has been shown to exhibit anti-viral activity such as inhibiting viral multiplication of pandemic viruses like the 1918 flu [29–31]. Under the conditions stated, our mechanism would suggest that the MxA distribution should also be broad, which translates to a broad range of anti-viral activity across the cell population. This result is derived from a theoretical study of experimental results that depend on both the virus and cell type used. Zhao et al.  draw attention to the fact that even the percentage of activated cells depends on the cell line used. The work of Rand et al.  was done by infecting murine fibroblasts (transfected with plasmids) with NDV and the experiments of Zhao et al. used the Sendai virus as the infecting agent. On the other hand, our experiments were done on human DCs infected by NDV. The time scales involved in our measurements differ from those of Rand et al. Our experimental results are on times up to 10 hours post-infection, whereas the bulk of the changes on murine fibroblasts  occur between 12 and 20 hours. As to the interferon-induced gene expression, Rand et al. show (in their Supplementary Section) that after the addition of IFNβ to the cells the distribution of IRF-7 has a broad expression pattern with bimodality. In our experiments, however, the cells themselves secrete IFN-β as a result of viral infection. All these differences render difficult a direct comparison of our results with those of Zhao et al. and Rand et al. We note in passing that it is possible to obtain bimodal distributions for the interferon stimulated genes (Figure 6A hints at such a possibility) in this model; we check this by varying the rate constants for the transition rates between two possible states of the DDX58 gene. This is consistent with the exact results obtained by us earlier for a simple bursting model .
In our simulations the source of the noise is the broad distribution of the times at which IFN-β induction commences in infected cells. We model this noise as resulting from the stochastic assembly of the enhanceosome and induction of IFNB1 as observed in measurements of intrinsic noise . Other sources of noise linked to cellular variability of the number of signaling molecules or other extrinsic noise emphasized by  would also lead to fluctuations in IFNB1 induction times. The specific mechanism that leads to the initial fluctuations is not important; it is the temporally sporadic, spatially random cytokine secretion that drives downstream noise. Bi-allelic production of the IFN-β mRNA [21, 32], which is not included in our model, will also increase the stochasticity since the two alleles can turn on at different times.
The distribution of DDX58 obtained from the simulations is in good agreement with experimental data. The broad distribution of DDX58 leads to a broad distribution of the product RIG-I protein (See Additional file 1: Figure S3). RIG-I is the key cellular sensor that initiates the anti-viral response of DCs and so the feedback loop through paracrine signaling primes other DCs over a broad time period and can include those DCs in which viral entry may occur late [33–36]. On the other hand we have shown that autocrine signaling dominates at early times (4 – 6 hours post-infection), which enhances the impact of those cells that respond early to viral intrusion.
We demonstrated that at early times (4 – 6 hours post-infection) autocrine signaling is dominant and enhances the cell-to-cell variability in IFN-β due to stochastic induction. At intermediate times (6 – 8 hours post-infection) the paracrine signaling produces large variability across the cell population in the interferon-stimulated genes. At later times (> 8 hours post-infection) paracrine signaling dominates and begins to quench the cell-to-cell variability of the interferon-stimulated genes.
We have identified, motivated by our measurements, how noise can be amplified by diffusive signaling in the transient state following viral infection of human dendritic cells and investigated the conditions under which it can occur. Though there has been work on modeling intercellular communication, none of these studies focus on the effects of noise in the transient state and how intracellular, intrinsic, stochasticity leads to further cell-to-cell variability, via intercellular communication. In the context of quorum sensing, coupled stochastic differential equations have been used [37, 38] to investigate in the steady state the effect of noise on gene expression in bacteria. Results of multiscale, stochastic modeling of various phenomena in immunology have been reported, for example, in host-pathogen interactions , the modeling of lymph nodes , and the resolution of inflammation by leukocytes . In a recent study, the influence of cytokines following tuberculosis infection on the granuloma environment of lung tissue has been studied with agent-based modeling . Importantly, all of these studies involve different time or length scales from the scales presented here.
In this paper we propose a general mechanism by which intracellular noise in protein numbers can be transmitted in the transient state via extracellular communication to induced downstream genes in other cells. The specific process by which the temporal noise in the proteins is produced is not important. We illustrated our general mechanism in the context of the experimentally studied system of dendritic cells exposed to a viral antagonist.
We have identified external factors that can significantly affect the level of noise and relevant time scales - in particular, the density of cells (an important element in interpreting experiments) and the level of infection as measured by the fraction of infected cells. Among the intrinsic factors that impact the propagation of noise and response of a cell population, an important one is the threshold number of bound receptors. This number can, therefore, affect the overall noise in the anti-viral response of the cell population.
The mechanism of cellular stochasticity of gene induction, which we have investigated by means of an ABM with a systems biology approach, is not limited to the particular interferon-stimulated gene we studied; a broad distribution across cells of copy number is to be expected for other interferon-stimulated genes. This can lead to functional consequences for cell-to-cell variability in the range of anti-viral states of a population of cells and is a subject for future study.
All the intracellular interactions used in the simulations and the corresponding rate constants are included in Additional file 1: Tables S1, S2, S3, S4, and S5.
We simulated the stochastic intracellular processes of both infected and uninfected DCs using the standard Gillespie algorithm . The method used to simulate the extracellular diffusion of IFN-β is described in detail in . The code was written in C++ and the computations were performed on a PC.
We modeled the system in silico on a two dimensional lattice of 40 × 40 squares that represents the medium. The size of the squares is chosen to be slightly larger than the diameter of a DC thus allowing at most one cell per square. The system contained 210 DCs uniformly randomly distributed with 40% of the DCs infected corresponding to an MOI of 0.5. The average diameter of a DC is 30 μm. In the simulation we used a density of roughly 5 × 106 cells mL-1. The simulation volume can be viewed as a region of space with a thickness chosen to be the diameter of a DC and a cross-sectional area of (1200 μm)2.
The parameters for the intercellular modeling were based on experimental data and previous in silico simulations . The experimental value for the diffusion coefficient for the cytokine IFN-β is approximately 10 μm2 s-1. Given the diffusion coefficient and the dimensionality of a lattice box we determined the simulation diffusion time step of 11.25 s for the IFN-β to diffuse to an adjacent square with 50% probability (See Additional file 1 for a derivation of the simulation diffusion time step).
We describe the intracellular part of the simulation next. The binding and unbinding of IFN-β to the IFNAR reactions are included in the intracellular part of the algorithm. This is justified because only the IFN-β proteins inside a lattice box containing a DC have a non-zero probability of being bound to a free IFNAR on the cell surface. The rate constants for the binding and unbinding of IFN-β to the IFNAR are chosen based on the literature .
The induction of IFN-β is described by an extension of an intracellular model of IFN-β mRNA induction developed earlier to explain experimentally observed power-law behavior in IFN-β mRNA enhanceosome . It has been shown experimentally [45, 46] that the assembly of the enhanceosome is promoted by HMGI, an architectural protein; NFκB is detected initially at the promoter with an IRF and ATF-2 recruited, later followed by the arrival of IRF-3 or IRF-7. We model the enhanceosome with the sequential cooperative binding of four proteins. As in the earlier model, the cascade of steps required for the assembly of the pre-initiation complex is represented by a single step that takes the assembled enhanceosome to a transcribing state. This gives rise to bursting-type kinetics [9, 24, 25, 47] that leads to good agreement with the experimentally observed power-law distributions of the IFN-β mRNA copy number .
We do not explicitly model the stochastic activation of RIG-I and the transcription factors involved in the enhanceosome assembly to keep the model tractable; however, we modify the forward rates for the assembly of the enhanceosome to be a function of RIG-I number. This represents the complex set of reactions that ensue following viral detection by RIG-I in the cytosol. The transcription rate of IFN-β mRNA was modified to be a function of bound IFNAR. This was done to simulate the increased production of IFN-β mRNA through signal transduction by means of the exchange of IRF-3 with the induced IRF-7 . The rate constants for the up regulation of IFN-β mRNA’s transcription rate via the exchange of IRF-3 with induced IRF-7 were chosen to match the experimental IFN-β mRNA distribution .
The IFN-β secretion was modeled directly as translation of IFN-β mRNA and export because the transport of the IFN-β is deemed to be rapid with a rate of secretion chosen based on the  paper. We emphasize that the intracellular reactions involving IFN-β occur only in infected cells.
We use a more detailed model of DDX58 gene induction than used previously: the gene is assumed to have two states, a basal (low) production state in the absence of the activated JAK/STAT pathway and an enhanced production state after activation. The transition rate of the DDX58 gene from a low to a high production state was modeled in a coarse-grained way as a function of the number of bound IFNARs; this determines the level of signal transduction of the JAK/STAT pathway that in turn enhances the production of DDX58. The chemical reactions for DDX58 and rate constants are found in the Additional file 1: Tables S2, S3, and S4. The rate constant for DDX58 degradation was chosen to be the same as in earlier work . The production rates in the two states of the gene and the transition rate between them were chosen to match the average number of DDX58 at six and eleven hours observed experimentally. The RIG-I production was modeled as translation of DDX58 with the same rate constants as used earlier .
It is computationally infeasible to do a systematic variation of all the rate constants and parameters in the model. It is, however, important to understand the effects of changing specific model ingredients. Since we have a clear mechanistic understanding of the proposed mechanism for explaining the experimentally observed broad distribution of DDX58 in human DCs with NDV infection, we vary the rate constants for the key reactions that affect the noise by roughly an order of magnitude: from 1/3 or 1/4 of the value used in the reported results to 3 or 4 times the value, in order to understand the robustness of the results and identify the rate constants to which the results are most sensitive. We summarize the results here and provide the relevant figures in the Additional file 1.
We modify the IFN-β mRNA induction model to include the two-stage induction process reported in the literature. It is known  that IRF-7 is the master regulator and is more efficient in promoting IFN-β transcription but its constitutive production is negligible in m-DCs. It is induced through the JAK/STAT pathway by the secreted IFN-β protein. We have modeled this two-stage process by using a lower production rate of mRNA initially in the presence of the constitutively expressed IRF-3 and a higher rate after a fraction of the receptors (IFNAR) are bound. Choosing rate constants that fit the observed IFN-β data leaves all of our main results for the induced gene unaffected.
In the model we vary the rate at which the enhanceosome (once it is formed) is activated and deactivated; this changes the power-law distribution observed experimentally  and eliminates it entirely in one case. The activation rate constant for the IFN-β gene controls the location of the DDX58 Fano factor peak: the peak time occurs later by as much as 90 minutes as the activation rate is decreased (see Additional file 1: Figure S5). The activation rate constant for the IFN-β gene after the enhanceosome is formed also controls how rapidly the infected DCs become active. A three-fold increase or decrease varies the percent of activated infected DCs by up to approximately 30% while the noise in the interferon-induced genes remains significant.
Another important parameter is the binding rate of IFN-β protein to IFNAR. A four-fold increase in the binding rate decreases the time of occurrence of the Fano factor peak by about an hour, while a four-fold decrease delays the peak position by more than 2 hours. The effect on the ratio of autocrine to paracrine signaling is not large, although autocrine signaling is somewhat enhanced as the binding rate increases (see Additional file 1: Figure S6).
We check that our results are insensitive to the initial conditions, for example, the precise spatial distribution of infected cells. We test the importance of statistical fluctuations (the number of cells is 210 in the experiments and for the results reported here) by simulating 1050 cells, keeping the same density of cells. Within the expected level of fluctuations the results remain the same. Changing the size of the boxes by a few percent (still keeping at most one DC per box) left the results substantially unaltered. In summary, when the spatio-temporal production of the cytokine is heterogeneous, the mRNA distribution of the induced genes across cells can be broad and we have studied the effect of different factors on this phenomenon.
Newcastle disease virus
Interferon-stimulated response element
Multiplicity of infection.
Spiller DG, Wood CD, Rand DA, White MR: Measurement of single-cell dynamics. Nature. 2010, 465: 736-745. 10.1038/nature09232.
McAdams HH, Arkin A: Stochastic mechanisms in gene expression. PNAS. 1997, 94: 81419-81419.
Arkin A, Ross J, McAdams HH: Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. Genetics. 1998, 149: 1633-1648.
Pedraza JM, van Oudenaarden A: Noise propagation in gene networks. Science. 2005, 307: 1965-1969. 10.1126/science.1109090.
Rosenfeld N, Young JW, Alon U, Swain PS, Elowitz MB: Gene regulation at the single-cell level. Science. 2005, 307: 1962-1965. 10.1126/science.1106914.
Blake WJ, Balazsi G, Kohanski MA, Isaacs FJ, Murphy KF, Kuang Y, Cantor CR, Walt DR, Collins JJ: Phenotypic consequences of promoter-mediated transcriptional noise. Mol Cell. 2006, 24: 853-865. 10.1016/j.molcel.2006.11.003.
Pascal V, Stulberg MJ, Anderson SK: Regulation of class I major histocompatibility complex receptor expression in natural killer cells: one promoter is not enough!. Immunol Rev. 2006, 214: 9-21. 10.1111/j.1600-065X.2006.00452.x.
Volfson D, Marciniak J, Blake WJ, Ostroff N, Tsimring LS, Hasty J: Origins of extrinsic variability in eukaryotic gene expression. Nature. 2006, 439: 861-864.
Eldar A, Elowitz MB: Functional roles for noise in genetic circuits. Nature. 2010, 467: 167-173. 10.1038/nature09326.
Hu J, Sealfon SC, Hayot F, Jayaprakash C, Kumar M, Pendleton AC, Ganee A, Fernandez-Sesma A, Morn TM, Wetmur JG: Chromosome-specific and noisy IFNb1 transcription in individual virus-infected human primary dendritic cells. NAR. 2007, 35: 5232-5241. 10.1093/nar/gkm557.
Weinberger LS, Burnett JC, Toettcher JE, Arkin AP, Schaffer DV: Stochastic gene expression in a lentiviral positive-feedback loop: HIV-1 Tat fluctuations drive phenotypic diversity. Cell. 2005, 122: 169-182. 10.1016/j.cell.2005.06.006.
Raj A, van Oudenaarden A: Nature, nurture, or chance: stochastic gene expression and its consequences. Cell. 2008, 135: 216-226. 10.1016/j.cell.2008.09.050.
Balazsi G, van Oudenaarden A, Collins JC: Cellular decision-making and biological noise: from microbes to mammals. Cell. 2011, 144: 910-925. 10.1016/j.cell.2011.01.030.
Thattai M, van Oudenaarden A: Intrinsic noise in gene regulatory networks. PNAS. 2001, 98: 8614-8619. 10.1073/pnas.151588598.
Golding I, Paulsson J, Zawilski SM, Cox EC: Real-time kinetics of gene activity in individual bacteria. Cell. 2005, 123: 1025-1036. 10.1016/j.cell.2005.09.031.
Raj A, Peskin CS, Tranchina D, Vargas DY, Tyagi S: Stochastic mRNA synthesis in mammalian cells. PLoS Biol. 2006, 4: e309-10.1371/journal.pbio.0040309.
Elowitz MB, Levine AJ, Siggia ED, Swain PS: Stochastic gene expression in a single cell. Science. 2002, 297: 1183-1186. 10.1126/science.1070919.
Hu J, Nudelman G, Shimoni Y, Kumar M, Ding Y, López C, Hayot F, Wetmur JG, Sealfon SC: Role of cell-to-cell variability in activating a positive feedback antiviral response in human dendritic cells. PLoS One. 2011, 6: 1661-1664.
Shimoni Y, Nudelman G, Hayot F, Sealfon SC: Multi-scale stochastic simulation of diffusion-coupled agents and its application to cell culture simulation. PLoS One. 2011, 6: e29298-e29298. 10.1371/journal.pone.0029298.
Park MS, Garcia-Sastre A, Cros JF, Basler CF, Palese P: Newcastle disease virus V protein is a determinant of host range restriction. J Virol. 2003, 77: 9522-9532. 10.1128/JVI.77.17.9522-9532.2003.
Apostolou E, Thanos D: Virus infection induces NF-κB-dependent interchromosomal associations mediating monoallelic IFN-β gene expression. Cell. 2008, 134: 85-96. 10.1016/j.cell.2008.05.052.
Rand U, Rinas M, Schwenk J, Nöhren G, Linnes M, Kröger A, Flossdorf M, Kály-Kullai K, Hauser H, Höfer T, Köster M: Multi-layered stochasticity and paracrine signal propagation shape the type-I interferon response. Mol Syst Biol. 2012, 8: 584-596.
Zhao M, Zhang J, Phatnani H, Scheu S, Maniatis T: Stochastic expression of the interferon-β gene. PLoS Biol. 2012, 10: 1-16.
Iyer-Biswas S, Hayot F, Jayaprakash C: Stochasticity of gene products from transcriptional pulsing. Phys Rev E. 2009, 79: 031911-
Dar RD, Razooky BS, Singh A, Trimeloni TV, McCollum JM, Cox CD, Simpson ML, Weinberger LS: Transcriptional burst frequency and burst size are equally modulated across the human genome. PNAS. 2012, 109: 17454-17459. 10.1073/pnas.1213530109.
Zaslavsky E, Hershberg U, Seto J, Pham AM, Marquez S, Duke JL, Wetmur JG, Tenoever BR, Sealfon SC, Kleinstein SH: Antiviral response dictated by choreographed cascade of transcription factors. J Immunol. 2010, 184: 2908-2917. 10.4049/jimmunol.0903453.
Marie I, Durbin JE, Levy DE: Differential viral induction of distinct interferon-alpha genes by positive feedback through interferon regulatory factor-7. EMBO J. 1998, 17: 6660-6669. 10.1093/emboj/17.22.6660.
Brierley MM, Fish EN: Stats: multifaceted regulators of transcription. J Interferon Cytokine Res. 2005, 25: 733-744. 10.1089/jir.2005.25.733.
Pavlovic J, Haller O, Staeheli P: Human and mouse mx proteins inhibit steps of the influenza virus multiplication cycle. J Virol. 1992, 66: 2564-2569.
Tumpey TM, Szretter KJ, Van Hoeven N, Katz JM, Kochs G, Haller O, Garcia-Sastre A, Staeheli P: The Mx1 gene protects mice against the pandemic 1918 and highly lethal H5N1 influenza viruses. J Virol. 2007, 81: 10818-10821. 10.1128/JVI.01116-07.
Carlos TS, Young D, Stertz S, Kochs G, Randall RE: Interferon-induced inhibition of parainfluenza virus type 5; the roles of MxA, PKR and oligo A synthetase/RNase. Virology. 2007, 363: 166-173. 10.1016/j.virol.2007.01.014.
Hu J, Iyer-Biswas S, Sealfon SC, Wetmur J, Jayaprakash C, Hayot F: Power-laws in interferon-b mRNA distribution in virus-infected dendritic cells. Biophys J. 2009, 97: 1984-1989. 10.1016/j.bpj.2009.05.067.
Brennan K, Bowie AG: Activation of host pattern recognition receptors by viruses. Curr Opin Microbiol. 2010, 13: 503-507. 10.1016/j.mib.2010.05.007.
Theofilopoulos AN, Baccala R, Beutler B, Kono DH: Type I interferons (alpha/beta) in immunity and autoimmunity. Annu Rev Immunol. 2005, 23: 307-336. 10.1146/annurev.immunol.23.021704.115843.
Kato H, Sato S, Yoneyama M, Yamamoto M, Uematsu S, Matsui K, Tsujimura T, Takeda K, Fujita T, Takeuchi O, Akira S: Cell type-specific involvement of RIG-I in antiviral response. Immunity. 2005, 23: 19-28. 10.1016/j.immuni.2005.04.010.
Kawai T, Akira S: Innate immune recognition of viral infection. Nat Immunol. 2006, 7: 131-137.
Goryachev AB, Toh D, Wee KB, Lee T, Zhang H, Zhang L: Transition to quorum sensing in an Agrobacterium population: a stochastic model. PLoS Comput Biol. 2005, 1: e37-10.1371/journal.pcbi.0010037.
Tanouchi Y, Tu D, Kim J, You Y: Noise reduction by diffusional dissipation in a minimal quorum sensing motif. PLoS Comput Biol. 2008, 4: e1000167-10.1371/journal.pcbi.1000167.
Bauer AL, Beauchemin CA, Perelson AS: Agent-based modeling of host-pathogen systems: the successes and challenges. Inf Sci (Ny). 2009, 179: 1379-1389.
Mirsky HP, Miller MJ, Linderman JJ, Kirschner DE: Systems biology approaches for understanding cellular mechanisms of immunity in lymph nodes during infection. J Theor Biol. 2011, 287: 160-170.
Kepler TB, Chan C: Spatiotemporal programming of a simple inflammatory process. Immunol Rev. 2007, 216: 153-163.
Cilfone NA, Perry CR, Kirschner DE, Linderman JJ: Multi-scale modeling predicts a balance of tumor necrosis factor-a and interleukin-10 controls the granuloma environment during mycobacterium tuberculosis infection. PLoS One. 2013, 8: e68680-10.1371/journal.pone.0068680.
Gillespie DT: A general method for numerically simulating the stochastic time evolution of coupled chemical reactions. J Comput Phys. 1976, 22: 403-434. 10.1016/0021-9991(76)90041-3.
Coppey M, Berezhkovskii AM, Sealfon SC, Shvartsman SY: Time and length scales of autocrine signals in three dimensions. Biophys J. 2007, 93: 1917-1922. 10.1529/biophysj.107.109736.
Munshi N, Agalioti T, Lomvardas S, Merika M, Chen G, Thanos D: Coordination of a transcriptional switch by HMGI(Y) acetylation. Science. 2001, 293: 1133-1136. 10.1126/science.293.5532.1133.
Panne D, Maniatis T, Harrison SC: An atomic model of the interferon-β enhanceosome. Cell. 2007, 129: 1111-1123. 10.1016/j.cell.2007.05.019.
Suter DM, Molina N, Gatfield D, Schneider K, Schibler U, Naef F: Mammalian genes are transcribed with widely different bursting kinetics. Science. 2011, 332: 472-474. 10.1126/science.1198817.
Honda K, Yanai H, Negishi H, Asagiri M, Sato M, Mizutani T, Shimada N, Ohba Y, Takaoka A, Yoshida N, Taniguchi T: IRF-7 is the master regulator of type-I interferon-dependent immune responses. Nature. 2005, 434: 772-777. 10.1038/nature03464.
We thank James Wetmur for helpful discussions about the experiment. We thank the referees for useful comments about the manuscript. This work was supported by the National Institute of Allergy and Infectious Diseases [contract HHSN 272201000054C].
The authors declared that they have no competing interest.
FH and CJ conceived the project. CJ, GN, and OPT contributed to the algorithm development. OPT performed the simulations. FH, CJ, SCS, and OPT wrote the paper. All authors read and approved the final manuscript.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.