 Research Article
 Open Access
Multiobjective optimization framework to obtain modelbased guidelines for tuning biological synthetic devices: an adaptive network case
 Yadira Boada^{1},
 Gilberto ReynosoMeza^{2},
 Jesús Picó^{1} and
 Alejandro Vignoni^{1, 3}Email authorView ORCID ID profile
https://doi.org/10.1186/s1291801602690
© Boada et al. 2016
 Received: 13 October 2015
 Accepted: 16 February 2016
 Published: 11 March 2016
Abstract
Background
Model based design plays a fundamental role in synthetic biology. Exploiting modularity, i.e. using biological parts and interconnecting them to build new and more complex biological circuits is one of the key issues. In this context, mathematical models have been used to generate predictions of the behavior of the designed device. Designers not only want the ability to predict the circuit behavior once all its components have been determined, but also to help on the design and selection of its biological parts, i.e. to provide guidelines for the experimental implementation. This is tantamount to obtaining proper values of the model parameters, for the circuit behavior results from the interplay between model structure and parameters tuning. However, determining crisp values for parameters of the involved parts is not a realistic approach. Uncertainty is ubiquitous to biology, and the characterization of biological parts is not exempt from it. Moreover, the desired dynamical behavior for the designed circuit usually results from a tradeoff among several goals to be optimized.
Results
We propose the use of a multiobjective optimization tuning framework to get a modelbased set of guidelines for the selection of the kinetic parameters required to build a biological device with desired behavior. The design criteria are encoded in the formulation of the objectives and optimization problem itself. As a result, on the one hand the designer obtains qualitative regions/intervals of values of the circuit parameters giving rise to the predefined circuit behavior; on the other hand, he obtains useful information for its guidance in the implementation process. These parameters are chosen so that they can effectively be tuned at the wetlab, i.e. they are effective biological tuning knobs. To show the proposed approach, the methodology is applied to the design of a well known biological circuit: a genetic incoherent feedforward circuit showing adaptive behavior.
Conclusion
The proposed multiobjective optimization design framework is able to provide effective guidelines to tune biological parameters so as to achieve a desired circuit behavior. Moreover, it is easy to analyze the impact of the context on the synthetic device to be designed. That is, one can analyze how the presence of a downstream load influences the performance of the designed circuit, and take it into account.
Keywords
 Biological circuits
 Dynamic behavior
 Multiobjective optimization
 Kinetic parameters
 Biological tuning knobs
Background
Synthetic Biology is defined as the engineering of biology: the deliberate (re)design and construction of novel biological and biologically based parts, devices and systems to perform new functions for useful purposes [1]. As an engineering discipline, it emphasizes engineering principles and methodology in designing, constructing and characterizing biological systems to be applied in industrial, environmental and other applications. Currently, there still is a disparity between the ability to design systems and the one to synthesize them. This disparity can partly be attributed to a lack of wellcharacterized parts and methods for reliably and robustly composing parts into devices [2].
From the very beginning of Synthetic Biology, efforts have been made in order to characterize standard biological parts –i.e. DNA sequences encoding a function that can be assembled with other standard parts to form devices [3]. Yet, the roadmap to engineering biological systems is determined not by the biological parts but rather by how they interact [4]. Thus, both precise characterization and predictable part composition are essential for the efficient creation of sophisticated genetic circuits [5, 6]. In this context, developing frameworks for functional composition is a current challenge, the solution of which will allow biological components to be systematically, reliably, and predictably assembled into a functional device or system [2].
The systematic design of complex biocircuits from libraries of standard parts relies on mathematical models describing the circuit dynamics. In this regard, modular modeling tools facilitate the mathematical representation of biological parts and their combinations, providing the description of the reactions which take place inside the different parts and the interfaces that connect them [7, 8]. Computeraided (model based) methods and tools can be used to guide the design of synthetic biochemical pathways [9–11].
Several problems arise when building up biological devices by combining parts. First, composing different biological parts and devices together can be difficult, even if assuming a synthetic circuit structure has been properly designed to have a prespecified dynamic behavior, because the desired input and output levels of a module are often unknown, difficult to measure quantitatively, or difficult to compare. Additionally, the ratio part/device performance may be altered due to the interaction of loads in the combined system, the socalled retroactivity [12]. Along with this, there is an evergrowing appreciation for biological complexity, which requires new circuit modeling and design principles to overcome barriers such as metabolic load, crosstalk, resource sharing, and gene expression noise [5, 13–15]. Finally, one must never forget the gap between computational (drylab) design, and wetlab implementation. In practice, biological parts are subject to uncertainty. Circuit structure design and parameters tuning methods must cope with this uncertainty in the biological parts and context to narrow the gap.
To this end, the modular and systematic design of biocircuits, i.e. the systematic way of finding combinations of components from a library of standard parts allowing to optimally perform a predefined function, can be formulated using an optimization framework [16–18]. Indeed, it has been argued that Synthetic Biology is less like highly modular (or ‘switchlike’) electrical engineering and computer science, and more like civil and mechanical engineering in its use of models optimization of whole systemlevel stresses and traffic flow [5].
Advanced optimizationbased methods, capable of handling high levels of complexity and multiple design criteria have been proposed for the modular and systematic structural design of biocircuits [19]. These new approaches combine the efficiency of global Mixed Integer Nonlinear Programming solvers with multiobjective optimization techniques [20, 21].
On the other hand, a natural approach to modelbased tuning of synthetic circuits consists of the analysis of the effect of key parameters that can be used as tuning knobs in the experimental implementation. In this approach, selection of biological parts is understood as choice of the range of values of key parameters of the device that yield the desired dynamical behavior. A current challenge is to devise methods to provide the set of circuit parameters that satisfies a specified circuit behavior in a way that can be readily used for their wetlab implementation [22]. Thus, for instance, in [23], the authors synthesize regulatory promoter libraries, characterize key parameters, and use them to guideline the construction of synthetic networks with different predicted inputoutput characteristics. Global sensitivity analysis is used in [16]. The sensitivity information is used to guide the selection of circuit components and thereby reduce the wetlab implementation effort. In [24] the authors express the desired behavior as a functional cost index of the desired circuit trajectories. Then, the inverse sensitivity of the mapping between parameters and cost index is obtained after linearising the functional cost index around an initial value of the model parameters. This local inverse mapping is used to map a region of specifications into a one of parameters.
Although the specification of the desired dynamic of the circuit is most often naturally expressed as a multiobjective global optimization problem, this approach has not been used so far. Instead, current approaches define independent thresholds set a priori for each of the functional goals characterizing the desired behavior of the circuit. Then, global Monte Carlolike approaches are used, sampling the parameters space and simulating the circuit time response. The result of these simulations is used to assess the circuit behavior, so as to profile the subset of the parameters space that result in circuit behavior fulfilling all thresholds. After this, some statistical posttreatment of the results is used, like clustering or correlation analysis or global sensitivity analysis, to draw conclusions between the distribution of the parameters, and the circuit behavior [25]. This Monte Carlo based approach has a huge computational cost. Given a defined search space in the parameters space, the Monte Carlo sampling does not ensure that a solution will be found, thus requiring a large number of samples to find solutions. This problem increases as the thresholds defining the acceptable circuit behavior are more stringent. On the other hand, the solution space obtained weighs, either equally or ad hoc, all the functional goals of the circuit. Thus, besides missing many possible optimal solutions, there may be little variability among the different solutions in the parameters space, making the statistical posttreatment less sensitive.
Feedforward circuits have been used within this context as an important casestudy. In [26] all threenode possible network topologies that present adaptive dynamical behavior are analyzed using functiontopology maps based on Monte Carlo sampling in the parameters space. Using a simple enzymatic model, the authors draw design principles of adaptation circuits. They show that there are only two core solutions that achieve robust adaptation: negative feedback loops and incoherent feedforward ones. In [27], the incoherent feedforward adaptive enzyme network structure derived in [26], is used as case study. A method is proposed to make inferences on the contribution of individual parameters to specific components of the system. Classes of kinetic parameters are obtained that may correspond to varying strengths of enzymatic reactions that can be measured and classified experimentally. The authors show that, for a given network structure, certain types of values, or motifs, also exist for kinetic parameters in order to achieve specific system dynamics. Clustering in the parameters space to detect kinetic motifs, i.e. sets of parameters yielding desired circuit dynamics, is used in [25].
In this paper, to build a given functional device with desired dynamic behavior, we study the application of a multiobjective optimization design (MOOD) framework [28] to obtain a modelbased set of guidelines for the selection of its biological parts. In MOOD all objectives are important, so all of them are optimized simultaneously. Thus, the solution rarely is unique, but a set of solutions called the Pareto Front. In this sense all solutions are Paretooptimal and differ from each other in the tradeoff of objectives that each one represents. Then, the design reduces to encode carefully the desired dynamics into the objectives and optimization problem itself in the MOOD [28]. As a result, the designer obtains qualitative regions/intervals of parameters along the Pareto Front giving rise to the predefined behavior of the circuit. Contrarily to the passive search for solutions of Monte Carlobased approaches, the multiobjective optimization approach actively searches for all the optimal solutions as a first step. The MOOD framework also naturally provides a classification of the parameters along the Pareto front, by taking into account their effect on each of the goals. Moreover, this framework makes easy to analyze the impact of context on the synthetic devices to be designed. This can be done by just incorporating information about the relationship between the device and the context. In general, this means we only need to know where do we connect the device which is being designed and how we are connecting it. Including this information in the optimization problem, we obtain a qualitative region of parameters taking into account the effect of the context on the device.
The remaining of the paper is organized as follows. In Methods, the general framework, and the type1 incoherent feedforward (I1FFL) circuit that will be used as case study, are presented. Next, in Results, the proposed methodology is applied to the I1FFL case study, and the main findings for the circuit are described. Two typical application scenarios of the methodology are also considered. Finally, some discussion and general conclusions, both on the methodology and its results on the I1FFL case study are drawn in Discussion and Conclusion sections.
Methods
Multiobjective optimization design framework
General workflow
Achieving a synthetic biological circuit fulfilling some behavioral specifications requires in practice an iterative process through three main steps: choosing a circuit structure capable to perform the desired behavior after the proper tuning of its parameters, tuning the circuit parameters, and validating the circuit with the selected tuned components. The use of models to solve the first two subproblems in silico, before attempting the wetlab implementation to validate the circuit, reduces the wetlab effort and speedsup the design process. This work focuses on the second subproblem: in silico tuning of the circuit model parameters, so as to achieve the desired behavioral specifications.
First, a topology for the functional module or circuit is needed, capable to perform the desired behavior after the proper tuning of its parameters. This will provide the circuit model structure. Although currently there are no catalogues as such for functional modules, there is a vast literature in the systems biology area on network motifs producing a variety of dynamic behaviors [29]. Much work has also been done and is ongoing on the design of circuits with various capabilities: repressilators [30], biomolecular concentration trackers [31], feedback regulation circuits [32], switchable genetic oscillators [33], etc. Many of the functional circuits that are being implemented in synthetic biology take advantage from wellestablished work in areas such as electronics and feedback control for the design of bistables, feedback and feedforward structures, switches, etc; see, for example, [26, 29, 34–39] and the references therein. Alternatively, one may find the potential circuit structure casting the problem as an optimization one, starting from coarsegrained models of the potential circuit structural components, and looking for the optimal circuit topology [19].
Models may have different degrees of detail. Our goal is to tune the model parameters using a degree of detail in the model amenable to serve as basis to provide guidelines for the experimental implementation of the circuit. That is, the parameters to be tuned should correspond to biological tuning knobs that can be modified experimentally [40]. Mass action kinetic models obtained from the set of biochemical reactions will be used for this purpose. These models can be reduced using singular perturbation methods (the socalled quasisteady state approximation, QSSA) by neglecting the dynamics associated to fast binding reactions  e.g. RNA polymerase binding to DNA and by taking into account the algebraic relationships among species resulting from conserved moieties [41]. The reduction process can be performed so that both the species in the reduced model are a subset of the original one [42, 43], and that the resulting aggregated parameters have a clear matching with experimental biological tuning knobs [44].
From this starting point, we can proceed to tune the model parameters so that eventually the circuit fulfills the behavioral specifications. We will consider the general case when a set of specifications is desired, thus leading to a multiobjective problem. A usual approach to face a multiobjective problem consists of building an aggregate function in order to assemble the design objectives in a unique index, normally by means of a weighting vector. This approach is followed for example in [25]. However, the solution obtained depends too much on the correct selection of the weighting factors, and it might not possibly reflect with enough clarity the designer’s preferences in relation with the desired balance of requirements. An alternative option is to use multiobjective optimization [45]. This is a natural choice to face this kind of problems. In multiobjective optimization all design objectives are important to the designer, so all of them are optimized simultaneously. Thus, the solution rarely is unique, but a set of solutions called the Pareto Front. In this sense all solutions are Paretooptimal and differ from each other in the tradeoff of objectives each one represents.
 1.the multiobjective problem (MOP) definition: defining the circuit behavioral specifications in a proper way.
 2.
the optimization process: tuning the parameters using multiobjective global optimization (MOO).
 3.
and the multicriteria decision making (MCDM) stage: obtaining tuning guidelines useful for the wetlab implementation.
This overall multiobjective optimization design (MOOD) procedure enables to analyze design objectives tradeoffs to implement a preferable solution [28]. Furthermore, it may provide a better understanding of the problem at hand by the so called process of innovization through optimization as stated by [47]. Next we describe each of the steps in detail.
Defining the circuit behavioral specifications
The starting point of the proposed methodology is the multiobjective problem definition, that is the specification of the desired dynamical behavior for the circuit to be designed. This can be done in several ways. From the designer’s point of view, specifying the circuit behavior in terms of the desired output signal profile for a given input signal profile is a natural approach [48]. The input signal is chosen as the one that is going to be used in working conditions, or as simple standard probing inputsignals (e.g. steplike, sinusoidal, or pulse ones). Once the desired inputoutput relationship is defined, the set of circuit parameters achieving it can be obtained by optimizationbased system identification [20]. This approach is useful for linear dynamical systems, as their timeresponse to these probing signals fully characterizes the circuit dynamical behavior. This is not the case for nonlinear circuits as the ones typically encountered in synthetic biology. Thus, the particular signal to be used in working conditions should be chosen. Yet, this may be very restrictive. Indeed, usually the input signal to a circuit will have varying characteristics. In the best case, it will belong to a given class (e.g. steplike signal with varying amplitude). Therefore, the dynamical behavior, i.e. the desired circuit timeresponse to a given input signal, is better given as a set of inputoutput performance indexes to be optimized.
for some possibly timedependent function h(.) of the system trajectories during a time interval of interest [t _{0},t _{ f }], being i=1…n _{ i } is the number of indexes. These can be made valid for a whole class of input signals, may consider other signals in the circuit besides the input and output ones, robustness with respect to uncertainty in the circuit parameters can be included, etc. They will typically consider the desired performance at steady state (precision), and some measure of the quality of the transient. Proper definition of the optimization indexes representing the desired behavior is a key point. An incorrectly specified objective, not properly representing the actual desired behavior, will lead the optimization in a wrong direction, returning a parameter set that will give misleading design guidelines. Moreover, for the proper interpretation of results by the designer, one must pose meaningful design objectives.
Multiobjective parameters tuning
As mentioned above, representing the desired behavior will eventually lead to several objectives to be optimized. That is, the optimization problem will be a multiobjective one in the general case. Typically, some of the objectives will be in conflict, so a trade off among solutions is required. Ad hoc weighting of the different objectives may be used to transform the problem into a singleobjective one [49]. Alternatively, thresholds on each of the objectives may be set in order to run multiple times a singleobjective optimization. Instead, we address the problem as a truly multiobjective optimization design (MOOD) one.
The multiobjective optimization (MOO) process seeks to approximate the best parameters \({\theta _{P}^{*}}\) that give the best Paretofront approximation \({J_{P}^{*}}\) [45]. Such search could be done through a random MonteCarlo sampling in the decision variables space θ –the set of parameters determining our biological model–, followed by a filtering of the solutions in order to obtain the \({\theta _{P}^{*}}\) that defines the Pareto front approximation \({J_{P}^{*}}\). This could be a good option for problems with few decision variables. For problems with a large number of decision variables, as our case, it is more efficient to use an appropriate multiobjective optimization algorithm to approximate this solution.

improves convergence by using an external file to store solutions and include them in the evolutionary process;

improves spreading by using the spherical pruning mechanism [50];

improves pertinency of solutions, i.e. getting interesting solutions from the designer’s point of view, by means of a basic bound mechanism in the objective space, as described in [52].
Obtaining tuning guidelines for implementation
After the multiobjective optimization, a set of solutions is obtained: values for the kinetic parameters that represent a tradeoff between the objectives. Then, the final step is to obtain tuning guidelines to select the values of the kinetic parameters of the model and correspondingly cues for the implementation of the circuit in the wetlab. In this work we present two alternatives for this last step: a semiautomated one based on an optimized clustering of the solutions, that is, providing some guinelines; and a second one, in case the implementation needs more insight allowing to learn more about the problem, based on the visualization of the Pareto front and set using suitable tools, thus, providing a guidance with this information.

Plasmid copy number. It can be tuned by selecting the appropriate replication origin of the plasmid.

Promoter strength. It can be modified by selecting the appropriate promoter with predicted strength; for example from the Anderson Promoter library [53] available at the iGEM Parts Registry.

Ribosome Binding Site strength. It is one of the easiest parameters to tune in the wetlab using, for instance, RBS libraries, the RBS Calculator from Sallis Lab [54], or nucleotides repetition [55].

Protein degradation rate. It can be tuned globally by changing the growth rate of the microorganism. It can also be tuned by adding a protein degradation tag to include the protein in an active degradation pathway.
In order to facilitate the obtention of the guidelines, a hierarchical clustering is performed with the solutions (also using a Matlab script, see Additional files 1 and 2), including the values of the objectives and also the kinetic parameters of each solution. This process is achieved by using a cluster tree based on the Euclidean distance among the vectors containing the attained values of the objectives for all points along the Pareto front. The distance among clusters is obtained by means of the weighted center of mass distance. Then we set the number of clusters in an iterative manner from ten to two, and in each iteration we perform a KruskalWallis [56] test (which is the nonparametric equivalent of the oneway analysis of variance ANOVA) to study the correlation between the kinetic parameters and the clusters. With this process the optimal number of clusters is selected by choosing the one that maximizes the number of significantly correlated parameters with the clusters. Each one of the resulting correlated parameters has different value ranges in each one of the clusters which represents a guideline for this parameter. For example it can range around low values (with respect to the initial interval for that parameter) for some clusters and high values for other clusters. This parameters are particular guidelines for each cluster.
For the parameters that do not exhibit a significative correlation, its optimized range is also checked against the initial interval given to the optimizer. If the ranges are different this means the optimization process found an optimal range for the parameter, but general to all the clusters. This parameters are general guidelines for optimality.

It must enable design alternatives comparison (analyze different solutions).

It must enable design concepts comparison (analyze different Pareto front approximations).

Completeness: all relevant information should be contained in the visualization.

Persistence: all the relevant information should be retained in the designer’s mind.

Simplicity: the visualization should be easily understandable.
In this work we use the visualization tool Level Diagrams (LD) [57, 58], which has a freely available implementation for designers: LDTool^{2}. LDTool allows to correlate design objectives with decision variables. It classifies the calculated optimal parameters \({\theta }_{P}^{*}\) with respect to each objective J _{ q }(θ) normalized with respect to its minimum and maximum value. A graph for each objective is displayed (see Additional file 1: Figure S1), where the Yaxis is the pnorm \(\\hat {{J}}({\theta)}\_{p}\) of the objectives vector, and the Xaxis corresponds to the objective value or decision variable depending on the case. A second graph displays \(\\hat {{J}}({\theta)}\_{p}\) with respect to each decision variable. These characteristics make it helpful in order to propagate the information from clustering between design objectives space and decision variables space. Thus, a given solution will have the same value y in all graphs. As it is, LD enables the alternative and design concept comparison. In order to also incorporate the information obtained in the clustering, the yaxis of the LD plot is modified to show the membership of a solution to a cluster, therefore, improving completeness for our problem. And this is coded also in the color of the points in all the graphs, improving persistence and simplicity. This correspondence of colors helps to evaluate general tendencies along the Pareto front and compare solutions according to the clusters they belong to. Additionally, with the aim of improving simplicity and completeness, the dynamic response of species from the model is ploted using the same color code. To sumarize, this step consists in first the clustering of the solutions and then: For the guidelinesStudy correlations between the parameters and the clusters and obtain guidelines. For the guidance to help manual decision makingVisualization of the Pareto Front and Pareto Set of the clustered solutions to obtain more insight and learn about the specific problem.
All this step is performed in matlab scripts (see Additional files 1 and 2 for a description and the scripts respectively)^{3}.
Finally, it is interesting to note that the selection of the preferable solution according to designer’s criteria, or equivalently the extraction of qualitative levels for the parameters, takes place in an aposteriori multicriteria analysis of the Pareto Front approximation, and it is in general computationally cheap in comparison with the multiobjective optimization step.
Incoherent type 1 feedforward loop (I1FFL)
We model the designed genetic circuit using a deterministic approach and taking into account the key regulatory interactions between the main biochemical species present in the genetic circuit: proteins A,B, and C, and inducer I. In our gene synthetic circuit (see Fig. 3 b), the circuit comprises a gene gC under the control of the promoter P _{gC}. The concentration of protein C is considered to be the circuit output signal. Expression of C is activated by the dimer (A·I)_{2} that acts as transcription factor for the hybrid promoter P _{gC}, and it is repressed by protein B. The dimer (A·I)_{2} also acts as transcription factor activating the promoter P _{gB}. Protein A is constitutively expressed, and bounds to the inducer I. The inducer can passively diffuse across the cell membrane. Though the input signal to the circuit is the intracellular inducer concentration I, the experimental input signal is the external application of the inducer in the broth I _{ e }.
List of variables used in the reduced model
Variable  Description  Units  Symbol 

x _{1}  mRNA _{gA}  nM  mA 
x _{2}  A protein  nM  A 
x _{3}  Inducer  nM  I 
M  A ·I monomer  nM  A ·I 
x _{4}  (A ·I)_{2} dimer  nM  (A ·I)_{2} 
x _{5}  mRNA_{gB}  nM  mB 
x _{6}  B protein  nM  B 
x _{7}  mRNA_{gC}  nM  mC 
x _{8}  C protein  nM  C 
x _{9}  Extracellular inducer  nM  I_{ e } 
Parameters of the reduced model
Parameter  Description  Value  Unit 
\(C_{{g_A}}, C_{{g_B}}, C_{{g_C}}\)  gA, gB, gC copy number    adim. 
\(k_{{m_A}}, k_{{m_B}}, k_{{m_C}}\)  gA, gB, gC transcription rate    min ^{−1} 
\(d_{{m_A}}, d_{{m_B}}, d_{{m_C}}\)  m _{ A }, m _{ B }, m _{ C } degradation rate  0.3624  min ^{−1} 
\(k_{{p_A}}\)  m _{ A } translation rate  80  min ^{−1} 
\(k_{{p_B}}, k_{{p_C}}\)  m _{ B }, m _{ C } translation rate    min ^{−1} 
d _{ A }  A degradation rate  0.035  min ^{−1} 
d _{ B },d _{ C }  B, C degradation rate    min ^{−1} 
k _{ d }  inducer diffusion rate  0.06  min ^{−1} 
k _{2}, k _{3}  (AI) and (AI) _{2} association rate  0.1  min ^{−1} 
k _{−2}  (AI) dissociation rate  20  min ^{−1} 
k _{−3}  (AI) _{2} dissociation rate  1  min ^{−1} 
γ _{1}  gB promoter Hill constant    nM 
γ _{2}  gC promoter coefficients  0.2  nM 
γ _{3},γ _{4},γ _{5}  gC promoter coefficients    adim, adim, nM ^{−1} 
β _{1},β _{2}  gC promoter basal expression coefficients  0.05  adim, nM ^{−1} 
d _{ I },d _{ Ie }  inducer degradation rate  0.0164  min ^{−1} 
d _{ AI },d _{ A I2}  (AI), (AI) _{2} degradation rate  0.035  min ^{−1} 
An SBML implementation of this model was deposited in BioModels [62] and assigned the identifier MODEL1511290000. This implementation is not part of the multiobjective optimization design procedure, although it was included for completenes and is intended to be used separately. The implementation as matlab scripts is in the Additional file 2, and will be available in Matlab Central.
Parameters of the reduced model selected for optimization
Parameter  Wetlab implication 

\( k_{m_{B}}C_{g_{B}}, k_{m_{C}}C_{g_{C}}\)  Promoter strength and Plasmid origin of replication 
\(k_{p_{B}}, k_{p_{C}}\)  RBS Strength 
γ _{1},γ _{3},γ _{4},γ _{5}  Mutations in promoter sequence 
d _{ B },d _{ C }  Degradation tag sequence 
Results
Using the presented framework we considered its application for tuning the kinetic parameters of the I1FFL circuit to achieve adaptation behaviour. The idea is to apply the three steps of the MOOD considering the I1FFL model presented in the previous section. This way, the implementation of the MOOD procedure will be clarified by an example. Later we will show two scenarios related with the wetlab implementation and usability of the guidelines obtained.
I1FFL tuning using MOOD framework
Multiobjective problem (MOP) definition
The first step of the MOOD framework is to formulate the circuit specifications as design objectives to be optimized. Recall the desired inputoutput behavior for the I1FFL circuit, depicted in Fig. 2. Let θ denote the following subset of parameters selected for optimization from the reduced model (3):

Sensitivity: after input stimulation, a clear transient peak value is desired for the output. Sensitivity can be defined in relative terms as the relationship between the input and output variation during the transient. In our case, we define sensitivity as the ratio between the absolute total variation of the output signal –the C protein concentration x _{8}–, and the variation of the input signal –the external inducer x _{9}.

Precision: after the peak transient, the output must go back to its value previous to circuit stimulation. Thus, precision can be defined as the inverse of the normalized output error. The lower the steady state error, the higher the precision.
where t _{ f } is the time length of the experiment. The input stimulus is applied at t _{0}.
Sensitivity is the inverse of J _{1}(θ). Notice the total absolute variation of the C protein concentration is obtained as half the accumulated absolute value of the time derivative of x _{8}. The lower J _{1}(θ) (larger output peak w.r.t. input variation), the higher the sensitivity.
Precision is the inverse of J _{2}(θ), i.e. the inverse of the ratio between the variation of the C protein concentration between t _{0} and t _{ f }, and the variation of the external inducer concentration between t _{0} and t _{ f }. If the C protein concentration x _{8} at time t _{ f } is the same as the initial one at time t _{0}, precision is infinite.
Note that both objectives are defined as the inverses of Sensitivity and Precision in order to use them in the minimization problem as it is the standard for optimization problems [46].
To make the precision higher (that is, low output error) the easiest option is to have very high values of protein B concentration, which acts as repressor of protein C. To avoid this unrealistic solution, it is possible to make the concentration of protein B to have an upper bound. In the case of not having this restriction, the solutions may have higher precision at the cost of unrealistically high values of protein B concentration. The restriction penalizes this fact and drives the search to a different region of the parameter space (going away from this undesired region, the one corresponding to high values of protein B).
Another relevant issue is the definition of limits for J _{1}(θ) and J _{2}(θ) beyond which we consider that precision and sensitivity degrade to such an extent that we cannot talk about adaptive behavior anymore [26]. This is the socalled pertinency range of the objectives. The limits established in this work are: J _{1}(θ)∈[ 1×10^{−3}, 200], and J _{2}(θ)∈[ 1×10^{−4}, 20].
Multiobjective optimization
As a second step we carried out the dynamic optimization of (6) using the multiobjective differential evolution spMODE genetic algorithm described in Subsection Multiobjective parameters tuning. Starting from an initial random population of candidate solutions, we set 15.000 iterations as the maximum number of evaluations of the objective functions. We obtained a Pareto front containing 33 solutions that achieve adaptation, together with the Pareto set containing the kinetic model parameters corresponding to the Pareto front solutions (see Additional file 1: Table S3). These solutions show, as expected, a tradeoff. Solutions range from high sensitivity (low values of J _{1}) and low precision (high values of J _{2}) ones to low sensitivity (high values of J _{1}) and high precision (low values of J _{2}) ones. Note in all cases these solutions are the optimal ones, in the sense of Pareto.
Obtaining guidelines for the implementation
The third step is to obtain guidelines and guidance for the implementation of the circuit. To obtain the guidelines, the solutions gathered from the optimization were clustered hierarchically in an agglomerative tree (see Matlab code in Additional file 1) and the optimal number of clusters obtained with the procedure explained in the Methods section. The guidelines obtained are shown as intervals in the next Table.

d _{ B }: Degradation rate of protein B, has to be the lowest possible in all the cases.

K p _{ B }: The RBS strength of gene B has to be the lowest possible in all the cases.

γ _{1}: The promoter strength (activation strength) has to be high in general, but it does not has an apparent effect.

γ _{3}: The hybrid promoter strength (activation strength), has to be the lowest possible in all the cases.
 ■■■High Sensitivity Strategy:

K m _{ C } C g C and K p _{ C }: increasing values of the promoter strength and plasmid copy number of gene C, and the RBS Strength of gene C, lead to increasing values of sensitivity (higher peak values). These are tuning knobs for sensitivity.Table 4
Design guidelines. Each one of the optimized parameters is either a general guideline for all clusters, or is a tradeoff control tuning knob for a specific cluster
Parameter
Initial parameter range
Design guideline
General guideline
Cluster 1
Cluster 2
kmACgA ^{∗}
[1 200]
–
[1 171.91]
1
kmBCgB
[1 200]
–
1
[1 200]
kmCCgC
[1 200]
–
[1 171.91]
1
k_{pB}
[1 100]
1
–
–
k_{pC}
[1 100]
–
[1 15.68]
1
d_{B}
[0.01 0.3]
[0.01 0.0792]
–
–
d_{C}
[0.01 0.3]
–
[0.2784 0.3]
0.3
γ _{1}
[50 200]
[78.93 200]
–
–
γ _{3}
[1e4 0.5]
–
[1e4 0.013]
[1e4 0.0141]
γ _{4}
[5e4 5]
–
[5e4 1.4424]
[0.0697 5]
γ _{5}
[1 100]
–
[1 9.2546]
[12.125 100]

d _{ C }: degradation of protein C has to be slightly lower for high sensitivity.

γ _{4} and γ _{5}: Hybrid promoter strengths (repression, and activation  repression cross combined strength), should be kept low.

K m _{ B } C g B: Promoter strength and plasmid copy number of gene B, must have low values.

 ■■■High Precision Strategy:

K m _{ B } C g B: Promoter strength and plasmid copy number of gene B, is a tuning knob for Cluster 6, increasing precision proportionally to its value.

γ _{4} and γ _{5}: Increasing values of the hybrid promoter strengths lead to increasing values of precision (lower error).

K m _{ C } C g C and K p _{ C }: Promoter strength and plasmid copy number of gene C, and the RBS Strength of gene C, keep them low.

d _{ C }: degradation of protein C has to be high.

The results show that the value of d _{ C }, i.e. the degradation rate of the C protein, is a key parameter to correctly achieve adaptation. With high values of this parameter, the concentration of the C protein will to return faster to its original level.
Some parameters γ in the hybrid promoter of protein C are also forced to take certain values for the system to attain the adaptive behavior. In particular, it is interesting to notice that the repression strength, parameter γ _{4} plays an important role, which is in agreement with the analysis in [34], where a mutation was performed on the hybrid promoter so as to affect the same parameter.
In the case the designed needs more insight, we provide the tools for visualization to allow a proper decision making procedure and selection of the appropriate parameters for the design.
In the Additional file 1: Figures S3 and S4 the original Level Diagrams of the Pareto front and set are shown, in case the designed needs more information and insight for the guidance of its multicriteria decisionmaking.
Application scenario I: selecting parameters for an implementation
As a proof of concept, and also to validate the guidelines obtained for the I1FFL we proceed as we would do in the wetlab. Let us suppose we have two implementations obtained with the guidelines proposed in this work: one designed with the High Sensitivity Strategy (Case A) and another one with High Precision Strategy (Case B).
Also, starting from the high precision implementation (Case B), we show how changing one of the tuning knobs from our High Precision Strategy (K m _{ B } C g B for example) one can almost move along the Pareto front and obtain higher sensitivity solutions without losing precision, as shown by the blueish dots. In the insets of Fig. 7 is possible to see the temporal behavior of the obtained solutions.
Conversely to this, changing values of key parameters like d _{ C } completely destroy the adaptation behavior independently of the selected solution (see Figure S2 in Additional file 1).
Application scenario II: output robustness analysis
This framework is also useful to analyze the output performance of the designed functional device when connecting it to other devices.
where x _{10} represents the empty load species (e.g. an unbound promoter or protein), and x _{11} represents the complex C bound to the load species. K _{1} and K _{2} are the binding constants. For this case we used K _{1}=40 n M ^{−1} m i n ^{−1}, and K _{2}=20 m i n ^{−1}, which correspond to a mildly fast binding. We chose the initial condition x _{10}(t _{0})+x _{11}(t _{0})=800 n M. Since we did not consider degradation terms in (7), this initial condition represents the total amount of available load species.
Finally, in the inset of Fig. 9, the loaded time courses of the protein C concentration after stimulus (red line) are shown and compared with the original ones (blue line) for values of the parameters corresponding to solutions 1, 2 and 3. As we see, solution 1 is practically not affected; but solution 2 is affected considerably. Finally, solution 3 is way out from is location and actually looses adaptation behavior. Consequently, it is possible to use this framework to evaluate the output performance of our designed circuit.
Discussion
Computeraided modelbased methods and tools are being increasingly used in synthetic biology to guide the design of synthetic biochemical pathways so as to achieve userdefined functions and behaviors [9–11].
In this work, in order to obtain a set of guidelines to aid the design of synthetic genetic networks with a predefined functionality (functional modules), we developed a framework using a multiobjective optimization design (MOOD) procedure. Compared to previous studies [25], a novel feature of our framework is that the result of the optimization is already a set of parameters that optimally achieve the desired function and dynamics, as encoded in the objective indexes. Specifying the desired circuit behavior in terms of performance indexes to be optimized has many advantages. The indexes or objectives can be made valid for a whole class of input signals, they may consider other signals in the circuit apart from input and output, the robustness with respect to uncertainty in the circuit parameters can be included, etc. The proper definition of the optimization indexes representing the desired behavior is a key point. An incorrectly specified objective, not properly representing the actual desired behavior, will lead the optimization in a wrong direction, thus returning a parameters set that will give misleading design guidelines. This is a drawback, but easier to handle than setting the thresholds defining the acceptable circuit behavior after a Monte Carlo sampling, for these do not ensure that a solution will be found [25, 27].
The solutions obtained, i.e. the design objectives together with the respective parameter sets, may be clustered hierarchically, or postprocessed with any multivariate statistical analysis tool in order to get further insight into the role of the different parameters. The importance of this, is that the spMODE and LDtools already order the Pareto front solutions with respect to the objective functions. The LDtool, as a matter of fact, already provides insight into the role of the different solutions. Further statistical processing is very efficient, as only a small set of data has to be processed (the solutions at the Pareto front), and this set is already ordered. This allows us to reveal and understand associations of parameters and functionality. For example, cluster 1 (red) in the Results Section has the highest sensitivity together with the lowest precision. To implement in the wetlab a system with this functionality, the RBS in gene B has to be weak, and it should be cloned in a low copy plasmid, as reflected by the guidelines obtained for parameters k p _{ B } and K m _{ B } C g B, respectively. On the contrary, to implement a cluster 2 (blue) system, the guidelines obtained for the same parameters tell us to put gene B also with a weak RBS and but in a high copy plasmid (Fig. 6).

Km _{ X } CgX. This is a lumped plasmid copy number and promoter strength, so it can be tuned by selecting the appropriate replication origin of the plasmid and the promoter; for example from the Anderson Promoter library [53>] available at the iGEM Parts Registry.

kp _{ X } represents the Ribosome Binding Site strength, and is one of the easiest parameters to tune in the wetlab using, for instance, RBS libraries, the RBS Calculator from Sallis Lab [54], or nucleotides repetition [55].

d _{ X } is the protein degradation rate. It also can be tuned globally by changing the growth rate of the microorganism. It also can be tuned by adding a protein degradation tag to include the protein in an active degradation pathway.
As more and more parts are deposited and characterized in these libraries, frameworks providing guidelines for the design and wetlab implementation, like the ones presented here, will gain more applicability and the design of synthetic genetic circuits will become more rationalebased than intuitionbased.
The analysis performed in the Application Scenario I, shows that it is possible to use only one parameter to move from the Pareto front to a suboptimal solution. For example, starting from a solution with high precision and low sensitivity, one can move to a solution with higher sensitivity and lower precision; with almost no losing optimality. This is very useful in the wetlab, because it means that once you have the system implemented in the wetlab, it is possible to change the output of your system in a controlled way by performing the minimum amount of changes to it. The methodology easily allows to check how the initial solution will deteriorate by changing the value of only one parameter (see Fig. 7). Of course, moving along the Pareto front solutions requires modifying more parameters, i.e. changing the values of the parameters from a cluster to another one; however we showed that the obtained guidelines are really robust and that we can use a particular parameter as a tuning knob in the wetlab implementation.
In the Application Scenario II, we saw that it is straightforward to have an idea of how much the functionality of the system can be compromised by loading it, i.e. by connecting it to another module. The proposed methodology allows to design the system taking this into account. The analysis is computationally efficient, as it has to be performed only for the Pareto front solutions, and not for the whole objective space. Thus, we foresee that extending the approach to the analysis of interconnecting several devices will not be difficult. In a way, as advocated in [5], the approach is less like highly modular electrical engineering, and more like civil and mechanical engineering in its use of optimization of modeling of whole systemlevel taking into account loads and flows.
Notice that the analysis needs to be performed only along the Pareto front solutions. In this case, we are performing a robustness analysis a posteriori with the Pareto optimal solutions approximated. That is, the decision making process is carried out at the end of the MOOD process using additional information, in order to select a robust configuration. This is congruent with similar analysis of uncertainties and decision making [67].
If it is required by the decision maker to seek actively for a robust set of solutions, a different approach will be required. That is, in order to get such solutions then the robustness measure analysis should be included a priori within the optimisation process. This leads to different optimisation instances known as robust design optimization (RDO) and reliability based design optimisation (RBDO) [68]. The former seeks to minimize the sensitivity of a solution; the latter to provide a measure of risk failure. In any case, such optimization instances are out of the scope of this work and are proposed as future work.
The general applicability of the framework allows to use it with different functional modules and topologies, as soon as the ODEs can be obtained from reactions, although evidently difficulties will arise when dealing with larger networks. In that sense it is interesting to note the difference between the problem of expensive computation and the one of largescale optimization. Expensive computation arises when the complexity of the system makes the evaluation of the objective function an expensive task. On the contrary, largescale is related with the amount of decision variables and the size of the objective space. In the cases we are dealing with, this two problems will be more or less coupled. For a larger network, more kinetic parameters (decision variables) and more expensive computation of the dynamics of the system to evaluate the objectives. Nevertheless, one of the key issues will be to obtain a reasonable reduced model of the module to give to the optimization algorithm rather than the optimization itself. Genetic algorithms like spMODE have been used in the past with problems with sizes including 15 objectives and hundreds of decision variables with reasonable computational cost, and related research is a hot topic [69, 70]. Also memory handling in the mentioned algorithms is very efficient, as the only information that propagates from generation to generation is the population.
Conclusion
The proposed multiobjective optimization design framework is able to provide effective guidelines to tune biological parameters so as to achieve a desired circuit behavior. Moreover, it is easy to analyze the impact of the context on the synthetic device to be designed. That is, one can analyze how the presence of a downstream load influences the performance of the designed circuit, and take it into account. Finally, our results suggest that –although system dynamics actually put constraints on the possible values of the kinetic parameters– design guidelines can be obtained to build a biological systems with a desired functionality.
Availability of data and materials

The spMODE, a multiobjective optimization algorithm based on differential evolution implemented in MATLAB is available at MatlabCentral, code 39215. http://www.mathworks.com/matlabcentral/fileexchange/39215

The LDtool toolbox to help visualization in MATLAB is available at MatlabCentral, code 24042. http://www.mathworks.com/matlabcentral/fileexchange/24042

An SBML implementation of the I1FFL model was deposited in BioModels with identifer MODEL1511290000. https://www.ebi.ac.uk/biomodelsmain/ (This implementation is not part of the multiobjective optimization design procedure, although it was included for completeness and is intended to be used separately.)

The source code of the all the software developed for this work is available in the Additional file 2 — matlabscripts.zip and also publicly available at http://sb2cl.ai2.upv.es/content/software, and it is explained in Additional file 1, Section 2. Matlab CODE.
Endnotes
^{1} http://es.mathworks.com/matlabcentral/fileexchange/39215.
^{2} Tool available at http://www.mathworks.com/matlabcentral/fileexchange/24042.
^{3} publicly available at http://sb2cl.ai2.upv.es/content/software.
Declarations
Acknowledgements
Research in this area is partially supported by Spanish government and European Union (FEDERCICYT DPI201128112C0401, and DPI201455276C51R). Yadira Boada thanks grant FPI/20133242 of Universitat Politècnica de València; Gilberto ReynosoMeza gratefully acknowledges the partial support provided by the postdoctoral fellowship BJT304804/20142 from the National Council of Scientific and Technologic Development of Brazil (CNPq) for the development of this work.
We are grateful to Alejandra GonzalezBoscá for her collaboration on this topic while doing her Bachelor thesis, and to Dr. José Luis Pitarch from Universidad de Valladolid for his advise in algorithmic implementations and for proof reading the manuscript.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Authors’ Affiliations
References
 ERASynBio. Next steps for european synthetic biology: a strategic vision from erasynbio. Report, ERASynBio. 2014. https://www.erasynbio.eu/lw_resource/datapool/_items/item_58/erasynbiostrategicvision.pdf.
 Way J, Collins J, Keasling J, Silver P. Integrating biological redesign: Where synthetic biology came from and where it needs to go. Cell. 2014; 157(1):151–61.View ArticlePubMedGoogle Scholar
 Canton B, Labno A, Endy D. Refinement and standardization of synthetic biological parts and devices. Nat Biotechnol. 2008; 26(7):787–93.View ArticlePubMedGoogle Scholar
 De Lorenzo V, Danchin A. Synthetic biology: discovering new worlds and new words. EMBO Rep. 2008; 9(9):822–7.View ArticlePubMedPubMed CentralGoogle Scholar
 Church GM, Elowitz MB, Smolke CD, Voigt CA, Weiss R. Realizing the potential of synthetic biology. Nat Rev Mol Cell Biol. 2014; 15(4):289–94.View ArticlePubMedGoogle Scholar
 Takahashi CN, Miller AW, Ekness F, Dunham MJ, Klavins E. A low cost, customizable turbidostat for use in synthetic circuit characterization. ACS Synth Biol. 2015; 4(1):32–8. [doi:10.1021/sb500165g].View ArticlePubMedPubMed CentralGoogle Scholar
 Cooling MT, Rouilly V, Misirli G, Lawson J, Yu T, Hallinan J, Wipat A. Standard virtual biological parts: a repository of modular modeling components for synthetic biology. Bioinformatics. 2010; 26(7):925–31.View ArticlePubMedGoogle Scholar
 Medema MH, van Raaphorst R, Takano E, Breitling R. Computational tools for the synthetic design of biochemical pathways. Nat Rev Microbiol. 2012; 10(3):191–202.View ArticlePubMedGoogle Scholar
 Marchisio MA, Stelling J. Automatic design of digital synthetic gene circuits. PLoS Comput Biol. 2011; 7(2):e1001083. [doi:10.1371/journal.pcbi.1001083].View ArticlePubMedPubMed CentralGoogle Scholar
 Rodrigo G, Carrera J, Landrain TE, Jaramillo A. Perspectives on the automatic design of regulatory systems for synthetic biology. FEBS Lett. 2012; 586(15):2037–42.View ArticlePubMedGoogle Scholar
 Crook N, Alper HS. Modelbased design of synthetic, biological systems. Chem Eng Sci. 2013; 103:2–11.View ArticleGoogle Scholar
 Jayanthi S, Nilgiriwala K, Del Vecchio D. Retroactivity controls the temporal dynamics of gene transcription. ACS Synth Biol. 2013; 2(8):431–41.View ArticlePubMedGoogle Scholar
 Mélykúti B, Hespanha JP, Khammash M. Equilibrium distributions of simple biochemical reaction systems for timescale separation in stochastic reaction networks. J R Soc Interface. 2014; 11(97):20140054.View ArticlePubMedPubMed CentralGoogle Scholar
 Oyarzún DA, Lugagne JB, Stan GB. Noise propagation in synthetic gene circuits for metabolic control. ACS Synth Biol. 2015; 4(2):116–25. [doi:10.1021/sb400126a].View ArticlePubMedGoogle Scholar
 Picó J, Vignoni A, PicóMarco E, Boada Y. Modelado de sistemas bioquímicos: De la ley de acción de masas a la aproximación lineal del ruido. Revista Iberoamericana de Automática e Informática Industrial RIAI. 2015; 12(3):241–52.View ArticleGoogle Scholar
 Feng XjJ, Hooshangi S, Chen D, Li G, Weiss R, Rabitz H. Optimizing genetic circuits by global sensitivity analysis. Biophys J. 2004; 87(4):2195–202.View ArticlePubMedPubMed CentralGoogle Scholar
 Dasika MS, Maranas CD. Optcircuit: An optimization based method for computational design of genetic circuits. BMC Syst Biol. 2008; 2:24.View ArticlePubMedPubMed CentralGoogle Scholar
 Rodrigo G, Carrera J, Jaramillo A. Genetdes. Bioinformatics. 2007; 23(14):1857–8.View ArticlePubMedGoogle Scholar
 OteroMuras I, Banga JR. Multicriteria global optimization for biocircuit design. 2014. arXiv preprint arXiv:1402.7323.Google Scholar
 Banga JR. Optimization in computational systems biology. BMC Syst Biol. 2008; 2:47.View ArticlePubMedPubMed CentralGoogle Scholar
 Sendin J, Exler O, Banga JR. Multiobjective mixed integer strategy for the optimisation of biological networks. IET Syst Biol. 2010; 4(3):236–48.View ArticlePubMedGoogle Scholar
 Miller M, Hafner M, Sontag E, Davidsohn N, Subramanian S, Purnick PE, Lauffenburger D, Weiss R. Modular design of artificial tissue homeostasis: robust control through synthetic cellular heterogeneity. PLoS Comput Biol. 2012; 8(7):1002579.View ArticleGoogle Scholar
 Ellis T, Wang X, Collins JJ. Diversitybased, modelguided construction of synthetic gene networks with predicted functions. Nat Biotechnol. 2009; 27(5):465–71.View ArticlePubMedPubMed CentralGoogle Scholar
 Koeppl H, Hafner M, Lu J. Mapping behavioral specifications to model parameters in synthetic biology. BMC Bioinforma. 2013; 14(Suppl 10):9.Google Scholar
 Chiang AWT, Hwang MJJ. A computational pipeline for identifying kinetic motifs to aid in the design and improvement of synthetic gene circuits. BMC Bioinforma. 2013; 14 Suppl 16:5.View ArticleGoogle Scholar
 Ma W, Trusina A, ElSamad H, Lim WA, Tang C. Defining network topologies that can achieve biochemical adaptation. Cell. 2009; 138(4):760–73.View ArticlePubMedPubMed CentralGoogle Scholar
 Chiang AWT, Liu WCC, Charusanti P, Hwang MJJ. Understanding system dynamics of an adaptive enzyme network from globally profiled kinetic parameters. BMC Syst Biol. 2014; 8:4.View ArticlePubMedPubMed CentralGoogle Scholar
 ReynosoMeza G, Blasco X, Sanchis J, Martínez M. Controller tuning using evolutionary multiobjective optimisation: current trends and applications. Control Eng Pract. 2014; 28:58–73.View ArticleGoogle Scholar
 Alon U. An Introduction To Systems Biology. Design Principles of Biological Circuits. London: Chapman & Hall/ CRC Mathematical and computational Biology Series; 2006.Google Scholar
 Elowitz MB, Leibler S. A synthetic oscillatory network of transcriptional regulators. Nature. 2000; 403(6767):335–8.View ArticlePubMedGoogle Scholar
 Hsiao V, de los Santos ELC, Whitaker WR, Dueber JE, Murray RM. Design and implementation of a biomolecular concentration tracker. ACS Synth Biol. 2015; 4(2):150–61. [doi:10.1021/sb500024b].View ArticlePubMedPubMed CentralGoogle Scholar
 Franco E, Giordano G, Forsberg PO, Murray RM. Negative autoregulation matches production and demand in synthetic transcriptional networks. ACS Synth Biol. 2014; 3(8):589–99. [doi:10.1021/sb400157z].View ArticlePubMedGoogle Scholar
 Strelkowa N, Barahona M. Switchable genetic oscillator operating in quasistable mode. J R Soc Interface. 2010; 7(48):1071–82.View ArticlePubMedPubMed CentralGoogle Scholar
 Basu S, Mehreja R, Thiberge S, Chen MT, Weiss R. Spatiotemporal control of gene expression with pulsegenerating networks. Proc Natl Acad Sci U S A. 2004; 101(17):6355–60.View ArticlePubMedPubMed CentralGoogle Scholar
 Bleris L, Xie Z, Glass D, Adadey A, Sontag E, Benenson Y. Synthetic incoherent feedforward circuits show adaptation to the amount of their genetic template. Mol Syst Biol. 2011; 7(519):1–12. [doi:10.1038/msb.2011.49].Google Scholar
 Hart Y, Antebi YE, Mayo AE, Friedman N, Alon U. Design principles of cell circuits with paradoxical components. Proc Natl Acad Sci. 2012; 109(21):8346–51.View ArticlePubMedPubMed CentralGoogle Scholar
 Zhang Q, Bhattacharya S, Andersen ME. Ultrasensitive response motifs: basic amplifiers in molecular signalling networks. Open Biol. 2013; 3(4):130031.View ArticlePubMedPubMed CentralGoogle Scholar
 Weber M, Buceta J, Others. Dynamics of the quorum sensing switch: stochastic and nonstationary effects. BMC Syst Biol. 2013; 7(1):6.View ArticlePubMedPubMed CentralGoogle Scholar
 Womelsdorf T, Valiante TA, Sahin NT, Miller KJ, Tiesinga P. Dynamic circuit motifs underlying rhythmic gain control, gating and integration. Nat Neurosci. 2014; 17(8):1031–9.View ArticlePubMedGoogle Scholar
 Arpino JAJ, Hancock EJ, Anderson J, Barahona M, Stan GBVB, Papachristodoulou A, Polizzi K. Tuning the dials of synthetic biology. Microbiology. 2013; 159(Pt 7):1236–53.View ArticlePubMedPubMed CentralGoogle Scholar
 Zagaris A, Kaper HGG, Kaper TJJ. Analysis of the computational singular perturbation reduction method for chemical kinetics. J Nonlinear Sci. 2004; 14(1):59–91.View ArticleGoogle Scholar
 Anderson J, Chang YCC, Papachristodoulou A. Model decomposition and reduction tools for largescale networks in systems biology. Automatica. 2011; 47(6):1165–74.View ArticleGoogle Scholar
 Prescott TP, Papachristodoulou A. Layered decomposition for the model order reduction of timescale separated biochemical reaction networks. J Theor Biol. 2014; 356:113–22.View ArticlePubMedGoogle Scholar
 Hancock EJ, Stan GB, Arpino JAJ, Papachristodoulou A. Simplified mechanistic models of gene regulation for analysis and design. J R Soc Interface. 2015; 12(108).Google Scholar
 Miettinen K, Vol. 12. Nonlinear Multiobjective Optimization. Boston: Kluwer Academic Publishers; 1999.Google Scholar
 Miettinen K, Ruiz F, Wierzbicki AP. Introduction to multiobjective optimization: interactive approaches. In: Multiobjective Optimization. Berlin: Springer: 2008. p. 27–57.Google Scholar
 Deb K, Bandaru S, Greiner D, GasparCunha A, Tutum CC. An integrated approach to automated innovization for discovering useful design principles: Case studies from engineering. Appl Soft Comput. 2014; 15(0):42–56.View ArticleGoogle Scholar
 Ang J, Ingalls B, McMillen D. Probing the inputoutput behavior of biochemical and genetic systems: System identification methods from control theory In: Johnson ML, Brand L, editors. Methods in Enzymology. Academic Press: 2011. p. 279–317, doi:10.1016/B9780123812704.00010X.
 Mattson CA, Messac A. Pareto frontier based concept selection under uncertainty, with visualization. Optim Eng. 2005; 6(1):85–115.View ArticleGoogle Scholar
 ReynosoMeza G, Sanchis J, Blasco X, Martínez M. Design of continuous controllers using a multiobjective differential evolution algorithm with spherical pruning. Appl Evol Comput. 2010;532–541.Google Scholar
 ReynosoMeza G, GarcíaNieto S, Sanchis J, Blasco X. Controller tuning using multiobjective optimization algorithms: a global tuning framework. IEEE Trans Control Syst Technol. 2013; 21(2):445–58.View ArticleGoogle Scholar
 ReynosoMeza G, Sanchis J, Blasco X, Herrero JM. Multiobjective evolutionary algortihms for multivariable PI controller tuning. Expert Syst Appl. 2012; 39:7895–907.View ArticleGoogle Scholar
 Anderson C. Anderson promoter collection [online]. 2006. http://parts.igem.org/Promoters/Catalog/Anderson. Accesed 20 Feb 2015.
 Salis HM, Mirsky EA, Voigt CA. Automated design of synthetic ribosome binding sites to control protein expression. Nat Biotechnol. 2009; 27(10):946–50.View ArticlePubMedPubMed CentralGoogle Scholar
 Egbert RG, Klavins E. Finetuning gene networks using simple sequence repeats. PNAS. 2012; 109(42):16817–22. [doi:10.1073/pnas.1205693109].View ArticlePubMedPubMed CentralGoogle Scholar
 Hair JF, Suárez MG. Análisis Multivariante vol. 491. Madrid: Prentice Hall; 1999.Google Scholar
 Blasco X, Herrero JM, Sanchis J, Martínez M. A new graphical visualization of ndimensional pareto front for decisionmaking in multiobjective optimization. Inf Sci. 2008; 178(20):3908–24. [doi:10.1016/j.ins.2008.06.010].View ArticleGoogle Scholar
 ReynosoMeza G, Blasco X, Sanchis J, Herrero JM. Comparison of design concepts in multicriteria decisionmaking using level diagrams. Inform Sci. 2013; 221:124–41.View ArticleGoogle Scholar
 Goentoro L, Shoval O, Kirschner MW, Alon U. The incoherent feedforward loop can provide foldchange detection in gene regulation. Mol Cell. 2009; 36(5):894–9.View ArticlePubMedPubMed CentralGoogle Scholar
 Rodrigo G, Elena SF. Structural discrimination of robustness in transcriptional feedforward loops for pattern formation. PloS ONE. 2011; 6(2):16904.View ArticleGoogle Scholar
 Kim J, Khetarpal I, Sen S, Murray RM. Synthetic circuit for exact adaptation and foldchange detection. Nucleic Acids Res. 2014; 42(2):6078–89. [doi:10.1093/nar/gku233].View ArticlePubMedPubMed CentralGoogle Scholar
 Chelliah V, Juty N, Ajmera I, Ali R, Dumousseau M, Glont M, Hucka M, Jalowicki G, Keating S, KnightSchrijver V, et al. Biomodels: tenyear anniversary. Nucleic Acids Res. 2015; 43(D1):542–8.View ArticleGoogle Scholar
 Ang J, Bagh S, Ingalls BP, McMillen DR. Considerations for using integral feedback control to construct a perfectly adapting synthetic gene network. J Theor Biol. 2010; 266(4):723–38.View ArticlePubMedGoogle Scholar
 Biobrick Foundation. 2006. Part Registry [online]. http://partsregistry.org/. Accessed 20 Feb 2015.
 BIOSS. 2006. BIOSS Toolbox [online]. http://www.bioss.unifreiburg.de/cms/toolboxhome.html. Accessed 20 Feb 2015.
 BioFab. 2006. International Open Facility Advancing Biotechnology [online]. http://www.biofab.org/. Accessed 20 Feb 2015.
 Vallerio M, Hufkens J, Van Impe J, Logist F. An interactive decisionsupport system for multiobjective optimization of nonlinear dynamic processes with uncertainty. Expert Syst Appl. 2015; 42(21):7710–31.View ArticleGoogle Scholar
 Frangopol DM, Maute K. Lifecycle reliabilitybased optimization of civil and aerospace structures. Comput Struct. 2003; 81(7):397–410.View ArticleGoogle Scholar
 Lozano M, Molina D, Herrera F. Editorial scalability of evolutionary algorithms and other metaheuristics for largescale continuous optimization problems. Soft Comput. 2011; 15(11):2085–7.View ArticleGoogle Scholar
 SantanaQuintero LV, Montano AA, Coello CAC. A review of techniques for handling expensive functions in evolutionary multiobjective optimization. In: Computational Intelligence in Expensive Optimization Problems. Berlin: Springer: 2010. p. 29–59.Google Scholar