Tav4SB: integrating tools for analysis of kinetic models of biological systems
© Rybiński et al; licensee BioMed Central Ltd. 2012
Received: 15 September 2011
Accepted: 5 April 2012
Published: 5 April 2012
Progress in the modeling of biological systems strongly relies on the availability of specialized computer-aided tools. To that end, the Taverna Workbench eases integration of software tools for life science research and provides a common workflow-based framework for computational experiments in Biology.
The Taverna services for Systems Biology (Tav4SB) project provides a set of new Web service operations, which extend the functionality of the Taverna Workbench in a domain of systems biology. Tav4SB operations allow you to perform numerical simulations or model checking of, respectively, deterministic or stochastic semantics of biological models. On top of this functionality, Tav4SB enables the construction of high-level experiments. As an illustration of possibilities offered by our project we apply the multi-parameter sensitivity analysis. To visualize the results of model analysis a flexible plotting operation is provided as well. Tav4SB operations are executed in a simple grid environment, integrating heterogeneous software such as Mathematica, PRISM and SBML ODE Solver. The user guide, contact information, full documentation of available Web service operations, workflows and other additional resources can be found at the Tav4SB project’s Web page: http://bioputer.mimuw.edu.pl/tav4sb/.
The Tav4SB Web service provides a set of integrated tools in the domain for which Web-based applications are still not as widely available as for other areas of computational biology. Moreover, we extend the dedicated hardware base for computationally expensive task of simulating cellular models. Finally, we promote the standardization of models and experiments as well as accessibility and usability of remote services.
The Taverna Workbench  is a tool which facilitates the design and execution of in silico experiments. The experiments are constructed as workflows which can be stored and executed when needed. The building blocks of a workflow are services, also known as processors. Technically, workflow is a set of processors, together with connections between their inputs and outputs. The remote processors are implemented as Web service (WS)  operations. Scattered physically throughout computational resources of numerous scientific facilities and combined together, the WSs operations enable a highly complex analysis, surpassing limits of a common workstation.
Taverna services come from a diverse set of life science domains. In the field of computational biology, the Taverna Workbench provides an access to services which are mainly related to the sequence annotation and analysis. Here, we present remote processors that extend Taverna’s functionality in the domain of systems biology, specifically, in the analysis of kinetic models of biological systems. Our hardware base offers computational resources sufficient for computationally demanding experiments, such as multiple invocations of the model-checking procedure. Essentially, the Taverna Workbench provides a convenient user interface for our WS operations. Without programming their own WS client, users can analyze the behavior of cellular systems under various conditions.
For a given biochemical network model, the underlying mathematical model is determined by the chosen semantics. The most common representations are ordinary differential equations (ODEs) for the deterministic framework and continuous-time Markov chain (CTMC) for the framework [3, 4]. The latter representation may be equivalently expressed as a set of differential equations, know also as the chemical master equation. Unlike the Tav4SB project, almost all of the Web-based applications reviewed in  allow for the analysis of only deterministic representations of biological systems.
numerical simulations for the deterministic formulation of a biochemical network model, using the SBML ODE Solver library (SOSlib) ,
visualization of data series, such as ODEs trajectories or values of parametrized CSL properties, and probabilistic distribution sampling, using Mathematica , and
high-level analysis, such as multi-parameter sensitivity analysis (MPSA)  of biological models, with error calculation via either numerical simulations or the probabilistic model checking technique.
The SBML ODE Solver library enables numerical analysis of models encoded directly in Systems Biology Markup Language (SBML) . The library employs libSBML  to automatically derive ODEs, plus their Jacobian and higher derivatives, as well as the CVODES package — the state of the art numerical integration library from SUNDIALS .
PRISM is one of the leading tools implementing probabilistic model checking, a technique of formal verification of systems that exhibit a stochastic behavior. A system to be analyzed is modeled as a Markov chain, and an examined property is expressed in a suitable probabilistic temporal logic. Some recent works, see e.g. [14, 15], demonstrate applicability of PRISM to analysis of models of biological systems. Case studies include models of cell cycle control, fibroblast growth factor signaling, and MAPK cascade . For biological applications a CTMC is typically chosen as an underlying mathematical model and its properties are specified in a continuous time logic, for instance in CSL. This approach seems promising and, compared with numerical simulations, it can often yield a better understanding of the dynamics of analyzed systems.
PRISM handles models defined in the PRISM input language. Currently, a prototype translator from SBML is not integrated into the application itself. Therefore, we also provided a separate operation to automatically translate from SBML to the PRISM language, using the prototype translator.
Finally, Wolfram’s Mathematica is a tool with one of the most advanced graphics engines among plotting software. Tav4SB provides Mathematica’s two- and three-dimensional list plots together with a versatile set of options for customizing their display. Additionally, Tav4SB allows to sample from the extensive collection of parametric probability distributions available in Mathematica.
The aim of the Tav4SB project is to support the orchestration of physically scattered tools for execution of repeatable scientific experiments To understand a place of Tav4SB in a plethora of similar software, consider the following, mundane technical problem. You have a set of scripts, command line tools or any other form of legacy code, installed on one or more computational servers, not necessarily in the same local area network. For instance, you might have a Mathematica script which can be only executed on a server which has Mathematica installed on it; and simultaneously you might need to use PRISM, installed on a remote server with a large amount of required memory. You want to connect these tools in an in silico experiment, say described by a workflow. Moreover, in case the experiment doesn’t go as planned, you want to be able to easily modify and re-run your workflow.
Tav4SB project is a realization of a minimalist approach to a platform-independent solution, based on the workflow management system and a service-oriented architecture built around the Web service standard and a straightforward queue of computational tasks.
Tav4SB project consists of two parts. The client part of the project (Tav4SB client) is a library of sample workflows and helper scripts for analysis of kinetic models of biological systems, using earlier described features. The server part of the project (Tav4SB server) is a simple grid environment which wraps aforementioned computational tools. Those tools are intended to be run in a multi-threaded manner, on one or more, possibly remote, computational servers.
As an utility for wrapping scientific software in Web services, the Tav4SB project enters premises of projects such as Soaplab2  and Opal2 [18, 19]. The main difference is that the support for the physical scattering of computational tools is an integral part of the Tav4SB server. Moreover, Tav4SB server easily allows for a direct connection with legacy code. If necessary, the Java Native Interface (JNI)  can be used to connect with the platform-specific libraries written, for instance in C, C++, or Fortran. However, in the current state of the project, all that comes at a cost of moderate programming skills required from a user of the Tav4SB server, when compared to Soaplab2 and Opal2 strategy with the custom configuration file languages. Please note however that these languages need to be learned and they pose an easier approach for the user only to a limited extend. Also note that, as a minimalist solution with the stateless Web service interface, the Tav4SB server doesn’t comply with the standards of an open, stateful grid services architecture (cf. Web Services Resource Framework ), which the most prominent representative is Globus Toolkit , a full-fledged grid environment.
We have chosen the popular Systems Biology Markup Language (SBML) , an XML-based data format, to represent kinetic models of biological systems. Due to the wide range of dedicated software and due to the support by models repositories like BioModels , SBML can be used without a detailed knowledge of the language specification.
Client communicates with the server side via WS operations, using Simple Object Access Protocol (SOAP) . These operations represent the workflow’s remote processors. Their signatures are defined in a Web Service Definition Language (WSDL)  file. We employed a “WSDL first” approach: the WSDL file was manually written (in a document/literal style).
Java Web service classes were automatically generated from the WSDL file.
The WSDL file is hosted by the Apache Tomcat servlet container. It acts as a proxy between the client and the computational part of the server. A Web service operation call is translated into a Java Message Service (JMS)  messages. JMS Application Programming Interface (API) allows Java applications to create, send, receive, and read messages. It is a part of the Java Platform, Enterprise Edition (JEE) standards. In our system, JMS messages represent computational tasks, and their results. One operation call can be translated into multiple tasks, enabling seamless, tool-specific parallelization of a submitted job.
Computational cluster management modules are written in Java using the Apache ActiveMQ implementation of the JMS standard. These modules are deployed as the Java Archive (JAR) files. The JMS messages are sent over TCP/IP, which basically makes modules independent of their physical location.
New tasks, created by the Web server module, are added to the tasks queue. At this point tasks are assigned to any available worker of a compatible type. Results are collected in a temporary queue, exclusive for a single WS operation call. Long-running tasks use an asynchronous call registry. In such case, direct (synchronous) response to the WS operation call is merely a message reporting the start of computations. The computed results are collected in a dedicated queue and, when completed, sent to a caller by email (using the JavaMail package).
Worker translates both a JMS task message into running computational processes and results of these processes back into a JMS result message. Each worker supports a specific type of computation and can communicate with an actual computational tool differently. Currently we implemented three types of workers: Mathematica worker which communicates with Mathematica via J/Link library, PRISM and odeSolver workers which communicate with, respectively, PRISM and SOSlib via a command-line interpreter (shell).
Results and Discussion
We constructed a set of exemplary workflows. Their main purpose is to demonstrate how Tav4SB WS operations can be used by the Taverna Workbench client. There are two kinds of workflows: Tav4SB WS operation wrappers and in silico experiments.
Wrapper workflows illustrate a direct usage of Tav4SB operations in Taverna. Their purpose is to be re-used as nested workflows — building blocks of experiments described below. Additionally, we built a number of helper Taverna processors, used for interacting with XML-formatted inputs and outputs of WS operations.
Numerical ODEs simulations
The first workflow numerically simulates the ODEs of the model and plots resulting trajectories. ODEs are derived automatically from a SBML model file, based on rate laws of reactions. In the deterministic model of the enzymatic reaction, rates are described by the law of mass-action. As a result of running this simple experiment one gets time evolution of species concentrations in the form of both data points series and a plot.
Probabilistic model checking
Multi-parameter sensitivity analysis
Sensitivity analysis investigates a relation between uncertain input or parameters of a model, and a property of an observable output [10, 29]. Sensitivity analysis has been used for various parametrization tasks of models of biological systems, including finding essential parameters for research prioritization , identifying insignificant parameters for the model reduction  or parameters clustering for the discovery of common functions .
Select parameters to assess.
Set parameters range.
Generate independent samples.
For each sample calculate the error (based on the output).
Classify samples as acceptable or unacceptable.
For each of the selected parameters compare the classified samples sets.
Calculating the error for each sample (Step 4) involves a separate analysis of the model. This is a factor that determines the running time of the MPSA procedure. We ran two variants of MPSA, differing in the way in which the error is calculated. In one variant we used ODEs simulations and in the other one we exploited the probabilistic model checking technique. We focused on kinetic parameters of two forward reactions of enzymatic reaction models (Equation (1)), i.e. k1 and k3. As an error function we took, respectively, the mean squared error of an ODE trajectory of the product P and the absolute difference of the value of the formula (3), in both cases between results for a parameters sample and for the reference values of parameters (Equation (2)). In turn, we obtained empirical cumulative distribution functions (ECDF) of acceptable and unacceptable samples, for each of the selected parameters. ECDFs were compared using the Kolmogorov-Smirnov test (KS-test) and one minus the Pearson product–moment correlation coefficient (PMCC). As a final output of the MPSA method, we got two rankings for each of the sensitivity indices: KS-test and PMCC.
Interestingly, the results of the other variant of the MPSA procedure are significantly different; one observes that now k1 dominates k3. This may be ascribed to the particular choice of the formula (3) which calculates the average number of occurrences of the first reaction r1. Furthermore, an inspection of values of sensitivity indices given in Figure 5 brings to light that the domination is not as definite as in the first variant of MPSA. Results demonstrate that an application of the probabilistic model checking technique may allow for revealing more subtle dependencies in the model, depending on the properties of interest.
MPSA combined with PMC may be applied as a pre-processing step which finds parameters that are insignificant for an analysis oriented on a very specific property of a model. This would provide a novel notion of a probabilistic abstraction , i.e. property-specific reduction of the probabilistic model. However, for a successful application, the pre-processing should have low running time, compared to an analysis that follows. In our experiment this is not the case, as we run the exact PMC procedure, which is essentially the same one that would be ran during the further analysis. However, we conjecture that for the MPSA procedure the level of accuracy offered by PRISM is much too high. We suppose that satisfactory results may be obtained using an approximate approach, such as Monte Carlo model-checking . We plan to pursue this idea as a continuation of the work presented here.
To measure the network load and the overhead of the task management in Tav4SB server we ran a performance test. The test was set up with the MAPK cascade case study from the PRISM Web page  and with the asynchronous version of the PRISM WS operation. This version of the PRISM operation sends computation time statistics, together with results (by email). To run the performance test, we deployed the Tav4SB server on the conventional, computational cluster maintained by the Center of Excellence BioExploratorium at the University of Warsaw. The cluster contains 16 machines with 2 dual-core CPUs each, giving 64 cores in total. We used 14 machines to deploy workers and 1 machine for the management queue. The Web server was deployed on a separate gate server.
Results of the performance test of Tav4SB server
# of threads/machines
Web-based applications are still not as widely available for the systems biology domain as for other research areas . One reason for this state of affairs is the fact that simulating cellular models is computationally expensive, when compared to the data processing tasks. In turn, there is a constant demand for a hardware dedicated to the analysis of kinetic models of biological systems .
Our services extend the functionality of the Taverna Workbench in the field of systems biology. Together with the services we provide a hardware base for our minimalist grid environment. The grid itself can, and will be, easily extended, independently of a physical location of peripherals and independently of an operating system they are running. Moreover, our grid facilitates integration of heterogeneous tools, such as Mathematica, PRISM or SOSlib. The end-user goal of the Tav4SB project is to abstract details of the technological infrastructure. Finally, via SBML and the Taverna Workbench, we would like to promote standardization of models and experiments as well as accessibility of services and their usability for non-programmers. In order to further enhance the usability, we released the source code of the project so that users can extended the Tav4SB functionality with their own workers modules. Users with programming skills can contribute to the development of the technical aspects of the server part of the project. These aspects cover the plug-in architecture of workers, the library of legacy code connectors (e.g., currently used, command-line interface or Java library), descriptors for the automatic generation of the workers code for common types of wrapped applications (cf. ACD metadata files in the Soaplab2 project ), and, last but not least, the support for Semantic Web services and ontologies [39–41].
From the point of view of in silico experiments, we propose a novel technique: application of the probabilistic model checking to the calculation of error in the multi-parameter sensitivity analysis procedure. It seem that this approach is particularly well suited for revealing intricate and subtle dependencies, that may not be discovered using, for instance, ODE-based numerical simulations of a model. We suppose that this technique may have interesting applications, e.g. for probabilistic abstraction .
Availability and requirements
Project name: Tav4SB
Project home page: http://bioputer.mimuw.edu.pl/tav4sb/
Operating system(s): Platform independent (both client and server parts)
Programming language: Optionally, SCUFL/t2flow, BeanShell, XSLT (client) and Java, Mathematica, Bash (server)
Other requirements: the Taverna Workbench client 2.3 or higher, JSBML 0.8-b2, plus, optionally, any files hosting Web server (client) and Apache Tomcat 6.0 series, Apache Maven 2 or higher, plus, optionally, Mathematica 7.0 or higher, PRISM 4.0 series and SBML ODE Solver 1.6 (server)
License: GNU AGPL
Any restrictions to use by non-academics: None
Please note that, technically, SCUFL and t2flow are workflow description languages, but together with the graphical notation provided by the Taverna Workbench they can be seen as visual programming languages. These and other client dependencies on a programming language are optional because one can write their own WS client in virtually any language. Also, be advised that the Apache Maven tool (in other requirements) automatically resolves all dependencies on Java libraries, such as JavaMail or Apache ActiveMQ (cf. Figure 1).
The definition of operations provided by Tav4SB WS plus workflows files, together with installation and execution instructions are available from the project’s home page. Documentation of the Tav4SB WS can be found in BioCatalogue , a curated catalogue of life sciences Web services. Wrappers and experiments workflows are also available from the myExperiment repository , together with the workflow figures.
Client workflows were tested on Ubuntu Linux (10.10), Mac OS X (10.6.8) and Windows Vista (Business) operating systems. The production server is currently deployed on computational servers at the Faculty of Mathematics, Informatics and Mechanics of the University of Warsaw (running Ubuntu Linux Server, Gentoo Linux and PLD Linux). The performance test server was deployed on a cluster of Ubuntu Linux machines (workers and queue) and Solaris gateway (WS). A local developer’s environment, with both client and server, was deployed and tested on Ubuntu Linux (10.10) and Mac OS X (10.6.8).
This work was partially supported by the Polish government grant N N206 356036, and by the Biocentrum Ochota project (POIG.02.03.00-00-003/09). The first author is a scholar within the Human Capital Operational Programme financed by the European Social Fund and state budget. This paper was written for the benefit of University of Zielona Góra.
EU logotypes We would like to thank to Janusz Dutkowski (Departments of Medicine and Bioengineering, University of California San Diego) for helpful comments on the manuscript.
- Hull D, Wolstencroft K, Stevens R, Goble C, Pocock MR, Li P, Oinn T: Taverna: a tool for building and running workflows of services. Nucleic Acids Research 2006, 34: 729-732. 10.1093/nar/gkl320View Article
- The World Wide Web Consortium: Web Services Activity (Last accessed: 11 January 2012). [http://www.w3.org/2002/ws/] (Last accessed: 11 January 2012).
- Aldridge BB, Burke JM, Lauffenburger DA, Sorger PK: Physicochemical modelling of cell signalling pathways. Nature Cell Biology 2006,8(11):1195-1203. 10.1038/ncb1497View Article
- Wolkenhauer O, Ullah M, Kolch W, Cho K: Modeling and simulation of intracellular dynamics: choosing an appropriate framework. IEEE Transactions on Nanobioscience 2004,3(3):200-207. 10.1109/TNB.2004.833694View Article
- Lee D, Saha R, Yusufi FNK, Park W, Karimi IA: Web-based applications for building, managing and analysing kinetic models of biological systems. Briefings in Bioinformatics 2009, 10: 65-74.View Article
- Machné R, Finney A, Müller S, Lu J, Widder S, Flamm C: The SBML ODE Solver Library: a native API. for symbolic and fast numerical analysis of reaction networks. Bioinformatics 2006, 22: 1406-1407. 10.1093/bioinformatics/btl086View Article
- Aziz A, Sanwal K, Singhal V, Brayton R: Verifying continuous time Markov chains. Springer: In Proc. 8th International Conference on Computer Aided Verification (CAV’96), Volume 1102 of Lecture Notes in Computer Science; 1996:269-276.
- Hinton A, Kwiatkowska M, Norman G, Parker D: PRISM: A Tool for Automatic Verification of Probabilistic Systems. Springer: In Proc. 12th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’06), Volume 3920 of Lecture Notes in Computer Science; 2006:441-444.
- Wolfram Research, Inc: Mathematica Edition. Champaign, Illinois: Version 7.0; 2008.
- Saltelli A, Ratto M, Andres T, Campolongo F, Cariboni J, Gatelli D, Saisana M, Tarantola S: Global Sensitivity Analysis. Wiley-Interscience: The Primer; 2008.
- Hucka M, Finney A, Sauro HM, Bolouri H, Doyle JC, Kitano H, Arkin AP, Bornstein BJ, Bray D, Cornish-Bowden A, Cuellar AA, Dronov S, Gilles ED, Ginkel M, Gor V, Goryanin II, Hedley WJ, Hodgman TC, Hofmeyr JH, Hunter PJ, Juty NS, Kasberger JL, Kremling A, Kummer U, Le Novère N, Loew LM, Lucio D, Mendes P, Minch E, Mjolsness ED, Nakayama Y, Nelson MR, Nielsen PF, Sakurada T, Schaff JC, Shapiro BE, Shimizu TS, Spence HD, Stelling J, Takahashi K, Tomita M, Wagner J, Wang J: The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models. Bioinformatics 2003, 19: 524-531. 10.1093/bioinformatics/btg015View Article
- Bornstein BJ, Keating SM, Jouraku A, Hucka M: LibSBML: an API library for SBML. Bioinformatics 2008,24(6):880-1. 10.1093/bioinformatics/btn051View Article
- Hindmarsh AC, Brown PN, Grant KE, Lee SL, Serban R, Shumaker DE, Woodward CS: SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers. ACM Transactions on Mathematical Software 2005,31(3):363-396. 10.1145/1089014.1089020View Article
- Heath J, Kwiatkowska M, Norman G, Parker D, Tymchyshyn O: Probabilistic model checking of complex biological pathways. Theoretical Computer Science 2008,391(3):239-257. 10.1016/j.tcs.2007.11.013View Article
- Kwiatkowska M, Norman G, Parker D: Using probabilistic model checking in systems biology. ACM SIGMETRICS Performance Evaluation Review 2008,35(4):14-21. 10.1145/1364644.1364651View Article
- PRISM Web page 2012.http://www.prismmodelchecker.org/ (Last accessed: 11 January 2012).
- Senger M, Rice P, Bleasby A, Oinn T, Uludag M: Soaplab2: more reliable Sesame door to bioinformatics programs. Toronto, Canada: In The 9th Annual Bioinformatics Open Source Conference; 2008.
- Krishnan S, Clementi L, Ren J, Papadopoulos P, Li W: Design and Evaluation of Opal2: A Toolkit for Scientific Software as a Service. In Proceedings of the: Congress on Services - I. Washington, DC, USA: IEEE Computer Society 2009, 2009: 709-716.
- Ren J, Williams N, Clementi L, Krishnan S, Li WW: Opal web services for biomedical applications. Nucleic Acids Research 2010, 38: 724-731. 10.1093/nar/gkq503View Article
- Oracle Corporation: Java™ Native Interface. 2012. (Last accessed: 16 January 2012). [http://docs.oracle.com/javase/7/docs/technotes/guides/jni/] (Last accessed: 16 January 2012).
- OASIS WSRF Technical Committee: OASIS Web Services Resource Framework (WSRF) version 1.2 standard. 2012. (Last accessed: 16 January 2012). [http://www.oasis-open.org/committees/wsrf/] (Last accessed: 16 January 2012).
- Foster I: Globus Toolkit Version 4: Software for Service-Oriented Systems. Journal of Computer Science and Technology 2006,21(4):513-520. 10.1007/s11390-006-0513-yView Article
- Le Novère N, Bornstein B, Broicher A, Courtot M, Donizelli M, Dharuri H, Li L, Sauro H, Schilstra M, Shapiro B, Snoep JL, Hucka M: BioModels Database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems. Nucleic Acids Research 2006,34(Database issue):689-91.View Article
- DrÃ¤ger A, Rodriguez N, Dumousseau M, Dörr A, Wrzodek C, Le Novère N, Zell A, Hucka M: JSBML: a flexible Java library for working with SBML. Bioinformatics (Oxford, England) 2011,27(15):2167-2168. 10.1093/bioinformatics/btr361View Article
- The World Wide Web Consortium: SOAP version 1.2. 2012. (Last accessed: 11 January 2012). [http://www.w3.org/TR/soap12/] (Last accessed: 11 January 2012).
- Christensen E, Curbera F, Meredith G, Weerawarana S: Web Service Definition Language (WSDL). 2001. (Last accessed: 11 January 2012). [http://www.w3.org/TR/wsdl] (Last accessed: 11 January 2012).
- Hapner M, Burridg R, Sharma R, Fialli J, Stout K: Java Message Service. 1, Sun Microsystems, Inc: Specification, version: 1;
- Cho KH, Shin SY, Kolch W, Wolkenhauer O: Experimental Design in Systems Biology, Based on Parameter Sensitivity Analysis Using a Monte Carlo Method: A Case Study for the TNFα–Mediated NF–κB Signal Transduction Pathway. SIMULATION 2003, 79: 726-739. 10.1177/0037549703040943View Article
- Saltelli A, Ratto M, Tarantola S, Campolongo F: Sensitivity analysis for chemical models. Chemical Reviews 2005, 105: 2811-28. 10.1021/cr040659dView Article
- Yue H, Brown M, He F, Jia J, Kell D: Sensitivity analysis and robust experimental design of a signal transduction pathway system. International Journal of Chemical Kinetics 2008,40(11):730-741. 10.1002/kin.20369View Article
- Shankaran H, Wiley HS, Resat H: Modeling the effects of HER/ErbB1-3 coexpression on receptor dimerization and biological response. Biophysical Journal 2006,90(11):3993-4009. 10.1529/biophysj.105.080580View Article
- Mahdavi A, Davey RE, Bhola P, Yin T, Zandstra PW: Sensitivity Analysis of Intracellular Signaling Pathway Kinetics Predicts Targets for Stem Cell Fate Control. PLoS Computational Biology 2007, 3: e130. 10.1371/journal.pcbi.0030130View Article
- Hornberger GM, Spear RC: An approach to the preliminary analysis of environmental systems. Journal of Environmental Management 1981, 12: 7-18.
- Zi Z, Cho KH, Sung MH, Xia X, Zheng J, Sun Z: In silico identification of the key components and steps in IFN–gamma induced JAK–STAT. signaling pathway. FEBS Letters 2005, 579: 1101-1108. 10.1016/j.febslet.2005.01.009View Article
- Michaelis L, Menten M: Die Kinetik der Invertinwirkung. Biochemische Zeitschrift. 1913, 49: 333-369.
- McKay M, Conover W, Beckman R: A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code. Technometrics 1979,21(2):239-245.
- Laplante S, Lassaigne R, Magniez F, Peyronnet S, de Rougemont M: Probabilistic abstraction for model checking: An approach based on property testing. ACM Transactions on Computational Logic 2007.,8(4):
- Grosu R, Smolka SA: Monte Carlo Model Checking. Springer: In Proc. 11th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’05), Volume 3440 of Lecture Notes in Computer Science; 2005:271-286.
- Bhagat J, Tanoh F, Nzuobontane E, Laurent T, Orlowski J, Roos M, Wolstencroft K, Aleksejevs S, Stevens R, Pettifer S, Lopez R, Goble CA: BioCatalogue: a universal catalogue of web services for the life sciences. Nucleic Acids Research 2010,38(Web Server issue):689-694.View Article
- Wilkinson MD, Senger M, Kawas E, Bruskiewich R, Gouzy J, Noirot C, Bardou P, Ng A, Haase D, Saiz EA, Wang D, Gibbons F, Gordon PMK, Sensen CW, Carrasco JMR, FernÃ¡ndez JM, Shen L, Links M, Ng M, Opushneva N, Neerincx PBT, Leunissen JAM, Ernst R, Twigger S, Usadel B, Good B, Wong Y, Stein L, Crosby W, Karlsson J, Royo R, PÃ¡rraga I, RamÃrez S, Gelpi JL, Trelles O, Pisano DG, Jimenez N, Kerhornou A, Rosset R, Zamacola L, Tarraga J, Huerta-Cepas J, Carazo JM, Dopazo J, Guigo R, Navarro A, Orozco M, Valencia A, Claros MG, PÃ©rez AJ, Aldana J, Rojano MM, Fernandez-Santa Cruz R, Navas I, Schiltz G, Farmer A, Gessler D, Schoof H, Groscurth A: Interoperability with Moby 1.0–it’s better than sharing your toothbrush! Briefings in Bioinformatics 2008,9(3):220-231.View Article
- Courtot M, Juty N, KnÃ¼pfer C, Waltemath D, Zhukova A, DrÃ¤ger A, Dumontier M, Finney A, Golebiewski M, Hastings J, Hoops S, Keating S, Kell DB, Kerrien S, Lawson J, Lister A, Lu J, Machne R, Mendes P, Pocock M, Rodriguez N, Villeger A, Wilkinson DJ, Wimalaratne S, Laibe C, Hucka M, Le NovÃ¨re N: Controlled vocabularies and semantics in systems biology. Molecular Systems Biology 2011, 7: 543.View Article
- Goble CA, Bhagat J, Aleksejevs S, Cruickshank D, Michaelides D, Newman D, Borkum M, Bechhofer S, Roos M, Li P, Roure DD: myExperiment: a repository and social network for the sharing of bioinformatics workflows. Nucleic Acids Research 2010,38(Web Server issue):677-682.View Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.