- Research article
- Open Access
Incorporation of enzyme concentrations into FBA and identification of optimal metabolic pathways
- Rajat K De^{1}Email author,
- Mouli Das^{1} and
- Subhasis Mukhopadhyay^{2}
https://doi.org/10.1186/1752-0509-2-65
© De et al; licensee BioMed Central Ltd. 2008
- Received: 31 March 2008
- Accepted: 18 July 2008
- Published: 18 July 2008
Abstract
Background
In the present article, we propose a method for determining optimal metabolic pathways in terms of the level of concentration of the enzymes catalyzing various reactions in the entire metabolic network. The method, first of all, generates data on reaction fluxes in a pathway based on steady state condition. A set of constraints is formulated incorporating weighting coefficients corresponding to concentration of enzymes catalyzing reactions in the pathway. Finally, the rate of yield of the target metabolite, starting with a given substrate, is maximized in order to identify an optimal pathway through these weighting coefficients.
Results
The effectiveness of the present method is demonstrated on two synthetic systems existing in the literature, two pentose phosphate, two glycolytic pathways, core carbon metabolism and a large network of carotenoid biosynthesis pathway of various organisms belonging to different phylogeny. A comparative study with the existing extreme pathway analysis also forms a part of this investigation. Biological relevance and validation of the results are provided. Finally, the impact of the method on metabolic engineering is explained with a few examples.
Conclusions
The method may be viewed as determining an optimal set of enzymes that is required to get an optimal metabolic pathway. Although it is a simple one, it has been able to identify a carotenoid biosynthesis pathway and the optimal pathway of core carbon metabolic network that is closer to some earlier investigations than that obtained by the extreme pathway analysis. Moreover, the present method has identified correctly optimal pathways for pentose phosphate and glycolytic pathways. It has been mentioned using some examples how the method can suitably be used in the context of metabolic engineering.
Keywords
- Lycopene
- Zeaxanthin
- Phytoene
- Violaxanthin
- Flux Vector
Background
Metabolism is a complex process that takes place for producing energy and forms the driving force for cellular activity. It involves a large number of chemical reactions/conversions carried out by living organisms as they feed, grow and reproduce. A cascade of such reactions/conversions form a highly branched network. A metabolic network consists of many reactions and transport processes associated with the production and depletion of cellular metabolites. Metabolic pathways are defined as coordinated series of biochemical reactions in which the product of one reaction is the reactant of the subsequent one in the chain. Examples of metabolic pathways include Glycolysis, the Krebs cycle and the Pentose phosphate pathways.
There exist various categories of data models for analyzing metabolic pathways. The huge amount of genomic data, available at present, has led to the construction of genome-scale models of metabolism [1]. The biological information from genomes can be extracted by constructing computational models and subsequently making predictions from them [2, 3]. Flux balance analysis is a constraint-based approach [4–6] that spans the closed solution space within which many steady state solutions would lie. Optimization techniques are used to find out a single state, within this space of allowed states, which reflects the actual flux distribution of the cell under a defined set of nutrient conditions [7, 8]. The utilities of such modeling include predicting systems behavior, identifying crucial steps in systems regulation. In [9], Cascante et. al. have shown how this kind of modeling can be used for characterizing fermentation pathway of S. cerevisiae. Moreover, modeling and analysis of metabolic networks may be useful to perform rational drug design [10].
Reactions in a metabolic pathway are mostly enzymatic. That is, for a reaction A → B catalyzed by an enzyme E, the rate of production of B depends not only on the concentration of the substrate A but also on the concentration of E that is available for catalyzing the reaction. Assuming that sufficient amount of the substrate A being present, if the concentration of E is low (high) then the rate of production of B will also be low (high). In the extreme pathway analysis (one of the methods under flux balance approach) [11], the authors have considered the reaction flux but not the enzyme concentration. This motivates us to develop a new method that considers both the substrate and enzyme concentration, thereby it becomes somewhat closer to real life situations than what extreme pathway analysis offers. We intend to undertake this endeavor in the present article.
The effectiveness of the present method is demonstrated on two synthetic systems designed in [12, 13], on two pentose phosphate, two glycolytic pathways [14], one large carotenoid biosynthesis pathway [14] and a network of core carbon metabolism [15] of various organisms belonging to different phylogeny. The method is compared with the existing extreme pathway analysis [11]. The major differences of the present method from the existing extreme pathway analysis have been pointed out. Finally, we provide biological relevance of the results. A possible validation from biological point of view along with the salient features of the method is also included. It has been demonstrated with a few examples that the method can be appropriately applied to the problems of metabolic engineering.
Results
The proposed method is described in the methodology section. Here we provide a comparative analysis of the present method with extreme pathway analysis using two synthetic [12, 13] and four different real life pathways. Real life pathways include pentose phosphate and glycolytic pathways of E. coli K-12 MG1655, T. pallidum and P. falciparum, a large network of carotenoid biosynthesis [16–20] and a network of core carbon metabolism [15]. All these real life pathways are obtained from the KEGG database [14]. In order to restrict the size of the article, we have provided a brief account on these real-life pathways in the Additional File 1. Some of the results are included here while the others are provided in the Additional File 1 for restricting the size of the article.
Analysis of the results
On the synthetic system in Fig. 2
For the system in Fig. 2, we want to maximize the rate of yield of the metabolite P, starting from the substrate A. The system is composed of 10 reactions R_{1}, R_{2},...,R_{10} involving 6 metabolites A, B, C, D, E and P. The reactions R_{2} and R_{8} are reversible. We associate the weighting factors c_{1}, c_{2},...,c_{10} corresponding to the enzymes catalyzing these reactions respectively. There are 6 internal fluxes R_{5}, R_{6},...,R_{10} and 4 exchange fluxes R_{1}, R_{2},...,R_{4} as depicted in Fig. 2. The constraints as mentioned in the methodology section, and following [13] are as follows:
α = (0, -∞, 0, 0, 0, 0, 0, -∞, 0, 0); β = (1, 0, ∞, ∞, ∞, ∞, ∞, ∞, ∞, ∞).
The terms α_{2} and α_{8} are -∞ because R_{2} and R_{8} are reversible. Moreover, β_{2} = 0 because exclusive growth on substrate A is considered. Finally, we assume that the maximal uptake rate of A is 1 (β_{1} = 1). Following the method described in the methodology section, we have generated a set of flux vectors.
In order to maximize the rate of yield of P for growth on substrate A, the objective function y (Eq. (7)) is minimized, where z is given by z = c_{9}v_{9} + c_{10}v_{10} - c_{3}v_{3}. We vary the value of λ from 0.1 to 1.0. Initially, we should always give stress on the maximization of the rate of yield rather than on the constraint. That is, initially λ should be kept small. As we go from λ = 0.1 to λ = 1.0, it implies that we are increasing the stress on the constraint, and finally both the rate of yield (z) and the constraint are treated equally. For each value of λ, we minimize y, and consider that set of c_{ i }-values corresponding to the λ-value as the final solution, for which y becomes minimum. Here we have obtained an optimal pathway as R_{1} → R_{5} → R_{9} → R_{3}, which is in accordance with earlier investigations [13]. The optimal pathway is obtained for λ = 1.0 in 85 iterations.
Some possible pathways for the system in Fig. 2 (or Fig. 6)
Serial Number | Some possible paths | Optimal c-values | Average quantity (z) of P |
---|---|---|---|
1 | R_{1} → R_{5} → R_{9} → R_{3} | c_{1} = 0.88, c_{5} = 0.80, c_{9} = 0.80, c_{3} = 0.86 | 51.53 |
2 | R_{1} → R_{6} → R_{8} → R_{9} → R_{3} | c_{1} = 0.88, c_{6} = 0.56, c_{8} = 0.57, c_{9} = 0.80, c_{3} = 0.86 | 12.22 |
3 | R_{1} → R_{5} → R_{8} → R_{10} → R_{3} | c_{1} = 0.88, c_{5} = 0.80, c_{8} = 0.57, c_{10} = 0.04, c_{3} = 0.86 | 24.63 |
4 | R_{1} → R_{6} → R_{10} → R_{3} | c_{1} = 0.88, c_{6} = 0.56, c_{10} = 0.04, c_{3} = 0.86 | 19.88 |
5 | R_{1} → R_{7} → R_{10} → R_{3} | c_{1} = 0.88, c_{7} = 0.18, c_{10} = 0.04, c_{3} = 0.86 | 29.41 |
Variation of c-values and average z with the upper bound on reaction fluxes for the optimal path R_{1} → R_{5} → R_{9} → R_{3} of the system in Fig. 2
Serial Number | Upper bound on flux value | Optimal c-values | Average quantity (z) of P |
---|---|---|---|
1 | 5000 | c_{1} = 0.93, c_{5} = 0.83, c_{9} = 0.91, c_{3} = 0.85 | 6670.68 |
2 | 4000 | c_{1} = 0.91, c5 = 0.92, c_{9} = 0.82, c_{3} = 0.98 | 5458.83 |
3 | 3000 | c_{1} = 0.91, c_{5} = 0.85, c_{9} = 0.83, c_{3} = 0.91 | 4308.66 |
4 | 2000 | c_{1} = 0.88, c_{5} = 0.84, c_{9} = 0.81, c_{3} = 0.86 | 3451.73 |
5 | 1000 | c_{1} = 0.87, c_{5} = 0.82, c_{9} = 0.86, c_{3} = 0.83 | 2347.61 |
6 | 50 | c_{1} = 0.84, c_{5} = 0.89, c_{9} = 0.87, c_{3} = 0.82 | 55.69 |
7 | 40 | c_{1} = 0.94, c_{5} = 0.87, c_{9} = 0.89, c_{3} = 0.81 | 47.29 |
8 | 30 | c_{1} = 0.89, c_{5} = 0.86, c_{9} = 0.85, c_{3} = 0.85 | 42.57 |
9 | 20 | c_{1} = 0.86, c_{5} = 0.84, c_{9} = 0.81, c_{3} = 0.82 | 38.66 |
10 | 10 | c_{1} = 0.98, c_{5} = 0.93, c_{9} = 0.91, c_{3} = 0.87 | 34.96 |
On the Glycolytic Pathway in T. pallidum (Fig. 3)
The glycolytic pathway in T. pallidum consists of 13 metabolites and 25 fluxes (Fig. 3). The starting metabolite is α -D-Glucose-1P and the target product is phosphoenolpyruvate. Thus we maximize the rate of yield z = c_{25}v_{25} - c_{24}v_{24} of phosphoenolpyruvate, starting from the substrate α-D-Glucose-1P. Here an optimal pathway has been obtained as α - D - Gluucose - 1P → α - D - Gluucose - 6P → β - D - Fructose - 6P → β - D - Fructose - 1, 6P 2 → Glyceraldehyde - 3P → Glycerate - 1, 3P 2 → Glycerate - 3P → Glycerate - 2P → Phosphoenolpyruvate in 100 iterations as shown by bold (black) arrows. The optimal pathway is obtained for λ = 0.9.
On the Carotenoid biosynthesis pathway (Fig. 9 in Additional File 1)
On the core carbon metabolic network (Fig. 5)
We have applied the method to analyze a simple example that represents the skeleton network of core carbon metabolism [15, 23]. The network includes 23 reactions, seven of which are regulated by four regulatory proteins. The internal metabolites are A, B, C, D, E, F, O_{2}, NADH, ATP and the external metabolites are Carbon 1, Carbon 2, D_{ ext }, E_{ ext }, F_{ ext }, H_{ ext }and Oxygen. This network is a highly simplified representation of core metabolic processes including a glycolytic pathway with carbon 1 (C1) and carbon 2 (C2) as primary substrates, as well as a pentose phosphate pathway and a TCA cycle, through which amino acid H enters into the system. Fermentation pathways, amino acid biosynthesis, cell growth along with corresponding regulation (e.g. catabolite repression, aerobic/anaerobic regulation, and carbon storage regulation) are also included. The growth reaction is indicated by white arrows. For further details of the pathway, one may refer to [15, 23].
Our methodology aims at obtaining the optimal metabolic flux distribution within the solution space. In this study, R_{ z }, the biomass flux, is defined as C + F + H + 10AT P → 1 Biomass, and needs to be maximized. Applying the proposed methodology, the optimal pathway has been found to be: A → B → C → G → C → Biomass for λ = 0.8 in 95 iterations.
Comparison with the extreme pathway analysis [11, 24]
Extreme pathways are a set of generating vectors that describe the conical steady-state solution space for flux distributions through an entire metabolic network. These cone-generating vectors correspond to biochemical pathways. The optimal metabolic pathways are calculated using linear optimization and are then interpreted using the extreme pathways. For details of the method, one may refer to [11, 24]. Here we demonstrate a comparative analysis of the present method with the extreme pathway analysis [11, 24]. The comparative analysis has been done on all the above mentioned pathways. Optimal pathways obtained by extreme pathway analysis for the two synthetic systems (Fig. 2, and Fig. 8 in Additional File 1) are the same as that obtained by the present method. Similarly, for pentose phosphate and glycolytic pathways in E. coli K-12MG1655 (Figs. 10 and 11 in Additional File 1), optimal pathways are the same as obtained by both the methods.
For P. falciparum, an optimal pentose phosphate pathway α - D - Glucose - 6P → β - D - Fructose - 6P → D - Xylulose - 5P → D - Glyceraldehyde - 3P as obtained by the extreme pathway analysis was found to be different from that obtained by the present method as shown in Fig. 12 in Additional File 1. The glycolytic pathway in the organism T. pallidum as obtained by the present algorithm has been found to be different from the previously identified optimal pathway by the extreme pathway analysis. For the latter case, it was found to be α - D - Glucose - 1P → α - D - Glucose - 6P → β - D - Glucose - 6P → β - D - Fructose - 6P → β - D - Fructose - 1, 6P 2 → Glyceraldehyde - 3P → Glycerate - 1, 3P 2 → Glycerate - 3P → Glycerate - 2P → Phosphoenolpyruvate as shown by bold (white) arrows in Fig. 3. Using the extreme pathway analysis we have obtained a different carotenoid biosynthesis pathway: Phytoene → 9, 9' - Di - cis - ζ - Carotene → 7, 9, 7', 9' - Tetra - cis - lycopene → Lycopene → γ - Carotene → β - Carotene → β - Cryptoxanthin → Zeaxanthin → Antheraxanthin → Violaxanthin → 9 - cis - Violaxanthin → Xanthoxin → Abscisic aldehyde → Abscisic alcohol as shown by bold (white) arrows in Fig. 4.
For the carotenoid biosynthesis pathway, the path obtained by the proposed method is different from the extreme pathway analysis at the starting branch and at the end of the branch of the optimal path.
Starting from Phytoene there are two paths to arrive at the intermediate metabolite Lycopene. Of the two paths, the proposed method found three metabolites, Phytofluene, ζ-Carotene and Neurosporene while the extreme pathway analysis identified two metabolites, 9,9'-Di-cis-ζ-Carotene and 7,9,7',9'-Tetra-cis-lycopene, to reach Lycopene, as can be seen from Fig. 4. The paths identified by the above two methods are different till it reaches the metabolite Lycopene. From Lycopene both the methods follow the same path till they arrive at the other intermediate metabolite Violaxanthin. From Violaxanthin extreme pathway method found one intermediate metabolite, 9-cis-Violaxanthin to arrive at the other intermediate metabolite Xanthoxin. The proposed method found two intermediate metabolites Neoxanthin and 9'-cis-Neoxanthin to reach Xanthoxin. So we can conclude that from Violaxanthin the paths obtained by the above two methods are differnt till it arrives at the metabolite Xanthoxin. From Xanthoxin both the methods follow the same path to reach the target metabolite Abscisic alcohol.
Comparison of the flux values obtained by the proposed method and the extreme pathway analysis for the core carbon metabolic network in Fig. 5
Reaction | v _{ max } | v _{ av } | Percentage deviation |
---|---|---|---|
(Extreme path- way analysis) | (Proposed method) | |v_{ av }- v_{ max }|/v_{ av }× 100% | |
Tc1 | 10.5 | 11.13 | 5.66 |
Tc2 | 10.5 | 11.43 | 8.13 |
Td | 12 | 13.91 | 13.73 |
Te | 12 | 10.47 | 14.61 |
Tf | 5 | 7.65 | 34.64 |
Th | 5 | 6.84 | 26.90 |
To2 | 15 | 12.63 | 18.76 |
The values of v_{ max }in Table 3 corresponding to extreme pathway analysis were obtained by imposing certain environmental and regulatory constraints mentioned in [23], while the proposed method, for simplicity, does not consider such constraints. Moreover, for computing an average flux value by our method, we have taken average of a distribution of such flux values while the method of extreme pathway analysis determines the flux value. Finally, it may be mentioned here that we have developed the methodology accommodating certain characteristics of a system (i.e. within a specific metabolic system).
We did not consider the characteristics outside the system, from which the external fluxes enter into it. However, the method developed here has produced consistent results that have been validated by randomizing the starting point in generating flux vectors.
Comparison of flux values obtained by the proposed method and the extreme pathway analysis for the system in Fig. 2
Reaction | Average flux value (proposed method) | Flux value (Extreme pathway analysis) | Percentage deviation |
---|---|---|---|
(v_{ av }) | (v_{ epa }) | |v_{ av }- v_{ epa }|/v_{ av }× 100% | |
R1 | 48.73 | 46.21 | 5.17 |
R2 | 3.596 | 3.129 | 12.98 |
R3 | 36.286 | 32.543 | 10.31 |
R4 | 7.687 | 6.292 | 18.15 |
R5 | 49.227 | 46.341 | 5.86 |
R6 | 17.86 | 16.001 | 10.41 |
R7 | 12.35 | 12.31 | 0.32 |
R8 | 14.50 | 13.656 | 5.82 |
R9 | 68.318 | 65.734 | 3.78 |
R10 | 15.263 | 14.814 | 2.94 |
Biological relevance and validation
This section provides how the results obtained by the present method as well as extreme pathway analysis are relevant to some biological facts already observed by other researchers. Salient features of the present method along with true/false positive/negative scenarios are also depicted.
Relevance
Here we demonstrate how the results obtained by the present method are biologically more relevant than those obtained by the extreme pathway analysis.
In the carotenoid biosynthesis pathway, there are two possible paths from the initial metabolite phytoene, producing 9,9'-Di-cis-ζ-Carotene in one branch and phytofluene in another branch. Of the two possible paths, the branch that produces phytofluene as the intermediate metabolite is observed in [25, 26], which is the same as obtained by our proposed method (Fig. 4). It is to be mentioned here that the other path has been identified by the extreme pathway analysis.
As we proceed along the path, we observe that there are 4 possible paths emerging from the intermediate metabolite Neurosporene (Fig. 9 in Additional File 1). The path that produces α-Zeacarotene and Hydroxy-neurosporene are not biochemically feasible as they do not lead to the target metabolite Abscisic alcohol. Of the remaining two paths, the path producing Lycopene is obtained by the present method (Fig. 4). The path that leads from phytoene to lycopene through the intermediate paths as mentioned above can be found in fungi [27, 28]. Lycopene is also found to be an intermediate in the biosynthesis of other carotenoids, in some bacteria, fungi and green plants [29]. Thus both the present and extreme pathway analysis have correctly identified Lycopene as an intermediate over the other alternative β-Zeacarotene (Fig. 4).
There are 4 possible paths emerging from the intermediate metabolite Lycopene (Fig. 9 in Additional File 1). The paths producing δ-Carotene, 3,4-Dehydrolycopene and Rhodopin as the intermediate metabolites are not possible as they do not lead to the final product Abscisic alcohol. We can reach the target metabolite Abscisic alcohol only through the path that produces γ-carotene. There are 7 possible paths from the intermediate metabolite γ-carotene (Fig. 9 in Additional File 1). The paths yielding Chlorobactene, 1'-Hydroxy- γ-carotene, Myxol, Deoxymyxol, (2'S)-Deoxymyxol 2'-α-L- fucoside and 1'2'-Dihydro-γ-carotene do not terminate to the target metabolite Abscisic alcohol, and hence they are not biochemically feasible. The target metabolite can be obtained through the path producing β-carotene. The biosynthesis pathway for β-carotene has been determined for fungi such as Phycomyces blakesleeanus and Neurospora crassa [30]. β-carotene is also synthesized by a number of bacteria, fungi, and most green plants [30]. The path from β-carotene producing Echinenone terminates at the end products Adonixanthin and Astaxanthin. The other path terminates at the end product Isorenieratene. The above mentioned two paths are not possible as none of them yields Abscisic alcohol that is the desired target metabolite of carotenoid biosynthesis (Fig. 9 in Additional File 1). The path producing β-Cryptoxanthin is the only feasible path as it finally leads to the target metabolite.
From β-Cryptoxanthin there are two paths producing Thermo-biszeaxanthin and Zeaxanthin as the two products. The path producing Zeaxanthin is followed as it terminates to the desired end metabolite. The path from β-carotene to Zeaxanthin can be found in Flavobacterium Species [31]. The conversion between Zeaxanthin and Antheraxanthin is a reversible one, and as the forward reaction rate is greater than the reverse rate, the pathway from Zeaxanthin to Antheraxanthin is favored. As Capsanthin obtained from Antheraxanthin is not the desired end product (Fig. 9 in Additional File 1), this path is not followed. Violaxanthin obtained from Antheraxanthin via the reversible reaction ultimately leads to the target metabolite Abscisic alcohol. Capsorubin is obtained from Violaxanthin but this path is not followed as this does not yield the desired target metabolite Abscisic alcohol. Neoxanthin is produced from Violaxanthin. Arabidopsis is the best-characterized plant system of carotenoid biosynthesis. The path from β-carotene to Neoxanthin for xanthophyll biosynthesis has been observed in Arabidopsis. It may be emphasized that this path was identified by the present method but not by the extreme pathway analysis (Fig. 4).
Similarly, there exists a single path from Neoxanthin to 9'-cis-Neoxanthin and from 9'-cis-Neoxanthin to Xanthoxin. Two paths are emerging from Xanthoxin producing Abscisic aldehyde in one branch and Xanthoxic acid in the other. The path leading to Xanthoxic acid is not followed as this does not lead to the final metabolite of carotenoid biosynthetis. The other one producing Abscisic aldehyde is followed as it terminates to the target metabolite Abscisic alcohol by the subsequent reaction. Two intermediate metabolites, 9'-cis-neoxanthin and 9-cis-violaxanthin, have been identified in light-grown and etiolated leaves, and in roots of a variety of species [32]. Biochemical evidence has suggested the occurrence of this pathway in various eukaryotes and in archaea [33].
The existence of the sugar phosphates Glyceraldehyde-3P, Ribulose-5P, Xylulose-5P, Fructose-6P and Glucose-6P in the pentose-phosphate pathway (PPP) are found in [34–36] (Figs. 10 and 12 in Additional File 1). The major pathway for glucose-6P metabolism in E. coli in [37] is the same as obtained from our proposed methodology (Fig. 11 in Additional File 1).
A possible biological validation
Here we highlight some of the salient features of our method and try to argue that the results obtained thereof might not be a mathematical artefact. The present method maximizes the rate of production of biomass which in a way should be consistent with the law of mass action and subsumes the free energy minimization principle. Then we use the stoichiometric matrix based on these two fundamental and model independent principles. In our results, we are able to identify the true positive and the true negative scenarios correctly which could be a pointer to the fact that our method has not introduced any artefact in its formulation. As for the intermediate scenario our method for real systems so far has not produced any false positive or false negative results.
Considering the pentose phosphate pathway in the organism E. coli K-12 MG1655 (Fig. 10 in Additional File 1) we have found the path starting from the metabolite α-D-Glucose-6P to reach the target metabolite D-Glyceraldehyde-3P and D-Fructose-6P. We have observed the relative values of the components of the flux vector v that are involved in the aforesaid resulting pathway. The value of v_{6} is greater than v_{5}, and the value of v_{21} is greater than v_{22}. This leads us to obtain the target metabolite.
Starting from any intermediate metabolite, e.g., β-D-Glucose-6P, D-Glucono-1,5 lactone-6P and 6-Phospho-D-Gluconate, we were able to reach the target metabolite D-Glyceraldehyde-3P and D-Fructose-6P. While considering a particular intermediate metabolite, we noted the relative values of the components of the flux vector v. We observed that the relative values of the components of the flux vector v while obtaining the path from any intermediate metabolite to the target are of the same order of magnitude as that obtained by considering the original path from α-D-Glucose-6P to reach the target metabolite.
Moreover, we considered some other metabolite as starting substrate that are not on optimal path, and found that they did not lead to the target metabolite. For example, starting from D-Ribose-5P, we were able to reach the metabolite PRPP for most of the values of λ lying between 0.1 and 1.0, in steps of 0.1. For low values of λ, we could reach the metabolite D-Erythrose-4P and D-Fructose-6P. Thus we can conclude that any intermediate metabolite on optimal path produces the target metabolite, and it is independent of the starting metabolite. As desired, the metabolite not on optimal path do not lead to the target metabolite D-Glyceraldehyde-3P and D-Fructose-6P even via the reverse path. Similar observations were found for the other pathways.
We took two intermediate metabolites β-D-Glucose-6P and D-Glucono-1,5 lactone-6P that are indeed on the final path as identified by the present method, and we found that in most of the cases it led to the target. This shows that the method that we have developed is independent of choice of the initial substrate. Then we chose another substrate which also belongs to the path identified by us but this time the substrate could lead to various branches, of which one would eventually lead us to the target. We found that for certain range of values of the parameter λ, this would always lead us to the target, picking up the correct branch that is most of the time followed by the organism. Now for certain other ranges of the values of the parameter λ, the other branches in the pathway were picked up. In all the cases, the relative strength of the vector v reflects the correct strength that would drive the path from the starting substrate to the target. We have observed this feature for all the real life paths.
The kind of constraint that we have imposed on to the systems must have captured the essential biochemistry of the systems. That is why the method becomes independent of the choice of the various substrates within the conscensus pathway and makes our methodology quite a general one without centering around any specific model of the system.
Discussion
The method developed in this article may be useful for manipulating a metabolic pathway to achieve some desired goals constituting some tasks of metabolic engineering. Here we describe a few examples where this method may be useful.
• Consider the example of reducing the amount of acetate in glycolytic pathway as done by Yang et al [38]. Here the authors have proposed a method of adding a new path of forming Acetoin for reducing the amount of acetate. However, this problem may boil down to determining an optimal metabolic pathway through which the amount of acetate is minimum. Then we can apply our method to this problem for determining this optimal pathway and finally inhibit the other paths but only express this optimal path. This will lead to the formation of acetate to a minimum amount. The amount of acetate will be minimum if this optimal path is only expressed and the others are inhibited.
• For the third example, let us assume there are n paths P_{1}, P_{2},...P_{ n }starting from a given substrate to yield a given target metabolite. Also assume that out of these n pathways, there are multiple optimal pathways P_{1}, P_{2},...P_{ m }(m <n) through which the amount of the target metabolite becomes maximum. Now if we want to avoid a particular pathway, we may inhibit (by some means) the genes producing some of the enzymes catalyzing the reactions in that pathway.
Conclusions
Here we have developed a simple method for identifying an optimal metabolic pathway through which a metabolite attains a maximum rate of growth on a given substrate. The method involves formulation of the rate of yield of a metabolite incorporating weighting coefficients indicating the concentration levels of enzymes catalyzing biochemical reactions in the pathway. A new constraint incorporating these weighting coefficients has been defined. Using the method, a set of flux vectors has been generated, which has then been used to determine a set of above-mentioned weighting coefficients giving rise to a maximum rate of yield of a metabolite, starting from a given substrate. The entire method is based on well known flux balancing approach.
It is to be mentioned here that the extreme pathway analysis [11] does not consider the effect of enzymes catalyzing the reactions in a metabolic pathway. On the other hand, the method developed in this article involves enzyme concentration in its formulation; thereby it is closer to the real life situations than the extreme pathway analysis. The other difference between the said two methods is that extreme pathway analysis finds the flux vectors through optimization, whereas the present method generates a subset of possible flux vectors and finds an optimal pathway in terms of weighting coefficients reflecting enzyme concentration. Moreover, the extreme pathway analysis considers individual reactions in the pathway in a sequential manner, whereas the present method considers all the reactions in parallel.
It has been observed that the method though simple enough, is able to identify the optimal pathways which conform to the results of some earlier studies. The method can suitably be used using reaction databases without going into complex mathematical calculations, and without using various kinetic parameters that are hard to be estimated. Comparative analysis of the results obtained by the present method with that of the extreme pathway analysis shows that the present method has been able to identify optimal pathways correctly for almost all the pentose phosphate and glycolytic pathways considered here. The present method has identified a carotenoid biosynthesis pathway that is closer to some earlier investigations than that obtained by the extreme pathway analysis. All the optimal real life pathways have been biologically validated. Finally, possible direct impact of the method on certain problems of metabolic engineering has been pointed out.
Here we have assumed that a large amount of substrate is present. This assumption implies that any influx of the substrate from the other pathways does not have any effect on the rate of production of the corresponding product, due to limited supply of enzymes. Moreover, for simplicity, we have not considered any feedback inhibition on the enzyme activity. In other words, we are considering only the fraction of enzyme molecules that have not been inactivated due to feedback inhibitions. Incorporation of feedback inhibitions on enzyme activity forms a scope for further investigation.
In biochemical networks, crosstalk often occurs, which deals with multiple inputs and overlapping outputs [39]. Here we are dealing with metabolic networks. If crosstalk occurs in the networks under consideration then there may be more than one disjoint sources (metabolites) from which the target or any other intermediate metabolites on the pathway under consideration are found. In this case, we have to consider all these input metabolites of the other networks while constructing the stoichiometric matrix and generating the flux vectors. However, this forms a scope for further investigation.
Method for identification of metabolic pathways
In this section we describe the proposed method. First of all, we make some assumptions based on which we describe the method subsequently.
Assumptions
Here we assume that a large amount of substrate is present. Thus any sudden influx of the substrate from other pathways does not effect any change of the rate of production of the corresponding product. This is due to the limited availability of the enzymes in a pathway. In other words, the ratio of enzyme concentration to substrate concentration is very low. For simplicity, we have not considered any feedback inhibition on the enzyme activity. In other words, we are considering only the fraction of enzyme molecules that have not been inactivated due to feedback inhibitions.
System definition
A metabolic reaction network is a collection of enzymatic reactions and transport processes. A system boundary can be drawn around all these types of reactions that constitute internal fluxes operating inside the network. The system is closed to the passage of certain metabolites while others are allowed to enter and/or exit the system based on external sources and/or sinks that are operating on the network. The existence of an external source/sink on a metabolite necessitates the introduction of an exchange flux, which allows a metabolite to enter or exit the system boundary. These fluxes represent the inputs and outputs of the system.
Thus the term z needs to be maximized for yielding maximum rate of growth of B. Here v_{ k }is the flux of the reaction R_{ k }involving only the metabolite B [40]. The term c_{ k }in [0,1] denotes the weighting factor corresponding to this reaction R_{ k }. c_{ k }indicates the level of concentration of the enzyme catalyzing the reaction R_{ k }. c_{ k }= 1 indicates that the required amount of the enzyme catalyzing the reaction R_{ k }is present. On the other hand, c_{ k }→ 0 indicates that sufficient amount of enzyme is not present to carry out the reaction. Higher the value of c_{ k }, higher is the concentration of the enzyme and vice-versa. The term v_{ k }is considered to be positive if the reaction R_{ k }yields the metabolite B, otherwise it is negative. A reversible reaction is considered as two separate reactions corresponding to forward and backward reactions. It is to be mentioned here that the role of c_{ i }in Eq. (1) in extreme pathway analysis [11] is different from that in the present method. In the earlier case, c is a unit vector, along a particular flux, whereas in the present method, c indicates the level of concentration of the various enzymes catalyzing the reactions in the network.
Generation of flux vectors
For solving the above-mentioned maximization problem, we require the values of the flux vectors v = [v_{1}, v_{2},...,v_{ n }]^{ T }that cannot be obtained easily as the full dynamics is not known or becomes intrackable in most of the scenarios. In order to overcome this situation, we now propose an algorithm for generating flux vectors that satisfy approximately the quasi-steady state condition [11]. That is, we generate those v which satisfies
S.v ≈ 0
and the inequalities in (4) and (5). Here S is the m × n stoichiometric matrix [41] with m as the number of metabolites and n as the number of reactions. From a reaction database, S can be computed. Then the flux vectors v form the null space of S. In extreme pathway analysis, the approximately equality sign in Eq. (2) is replaced by the strict equality sign as the system is in a steady state scenario. The proposed method generates the flux vectors v as linear combinations of the basis vectors spanning the null space of S, and those satisfying the inequalities (4) and (5). We cannot always guarantee (due to finite memory, and the problem of overflow or underflow for representing a numerical value) the strict equality in Eq. (2) for the flux vectors that are generated. Thus we have considered approximate equality sign instead of strict equality. Since in practical situations, n > m, Eq. (2) is under determined. So we proceed as follows:
Step I:
Generate basis vectors v_{ b }that form the null space of the stoichiometric matrix S. Let the number of such basis vectors be l. (This is done by using standard routines and toolboxes of MATLAB.)
Step II:
(i) Generate l number of positive random numbers a_{ p }, p = 1, 2,...,l.
until certain inequality constraint on v is satisfied for all its components. All the internal fluxes are non-negative yielding [11]
v_{ i }≥ 0, ∀i
The constraints on the exchange fluxes depends on their directions [11]. These constraints can be expressed as
α_{ j }≤ v_{ j }≤ β_{ j }
where α_{ j }and β_{ j }are either zero, or negative and positive infinity, respectively, based on the direction of the exchange flux. The activity of these exchange fluxes is considered to be positive if the metabolite is exiting or being produced by the system, and negative if the metabolite is entering or being consumed by the system. For all metabolites in which a source or sink may be present, the exchange flux can operate in a bidirectional manner and is unconstrained. Under the existence of a source (input), α_{ j }is set to negative infinity and β_{ j }to zero. On the other hand, if only a sink (output) exists on the metabolite, α_{ j }is set to zero and β_{ j }to positive infinity. If both a source and a sink are present for the metabolite then the exchange flux is bidirectional with α_{ j }set to negative infinity and β_{ j }to positive infinity leaving the exchange flux unconstrained. For further details on these issues, one may refer to [11].
Thus we generate a large number of flux vectors, satisfying the inequality constraints, which form the data set. The flux vectors along with their corresponding weighting factors are used to determine z. The optimization algorithm searches through this generated data set, and estimates the values of the weighting coefficients c_{ k }(Eq. (7)) on convergence.
Formulation of a new constraint
Eq. (2) describes the quasi-steady state condition, which assumes that the concentration of the enzymes catalyzing various reactions in the network is present in the system at the required level. In other words, the genes that produce these enzymes need to be expressed at the required level. For a variety of reasons, in real systems, the genes that produce these enzymes may not be expressed at the required level. This imposes restrictions on the system, and for this purpose, we define a new constraint as
S.(C.v) = 0
Here C is an n × n diagonal matrix whose diagonal elements are the components of the vector c. That is, if C = [γ_{ ij }]_{n × n}, then γ_{ ij }= δ_{ ij }c_{ i }, where δ_{ ij }is the Kronecker delta. Note that c_{ i }is the weighting factor corresponding to the enzyme catalyzing ith reaction in the network, irrespective of whether the reaction involves the metabolite B or not.
Thus the problem of determining a metabolic pathway yielding maximum rate of production of a metabolite B starting from a substrate A, boils down to a maximization problem, where z is maximized with respect to c, subject to satisfying the constraint given in Eq. (6).
Estimation of weighting coefficients c_{ i }
Combining Eq. (1) and Eq. (6), we can reformulate the objective function as
y = 1/z + Λ^{ T }.(S.(C.v))
Thus the modified value of c_{ i }is given by
c_{ i }(t + 1) = c_{ i }(t) + Δc_{ i }, ∀i, t = 0, 1, 2,...
c_{ i }(t + 1) is the value of c_{ i }at iteration (t + 1), which is computed based on the c_{ i }-value at the iteration t. Regularization parameter λ is chosen empirically. Here we are varying the value of λ from 0.1 to 1.0 in steps of 0.1. Using the above mentioned method, for each value of λ, we finally get c_{ i }-values for which y attains a minimum value. For each value of λ, y is minimized. We choose the specific λ-value for which the y-value is the minimum over all the minima obtained for different values of λ. The c-values corresponding to this minimum y are finally considered.
The vector c corresponds to the flux vector v. That is, its i th component c_{ i }(c_{ i }ε [0,1]) is associated with the flux v_{ i }of the i th reaction of a metabolic network. On minimization of y, some of the c_{ i }values will attain non-zero values in [0,1] and the others are very close to zero. We consider a metabolic path to be an optimal one, if y is minimum and the c_{ i }-values of all the enzymes catalyzing the reactions in that path are greater than zero. Otherwise, a low c-value (close to zero) corresponding to an enzyme catalyzing an intermediate reaction may result in an insufficient product. This will reduce the rate of the next reactions and hence the amount of the target metabolite. In other words, these non-zero c_{ i }-values indicate an optimal pathway through which the rate of yield of metabolite B, being grown on the substrate A, becomes maximum. The major differences of the method from the existing extreme pathway analysis [11] are as follows.
• Unlike the extreme pathway analysis, the present method considers the presence of enzymes.
• Extreme pathway analysis finds the flux vectors upon optimization, whereas the present method generates a set of some possible flux vectors and finds an optimal pathway in terms of weighting coefficients reflecting enzyme concentration.
• Extreme pathway analysis considers individual reactions in the pathway in a sequential manner, whereas the present method considers all the reactions in parallel.
where S and P stand for substrate and product respectively. The terms k_{1}, k_{2} and k_{3} are rate constants. Let us also assume that x mole of S can produce y mole of P. Under this situation, assume that [E_{ min }] is the minimum concentration of the enzyme E that is required to obtain the maximal rate (V_{ max }) of product formation. Thus an estimate of c may be taken as
c = [E]/[E_{ min }]
where [E] is the concentration level of the enzyme E which is required to get an optimal path. Note that the values of V_{ max }, and the rate constants can be estimated in vitro [43]. Thus E_{ min }can also be determined through [43]
V_{ max }= k_{3}[E_{ min }]
and thereby [E] using c-value obtained by our method. On the other hand, if [E] can be determined in vitro, then the theoretical value of c (obtained by the proposed method) can be verified with the experimental value.
Declarations
Acknowledgements
Dr. S. Mukhopadhyay gratefully acknowledges the financial assistance received in the form of a grant, BT/BI/04/001/93 and BT/BI/10/019/99 from the Department of Biotechnology, Government of India.
Authors’ Affiliations
References
- Gadkar KG, Gunawan R, Doyle FJ: Iterative approach to model identification of biological networks. BMC Bioinformatics. 2005, 6: 155- 10.1186/1471-2105-6-155PubMed CentralView ArticlePubMedGoogle Scholar
- Kummel A, Panke S, Heinemann M: Systematic assignment of thermodynamic constraints in metabolic network models. BMC Bioinformatics. 2006, 7: 512- 10.1186/1471-2105-7-512PubMed CentralView ArticlePubMedGoogle Scholar
- Segre D, Vitkup D, Church GM: Analysis of optimality in natural and perturbed metabolic networks. Proceedings of the National Academy of Sciences of the United States of America, PNAS. 2002, 99: 15112-15117. 10.1073/pnas.232349399.View ArticlePubMedGoogle Scholar
- Varma A, Palsson BO: Metabolic flux balancing: basic concepts, scientific and practical use. Biotechnology. 1994, 12: 994-998. 10.1038/nbt1094-994.View ArticleGoogle Scholar
- Palsson BO: The challenges of in silico biology. Nat Biotechnol. 2000, 18: 1147-1150. 10.1038/81125View ArticlePubMedGoogle Scholar
- Lee JM, Gianchandani EP, Papin JA: Flux balance analysis in the era of metabolomics. Briefings in Bioinformatics. 2006, 7: 140-150. 10.1093/bib/bbl007View ArticlePubMedGoogle Scholar
- Covert MW, Schilling CH, Famili I: Metabolic modeling of microbial strains in silico. Trends Biochem Sci. 2001, 26: 179-186. 10.1016/S0968-0004(00)01754-0View ArticlePubMedGoogle Scholar
- Schilling CH, Edwards JS, Palsson BO: Toward metabolic phenomics: analysis of genomic data using flux balances. Biotechnol Prog. 1999, 15: 288-295. 10.1021/bp9900357View ArticlePubMedGoogle Scholar
- Curto R, Sorribas A, Cascante M: Comparative characterization of the fermentation pathway of Saccharomyces cerevisiae using biochemical systems theory and metabolic control analysis: model definition and nomenclature. Mathematical Biosciences. 1995, 130: 25-50. 10.1016/0025-5564(94)00092-EView ArticlePubMedGoogle Scholar
- Cascante M, Boros LG, Comin-Anduix B, de Atauri P, Centelles JJ, Lee PW: Metabolic control analysis in drug discovery and disease. Nature Biotechnology. 2002, 20: 243-249. 10.1038/nbt0302-243View ArticlePubMedGoogle Scholar
- Schilling CH, Letscher D, Palsson BO: Theory for the systemic definition of metabolic pathways and their use in interpreting metabolic function from a pathway-oriented perspective. Journal of Theoretical Biology. 2000, 203: 229-248. 10.1006/jtbi.2000.1073View ArticlePubMedGoogle Scholar
- Schilling CH, Palsson BO: The underlying pathway structure of biochemical reaction networks. Proceedings of the National Academy of Sciences of the United States of America, PNAS. 1998, 95: 4193-4198. 10.1073/pnas.95.8.4193.View ArticlePubMedGoogle Scholar
- Klamt S, Stelling J: Stoichiometric analysis of metabolic networks. Tutorial at the 4th International Conference on Systems Biology. 2003, 1-46. ICSB, Brisbane, AustraliaGoogle Scholar
- Kyoto encyclopedia of genes and genomes.http://www.genome.jp/kegg/pathway.html
- Covert MW, Schilling CH, Palsson BO: Regulation of gene expression in flux balance models of metabolism. Journal of Theoretical Biology. 2001, 213: 73-88. 10.1006/jtbi.2001.2405View ArticlePubMedGoogle Scholar
- Umeno D, Arnold FH: A C-35 carotenoid biosynthetic pathway. Applied and Enviromental Microbiology. 2003, 69: 3573-3579. 10.1128/AEM.69.6.3573-3579.2003.View ArticleGoogle Scholar
- Ku B, Jeong JC, Mijts BN, Schmidt-Dannert C, Dordick JS: Preparation, characterization, and optimization of an in vitro C30 carotenoid pathway. Applied and Enviromental Microbiology. 2005, 71: 6578-6583. 10.1128/AEM.71.11.6578-6583.2005.View ArticleGoogle Scholar
- Naik PS, Chanemougasoundharam A, Paul Khurana SM, Kalloo G: Genetic manipulation of carotenoid pathway in higher plants. Current Science. 2003, 85 (10): 1423-1430. http://www.ias.ac.in/currsci/nov252003/1423.pdfGoogle Scholar
- Bendich A, Olson JA: Biological actions of carotenoids. The FASEB Journal. 1989, 3: 1927-1932.PubMedGoogle Scholar
- Sandmann G: Carotenoid biosynthesis in microorganisms and plants. Eur J Biochem. 1994, 223: 7-24. 10.1111/j.1432-1033.1994.tb18961.xView ArticlePubMedGoogle Scholar
- Hirschberg J, Cohen M, Harker M, Lotan T, Mann V, Pecker I: Molecular genetics of the carotenoid biosynthesis pathway in plants and algae. Pure and Appl Chem. 1997, 69: 2151-2158. 10.1351/pac199769102151.http://stage.iupac.org/originalWeb/publications/pac/1997/pdf/6910x2151.pdf 10.1351/pac199769102151View ArticleGoogle Scholar
- Cunningham FX, Sun Z, Chamovitz D, Hirschberg J, Gantt E: Molecular structure and enzymatic function of lycopene cyclase from the cyanobacterium synechococcus sp strain PCC7942. The Plant Cell. 1994, 6: 1107-1121. 10.2307/3869889PubMed CentralView ArticlePubMedGoogle Scholar
- Covert MW, Palsson BO: Constraints-based models: regulation of gene expression reduces the steady-state solution space. Journal of Theoretical Biology. 2003, 221: 309-325. 10.1006/jtbi.2003.3071View ArticlePubMedGoogle Scholar
- Papin JA, Price ND, Palsson BO: Extreme pathway lengths and reaction participation in genome-scale metabolic networks. Genome Research. 2002, 12: 1889-1900. 10.1101/gr.327702PubMed CentralView ArticlePubMedGoogle Scholar
- Santos CAF, Senalik D, Simon PW: Path analysis suggests phytoene accumulation is the key step limiting the carotenoid pathway in white carrot roots. Genetics and Molecular Biology. 2005, 28: 287-293.http://www.scielo.br/pdf/gmb/v28n2/a19v28n2.pdfView ArticleGoogle Scholar
- Grimplet J, Deluc LG, Tillett RL, Wheatley MD, Schlauch KA, Cramer GR, Cushman JC: Tissue-specific mRNA expression profiling in grape berry tissues. BMC Genomics. 2007, 8: 187- 10.1186/1471-2164-8-187PubMed CentralView ArticlePubMedGoogle Scholar
- Davies BH: Carotene biosynthesis in fungi. Pure Appl Chem. 1973, 35: 1-28. 10.1351/pac197335010001View ArticlePubMedGoogle Scholar
- Busch M, Seuter A, Hain R: Functional analysis of the early steps of carotenoid biosynthesis in tobacco. Plant Physiology. 2002, 128: 439-453. 10.1104/pp.128.2.439PubMed CentralView ArticlePubMedGoogle Scholar
- Armstrong GA, Hearst JE: Genetics and molecular biology of carotenoid pigment biosynthesis. The Journal of the Federation of American Societies for Experimental Biology. 1996, 10: 228-237.http://www.fasebj.org/cgi/reprint/10/2/228Google Scholar
- Saiz M, Paz B, Fuente JL, Nieto MJ, Cabri W, Barredo JL: Blakeslea trispora genes for carotene biosynthesis. Applied and Environmental Microbiology. 2004, 70: 5589-5594. 10.1128/AEM.70.9.5589-5594.2004.View ArticleGoogle Scholar
- Mcdermott JCB, Brown DJ, Britton G, Goodwin TW: Alternative pathways of zeaxanthin biosynthesis in a flavobacterium species. Biochem J. 1974, 144: 231-243.PubMed CentralView ArticlePubMedGoogle Scholar
- Parry AD, Horgan R: Carotenoids and abscisic acid (ABA) biosynthesis in higher plants. Physiologia Plantarum. 1991, 82: 320-326. 10.1111/j.1399-3054.1991.tb00100.x.View ArticleGoogle Scholar
- Smit A, Mushegian A: Biosynthesis of isoprenoids via mevalonate in archaea: the lost pathway. Genome Research. 2000, 10: 1468-1484. 10.1101/gr.145600View ArticlePubMedGoogle Scholar
- Huck JH, Struys EA, Verhoeven NM, Jakobs C, van der Knaap MS: Profiling of pentose phosphate pathway intermediates in blood spots by tandem mass spectrometry: application to transaldolase deficiency. Clinical Chemistry. 2003, 49: 1375-1380. 10.1373/49.8.1375View ArticlePubMedGoogle Scholar
- Verho R, Londesborough J, Penttila M, Richard P: Engineering redox cofactor regeneration for improved pentose fermentation in Saccharomyces cerevisiae. Applied and Environmental Microbiology. 2003, 69: 5892-5897. 10.1128/AEM.69.10.5892-5897.2003.PubMed CentralView ArticlePubMedGoogle Scholar
- Sillero A, Selivanovy VA, Cascante M: Pentose phosphate and calvin cycles: Similarities and three-dimensional views. Biochemistry and Molecular Biology Education. 2006, 34: 275-277. 10.1002/bmb.2006.494034042627.View ArticlePubMedGoogle Scholar
- El-Kazzaz W, Morita T, Tagami H, Inada T, Aiba H: Metabolic block at early stages of the glycolytic pathway activates the Rcs phosphorelay system via increased synthesis of dTDP-glucose in Escherichia coli. Molecular Microbiology. 2004, 51: 1117-1128. 10.1046/j.1365-2958.2003.03888.xView ArticlePubMedGoogle Scholar
- Yang YT, Bennett GN, San KY: Genetic and metabolic engineering. Electronic Journal of Biotechnology. 1998, 1 (3): 134-141. 10.2225/vol1-issue3-fulltext-3.View ArticleGoogle Scholar
- Papin JA, Palsson BO: Topological analysis of mass-balanced signaling networks: a framework to obtain network properties including crosstalk. Journal of Theoretical Biology. 2004, 227: 283-297. 10.1016/j.jtbi.2003.11.016View ArticlePubMedGoogle Scholar
- Shlomi T, Berkman O, Ruppin E: Regulatory on/off minimization of metabolic flux changes after genetic perturbations. Proceedings of the National Academy of Sciences of the United States of America, PNAS. 2005, 102: 7695-7700. 10.1073/pnas.0406346102.View ArticlePubMedGoogle Scholar
- Urbanczik R, Wagner C: Functional stoichiometric analysis of metabolic networks. Bioinformatics. 2005, 21 (22): 4176-4180. 10.1093/bioinformatics/bti674View ArticlePubMedGoogle Scholar
- Haykin S: Neural Networks. 2001, Singapore: Pearson EducationGoogle Scholar
- Stryer L, Berg JM, Tymoczko JL, Clarke ND: Biochemistry. 1998, New york, USA: W H FreemanGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.