- Poster presentation
- Open Access
A global statistical test for improved detection of gene activity
BMC Systems Biology volume 1, Article number: P10 (2007)
Interpreting gene transcription for understanding cellular processes using DNA microarray measurements presents a number of challenges to the investigator. One of these is the relatively large number of genes (mRNA transcript identities) that are measured with relatively few independent biological samples. The small number of independent samples limits the statistical inference that can be made about the behaviour of individual genes. Consequently, the microarray end-user is faced with bewildering lists of differentially expressed genes that typically contain false positives – a direct result of the well-known 'few samples – many genes' dimensionality problem. At the same time investigators are using microarrays to understand processes involving the collective action of a number of genes, often organized as a complex or pathway . To address these needs and remedy the problem of dimensionality, we consider a global, likelihood ratio (LR) test for examining the behaviour of a pre-assigned group of genes – rather than individual genes.
This poster describes the development of the LR test for detecting low levels of activity in a group of related genes or 'pathway'. The underlying principle of the global LR test is to share variance information across related genes so that small concordant changes in expression in a group of genes can be detected more sensitively than current multiple univariate tests. The LR test takes into account only the magnitude and uncertainty of the changes, that is, it is not affected by whether the genes within the group are up- or down-regulated. Compared with other exploratory methods [2–4] that find patterns of differentially expressed genes, our method is more a confirmatory method. It is particularly well suited to investigating the involvement of a particular functional group of genes in explaining the difference between two or more phenotypes.
The LR method uses a two-layer hierarchy that models variation between genes within a pathway and experimental variation due to effects of sample preparation, microarray measurements and other sources. Hierarchical maximum likelihood estimation is used to determine the likelihood ratios, which are in-turn used to determine P-values (i.e. how likely the observed data would be if in fact none of the pathway genes are differentially expressed). The global maximum of the likelihood is evaluated using standard differential calculus techniques and numerical methods along similar lines described in previous work . Further details are given in the poster. Comparisons are made with P-values evaluated using standard procedures, such as, the univariate regularised t-test  with decision rules that take into account the effect of multiple or 'sequential' testing. In the examples described in the poster, the Family Wise Error Rate is controlled by adjusted P-values calculated using the Bonferroni correction or Hochberg multiple step-down procedure [7–9].
The P-values determined by LR and sequential t-test methods are compared using data from Monte Carlo (MC) simulations and a published two-channel spotted microarray experiment . The MC simulations generated LR and T-statistics that enabled pathways to be identified as True Positive (Tp) and False Positive (Fp) for a particular cut-off value. Counts of Tp and Fp were combined into Receiver Operating Characteristics (ROCs) similar to earlier work . The MC simulations show the hierarchical LR test yields lower P-values compared with the sequential t-test for low cutoff range, 0–5%, of interest. That is, the LR test leads to improved detection of differential gene-group expression compared to a sequential application of the t-test.
The LR and t-test methods were also applied to data about three transforming growth factor genes implicated in the regulation of breast cancer tumorigenesis [10, 11]. The effect of sample size on the P-values for the two methods was investigated by randomly selecting samples (maximum 10) and taking combinatorial averages. Computed relationships of the P-values versus number of samples shows the LR test requires almost three times fewer independent biological samples to give the same gene-group P-value compared with a multiple comparison t-test.
A global, likelihood ratio test is developed that shares variance information across a pre-assigned group of genes. The test is shown to be a more sensitive detector of differential gene expression than conventional techniques, such as, the multiple comparison t-test. This improvement is particularly advantageous for typical of microarray measurements where only a few independent biological samples are available.
Lewin B: Genes VII. 2002, Oxford University Press
Al-Shahrour F, Díaz-Uriarte R, Dopazo J: Discovering molecular functions significantly related to phenotypes by combining gene expression data and biological information. Bioinformatics. 2005, 21 (13): 2988-2993. 10.1093/bioinformatics/bti457.
Breitling R, Amtmann A, Herzyk P: Iterative group analysis (iGA): a simple tool to enhance sensivity and faciltate interpretation of microarray experiments. BMC Bioinformatics. 2004, 5: 34- 10.1186/1471-2105-5-34.
Martin D, Brun C, Remy E, Mouren P, Thieffry D, Jacq B: Gotoolbox: functional analysis of gene datasets based on gene ontology. Genome Biology. 2004, 5 (12): R101- 10.1186/gb-2004-5-12-r101.
Bakewell DJ, Wit E: Weighted analysis of microarray gene expression using maximum-likelihood. Bioinformatics. 2005, 21 (6): 723-729. 10.1093/bioinformatics/bti051.
Cui X, Churchill GA: Statistical tests for differential expression in cDNA microarray experiments. Genome Biol. 2003, 4 (4): 210-. 10.1186/gb-2003-4-4-210.
Dudoit S, Shaffer JP, Boldrick JC: Multiple hypothesis testing in microarray experiments. Working Paper Series 110. 2002, U. C. Berkeley Division of Biostatistics
Dudoit S, Yang YH, Callow MJ, Speed TP: Statistical methods for identifying differentially expressed genes in replicated cDNA microarray experiments. Statistica Sinica. 2002, 7: 111-139.
Hochberg Y: A sharper Bonferroni procedure for multiple tests of significance. Biometrika. 1988, 75 (4): 800-802. 10.1093/biomet/75.4.800.
West RB, Nuyten DSA, Subramanian S, Nielsen TO, Corless CL, Rubin PR, Montgomery K, Zhu S, Patel R, Hernandez-Boussard T, Goldblum JR, Brown PO, van de Vijver M, van de Rijn M: Determination of stromal signatures in breast carcinoma. PLoS Biology. 2005, 3 (6): e187- 10.1371/journal.pbio.0030187.
Akhurst RJ, Derynck R: Tgf-beta signalling in cancer – a double-edged sword. Trends in Cell Biology. 2001, 11 (11): S44-S51. 10.1016/S0962-8924(01)02130-4.
D. B. would like to thank Cancer Research U.K. and The Wellcome Trust (Project 062511) for financial support and facilities.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Bakewell, D.J., Wit, E. A global statistical test for improved detection of gene activity. BMC Syst Biol 1 (Suppl 1), P10 (2007). https://doi.org/10.1186/1752-0509-1-S1-P10
- Monte Carlo
- Family Wise Error
- Likelihood Ratio Method
- Hierarchical Likelihood Ratio Test
- Microarray Measurement