Estimating the Proportion of True Null Hypotheses for Multiple Comparisons
Hongmei Jiang1 and R.W. Doerge2
1Department of Statistics, Northwestern University, 2006 Sheridan Road, Evanston, IL 60208 U.S.A. 2Department of Statistics, Purdue University, 250 N. University Street, West Lafayette, IN 47907 U.S.A.
Abstract
Whole genome microarray investigations (e.g. differential expression, differential methylation, ChIP-Chip) provide opportunities to test millions of features in a genome. Traditional multiple comparison procedures such as familywise error rate (FWER) controlling procedures are too conservative. Although false discovery rate (FDR) procedures have been suggested as having greater power, the control itself is not exact and depends on the proportion of true null hypotheses. Because this proportion is unknown, it has to be accurately (small bias, small variance) estimated, preferably using a simple calculation that can be made accessible to the general scientific community. We propose an easy-to-implement method and make the R code available, for estimating the proportion of true null hypotheses. This estimate has relatively small bias and small variance as demonstrated by (simulated and real data) comparing it with four existing procedures. Although presented here in the context of microarrays, this estimate is applicable for many multiple comparison situations.
Readers of this also read:
- Estimating the Proportion of True Null Hypotheses for Multiple Comparisons
- Comparisons of Robustness and Sensitivity between Cancer and Normal Cells by Microarray Data
- Chromosome 20q Amplification Regulates in Vitro Response to Kinesin-5 Inhibitor
- A Biological Evaluation of Six Gene Set Analysis Methods for Identification of Differentially Expressed Pathways in Microarray Data
- Evaluating Microarray-based Classifiers: An Overview






