Original Article

You have free access to this content

# Controlling the Type I error rate by using the nonparametric bootstrap when comparing means

Article first published online: 3 MAY 2013

DOI: 10.1111/bmsp.12011

© 2013 The British Psychological Society

Issue

## British Journal of Mathematical and Statistical Psychology

Volume 67, Issue 1, pages 117–132, February 2014

Additional Information

#### How to Cite

Parra-Frutos, I. (2014), Controlling the Type I error rate by using the nonparametric bootstrap when comparing means. British Journal of Mathematical and Statistical Psychology, 67: 117–132. doi: 10.1111/bmsp.12011

#### Publication History

- Issue published online: 13 JAN 2014
- Article first published online: 3 MAY 2013
- Manuscript Accepted: 8 MAR 2013
- Manuscript Revised: 6 MAR 2013
- Manuscript Received: 12 JUL 2012

### References

- 2004). Heteroscedastic one-way ANOVA and lack-of-fit tests. Journal of the American Statistical Association, 99, 368–382. , & (
- 1994). A new and simpler approximation and ANOVA under variance heterogeneity. Journal of Educational Statistics, 19, 91–101. , & (
- 2004). The ANOVA F test can still be used in some balanced designs with unequal variances and nonnormal data. Journal of Statistical Planning and Inference, 126, 413–422. (
- 1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31, 144–152. (
- 1974). The small sample behavior of some statistics which test the equality of several means. Technometrics, 16, 129–132. , & (
- 2011). Testing the equality of several gamma means: a parametric bootstrap method with applications. Computational Statistics, 26, 55–76. , , & (
- 2010). Comparing several population means: a parametric bootstrap method, and its comparison with usual ANOVA F test as well as ANOM. Computational Statistics, 25, 71–95. , , , & (
- 2012). Effect of non-normality on test statistics for one-way independent groups designs. British Journal of Mathematical and Statistical Psychology, 65, 56–73. , , , & (
- 1996). A closer examination on some parametric alternatives to the ANOVA F-test. Statistical Papers, 37, 291–305. (
- 1981). Testing the equality of several means when the population variances are unequal. Communications in Statistics – Simulation and Computation, 10, 557–569. , & (
- 1993). An introduction to the bootstrap. New York, NY: Chapman & Hall. , & (
- 2009). The Wilcoxon–Mann–Whitney test under scrutiny. Statistics in Medicine, 28, 1487–1497. , & (
- 2009). The impact of Levene's test of equality of variances on statistical theory and practice. Statistical Science, 24, 343–360. , , & (
- 1972). Consequences of failure to meet assumptions underlying the fixed effects analyses of variance and covariance. Review of Educational Research, 42, 237–288. , , & (
- 1992). Summarizing Monte Carlo results in methodological research: The one- and two-factor fixed effects ANOVA cases. Journal of Educational Statistics, 17, 315–339. , , , & (
- 1985). Summarizing shape numerically: The
*g*- and*h*-distributions. In D. C. Hoaglin, F. Mosteller & J. W. Tukey (Eds.), Exploring data tables, trends, and shapes (pp. 461–513). New York, NY: Wiley. . ( - 1951). The comparison of several groups of observations when the ratios of the population variances are unknown. Biometrika, 38, 324–329. (
- 1986). Consequences of violating the independence assumption in analysis of variance. Psychological Bulletin, 99, 422–431. , & (
- 2002). Controlling the rate of Type I error over a large set of statistical tests. British Journal of Mathematical and Statistical Psychology, 55, 27–39.Direct Link: , , & (
- 1998). Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses. Review of Educational Research, 68, 350–386. , , , , , , , , , & (
- 1977). An evaluation of some non-parametric and parametric tests for location equality. British Journal of Mathematical and Statistical Psychology, 30, 213–221. , , & (
- 2007). A parametric bootstrap approach for ANOVA with unequal variances: Fixed and random models. Computational Statistics & Data Analysis, 51, 5737–5742. , , & (
- 1988). One-way fixed effects analysis of variance when the error variances may be unequal. Journal of Statistical Computation and Simulation, 30, 259–271. (
- 2011). Comparison of several means: A fiducial based approach. Computational Statistics and Data Analysis, 55, 1993–2002. , , & (
- 1998). To trim or not to trim: Tests of location equality under heteroscedasicity and nonnormality. Educational and Psychological Measurement, 58, 409–429. , & (
- 1996). Consequences of assumption violations revisited: A quantitative review of alternatives to the one-way analysis of variance F test. Review of Educational Research, 66, 579–619. , , & (
- 1999). A powerful transformation trimmed mean method for one-way fixed effects ANOVA model under non-normality and inequality of variances. British Journal of Mathematical and Statistical Psychology, 52, 303–320.Direct Link: & (
- 1997). Improving the Brown-Forsythe solution to the generalizied Behrens-Fisher problem. Communications in Statistics – Simulation and Computation, 26, 1139–1145. (
- 1992). Type I error rates for James's second-order test and Wilcox's Hm test under heteroscedasticity and non-normality. British Journal of Mathematical and Statistical Psychology, 45, 255–263. , & (
- 2004). Comparing measures of the ‘typical’ score across treatment groups. British Journal of Mathematical and Statistical Psychology, 57, 215–234.Direct Link: , , , , , & (
- 1964). Robustness of some procedures for the two-sample location problem. Journal of the American Statistical Association, 59, 665–680. (
- 2005). A bootstrap test of stochastic equality of two populations. American Statistician, 59, 1–6. , , & (
- 1977). Is the ANOVA F-test robust to variance heterogeneity when samples sizes are equal? American Educational Research Journal, 14, 493–498. , & (
- 1959). The analysis of variance. New York, NY: Wiley. (
- 2001). Should we always choose a nonparametric test when comparing two apparently nonnormal distributions? Journal of Clinical Epidemiology, 54, 86–92. , & (
- 2006). Comparing the ‘typical score’ across independent groups based on different criteria for trimming. Metodološki Zvezki, 3, 49–62. , , & (
- 1998). The Kruskal-Wallis test and stochastic homogeneity. Journal of Educational and Behavioral Statistics, 23, 170–192. , & (
- 1995). ANOVA under unequal error variances. Biometrics, 51, 589–599. (
- 1951). On the comparison of several mean values: An alternative approach. Biometrika, 38, 330–336. (
- 1990). Comparing the means of two independent groups. Biometrics Journal, 32, 771–780. (
- 1998). Can tests for treatment group equality be improved? The bootstrap and trimmed means conjecture. British Journal of Mathematical and Statistical Psychology, 51, 123–134. , , & (