Correspondence site: http://www.respond2articles.com/MEE/
Guidelines for estimating repeatability
Article first published online: 2 JUN 2011
© 2011 The Authors. Methods in Ecology and Evolution © 2011 British Ecological Society
Methods in Ecology and Evolution
Volume 3, Issue 1, pages 129–137, February 2012
How to Cite
Wolak, M. E., Fairbairn, D. J. and Paulsen, Y. R. (2012), Guidelines for estimating repeatability. Methods in Ecology and Evolution, 3: 129–137. doi: 10.1111/j.2041-210X.2011.00125.x
- Issue published online: 1 FEB 2012
- Article first published online: 2 JUN 2011
- Received 6 August 2010; accepted 6 May 2011 Handling Editor: Thomas Hansen
- experimental design;
- intraclass correlation coefficient;
- measurement error;
- sample size
1. Researchers frequently take repeated measurements of individuals in a sample with the goal of quantifying the proportion of the total variation that can be attributed to variation among individuals vs. variation among measurements within individuals. The proportion of the variation attributed to variation among individuals is known as repeatability and is most frequently estimated as the intraclass correlation coefficient (ICC). The goal of our study is to provide guidelines for determining the sample size (number of individuals and number of measurements per individual) required to accurately estimate the ICC.
2. We report a range of ICCs from the literature and estimate 95% confidence intervals for these estimates. We introduce a predictive equation derived by Bonett (2002), and we test the assumptions of this equation through simulation. Finally, we create an R statistical package for the planning of experiments and estimation of ICCs.
3. Repeatability estimates were reported in 1·5% of the articles published in the journals surveyed. Repeatabilities tended to be highest when the ICC was used to estimate measurement error and lowest when it was used to estimate repeatability of behavioural and physiological traits. Few authors report confidence intervals, but our estimated 95% confidence intervals for published ICCs generally indicated a low level of precision associated with these estimates. This survey demonstrates the need for a protocol to estimate repeatability.
4. Analysis of the predictions from Bonett’s equation over a range of sample sizes, expected repeatabilities and desired confidence interval widths yields both analytical and intuitive guidelines for designing experiments to estimate repeatability. However, we find a tendency for the confidence interval to be underestimated by the equation when ICCs are high and overestimated when ICCs and the number of measurements per individual are low.
5. The sample size to use when estimating repeatability is a question pitting investigator effort against expected precision of the estimate. We offer guidelines that apply over a wide variety of ecological and evolutionary studies estimating repeatability, measurement error or heritability. Additionally, we provide the R package, icc, to facilitate analyses and determine the most economic use of resources when planning experiments to estimate repeatability.