Reliability measures have been well studied over many years. Such measures have been thoroughly studied for two-factor models. Motivated by a medical research problem, point and confidence interval estimates of the intraclass correlation coefficient are extended to models containing three crossed random factors—subjects, raters, and occasions. The estimation is conducted using both analysis of variance and Monte Carlo Markov chain methods. Copyright © 2011 John Wiley & Sons, Ltd.