The impact of ignoring multiple membership data structures in multilevel models

This study compared the use of the conventional multilevel model (MM) with that of the multiple membership multilevel model (MMMM) for handling multiple membership data structures. Multiple membership data structures are commonly encountered in longitudinal educational data sets in which, for example, mobile students are members of more than one higher-level unit (e.g., school). While the conventional MM requires the user either to delete mobile students’ data or to ignore prior schools attended, MMMM permits inclusion of mobile students’ data and models the effect of all schools attended on student outcomes. The simulation study identified underestimation of the school-level predictor coefficient, as well as underestimation of the level-two variance component with corresponding overestimation of the level-one variance when multiple membership data structures were ignored. Results are discussed along with limitations and ideas for future MMMM methodological research as well as implications for applied researchers.