Statistical Properties of the K‐Index for Detecting Answer Copying
Abstract
We investigated the statistical properties of the K‐index (Holland, 1996) that can be used to detect copying behavior on a test. A simulation study was conducted to investigate the applicability of the K‐index for small, medium, and large datasets. Furthermore, the Type I error rate and the detection rate of this index were compared with the copying index, ω (Wollack, 1997). Several approximations were used to calculate the K‐index. Results showed that all approximations were able to hold the Type I error rates below the nominal level. Results further showed that using ω resulted in higher detection rates than the K‐indices for small and medium sample sizes (100 and 500 simulees).
Citing Literature
Number of times cited according to CrossRef: 32
- Diana Steger, Ulrich Schroeders, Oliver Wilhelm, Caught in the Act: Predicting Cheating in Unproctored Knowledge Assessment, Assessment, 10.1177/1073191120914970, (107319112091497), (2020).
- Cengiz Zopluoglu, Detecting Examinees With Item Preknowledge in Large-Scale Testing Using Extreme Gradient Boosting (XGBoost), Educational and Psychological Measurement, 10.1177/0013164419839439, (001316441983943), (2019).
- César Martinelli, Susan W. Parker, Ana Cristina Pérez-Gea, Rodimiro Rodrigo, Cheating and Incentives: Learning from a Policy Experiment, American Economic Journal: Economic Policy, 10.1257/pol.20150066, 10, 1, (298-325), (2018).
- Hotaka Maeda, Bo Zhang, An Algorithm to Improve Test Answer Copying Detection Using the Omega Statistic, International Journal of Testing, 10.1080/15305058.2016.1217418, 17, 1, (55-73), (2016).
- Cengiz Zopluoglu, Classification Performance of Answer-Copying Indices Under Different Types of IRT Models, Applied Psychological Measurement, 10.1177/0146621616664724, 40, 8, (592-607), (2016).
- Marcelo Perlin, Creating and Grading Latex Exams with Randomized Content Using RndTexExams, SSRN Electronic Journal, 10.2139/ssrn.2806570, (2016).
- Mauricio Romero, Álvaro Riascos, Diego Jara, On the Optimality of Answer-Copying Indices, Journal of Educational and Behavioral Statistics, 10.3102/1076998615595628, 40, 5, (435-453), (2016).
- James A. Wollack, Computer Software Review: Cheating Detection at Your Fingertips, Applied Psychological Measurement, 10.1177/0146621607300853, 31, 3, (233-239), (2016).
- Leonardo S. Sotaridona, Wim J. van der Linden, Rob R. Meijer, Detecting Answer Copying Using the Kappa Statistic, Applied Psychological Measurement, 10.1177/0146621606288891, 30, 5, (412-431), (2016).
- Wim J. van der Linden, Leonardo Sotaridona, Detecting Answer Copying When the Regular Response Process Follows a Known Response Model, Journal of Educational and Behavioral Statistics, 10.3102/10769986031003283, 31, 3, (283-304), (2016).
- CCsar A Martinelli, Susan Parker, Ana Cristina Perez-Gea, Rodimiro Rodrigo, Cheating and Incentives: Learning from a Policy Experiment, SSRN Electronic Journal, 10.2139/ssrn.2606487, (2015).
- Sébastien Béland, Gilles Raîche, David Magis, L’utilisation du facteur de Bayes pour identifier les étudiants qui répondent au hasardThe use of the Bayes factor to identify students who guess at randomLa utilización del factor de Bayes para identificar a los estudiantes que responden al azar, Revue des sciences de l'éducation, 10.7202/1035310ar, 41, 3, (385), (2015).
- Wim J. van der Linden, Charles Lewis, Bayesian Checks on Cheating on Tests, Psychometrika, 10.1007/s11336-014-9409-x, 80, 3, (689-706), (2014).
- Mauricio Romero, Alvaro Riascos, Diego Jara, A Derivation of the Optimal Answer-Copying Index and Some Applications, SSRN Electronic Journal, 10.2139/ssrn.2414058, (2014).
- Mauricio Romero, Alvaro Riascos, Diego Jara, A Derivation of the Optimal Answer-Copying Index and Some Applications, SSRN Electronic Journal, 10.2139/ssrn.2489178, (2014).
- Ardeshir Geranpayeh, Detecting Plagiarism and Cheating, The Companion to Language Assessment, 10.1002/9781118411360, (980-993), (2013).
- Cengiz Zopluoglu, CopyDetect, Applied Psychological Measurement, 10.1177/0146621612463119, 37, 1, (93-95), (2012).
- Cengiz Zopluoglu, Ernest C. Davenport, The Empirical Power and Type I Error Rates of the GBT and ω Indices in Detecting Answer Copying on Multiple-Choice Tests, Educational and Psychological Measurement, 10.1177/0013164412442941, 72, 6, (975-1000), (2012).
- Dmitry I. Belov, Detection of Answer Copying Based on the Structure of a High-Stakes Test, Applied Psychological Measurement, 10.1177/0146621611420705, 35, 7, (495-517), (2011).
- Dmitry I. Belov, Ronald D. Armstrong, Automatic Detection of Answer Copying via Kullback-Leibler Divergence and K-Index, Applied Psychological Measurement, 10.1177/0146621610370453, 34, 6, (379-392), (2010).
- Diego Jara, Alvaro Riascos, Mauricio Romero, Detecting Answer Copying in Standardized Tests (In Spanish), SSRN Electronic Journal, 10.2139/ssrn.1625509, (2010).
- Wim J. van der Linden, A Bivariate Lognormal Response-Time Model for the Detection of Collusion Between Test Takers, Journal of Educational and Behavioral Statistics, 10.3102/1076998609332107, 34, 3, (378-394), (2009).
- Bernard P. Veldkamp, A Review of Integrity ™ , International Journal of Testing, 10.1080/15305050802001268, 8, 2, (202-207), (2008).
- L. Andries van der Ark, Wilco H. M. Emons, Klaas Sijtsma, Detecting Answer Copying Using Alternate Test Forms and Seat Locations in Small‐Scale Examinations, Journal of Educational Measurement, 10.1111/j.1745-3984.2007.00055.x, 45, 2, (99-117), (2008).
- Walter M. Haney, Michael J. Clarke, Cheating on Tests, Psychology of Academic Cheating, 10.1016/B978-012372541-7/50015-2, (255-287), (2007).
- Avi Allalouf, Quality Control Procedures in the Scoring, Equating, and Reporting of Test Scores, Educational Measurement: Issues and Practice, 10.1111/j.1745-3992.2007.00087.x, 26, 1, (36-46), (2007).
- Yen-Zen Wang, Tzong-Mou Wu, Some mathematical models for deciding the number of examination questions on computerized adaptive tests, Applied Mathematics and Computation, 10.1016/j.amc.2005.11.133, 180, 1, (178-184), (2006).
- James A. Wollack, Simultaneous Use of Multiple Answer Copying Indexes to Improve Detection Rates, Applied Measurement in Education, 10.1207/s15324818ame1904_3, 19, 4, (265-288), (2006).
- Wim J. Linden, Leonardo Sotaridona, A Statistical Test for Detecting Answer Copying on Multiple‐Choice Tests, Journal of Educational Measurement, 10.1111/j.1745-3984.2004.tb01171.x, 41, 4, (361-377), (2006).
- Leonardo S. Sotaridona, Rob R. Meijer, Two New Statistics to Detect Answer Copying, Journal of Educational Measurement, 10.1111/j.1745-3984.2003.tb01096.x, 40, 1, (53-69), (2006).
- James A. Wollack, Comparison of Answer Copying Indices with Real Data, Journal of Educational Measurement, 10.1111/j.1745-3984.2003.tb01104.x, 40, 3, (189-205), (2006).
- Wilco H. M. Emons, Klaas Sijtsma, Rob R. Meijer, Testing Hypotheses About the Person-Response Function in Person-Fit Analysis, Multivariate Behavioral Research, 10.1207/s15327906mbr3901_1, 39, 1, (1-35), (2004).
