• 1
    Charlin B, Brailovsky CA, Leduc C, Blouin D. The diagnostic script questionnaire: a new tool to assess a specific dimension of clinical competence. Adv Health Sci Educ 1998;3:518.
  • 2
    Brazeau-Lamontagne L, Charlin B, Gagnon R, Samson L, van der Vleuten C. Measurement of perception and interpretation skills during radiology training: utility of the script concordance approach. Med Teach 2004;26:32632.
  • 3
    Cohen LJ, Fitzgerald SG, Lane S, Boninger ML. Development of the seating and mobility script concordance test for spinal cord injury: obtaining content validity evidence. Assist Technol 2005;17:12232.
  • 4
    Khonputsa P, Besinque K, Fisher D, Gong W. Use of script concordance test to assess pharmaceutical diabetic care: a pilot study in Thailand. Med Teach 2006;28 (6):5703.
  • 5
    Llorca G. Evaluation de résolution de problèmes mal définis en éthique clinique: variation des scores selon les méthodes de correction et selon les caractéristiques des jurys [Ill-defined problem assessment in clinical ethics: score variation according to scoring method and jury characteristics]. Pédagogie Médicale 2003;4:808.
  • 6
    Meterissian S, Zabolotny B, Gagnon R, Charlin B. Is the script concordance test a valid instrument for assessment of intraoperative decision-making skills? Am J Surg 2007;193:24851.
  • 7
    Brownell AK. The script concordance test. Can J Neurol Sci 2009;36:2723.
  • 8
    Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 2006;119:166.e7166.e16.
  • 9
    Downing SM. Validity: on meaningful interpretation of assessment data. Med Educ 2003;37:8307.
  • 10
    Kane M. An argument-based approach to validity. Psychol Bull 1992;112:52735.
  • 11
    Case SM, Swanson DB. Constructing Written Test Questions for the Basic and Clinical Sciences. Philadelphia, PA: National Board of Medical Examiners 1998.
  • 12
    Charlin B, van der Vleuten C. Standardised assessment of reasoning in contexts of uncertainty: the script concordance approach. Eval Health Prof 2004;27 (3):30419.
  • 13
    Kreiter CD, Bergus G. The validity of performance-based measures of clinical reasoning and alternative approaches. Med Educ 2009;43:3205.
  • 14
    Moss P. Shifting conceptions of validity in educational measurement: implications for performance assessment. Rev Educ Res 1992;62 (3):22958.
  • 15
    Williams R, Klamen D, Hoffman R. Medical student acquisition of clinical working knowledge. Teach Learn Med 2008;20 (1):510.
  • 16
    Montgomery K. How Doctors Think: Clinical Judgement and the Practice of Medicine. Oxford: Oxford University Press 2006.
  • 17
    Wainer H, Mee J. On assessing the quality of physicians’ clinical judgement: the search for outcome variables. Eval Health Prof 2004;27:36982.
  • 18
    Messick S. Validity. In: LinnRL, ed. Educational Measurement, 3rd edn. New York, NY: Macmillan 1989;13103.
  • 19
    American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: AERA 1999.
  • 20
    Fournier JP, Demeester A, Charlin B. Script concordance tests: guidelines for construction. BMC Med Inform Decis Mak 2008;8:18.
  • 21
    Meterissian S. A novel method of assessing clinical reasoning in surgical residents. Surg Innov 2006;13:1159.
  • 22
    Charlin B, Boshuizen H, Custers E, Feltovitch P. Scripts and clinical reasoning. Med Educ 2007;41:117884.
  • 23
    Lubarsky S, Chalk C, Kazitani D, Gagnon R, Charlin B. The script concordance test: a new tool assessing clinical judgement in neurology. Can J Neurol Sci 2009;36:32631.
  • 24
    Elstein AS, Shulman LS, Sprafka SA. Medical Problem Solving: An Analysis of Clinical Reasoning. Cambridge, MA: Harvard University Press 1978.
  • 25
    Boshuizen H, Schmidt H. The development of clinical reasoning expertise. In: HiggsJ, JonesM, eds. Clinical Reasoning in the Health Professions, 2nd edn. Oxford: Butterworth Heinemann 2005;1522.
  • 26
    Feltovich PJ, Barrows HS. Issues of generality in medical problem solving. In: SchmidtH, De VolderH, eds. Tutorials in Problem-based Learning: A New Direction in Teaching the Health Professions. Assen: Van Gorcum 1984;12842.
  • 27
    Carriere B, Gagnon R, Charlin B, Downing S, Bordage G. Assessing clinical reasoning in paediatric emergency medicine: validity evidence for a script concordance test. Ann Emerg Med 2009;53 (5):64752.
  • 28
    Lambert C, Gagnon R, Nguyen D, Charlin B. The script concordance test in radiation oncology: validation study of a new tool to assess clinical reasoning. Radiat Oncol 2009;4:7.
  • 29
    Gagnon R, Charlin B, Roy L, St-Martin M, Sauve E, Boshuizen HPA, van der Vleuten CPM. The cognitive validity of the script concordance test: a time processing study. Teach Learn Med 2006;18 (1):227.
  • 30
    Sibert L, Charlin B, Corcos J, Gagnon R, Lechevallier J, Grise P. Assessment of clinical reasoning competence in urology with the script concordance test: an exploratory study across two sites from different countries. Eur Urol 2001;41:22733.
  • 31
    Fournier JP, Thiercelin D, Pulcini C, Alunni-Perret V, Gilbert E, Minguet JM, Bertrand F. Clinical reasoning assessment in emergency medicine: script concordance tests are more efficient to detect clinical experience than rich-context multiple-choice questions. Pédagogie Médicale 2006;7:2030.
  • 32
    Gagnon R, Charlin B, Lambert C, Carrière B, van der Vleuten C. Script concordance testing: more cases or more questions? Adv Health Sci Educ Theory Pract 2009;14 (3):36775.
  • 33
    Norcini JJ, Swanson DB, Grosso LJ, Webster GD. Reliability, validity, and efficiency of multiple-choice question and patient management problem item formats in assessment of clinical competence. Med Educ 1985;19:23847.
  • 34
    Wass V, Jones R, van der Vleuten CPM. Standardised or real patients to test clinical competence? The long case revisited. Med Educ 2001;35:3215.
  • 35
    Gagnon R, Charlin B, Coletti M, Sauve E, van der Vleuten C. Assessment in the context of uncertainty: how many members are needed on the panel of reference of a script concordance test? Med Educ 2005;39:28491.
  • 36
    Charlin B, Gagnon R, Sauvé E, Coletti M. Composition of the panel of reference for concordance tests: do teaching functions have an impact on examinees’ ranks and absolute scores? Med Teach 2007;29:4953.
  • 37
    Sibert L, Charlin B, Corcos J, Gagnon R, Grise P, van der Vleuten C. Stability of clinical reasoning assessment results with the script concordance test across two different linguistic, cultural and learning environments. Med Teach 2002;24:5227.
  • 38
    Collard A, Gelaes S, Vanbelle S, Bredard S, Defraigne JO, Boniver J, Bourguignon JP. Reasoning versus knowledge retention and ascertainment throughout a problem-based learning curriculum. Med Educ 2009;43:85465.
  • 39
    Brailovsky C, Charlin B, Beausoleil S, Coté S, van der Vleuten C. Measurement of clinical reflective capacity early in training as a predictor of clinical reasoning performance at the end of residency: an exploratory study on the Script Concordance Test. Med Educ 2001;35:4306.
  • 40
    Norcini JJ, Shea JA, Day SC. The use of the aggregate scoring for a recertification examination. Eval Health Prof 1990;13:24151.
  • 41
    Norman GR. Objective measurement of clinical performance. Med Educ 1985;19:437.
  • 42
    Charlin B, Desaulniers M, Gagnon R, Blouin D, van der Vleuten C. Comparison of an aggregate scoring method with a consensus scoring method in a measure of clinical reasoning capacity. Teach Learn Med 2002;14:1506.
  • 43
    Charlin B, Gagnon R, Pelletier J, Coletti M, Abi-Rizk G, Nasr C, Sauve E, van der Vleuten CPM. Assessment of clinical reasoning in the context of uncertainty: the effect of variability within the reference panel. Med Educ 2006;40:84854.
  • 44
    Bland A, Kreiter C, Gordon J. The psychometric properties of five scoring methods applied to the Script Concordance Test. Acad Med 2005;80:3959.
  • 45
    Sabers DL, White GW. The effect of differential weighting of individual item responses on the predictive validity and reliability of an aptitude test. J Educ Meas 1970;6 (2):936.
  • 46
    Haladyna TM. Effects of empirical option weighting on estimating domain scores and making pass/fail decisions. Appl Measur Educ 1990;3 (3):23144.
  • 47
    Norcini J, Guille R. Combining tests and setting standards. In: NormanGR, van der VleutenCPM, NewbleDI, eds. International Handbook of Research in Medical Education. Dordrecht: Kluwer Academic Publishers 2002;81134.
  • 48
    Charlin B, Gagnon R, Lubarsky S, Lambert C, Meterissian S, Chalk C, Goudreau J, van der Vleuten CPM. Assessment in the context of uncertainty using the script concordance test: more meaning for scores. Teach Learn Med 2010;22 (3):1806.
  • 49
    Devlin J, Marquis F, Riker R, Robbins T, Garpestad E, Fong J, Didomenico D, Skrobik, Y. Combined didactic and scenario-based education improves the ability of intensive care unit staff to recognise delirium at the bedside. Crit Care 2008;12(1):R19 .
  • 50
    Labelle M, Beaulieu M, Paquette D, Fournier C, Bessette L, Choquette D, Rahme E, Thivierge RL. An integrated approach to improving appropriate use of anti-inflammatory medication in the treatment of osteoarthritis in Quebec (Canada): the CURATA model. Med Teach 2004;26 (5):46370.
  • 51
    Petrella R, Davis P. Improving management of musculoskeletal disorders in primary care: the Joint Adventures Program. Clin Rheumatol 2007;26:10616.
  • 52
    Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull 1959;56:81105.
  • 53
    van der Vleuten C. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract 1996;1:4167.
  • 54
    van der Vleuten C, Schuwirth LW. Assessing professional competence: from methods to programmes. Med Educ 2005;39:30917.
  • 55
    Miller G. The assessment of clinical skills/competence/performance. Acad Med 1990;65 (9):637.