• 1
    Van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1996;1 (1):4167.DOI: 10.1007/BF00596229
  • 2
    Gielen S, Dochy F, Dierick S. Evaluating the consequential validity of new modes of assessment: the influence of assessment on learning, including pre-, post- and true assessment effects. In: SegersM, DochyF, CascallarE, eds. Optimising New Modes of Assessment: in Search of Qualities and Standards. Dordrecht: Kluwer Academic Publishers 2003.
  • 3
    Linn RL, Baker E, Dunbar SB. Complex, performance-based assessment: expectations and validation criteria. Educational Res 1991;16: 121.
  • 4
    Messick S. The interplay of evidence and consequences in the validation of performance assessments. Educational Res 1995;23: 1323.
  • 5
    Schuwirth LWT, Van Der Vleuten CPM. Changing education, changing assessment, changing research. Med Educ 2004;38: 80512 .DOI: 10.1111/j.1365-2929.2004.01851.x
  • 6
    Downing SM. The metric of medical education. Validity: on the meaningful interpretation of assessment data. Med Educ 2003;37 (9):8307.DOI: 10.1046/j.1365-2923.2003.01594.x
  • 7
    Hodges B. Validity and the OSCE. Med Teach 2003;25 (3):2504.
  • 8
    Swanson DB, Norman GR, Linn RL. Performance-based assessment: lessons from the health professions. Educational Res 1995;24 (5):511.
  • 9
    Van Der Vleuten CPM, Norman GR, De Graaff E. Pitfalls in the pursuit of objectivity: issues of reliability. Med Educ 1991;25: 1108.
  • 10
    Petrusa ER. Clinical performance assessments. In: NormanGR, Van Der VleutenCPM, NewbleDI, eds. International Handbook for Research in Medical Education. Dordrecht: Kluwer Academic Publishers 2002;673709.
  • 11
    Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 2003;15 (4):27092.DOI: 10.1207/S15328015TLM1504_11
  • 12
    Schuwirth LWT, Van Der Vleuten CPM. The use of clinical simulations in assessment. Med Educ 2003;37 (1):6571.DOI: 10.1046/j.1365-2923.37.s1.8.x
  • 13
    Rethans JJ, Norcini JJ, Baron-Maldonado M et al. The relationship between competence and performance: implications for assessing practice performance. Med Educ 2002;36 (10):9019.DOI: 10.1046/j.1365-2923.2002.01316.x
  • 14
    Norcini JJ, Blank LL, Arnold GK, Kimbal HR. The mini-CEX (clinical evaluation exercise): a preliminary investigation. Ann Intern Med 1995;123: 7959.
  • 15
    Turnbull J, Van Barneveld C. Assessment of clinical performance: In-training evaluation. In: NormanGR, Van Der VleutenCPM, NewbleDI, eds. International Handbook of Research in Medical Education. Dordrecht: Kluwer Academic Publishers 2002;793810.
  • 16
    Ram P, Grol R, Rethans JJ, Schouten B, Van Der Vleuten CPM, Kester A. Assessment of general practitioners by video observation of communicative and medical performance in daily practice: issues of validity, reliability and feasibility. Med Educ 1999;33 (6):44754.DOI: 10.1046/j.1365-2923.1999.00348.x
  • 17
    Gorter S, Rethans JJ, Scherpbier A et al. How to introduce incognito patients into outpatient clinics of specialists in rheumatology. Med Teach 2001;23 (2):13844.DOI: 10.1080/014215931048
  • 18
    Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990;65 (9):637.
  • 19
    Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA 2002;287 (2):22635.DOI: 10.1001/jama.287.2.226
  • 20
    Harden RM. Developments in outcome-based education. Med Teach 2002;24 (2):11720.DOI: 10.1080/01421590220120669
  • 21
    Smith SR, Dollase RH, Boss JA. Assessing students' performance in a competency-based curriculum. Acad Med 2003;78: 97107.
  • 22
    Van Merriënboer JJG. Training Complex Cognitive Skills. Englewood Cliffs, New Jersey: Educational Technology Publications 1997.
  • 23
    Swanson DB, Norcini JJ, Grosso LJ. Assessment of clinical competence: written and computer-based simulations. Assess Eval Higher Educ 1987;12 (3):22046.
  • 24
    Regehr G, MacRae H, Reznick R, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 1998;73 (9):9937.
  • 25
    Coles C. Developing professional judgement. J Contin Educ Health Prof 2002;22 (1):310.
  • 26
    Jozefowicz RF, Koeppen BM, Case SM, Galbraith R, Swanson DB, Glew RH. The quality of in-house medical school examinations. Acad Med 2002;77 (2):15661.
  • 27
    Dochy F, Segers M, Sluijsmans D. The use of self-, peer and co-assessment in higher education: a review. Studies Higher Educ 1999;24 (3):33150.
  • 28
    Norcini JJ. The metric of medical education: peer assessment of competence. Med Educ 2003;37 (6):53943.DOI: 10.1046/j.1365-2923.2003.01536.x
  • 29
    Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof 2003;23: 210.
  • 30
    Snadden D. Portfolios – attempting to measure the unmeasurable? Med Educ 1999;33: 4789.DOI: 10.1046/j.1365-2923.1999.00446.x
  • 31
    Driessen EW, Van Der Vleuten CPM, Schuwirth L, Van Tartwijk J, Vermunt JD. The use of qualitative research criteria for portfolio assessment as an alternative for reliability evaluation: a case study. Med Educ 2005;38: 21420 .DOI: 10.1111/j.1365-2929.2004.02059.x
  • 32
    Anonymous. Standards for Educational and Psychological Testing. Washington DC: American Educational Research Association 1999.
  • 33
    Crossley J, Humphris G, Jolly B. Assessing health professionals. Med Educ 2002;36: 8004.
  • 34
    Mennin SP, Kalishman S. Student assessment. Acad Med 1998;73 (9):S4654.
  • 35
    Gibbs G, Simpson C. How Assessment Influences Student Learning – a Conceptual Overview: Heerlen, the Netherlands: Open University. Centre for Higher Education Practice 2002.
  • 36
    Chibnall JT. The influence of testing context and clinical rotation order on student OSCE performance. Acad Med 2004;79 (6):597601.
  • 37
    Davis WK, White CB. Managing the curriculum and managing change. In: NormanGR, Van Der VleutenCPM, NewbleDI, eds. International Handbook of Research in Medical Education. Dordrecht: Kluwer Academic Publishers 2002;91744.
  • 38
    Epstein RM. Comprehensive Assessment Manual. Rochester, New York: University of Rochester School of Medicine and Dentistry 2001.
  • 39
    Accreditation Council for Graduate Medical Education. Outcome project. Last accessed 25 January 2005.
  • 40
    Hays RB, Fabb WE, Van Der Vleuten CPM. Reliability of the fellowship examination of the Royal Australian College of General Practitioners. Teach Learn Med 1995;7: 4350.
  • 41
    Wass V, McGibbon D, Van Der Vleuten C. Composite undergraduate clinical examinations: how should the components be combined to maximise reliability? Med Educ 2001;35: 32630.
  • 42
    Norcini JJ, Swanson DB, Grosso LJ, Webster GD. Reliability, validity and efficiency of multiple choice question and patient management problem item formats in assessment of clinical competence. Med Educ 1985;19: 23847.
  • 43
    Hatala R, Norman GR. Adapting the key features examination for a clinical clerkship Med Educ 2002;36: 1605.
  • 44
    Swanson DB. A measurement framework for performance-based tests. In: HartI, HardenR, eds, Further Developments in Assessing Clinical Competence. Montreal: Can-Heal publications 1987;1345.
  • 45
    Wass V, Jones R, Van Der Vleuten C. Standardised or real patients to test clinical competence? The long case revisited. Med Educ 2001;35: 3215.
  • 46
    Van Der Vleuten CPM, Van Luijk SJ, Swanson DB. Reliability (Generalisability) of the Maastricht Skills Test. Proceedings of the 27th Annual Conference on Research in Medical Education (RIME). Chicago: American Association for Medical Colleges 1988.
  • 47
    Norcini JJ, Blank LL, Duffy FD, Fortna GS. The mini-CEX: a method for assessing clinical skills. Ann Intern Med 2003;138 (6):476481.
  • 48
    Gorter S, Rethans JJ, Van Der Heijde D et al. Reproducibility of clinical performance assessment in practice using incognito standardised patients. Med Educ 2002;36 (9):82732.