• 1
    Frank J JM, Tugwell P. Skills for the new millennium: report of the Societal Needs Working Group, CanMEDS 2000 Project. Ann Roy Coll Phys Surg Can. 1996; 29:20616.
  • 2
    King RW, Schiavone F, Counselman FL, Panacek EA. Patient care competency in emergency medicine graduate medical education: results of a consensus group on patient care. Acad Emerg Med. 2002; 9:122735.
  • 3
    Council of Emergency Medicine Residency Directors. Milestones in Training: More than Just Measurements! Council of Residency Directors in Emergency Medicine Annual Meeting. April 2, 2012, Atlanta, GA.
  • 4
    Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA. 2002; 287:22635.
  • 5
    Chou S, Cole G, McLaughlin K, Lockyer J. CanMEDS evaluation in Canadian postgraduate training programmes: tools used and programme director satisfaction. Med Educ. 2008; 42:87986.
  • 6
    Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB. Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7. Med Teach. 2006; 28:11728.
  • 7
    Norcini J, Anderson B, Bollela V, et al. Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 2011; 33:20614.
  • 8
    Cydulka RK, Emerman CL, Jouriles NJ. Evaluation of resident performance and intensive bedside teaching during direct observation. Acad Emerg Med. 1996; 3:34551.
  • 9
    Lane JL, Gottlieb RP. Structured clinical observations: a method to teach clinical skills with limited time and financial resources. Pediatrics. 2000; 105(4 Pt 2):9737.
  • 10
    Shayne P, Gallahue F, Rinnert S, Anderson CL, Hern G, Katz E. Reliability of a core competency checklist assessment in the emergency department: the Standardized Direct Observation Assessment Tool. Acad Emerg Med. 2006; 13:72732.
  • 11
    Norcini JJ, Blank LL, Duffy FD, Fortna GS. The mini-CEX: a method for assessing clinical skills. Ann Intern Med. 2003; 138:47681.
  • 12
    Young JQ, Lieu S, O'Sullivan P, Tong L. Development and initial testing of a structured clinical observation tool to assess pharmacotherapy competence. Acad Psychiatry. 2011; 35:2734.
  • 13
    Hamburger EK, Cuzzi S, Coddington DA, et al. Observation of resident clinical skills: outcomes of a program of direct observation in the continuity clinic setting. Acad Pediatr. 2011; 11:394402.
  • 14
    Kogan JR, Holmboe ES, Hauer KE. Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. JAMA. 2009; 302:131626.
  • 15
    Norcini JJ, Blank LL, Arnold GK, Kimball HR. Examiner differences in the mini-CEX. Adv Health Sci Educ Theory Pract. 1997; 2:2733.
  • 16
    Meagher FM, Butler MW, Miller SD, Costello RW, Conroy RM, McElvaney NG. Predictive validity of measurements of clinical competence using the team objective structured bedside assessment (TOSBA): assessing the clinical competence of final year medical students. Med Teach. 2009; 31:e54550.
  • 17
    Clay AS, Que L, Petrusa ER, Sebastian M, Govert J. Debriefing in the intensive care unit: a feedback tool to facilitate bedside teaching. Crit Care Med. 2007; 35:73854.
  • 18
    Richards ML, Paukert JL, Downing SM, Bordage G. Reliability and usefulness of clinical encounter cards for a third-year surgical clerkship. J Surg Res. 2007; 140:13948.
  • 19
    Hatala R, Ainslie M, Kassen BO, Mackie I, Roberts JM. Assessing the mini-clinical evaluation exercise in comparison to a national specialty examination. Med Educ. 2006; 40:9506.
  • 20
    Brennan BG, Norman GR. Use of encounter cards for evaluation of residents in obstetrics. Acad Med. 1997; 72(10 Suppl 1):S434.
  • 21
    Hamdy H, Prasad K, Williams R, Salih FA. Reliability and validity of the direct observation clinical encounter examination (DOCEE). Med Educ. 2003; 37:20512.
  • 22
    Dunnington GL, Wright K, Hoffman K. A pilot experience with competency-based clinical skills assessment in a surgical clerkship. Am J Surg. 1994; 167:6046.
  • 23
    Price J, Byrne JA. The direct clinical examination: an alternative method for the assessment of clinical psychiatry skills in undergraduate medical students. Med Educ. 1994; 28:1205.
  • 24
    Durning SJ, Cation LJ, Markert RJ, Pangaro LN. Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Acad Med. 2002; 77:9004.
  • 25
    Nuovo J, Bertakis KD, Azari R. Assessing resident's knowledge and communication skills using four different evaluation tools. Med Educ. 2006; 40:6306.
  • 26
    Boulet JR, McKinley DW, Norcini JJ, Whelan GP. Assessing the comparability of standardized patient and physician evaluations of clinical skills. Adv Health Sci Educ Theory Pract. 2002; 7:8597.
  • 27
    Musick DW, Bockenek WL, Massagli TL, et al. Reliability of the physical medicine and rehabilitation resident observation and competency assessment tool: a multi-institution study. Am J Phys Med Rehabil. 2010; 89:23544.
  • 28
    LaMantia J, Kane B, Yarris L, et al. Real-time inter-rater reliability of the Council of Emergency Medicine Residency Directors standardized direct observation assessment tool. Acad Emerg Med. 2009; 16(Suppl 2):S517.
  • 29
    Dorfsman ML, Wolfson AB. Direct observation of residents in the emergency department: a structured educational program. Acad Emerg Med. 2009; 16:34351.
  • 30
    Santora TA, Trooskin SZ, Blank CA, Clarke JR, Schinco MA. Video assessment of trauma response: adherence to ATLS protocols. Am J Emerg Med. 1996; 14:5649.
  • 31
    Ander DS, Heilpern K, Goertz F, Click L, Kahn S. Effectiveness of a simulation-based medical student course on managing life-threatening medical conditions. Simul Healthc. 2009; 4:20711.
  • 32
    Bond WF, Spillane L. The use of simulation for emergency medicine resident assessment. Acad Emerg Med. 2002; 9:12959.
    Direct Link:
  • 33
    Boulet JR, Murray DJ. Simulation-based assessment in anesthesiology: requirements for practical implementation. Anesthesiology. 2010; 112:104152.
  • 34
    McLaughlin SA, Doezema D, Sklar DP. Human simulation in emergency medicine training: a model curriculum. Acad Emerg Med. 2002; 9:13108.
  • 35
    Spillane L, Hayden E, Fernandez R, et al. The assessment of individual cognitive expertise and clinical competency: a research agenda. Acad Emerg Med. 2008; 15:10718.
  • 36
    Murray DJ, Boulet JR, Kras JF, McAllister JD, Cox TE. A simulation-based acute skills performance assessment for anesthesia training. Anesth Analg. 2005; 101:112734.
  • 37
    McLaughlin S, Fitch MT, Goyal DG, et al. Simulation in graduate medical education 2008: a review for emergency medicine. Acad Emerg Med. 2008; 15:111729.
  • 38
    Murray DJ, Boulet JR, Avidan M, et al. Performance of residents and anesthesiologists in a simulation-based skill assessment. Anesthesiology. 2007; 107:70513.
  • 39
    Murray D, Boulet J, Ziv A, Woodhouse J, Kras J, McAllister J. An acute care skills evaluation for graduating medical students: a pilot study using clinical simulation. Med Educ. 2002; 36:83341.
  • 40
    Boulet JR, Murray D, Kras J, Woodhouse J, McAllister J, Ziv A. Reliability and validity of a simulation-based acute care skills assessment for medical students and residents. Anesthesiology. 2003; 99:127080.
  • 41
    Girzadas DV Jr, Clay L, Caris J, Rzechula K, Harwood R. High fidelity simulation can discriminate between novice and experienced residents when assessing competency in patient care. Med Teach. 2007; 29:4726.
  • 42
    Gordon JA, Tancredi DN, Binder WD, Wilkerson WM, Shaffer DW. Assessment of a clinical performance evaluation tool for use in a simulator-based testing environment: a pilot study. Acad Med. 2003; 78(10 Suppl):S457.
  • 43
    Brett-Fleegler MB, Vinci RJ, Weiner DL, Harris SK, Shih MC, Kleinman ME. A simulator-based tool that assesses pediatric resident resuscitation competency. Pediatrics. 2008; 121:e597603.
  • 44
    Donoghue A, Nishisaki A, Sutton R, Hales R, Boulet J. Reliability and validity of a scoring instrument for clinical performance during Pediatric Advanced Life Support simulation scenarios. Resuscitation. 2010; 81:3316.
  • 45
    Wayne DB, Butter J, Siddall VJ, et al. Simulation-based training of internal medicine residents in advanced cardiac life support protocols: a randomized trial. Teach Learn Med. 2005; 17:2106.
  • 46
    Opar SP, Short MW, Jorgensen JE, Blankenship RB, Roth BJ. Acute coronary syndrome and cardiac arrest: using simulation to assess resident performance and program outcomes. J Grad Med Educ. 2010; 2:4049.
  • 47
    Ericsson KA. Deliberate practice and acquisition of expert performance: a general overview. Acad Emerg Med. 2008; 15:98894.
  • 48
    Noeller TP, Smith MD, Holmes L, et al. A theme-based hybrid simulation model to train and evaluate emergency medicine residents. Acad Emerg Med. 2008; 15:1199206.
  • 49
    Kirkpatrick D, ed. Evaluation of Training. New York, NY: McGraw-Hill, 1967.
  • 50
    Wayne DB, Didwania A, Feinglass J, Fudala MJ, Barsuk JH, McGaghie WC. Simulation-based education improves quality of care during cardiac arrest team responses at an academic teaching hospital: a case-control study. Chest. 2008; 133:5661.
  • 51
    Mayo PH, Hackney JE, Mueck JT, Ribaudo V, Schneider RF. Achieving house staff competence in emergency airway management: results of a teaching program using a computerized patient simulator. Crit Care Med. 2004; 32:24227.
  • 52
    Rosenthal ME, Adachi M, Ribaudo V, Mueck JT, Schneider RF, Mayo PH. Achieving housestaff competence in emergency airway management using scenario based simulation training: comparison of attending vs housestaff trainers. Chest. 2006; 129:14538.
  • 53
    Shavit I, Keidan I, Hoffmann Y, et al. Enhancing patient safety during pediatric sedation: the impact of simulation-based training of nonanesthesiologists. Arch Pediatr Adolesc Med. 2007; 161:7403.
  • 54
    Weaver SJ, Salas E, Lyons R, et al. Simulation-based team training at the sharp end: a qualitative study of simulation-based team training design, implementation, and evaluation in healthcare. J Emerg Trauma Shock. 2010; 3:36977.
  • 55
    Shapiro MJ, Morey JC, Small SD, et al. Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum? Qual Saf Health Care. 2004; 13:41721.
  • 56
    Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: the University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med. 2006; 34:216774.
  • 57
    Kim J, Neilipovitz D, Cardinal P, Chiu M. A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as “CRM simulator study IB”). Simul Healthc. 2009; 4:616.
  • 58
    Williams JB, McDonough MA, Hilliard MW, Williams AL, Cuniowski PC, Gonzalez MG. Intermethod reliability of real-time versus delayed videotaped evaluation of a high-fidelity medical simulation septic shock scenario. Acad Emerg Med. 2009; 16:88793.
  • 59
    Gogalniceanu P, Sheena Y, Kashef E, Purkayastha S, Darzi A, Paraskeva P. Is basic emergency ultrasound training feasible as part of standard undergraduate medical education? J Surg Educ. 2010; 67:1526.
  • 60
    Hayes OW, Reisdorff EJ, Walker GL, Carlson DJ, Reinoehl B. Using standardized oral examinations to evaluate general competencies. Acad Emerg Med. 2002; 9:13347.
  • 61
    Quest TE, Otsuki JA, Banja J, Ratcliff JJ, Heron SL, Kaslow NJ. The use of standardized patients within a procedural competency model to teach death disclosure. Acad Emerg Med. 2002; 9:132633.
  • 62
    Heron SL, Hassani DM, Houry D, Quest T, Ander DS. Standardized patients to teach medical students about intimate partner violence. West J Emerg Med. 2010; 11:5005.
  • 63
    Wong I, Jayatilleke T, Kendall R, Atkinson P. Feasibility of a focused ultrasound training programme for medical undergraduate students. Clin Teach. 2011; 8:37.
  • 64
    Ruesseler M, Weinlich M, Byhahn C, et al. Increased authenticity in practical assessment using emergency case OSCE stations. Adv Health Sci Educ Theory Pract. 2010; 15:8195.
  • 65
    Bianchi L, Gallagher EJ, Korte R, Ham HP. Interexaminer agreement on the American Board of Emergency Medicine oral certification examination. Ann Emerg Med. 2003; 41:85964.
  • 66
    McNiel DE, Hung EK, Cramer RJ, Hall SE, Binder RL. An approach to evaluating competence in assessing and managing violence risk. Psychiatr Serv. 2011; 62:902.
  • 67
    Davis D, Lee G. The use of standardized patients in the plastic surgery residency curriculum: teaching core competencies with objective structured clinical examinations. Plast Reconstr Surg. 2011; 128:2918.
  • 68
    Franzese CB. Pilot study of an Objective Structured Clinical Examination (“the Six Pack”) for evaluating clinical competencies. Otolaryngol Head Neck Surg. 2008; 138:1438.
  • 69
    Hawkins R, MacKrell Gaglione M, LaDuca T, et al. Assessment of patient management skills and clinical skills of practising doctors using computer-based case simulations and standardised patients. Med Educ. 2004; 38:95868.
  • 70
    Ozuah PO, Reznik M. Using unannounced standardized patients to assess residents’ competency in asthma severity classification. Ambul Pediatr. 2008; 8:13942.
  • 71
    Short MW, Jorgensen JE, Edwards JA, Blankenship RB, Roth BJ. Assessing intern core competencies with an objective structured clinical examination. J Grad Med Educ. 2009; 1:306.
  • 72
    Jefferies A, Simmons B, Tabak D, et al. Using an objective structured clinical examination (OSCE) to assess multiple physician competencies in postgraduate training. Med Teach. 2007; 29:18391.
  • 73
    Wallenstein J, Heron S, Santen S, Shayne P, Ander D. A core competency-based objective structured clinical examination (OSCE) can predict future resident performance. Acad Emerg Med. 2010; 17(Suppl 2):S6771.
  • 74
    Maker VK, Bonne S. Novel hybrid objective structured assessment of technical skills/objective structured clinical examinations in comprehensive perioperative breast care: a three-year analysis of outcomes. J Surg Educ. 2009; 66:34451.
  • 75
    Brown DJ, Thompson RE, Bhatti NI. Assessment of operative competency in otolaryngology residency: survey of U.S. program directors. Laryngoscope. 2008; 118:17614.
  • 76
    Wang E. Global assessment tool for emergency medicine-specific core competency evaluation [letter]. Acad Emerg Med. 2004; 11:1370.
  • 77
    Herbers JE Jr, Noel GL, Cooper GS, Harvey J, Pangaro LN, Weaver MJ. How accurate are faculty evaluations of clinical competence? J Gen Intern Med. 1989; 4:2028.
  • 78
    Baker K. Determining resident clinical performance: getting beyond the noise. Anesthesiology. 2011; 115:86278.
  • 79
    Durning SJ, Pangaro LN, Lawrence LL, Waechter D, McManigle J, Jackson JL. The feasibility, reliability, and validity of a program director's (supervisor's) evaluation form for medical school graduates. Acad Med. 2005; 80:9648.
  • 80
    Ander DS, Wallenstein J, Abramson JL, Click L, Shayne P. Reporter-interpreter-manager-educator (RIME) descriptive ratings as an evaluation tool in an emergency medicine clerkship. J Emerg Med. 2011; 43:7207.
  • 81
    Rodgers KG, Manifold C. 360-degree feedback: possibilities for assessment of the ACGME core competencies for emergency medicine residents. Acad Emerg Med. 2002; 9:13004.
  • 82
    Tintinalli JE. Evaluation of emergency medicine residents by nurses. Acad Med. 1989; 64:4950.
  • 83
    Wenrich MD, Carline JD, Giles LM, Ramsey PG. Ratings of the performances of practicing internists by hospital-based registered nurses. Acad Med. 1993; 68:6807.
  • 84
    Matthews DA, Sledge WH, Lieberman PB. Evaluation of intern performance by medical inpatients. Am J Med. 1987; 83:93844.
  • 85
    Matthews DA, Feinstein AR. A new instrument for patients’ ratings of physician performance in the hospital setting. J Gen Intern Med. 1989; 4:1422.
  • 86
    Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. JAMA. 1993; 269:165560.
  • 87
    Overeem K, Wollersheim H, Driessen E, et al. Doctors’ perceptions of why 360-degree feedback does (not) work: a qualitative study. Med Educ. 2009; 43:87482.
  • 88
    Boutin-Foster C, Charlson ME. Problematic resident-patient relationships: the patient’s perspective. J Gen Intern Med. 2001; 16:7504.
  • 89
    Johnson G, Booth J, Crossley J, Wade W. Assessing trainees in the workplace: results of a pilot study. Clin Med. 2011; 11:4853.
  • 90
    Webb TP, Merkley TR. An evaluation of the success of a surgical resident learning portfolio. J Surg Educ. 2012; 69:17.
  • 91
    O'Sullivan P, Greene C. Portfolios: possibilities for addressing emergency medicine resident competencies. Acad Emerg Med. 2002; 9:13059.
  • 92
    O'Sullivan PS, Reckase MD, McClain T, Savidge MA, Clardy JA. Demonstration of portfolios to assess competency of residents. Adv Health Sci Educ Theory Pract. 2004; 9:30923.
  • 93
    Buckley S, Coleman J, Davison I, et al. The educational effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teach. 2009; 31:28298.
  • 94
    Learman LA, Autry AM, O'Sullivan P. Reliability and validity of reflection exercises for obstetrics and gynecology residents. Am J Obstet Gynecol. 2008; 198:461.
  • 95
    Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006; 296:1094102.
  • 96
    Lipsett PA, Harris I, Downing S. Resident self-other assessor agreement: influence of assessor, competency, and performance level. Arch Surg. 2011; 146:9016.
  • 97
    Weller JM, Robinson BJ, Jolly B, et al. Psychometric characteristics of simulation-based assessment in anaesthesia and accuracy of self-assessed scores. Anaesthesia. 2005; 60:24550.
  • 98
    Brennan DF, Silvestri S, Sun JY, Papa L. Progression of emergency medicine resident productivity. Acad Emerg Med. 2007; 14:7904.
  • 99
    Ledrick D, Fisher S, Thompson J, Sniadanko M. An assessment of emergency medicine residents’ ability to perform in a multitasking environment. Acad Med. 2009; 84:128994.
  • 100
    Promes SB, Chudgar SM, Grochowski CO, et al. Gaps in procedural experience and competency in medical school graduates. Acad Emerg Med. 2009; 16(Suppl 2):S5862.
  • 101
    Overly FL, Sudikoff SN, Shapiro MJ. High-fidelity medical simulation as an assessment tool for pediatric residents’ airway management skills. Pediatr Emerg Care. 2007; 23:115.
  • 102
    Al-Eissa M, Chu S, Lynch T, et al. Self-reported experience and competence in core procedures among Canadian pediatric emergency medicine fellowship trainees. CJEM. 2008; 10:5338.
  • 103
    Jensen ML, Hesselfeldt R, Rasmussen MB, et al. Newly graduated doctors’ competence in managing cardiopulmonary arrests assessed using a standardized Advanced Life Support (ALS) assessment. Resuscitation. 2008; 77:638.
  • 104
    Ball CG, Lord J, Laupland KB, et al. Chest tube complications: how well are we training our residents? Can J Surg. 2007; 50:4508.
  • 105
    Cherry MG, Brown JM, Neal T, Ben Shaw N. What features of educational interventions lead to competence in aseptic insertion and maintenance of CV catheters in acute care? BEME Guide No. 15. Med Teach. 2010; 32:198218.
  • 106
    Friedman Z, Katznelson R, Devito I, Siddiqui M, Chan V. Objective assessment of manual skills and proficiency in performing epidural anesthesia–video-assisted validation. Reg Anesth Pain Med. 2006; 31:30410.
  • 107
    Laeeq K, Bhatti NI, Carey JP, et al. Pilot testing of an assessment tool for competency in mastoidectomy. Laryngoscope. 2009; 119:240210.
  • 108
    Laeeq K, Infusino S, Lin SY, Reh DD, Ishii M, Kim J, et al. Video-based assessment of operative competency in endoscopic sinus surgery. Am J Rhinol Allergy. 2010; 24:2347.
  • 109
    Chapman DM, Rhee KJ, Marx JA, et al. Open thoracotomy procedural competency: validity study of teaching and assessment modalities. Ann Emerg Med. 1996; 28:6417.
  • 110
    Black SA, Nestel DF, Kneebone RL, Wolfe JH. Assessment of surgical competence at carotid endarterectomy under local anaesthesia in a simulated operating theatre. Br J Surg. 2010; 97:5116.
  • 111
    Ander DS, Hanson A, Pitts S. Assessing resident skills in the use of rescue airway devices. Ann Emerg Med. 2004; 44:3149.
  • 112
    Binstadt E, Donner S, Nelson J, Flottemesch T, Hegarty C. Simulator training improves fiber-optic intubation proficiency among emergency medicine residents. Acad Emerg Med. 2008; 15:12114.
  • 113
    Ishman SL, Brown DJ, Boss EF, et al. Development and pilot testing of an operative competency assessment tool for pediatric direct laryngoscopy and rigid bronchoscopy. Laryngoscope. 2010; 120:2294300.
  • 114
    Langhan TS, Rigby IJ, Walker IW, Howes D, Donnon T, Lord JA. Simulation-based training in critical resuscitation procedures improves residents’ competence. CJEM. 2009; 11:5359.
  • 115
    Zheng B, Hur HC, Johnson S, Swanstrom LL. Validity of using Fundamentals of Laparoscopic Surgery (FLS) program to assess laparoscopic competence for gynecologists. Surg Endosc. 2010; 24:15260.
  • 116
    Lim TO, Soraya A, Ding LM, Morad Z. Assessing doctors’ competence: application of CUSUM technique in monitoring doctors’ performance. Int J Qual Health Care. 2002; 14:2518.
  • 117
    McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med. 2011; 86:70611.
  • 118
    Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB. Use of simulation-based education to reduce catheter-related bloodstream infections. Arch Intern Med. 2009; 169:14203.
  • 119
    Barsuk JH, McGaghie WC, Cohen ER, O'Leary KJ, Wayne DB. Simulation-based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit. Crit Care Med. 2009; 37:2697701.
  • 120
    Abramoff MD, Folk JC, Lee AG, Beaver HA, Boldt HC. Teaching and assessing competency in retinal lasers in ophthalmology residency. Ophthalmic Surg Lasers Imag. 2008; 39:27080.
  • 121
    Evans LV, Morse JL, Hamann CJ, Osborne M, Lin Z, D'Onofrio G. The development of an independent rater system to assess residents’ competence in invasive procedures. Acad Med. 2009; 84:113543.
  • 122
    Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. Shifting paradigms: from Flexner to competencies. Acad Med. 2002; 77:3617.