Declaration of interest: No conflict of interest is declared by both authors.
A practical educational tool for teaching child-care hospital professionals attending evidence-based practice courses for continuing medical education to appraise internal validity in systematic reviews
Article first published online: 29 JUL 2012
© 2012 John Wiley & Sons Ltd
Journal of Evaluation in Clinical Practice
Special Issue: EBM Thematic Issue
Volume 19, Issue 4, pages 648–652, August 2013
How to Cite
Rosati, P. and Porzsolt, F. (2013), A practical educational tool for teaching child-care hospital professionals attending evidence-based practice courses for continuing medical education to appraise internal validity in systematic reviews. Journal of Evaluation in Clinical Practice, 19: 648–652. doi: 10.1111/j.1365-2753.2012.01889.x
- Issue published online: 28 JUL 2013
- Article first published online: 29 JUL 2012
- Manuscript Accepted: 6 JUN 2012
- continuing medical education;
- evidence-based practice;
- meta-analysis (publication type);
Rationale, aims and objectives
Having a quick, practical, educational tool designed for busy child-care professionals to check whether systematic reviews (SRs) contain valid information would help them regularly update their evidence-based knowledge and apply it to their patients. Continuing our annual workshop courses encouraging paediatric hospital professionals to use evidence-based information, in a preliminary study, we compared the commonly used Critical Appraisal Skill Programme (CASP) questionnaire for appraising overall internal validity in SRs with a new, practical tool designed to check internal validity quickly.
During a course in 2010, two ‘teacher-brokers’ taught experienced paediatric hospital professionals to use and compare the CASP and the new practical tool to appraise a Cochrane SR on beclomethasone for asthma in children by assessing internal validity only from the two most weighted randomized controlled trials in the forest plot. At 15 days and 6 months, participants then answered questionnaires designed to assess qualitative data including feelings about working together, memorization and possibly provide feedback for Cochrane reviewers.
Using the CASP, participants agreed that the Cochrane SR analysed contained overall valid results. Conversely, using the new quick tool, they found poor internal validity. Participants worked well together in a group, took less time to apply the new tool than the CASP (1 vs. 2.5 hours) and provided Cochrane feedback.
Our quick practical tool for teaching critical appraisal encourages busy child-care hospital professionals to work together, carefully check validity in SRs, apply the findings in clinical practice and provide useful feedback for Cochrane reviewers.