Comprehensive computer searches and reporting in systematic reviews
Article first published online: 10 JUN 2011
Copyright © 2011 John Wiley & Sons, Ltd.
Research Synthesis Methods
Volume 2, Issue 1, pages 15–32, March 2011
How to Cite
Fehrmann, P. and Thomas, J. (2011), Comprehensive computer searches and reporting in systematic reviews. Res. Synth. Method, 2: 15–32. doi: 10.1002/jrsm.31
- Issue published online: 27 JUN 2011
- Article first published online: 10 JUN 2011
- Manuscript Accepted: 11 APR 2011
- Manuscript Revised: 11 MAR 2011
- Manuscript Received: 5 MAR 2010
- systematic review;
- computer searches;
Systematic reviews (SR) are a strategic resource for many who may assume that comprehensive computer searches are used to identify the studies that are used in SR. The current study assessed the reports of comprehensive computer searching in SR in psychology. Comprehensive computer search methods listed as basic in SR manuals and publications of major SR organizations (e.g., Cochrane Collaboration) were the “recommended methods” that became items on a checklist used to assess computer search reports. A methodology index search in PsycINFO identified SR in psychology that were compared to SR identified in the Cochrane Database of SR.
Checklist item frequencies supported descriptive analyses, and Mann–Whitney U-test was used to compare the PsycINFO and Cochrane SR. Two recommended computer search methods were significantly more common in Cochrane SR: truncation (z = −5.64, p < .001), controlled vocabulary (z = −5.08, p < .001 ). A third search method (Cited Reference Searching) was virtually absent (SR in psychology: 0/25; and Cochrane SR: 1/25).
Confidence in SR conclusions may be undermined when evidence of recommended or empirically-based search methods is not seen. Results and suggestions might have value for those who use, evaluate, or develop guidelines for SR; research topics are also described. Copyright © 2011 John Wiley & Sons, Ltd.