Inquisitio validus Index Medicus: A simple method of validating MEDLINE systematic review searches
Version of Record online: 16 SEP 2011
Copyright © 2011 John Wiley & Sons, Ltd.
Research Synthesis Methods
Volume 2, Issue 2, pages 103–109, June 2011
How to Cite
Sampson, M. and McGowan, J. (2011), Inquisitio validus Index Medicus: A simple method of validating MEDLINE systematic review searches. Res. Synth. Method, 2: 103–109. doi: 10.1002/jrsm.40
- Issue online: 29 SEP 2011
- Version of Record online: 16 SEP 2011
- Manuscript Accepted: 11 AUG 2011
- Manuscript Revised: 9 AUG 2011
- Manuscript Received: 9 JAN 2011
- 290-02-0021. Grant Number: Agency for Healthcare Research and Quality, US Department of Health and Human Services
- Systematic Reviews;
We offer a new method of validation for the effectiveness of MEDLINE searches used in systematic reviews, the Inquisitio Validus Index Medicus. Validation is essential to ensure that relevant studies are not missed by the MEDLINE search strategy.
To demonstrate the validation method, a sample of six updated Cochrane reviews with comprehensive searches was used. The MEDLINE searches of both the original and updated reviews were tested to determine the percent of eligible MEDLINE-indexed studies retrieved by the search (recall).
The validation method was robust and was able to demonstrate that the retrieval of relevant studies from MEDLINE was sub-optimal. The approach to revising searches in our sample appeared unsystematic. Some poorly performing searches were used unchanged in the updates, and of the two amended strategies, one performed worse than the original when tested against studies included in the original, while the other improved recall.
There is a clear need for search validation. Using this validation method can determine whether the search of the main database performs adequately or needs to be revised to improve recall, allowing the searcher an opportunity to improve their search strategy. Validation of the search is recommended for systematic reviews, where the intent is to identify all relevant studies. Copyright © 2011 John Wiley & Sons, Ltd.