A Bayesian model that predicts the impact of Web searching on decision making
Abstract
This study aimed to develop a model for predicting the impact of information access using Web searches, on human decision making. Models were constructed using a database of search behaviors and decisions of 75 clinicians, who answered questions about eight scenarios within 80 minutes in a controlled setting at a university computer laboratory. Bayesian models were developed with and without bias factors to account for anchoring, primacy, recency, exposure, and reinforcement decision biases. Prior probabilities were estimated from the population prior, from a personal prior calculated from presearch answers and confidence ratings provided by the participants, from an overall measure of willingness to switch belief before and after searching, and from a willingness to switch belief calculated in each individual scenario. The optimal Bayes model predicted user answers in 73.3% (95% CI: 68.71 to 77.35%) of cases, and incorporated participants' willingness to switch belief before and after searching for each scenario, as well as the decision biases they encounter during the search journey. In most cases, it is possible to predict the impact of a sequence of documents retrieved by a Web search engine on a decision task without reference to the content or structure of the documents, but relying solely on a simple Bayesian model of belief revision.
Number of times cited: 11
- Ramona Ludolph, Ahmed Allam and Peter J Schulz, Manipulating Google’s Knowledge Graph Box to Counter Biased Information Processing During an Online Search on Vaccination: Application of a Technological Debiasing Strategy, Journal of Medical Internet Research, 18, 6, (e137), (2016).
- Xujuan Zhou, Ying Wang, Guy Tsafnat, Enrico Coiera, Florence T. Bourgeois and Adam G. Dunn, Citations alone were enough to predict favorable conclusions in reviews of neuraminidase inhibitors, Journal of Clinical Epidemiology, 68, 1, (87), (2015).
- Adam G Dunn, Enrico Coiera and Kenneth D Mandl, Is Biblioleaks Inevitable?, Journal of Medical Internet Research, 16, 4, (e112), (2014).
- Varol Onur Kayhan, Seeking health information on the web: Positive hypothesis testing, International Journal of Medical Informatics, 82, 4, (268), (2013).
- Albert H. Huang, David C. Yen and Shin-Yuan Hung, Research issues of Internet-integrated cognitive style, Computers in Human Behavior, 28, 5, (1547), (2012).
- A. Y .S. Lau, T. M. Y. Kwok and E. Coiera, How Online Crowds Influence the Way Individual Consumers Answer Health Questions, Applied Clinical Informatics, 2, 2, (177), (2011).
- Annie YS Lau, Enrico Coiera, Tatjana Zrimec and Paul Compton, Clinician Search Behaviors May Be Influenced by Search Engine Design, Journal of Medical Internet Research, 12, 2, (e25), (2010).
- A. Y. S. Lau and E. W. Coiera, Can Cognitive Biases during Consumer Health Information Searches Be Reduced to Improve Decision Making?, Journal of the American Medical Informatics Association, 16, 1, (54), (2009).
- E. W. Coiera and V. Vickland, Is Relevance Relevant? User Relevance Ratings May Not Predict the Impact of Internet Search on Decision Outcomes, Journal of the American Medical Informatics Association, 15, 4, (542), (2008).
- A. Y. S. Lau and E. W. Coiera, Do People Experience Cognitive Biases while Searching for Information?, Journal of the American Medical Informatics Association, 14, 5, (599), (2007).
- Jeffrey M. Keisler and Wei Zhang, Enhancing Decision Analysis Models with Web-agents, Journal of Decision Systems, 15, 4, (453), (2006).
