The full text of this article hosted at iucr.org is unavailable due to technical difficulties.

Special Issue Article

Recommendations for Increasing Replicability in Psychology*

Jens B. Asendorpf

Corresponding Author

Department of Psychology, Humboldt University Berlin, Berlin, Germany

Correspondence to: Jens B. Asendorpf, Department of Psychology, Humboldt University, Unter den Linden 6, 10099 Berlin, Germany.E‐mail: E-mail address:jens.asendorpf@online.de
Search for more papers by this author
Mark Conner

Institute of Psychological Sciences, University of Leeds, Leeds, UK

Search for more papers by this author
Filip De Fruyt

Department of Developmental, Personality and Social Psychology, Ghent University, Ghent, Belgium

Search for more papers by this author
Jan De Houwer

Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium

Search for more papers by this author
Jaap J. A. Denissen

School of Social and Behavioral Sciences, Tilburg University, Tilburg, The Netherlands

Search for more papers by this author
Klaus Fiedler

Department of Psychology, University of Heidelberg, Heidelberg, Germany

Search for more papers by this author
Susann Fiedler

Max Planck Institute for Research on Collective Goods, Bonn, Germany

Search for more papers by this author
David C. Funder

Department of Psychology, University of California at Riverside, Riverside, CA, USA

Search for more papers by this author
Reinhold Kliegl

Department of Psychology, University of Potsdam, Potsdam, Germany

Search for more papers by this author
Brian A. Nosek

Department of Psychology, University of Virginia, Charlottesville, VA, USA

Search for more papers by this author
Marco Perugini

Department of Psychology, University of Milano‐Bicocca, Milan, Italy

Search for more papers by this author
Brent W. Roberts

Department of Psychology, University of Illinois, Chicago, IL, USA

Search for more papers by this author
Manfred Schmitt

Department of Psychology, University of Koblenz–Landau, Landau, Germany

Search for more papers by this author
Marcel A. G. van Aken

Department of Psychology, Utrecht University, Utrecht, The Netherlands

Search for more papers by this author
Hannelore Weber

Department of Psychology, University of Greifswald, Greifswald, Germany

Search for more papers by this author
Jelte M. Wicherts

School of Social and Behavioral Sciences, Tilburg University, Tilburg, The Netherlands

Search for more papers by this author
First published: 18 April 2013
Cited by: 220
*

This target paper is the result of an Expert Meeting on ‘Reducing non‐replicable findings in personality research’ in Trieste, Italy, July 14–16, 2012, financed by the European Association of Personality Psychology (EAPP) in the recognition of the current debate on insufficient replicability in psychology and medicine. The participants of this Expert Meeting served as authors of the current article (the organizer of the meeting as the first author) or as its editor.

Abstract

Replicability of findings is at the heart of any empirical science. The aim of this article is to move the current replicability debate in psychology towards concrete recommendations for improvement. We focus on research practices but also offer guidelines for reviewers, editors, journal management, teachers, granting institutions, and university promotion committees, highlighting some of the emerging and existing practical solutions that can facilitate implementation of these recommendations. The challenges for improving replicability in psychological science are systemic. Improvement can occur only if changes are made at many levels of practice, evaluation, and reward. Copyright © 2013 John Wiley & Sons, Ltd.

Number of times cited: 220

  • , The neuroscience of persuasion: A review with an emphasis on issues and opportunities, Social Neuroscience, 13, 2, (129), (2018).
  • , Introduction to the special issue – A replication project in personality psychology, Journal of Research in Personality, 72, (1), (2018).
  • , Benefits of Repeated Book Readings in Children With SLI, Communication Disorders Quarterly, 39, 2, (367), (2018).
  • , Accommodation, prediction and replication: model selection in scale construction, Synthese, (2018).
  • , Negative results in computer vision: A perspective, Image and Vision Computing, 69, (1), (2018).
  • , Open Sharing of Data on Close Relationships and Other Sensitive Social Psychological Topics: Challenges, Tools, and Future Directions, Advances in Methods and Practices in Psychological Science, (251524591774428), (2018).
  • , Reproducibility and replicability of rodent phenotyping in preclinical studies, Neuroscience & Biobehavioral Reviews, (2018).
  • , Psychology's Renaissance, Annual Review of Psychology, 69, 1, (511), (2018).
  • , Open science in sport and exercise psychology: Review of current approaches and considerations for qualitative inquiry, Psychology of Sport and Exercise, 36, (17), (2018).
  • , Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis, Annual Review of Psychology, 69, 1, (487), (2018).
  • , Random responses inflate statistical estimates in heavily skewed addictions data, Drug and Alcohol Dependence, 183, (102), (2018).
  • , Association between attention bias to threat and anxiety symptoms in children and adolescents, Depression and Anxiety, 35, 3, (229-238), (2017).
  • , A factor analytical investigation of the Japanese translation of the Cheek-Buss Shyness Scale in support of the three-component model of shyness, Personality and Individual Differences, 124, (160), (2018).
  • , In Defense of the Questionable: Defining the Basis of Research Scientists’ Engagement in Questionable Research Practices, Journal of Empirical Research on Human Research Ethics, 13, 1, (101), (2018).
  • , Associations Between Delay Discounting and Risk‐Related Behaviors, Traits, Attitudes, and Outcomes, Journal of Behavioral Decision Making, 30, 3, (769-781), (2016).
  • , You're Hired! Mortality Salience Increases Americans’ Support for Donald Trump, Analyses of Social Issues and Public Policy, 17, 1, (339-357), (2017).
  • , An introduction to Bayesian statistics in health psychology, Health Psychology Review, 11, 3, (248), (2017).
  • , New Issues for New Methods: Ethical and Editorial Challenges for an Experimental Philosophy, Science and Engineering Ethics, 23, 4, (1009), (2017).
  • , Meanings for Sex and Commitment Among First Semester College Men and Women: A Mixed-Methods Analysis, Archives of Sexual Behavior, 46, 6, (1831), (2017).
  • , Reading the Mind or Only the Story? Sharing Fiction to Develop ToM With Deaf Children, Communication Disorders Quarterly, (152574011774117), (2017).
  • , Using independent covariates in experimental designs: Quantifying the trade-off between power boost and Type I error inflation, Journal of Experimental Social Psychology, 72, (118), (2017).
  • , Human Subject Research for Engineers, (41)
  • , Compensatory Conscientiousness Redux, Social Psychological and Personality Science, 8, 1, (29), (2017).
  • , It’s Time to Broaden the Replicability Conversation: Thoughts for and From Clinical Psychological Science, Perspectives on Psychological Science, 12, 5, (742), (2017).
  • , The GRoLTS-Checklist: Guidelines for Reporting on Latent Trajectory Studies, Structural Equation Modeling: A Multidisciplinary Journal, 24, 3, (451), (2017).
  • , The influence of journal submission guidelines on authors' reporting of statistics and use of open research practices, PLOS ONE, 12, 4, (e0175583), (2017).
  • , The Weak Spots in Contemporary Science (and How to Fix Them), Animals, 7, 12, (90), (2017).
  • , Analyzing crowdsourced ratings of speech-based take-over requests for automated driving, Applied Ergonomics, 64, (56), (2017).
  • , Up and down regulation of a highly automatic process: Implementation intentions can both increase and decrease social projection, Journal of Experimental Social Psychology, 70, (19), (2017).
  • , Probing Birth-Order Effects on Narrow Traits Using Specification-Curve Analysis, Psychological Science, 28, 12, (1821), (2017).
  • , False positives and other statistical errors in standard analyses of eye movements in reading, Journal of Memory and Language, 94, (119), (2017).
  • , When “We” or “They” exclude others: attributing and evaluating ostracism observed in in-groups and out-groups, Comprehensive Results in Social Psychology, 2, 2-3, (143), (2017).
  • , Personality, Psychopathology, and Psychotherapy: A Pre-specified Analysis Protocol for Confirmatory Research on Personality–Psychopathology Associations in Psychotherapy Outpatients, Frontiers in Psychiatry, 8, (2017).
  • , The Hazard of Teetering at the Top and Being Tied to the Bottom: The Interactive Relationship of Power, Stability, and Social Dominance Orientation with Work Stress, Applied Psychology, 66, 4, (653-673), (2017).
  • , Editorial, European Journal of Personality, 31, 1, (3-7), (2017).
  • , Temporal Doppler Effect and Future Orientation: Adaptive Function and Moderating Conditions, Journal of Personality, 85, 3, (313-325), (2016).
  • , College Student Samples Are Not Always Equivalent: The Magnitude of Personality Differences Across Colleges and Universities, Journal of Personality, 85, 2, (123-135), (2015).
  • , An online paradigm for exploring the self-reference effect, PLOS ONE, 12, 5, (e0176611), (2017).
  • , Revisiting the Compassion Fatigue, Burnout, Compassion Satisfaction, and Resilience Connection Among CISM Responders, SAGE Open, 7, 3, (215824401773085), (2017).
  • , Questionable research practices among italian research psychologists, PLOS ONE, 12, 3, (e0172792), (2017).
  • , Predicting Faculty Integration of Faith and Learning, Christian Higher Education, 16, 3, (172), (2017).
  • , Human Subject Research for Engineers, (67)
  • , Exposure to thin-ideal media affect most, but not all, women: Results from the Perceived Effects of Media Exposure Scale and open-ended responses, Body Image, 23, (188), (2017).
  • , Replicability and Reproducibility in Comparative Psychology, Frontiers in Psychology, 8, (2017).
  • , Questionable science and reproducibility in electrical brain stimulation research, PLOS ONE, 12, 4, (e0175635), (2017).
  • , The Role of Trauma and Stressful Life Events among Individuals at Clinical High Risk for Psychosis: A Review, Frontiers in Psychiatry, 8, (2017).
  • , Cascading effects of attention disengagement and sensory seeking on social symptoms in a community sample of infants at-risk for a future diagnosis of autism spectrum disorder, Developmental Cognitive Neuroscience, 10.1016/j.dcn.2017.08.006, (2017).
  • , The particular need for replication in the quantitative study of SLA: A case study of the mnemonic effect of assonance in collocations, Journal of the European Second Language Association, 1, 1, (126), (2017).
  • , Univariate comparisons given aggregated normative data, The Clinical Neuropsychologist, 31, 6-7, (1155), (2017).
  • , Attitudinal Change Toward Same-Sex Parents: the Effect of the Explanation of the Etiology of the Homosexual Sexual Orientation, Sexuality Research and Social Policy, (2017).
  • , Connections of Grasping and Horizontal Hand Movements with Articulation in Czech Speakers, Frontiers in Psychology, 8, (2017).
  • , The Use of Human Factors to Address Medical Research Replicability Through the Development of Software Based Solution, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61, 1, (597), (2017).
  • , Modification of episodic memories by novel learning: a failed replication study, European Journal of Psychotraumatology, 8, sup1, (1315291), (2017).
  • , The Heuristic Value of p in Inductive Statistical Inference, Frontiers in Psychology, 8, (2017).
  • , Is a local sample internationally representative? Reproducibility of four cognitive tests in family dogs across testing sites and breeds, Animal Cognition, 20, 6, (1019), (2017).
  • , Is Psychology Moving in the Right Direction? An Analysis of the Evidentiary Value Movement, Perspectives on Psychological Science, 12, 4, (690), (2017).
  • , Simulate this! An Introduction to Agent-Based Models and their Power to Improve your Research Practice, International Review of Social Psychology, 30, 1, (149), (2017).
  • , Advanced analytic and statistical methods in health psychology, Health Psychology Review, 11, 3, (217), (2017).
  • , The advantages of partialling perfectionistic strivings and perfectionistic concerns: Critical issues and recommendations, Personality and Individual Differences, 104, (379), (2017).
  • , Generality or Specificity? Examining the Relation between Personality Traits and Mental Health Outcomes Using a Bivariate Bi‐factor Latent Change Model, European Journal of Personality, 30, 5, (467-483), (2016).
  • , Common Ideological Roots of Speciesism and Generalized Ethnic Prejudice: The Social Dominance Human–Animal Relations Model (SD‐HARM), European Journal of Personality, 30, 6, (507-522), (2016).
  • , Being alexithymic: Necessity or convenience. Negative emotionality × avoidant coping interactions and alexithymia, Psychology and Psychotherapy: Theory, Research and Practice, 89, 3, (261-275), (2015).
  • , Explaining Differences in Subjective Well‐Being Across 33 Nations Using Multilevel Models: Universal Personality, Cultural Relativity, and National Income, Journal of Personality, 84, 1, (46-58), (2014).
  • , Effects of Music in Advertising: Three Experiments Replicating Single-Exposure Musical Conditioning of Consumer Choice (Gorn 1982) in an Individual Setting, Journal of Advertising, 45, 1, (53), (2016).
  • , Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking, Frontiers in Psychology, 7, (2016).
  • , Internal conceptual replications do not increase independent replication success, Psychonomic Bulletin & Review, 23, 5, (1631), (2016).
  • , Observations versus assessments of personality: A five-method multi-species study reveals numerous biases in ratings and methodological limitations of standardised assessments, Journal of Research in Personality, 61, (61), (2016).
  • Proceedings of the 16th Koli Calling International Conference on Computing Education Research - Koli Calling '16, (2016).210.1145/2999541.2999554
  • , No Evidence for a Saccadic Range Effect for Visually Guided and Memory-Guided Saccades in Simple Saccade-Targeting Tasks, PLOS ONE, 11, 9, (e0162449), (2016).
  • , Playing with Data—Or How to Discourage Questionable Research Practices and Stimulate Researchers to Do Things Right, Psychometrika, 81, 1, (1), (2016).
  • , Further psychometric properties of the Yale–Brown Obsessive Compulsive Scale — Second Edition, Comprehensive Psychiatry, 66, (96), (2016).
  • , Validation of a French-Language Version of the Spatial Hearing Questionnaire, Cluster Analysis and Comparison with the Speech, Spatial, and Qualities of Hearing Scale, Ear and Hearing, 37, 4, (412), (2016).
  • , Using machine learning to predict outcomes in psychosis, The Lancet Psychiatry, 3, 10, (908), (2016).
  • , Validation of the direct and inferential mediation (DIME) model of reading comprehension in grades 7 through 12, Contemporary Educational Psychology, 44-45, (68), (2016).
  • , I still cannot see it – A replication of blind spots in self-perception, Journal of Research in Personality, 60, (1), (2016).
  • , An Assessment of the Magnitude of Effect Sizes, Journal of Leadership & Organizational Studies, 23, 1, (66), (2016).
  • , Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency, PLOS Biology, 14, 5, (e1002456), (2016).
  • , Replication and Extension of the Weight Loss For Life Community-Based Treatment Protocol, Behavioral Medicine, (1), (2016).
  • , Replication of the association between general intelligence and the general factor of personality using the California Child Q-set, Intelligence, 56, (35), (2016).
  • , Optimizing Research Payoff, Perspectives on Psychological Science, 11, 5, (664), (2016).
  • , Blinding Us to the Obvious? The Effect of Statistical Training on the Evaluation of Evidence, Management Science, 62, 6, (1707), (2016).
  • , Introduction, Reproducibility, (1-8), (2016).
  • , Pursuit of rigor in research: Illustration from coopetition literature, Industrial Marketing Management, 57, (12), (2016).
  • , Religious Priming, Personality and Social Psychology Review, 20, 1, (27), (2016).
  • , Paradoxical Effects of Worrisome Thoughts Suppression: the Influence of Depressive Mood, Current Psychology, (2016).
  • , No Evidence of the Ego-Depletion Effect across Task Characteristics and Individual Differences: A Pre-Registered Study, PLOS ONE, 11, 2, (e0147770), (2016).
  • , Students’ Achievement Goals, Learning-Related Emotions and Academic Achievement, Frontiers in Psychology, 7, (2016).
  • , Sources of variability of speech, spatial, and qualities of hearing scale (SSQ) scores in normal-hearing and hearing-impaired populations, International Journal of Audiology, 55, 2, (101), (2016).
  • , Reproducing the Wechsler Intelligence Scale for Children–Fifth Edition, Journal of Psychoeducational Assessment, 34, 4, (404), (2016).
  • , Distributions ofp-values smaller than .05 in psychology: what is going on?, PeerJ, 4, (e1935), (2016).
  • , The Relationship Between Right‐wing Attitudes and Cognitive Style: A Comparison of Self‐report and Behavioural Measures of Rigidity and Intolerance of Ambiguity, European Journal of Personality, 30, 6, (523-531), (2016).
  • , Developmental aspects of fear: Comparing the acquisition and generalization of conditioned fear in children and adults, Developmental Psychobiology, 58, 4, (471-481), (2016).
  • , Recommendations for Replication Research in Special Education, Remedial and Special Education, 37, 4, (244), (2016).
  • , Reconceptualizing replication as a sequence of different studies: A replication typology, Journal of Experimental Social Psychology, 10.1016/j.jesp.2015.09.009, 66, (81-92), (2016).
  • , Consumer Neoteny, Evolutionary Psychology, 14, 3, (147470491666182), (2016).
  • , Introduction to the Special Issue on Methodological Rigor and Replicability, Journal of Experimental Social Psychology, 66, (1), (2016).
  • , The TimeStudio Project: An open source scientific workflow system for the behavioral and brain sciences, Behavior Research Methods, 48, 2, (542), (2016).
  • , What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science, Perspectives on Psychological Science, 11, 4, (539), (2016).
  • , Never let an academic crisis go to waste: Leadership Studies in the wake of journal retractions, Leadership, 12, 4, (383), (2016).
  • , Encyclopedia of Personality and Individual Differences, (1), (2016).
  • , Replication of Special Education Research, Remedial and Special Education, 37, 4, (205), (2016).
  • , The Novel Object and Unusual Name (NOUN) Database: A collection of novel images for use in experimental research, Behavior Research Methods, 48, 4, (1393), (2016).
  • , Footedness Is Associated with Self-reported Sporting Performance and Motor Abilities in the General Population, Frontiers in Psychology, 7, (2016).
  • , How Bayes factors change scientific practice, Journal of Mathematical Psychology, 72, (78), (2016).
  • , Researchers’ Intuitions About Power in Psychological Research, Psychological Science, 27, 8, (1069), (2016).
  • , Development of a cloud-based platform for reproducible science: A case study of an IUCN Red List of Ecosystems Assessment, Ecological Informatics, 36, (221), (2016).
  • , The empirical benefits of conceptual rigor: Systematic articulation of conceptual hypotheses can reduce the risk of non-replicable results (and facilitate novel discoveries too), Journal of Experimental Social Psychology, 66, (107), (2016).
  • , Thinking About Data, Research Methods, and Statistical Analyses: Commentary on Sijtsma’s (2014) “Playing with Data”, Psychometrika, 81, 1, (16), (2016).
  • , Handbuch Bildungsforschung, (1), (2016).
  • , Inferential statistics in Language Teaching Research: A review and ways forward, Language Teaching Research, 20, 6, (741), (2016).
  • , Prediction Interval: What to Expect When You’re Expecting … A Replication, PLOS ONE, 11, 9, (e0162874), (2016).
  • , Misconceptions of the p-value among Chilean and Italian Academic Psychologists, Frontiers in Psychology, 7, (2016).
  • , Boon and bane of being sure: the effect of performance certainty and expectancy on task performance, European Journal of Psychology of Education, 31, 2, (245), (2016).
  • , Increasing Transparency Through a Multiverse Analysis, Perspectives on Psychological Science, 11, 5, (702), (2016).
  • , Trust matters: Seeing how an adult treats another person influences preschoolers' willingness to delay gratification, Developmental Science, 19, 6, (1011), (2016).
  • , Qualitative variations in personality inventories: subjective understandings of items in a personality inventory, Qualitative Research in Psychology, 13, 2, (166), (2016).
  • , Intrinsic and Extrinsic Science, Perspectives on Psychological Science, 11, 6, (893), (2016).
  • , Enhancing predictive accuracy and reproducibility in clinical evaluation research, Journal of Evaluation in Clinical Practice, 22, 6, (829), (2016).
  • , A Heart and A Mind: Self-distancing Facilitates the Association Between Heart Rate Variability, and Wise Reasoning, Frontiers in Behavioral Neuroscience, 10, (2016).
  • , Blinded by the Light: How a Focus on Statistical “Significance” May Causep-Value Misreporting and an Excess ofp-Values Just Below .05 in Communication Science, Communication Methods and Measures, 9, 4, (253), (2015).
  • , Why are heterosexual men (vs. women) particularly prejudiced toward gay men? A social dominance theory explanation, Psychology & Sexuality, 6, 3, (275), (2015).
  • , The Chicago face database: A free stimulus set of faces and norming data, Behavior Research Methods, 47, 4, (1122), (2015).
  • , A surge ofp-values between 0.041 and 0.049 in recent decades (but negative results are increasing rapidly too), PeerJ, 3, (e733), (2015).
  • , When the cat’s away, some mice will play: A basic trait account of dishonest behavior, Journal of Research in Personality, 10.1016/j.jrp.2015.04.003, 57, (72-88), (2015).
  • , QRTEngine: An easy solution for running online reaction time experiments using Qualtrics, Behavior Research Methods, 47, 4, (918), (2015).
  • , Relationships of career adaptabilities with explicit and implicit self-concepts, Journal of Vocational Behavior, 10.1016/j.jvb.2015.05.003, 89, (92-101), (2015).
  • , Message Generalizations That Support Evidence-Based Persuasive Message Design: Specifying the Evidentiary Requirements, Health Communication, 30, 2, (106), (2015).
  • , Reducing the risk of bias in health behaviour change trials: Improving trial design, reporting or bias assessment criteria? A review and case study, Psychology & Health, 30, 1, (8), (2015).
  • , The auditory dynamic attending theory revisited: A closer look at the pitch comparison task, Brain Research, 1626, (198), (2015).
  • , National nostalgia: A group-based emotion that benefits the in-group but hampers intergroup relations, International Journal of Intercultural Relations, 49, (54), (2015).
  • , Small Telescopes, Psychological Science, 26, 5, (559), (2015).
  • , When Relevance Matters, Social Psychology, 46, 1, (4), (2015).
  • , A Powerful Nudge? Presenting Calculable Consequences of Underpowered Research Shifts Incentives Toward Adequately Powered Designs, Social Psychological and Personality Science, 6, 7, (847), (2015).
  • , Replicability of sight word training and phonics training in poor readers: a randomised controlled trial, PeerJ, 3, (e922), (2015).
  • , Risky Tests of Etiological Models in Psychopathology Research: The Need for Meta-Methodology, Psychological Inquiry, 26, 3, (253), (2015).
  • , Questionable Research Practices in Experimental Communication Research: A Systematic Analysis From 1980 to 2013, Communication Methods and Measures, 9, 4, (193), (2015).
  • , A New Replication Norm for Psychology, Collabra, 1, 1, (2015).
  • , Definitely maybe: can unconscious processes perform the same functions as conscious processes?, Frontiers in Psychology, 6, (2015).
  • , Editorial statement: Towards a broad, consequential and trustworthy social psychology, European Journal of Social Psychology, 45, 1, (1-2), (2015).
  • , The Social Consequences of Personality: Six Suggestions for Future Research, European Journal of Personality, 29, 2, (296-307), (2015).
  • , Behavioral Economics: Where Is It Heading?, Psychology, 06, 09, (1114), (2015).
  • , Research Preregistration in Political Science: The Case, Counterarguments, and a Response to Critiques, PS: Political Science & Politics, 48, 03, (425), (2015).
  • , Possible Solution to Publication Bias Through Bayesian Statistics, Including Proper Null Hypothesis Testing, Communication Methods and Measures, 9, 4, (280), (2015).
  • , A Cross-Cultural Perspective on the Preference for Potential Effect: An Individual Participant Data (IPD) Meta-Analysis Approach, PLOS ONE, 10, 3, (e0124170), (2015).
  • , A Large Scale Test of the Effect of Social Class on Prosocial Behavior, PLOS ONE, 10, 7, (e0133193), (2015).
  • , Analyzing small data sets using Bayesian estimation: the case of posttraumatic stress symptoms following mechanical ventilation in burn survivors, European Journal of Psychotraumatology, 6, 1, (25216), (2015).
  • , Tumor promotion by exposure to radiofrequency electromagnetic fields below exposure limits for humans, Biochemical and Biophysical Research Communications, 459, 4, (585), (2015).
  • , Who is open to a narcissistic romantic partner? The roles of sensation seeking, trait anxiety, and similarity, Journal of Research in Personality, 58, (84), (2015).
  • , Replicating Studies in Which Samples of Participants Respond to Samples of Stimuli, Perspectives on Psychological Science, 10, 3, (390), (2015).
  • , Replication, falsification, and the crisis of confidence in social psychology, Frontiers in Psychology, 6, (2015).
  • , A researcher's guide to regression, discretization, and median splits of continuous variables, Journal of Consumer Psychology, 25, 4, (666-678), (2015).
  • , Semantic properties, aptness, familiarity, conventionality, and interpretive diversity scores for 84 metaphors and similes, Behavior Research Methods, 47, 3, (800), (2015).
  • , Lexical Influences on Spoken Spondaic Word Recognition in Hearing-Impaired Patients, Frontiers in Neuroscience, 9, (2015).
  • , Television Commercials and Fading Behavioral Brand Choice Effects in Austrian Children, Journal of Children and Media, 9, 4, (435), (2015).
  • , The subject-relative advantage in Chinese: Evidence for expectation-based processing, Journal of Memory and Language, 79-80, (97), (2015).
  • , Promoting an open research culture, Science, 348, 6242, (1422), (2015).
  • , Psychopathy, narcissism, and borderline personality: A critical test of the affective empathy-impairment hypothesis, Personality and Individual Differences, 86, (257), (2015).
  • , An Introduction to Replication Research in Gifted Education, Gifted Child Quarterly, 59, 3, (157), (2015).
  • , No Effect of Weight on Judgments of Importance in the Moral Domain and Evidence of Publication Bias from a Meta-Analysis, PLOS ONE, 10, 8, (e0134808), (2015).
  • , Teasing apart retrieval and encoding interference in the processing of anaphors, Frontiers in Psychology, 6, (2015).
  • , Predictors in Internet-delivered cognitive behavior therapy and behavioral stress management for severe health anxiety, Behaviour Research and Therapy, 64, (49), (2015).
  • , Gender Profiling, Personality and Social Psychology Bulletin, 41, 6, (853), (2015).
  • , Reproducibility in forecasting research, International Journal of Forecasting, 31, 1, (79), (2015).
  • , Working memory differences in long-distance dependency resolution, Frontiers in Psychology, 6, (2015).
  • , Validation of a French translation of the speech, spatial, and qualities of hearing scale (SSQ) and comparison with other language versions, International Journal of Audiology, 54, 12, (889), (2015).
  • , A Gentle Introduction to Bayesian Analysis: Applications to Developmental Research, Child Development, 85, 3, (842-860), (2013).
  • , Implicit versus explicit measures of self-concept of self-control and their differential predictive power for spontaneous trait-relevant behaviors, Journal of Behavior Therapy and Experimental Psychiatry, 45, 1, (1), (2014).
  • , Using science and psychology to improve the dissemination and evaluation of scientific work, Frontiers in Computational Neuroscience, 8, (2014).
  • , Big secrets do not necessarily cause hills to appear steeper, Psychonomic Bulletin & Review, 21, 3, (696), (2014).
  • , You Cannot Step Into the Same River Twice, Perspectives on Psychological Science, 9, 6, (612), (2014).
  • , Sailing From the Seas of Chaos Into the Corridor of Stability, Perspectives on Psychological Science, 9, 3, (278), (2014).
  • , Priming, Replication, and the Hardest Science, Perspectives on Psychological Science, 9, 1, (40), (2014).
  • , Does “thinking about thinking” interfere with memory? An experimental memory study in obsessive–compulsive disorder, Journal of Anxiety Disorders, 10.1016/j.janxdis.2014.07.009, 28, 7, (679-686), (2014).
  • , Physical Warmth and Perceptual Focus: A Replication of IJzerman and Semin (2009), PLoS ONE, 9, 11, (e112772), (2014).
  • , Lateral preferences for hand clasping and arm folding are associated with handedness in two large-sample latent variable analyses, Laterality: Asymmetries of Body, Brain and Cognition, 19, 5, (602), (2014).
  • , Best Practice Recommendations for Designing and Implementing Experimental Vignette Methodology Studies, Organizational Research Methods, 10.1177/1094428114547952, 17, 4, (351-371), (2014).
  • , The Multicultural Jigsaw Puzzle, Personality and Social Psychology Bulletin, 40, 11, (1480), (2014).
  • , Safeguard Power as a Protection Against Imprecise Power Estimates, Perspectives on Psychological Science, 9, 3, (319), (2014).
  • , Prime Numbers: Anchoring and its Implications for Theories of Behavior Priming, Social Cognition, 32, Supplement, (88), (2014).
  • , Estimating the Expected Replicability of a Pattern of Correlations and Other Measures of Association, Multivariate Behavioral Research, 49, 1, (17), (2014).
  • , Replication of Experiments Evaluating Impact of Psychological Distance on Moral Judgment, Social Psychology, 45, 3, (223), (2014).
  • , Evidence for general right-, mixed-, and left-sidedness in self-reported handedness, footedness, eyedness, and earedness, and a primacy of footedness in a large-sample latent variable analysis, Neuropsychologia, 62, (220), (2014).
  • , Latent variable analysis indicates that seasonal anisotropy accounts for the higher prevalence of left-handedness in men, Cortex, 57, (188), (2014).
  • , Editorial, Quarterly Journal of Experimental Psychology, 67, 1, (1), (2014).
  • , Evidence‐based vegetation management: prospects and challenges, Applied Vegetation Science, 17, 3, (604-608), (2014).
  • , Personality‐Relationship Transactions Revisited, Journal of Personality, 82, 6, (539-550), (2013).
  • , The Replication Recipe: What makes for a convincing replication?, Journal of Experimental Social Psychology, 50, (217), (2014).
  • , Breakthrough or One-Hit Wonder?, Social Psychology, 45, 3, (179), (2014).
  • , What Lies Within, Perspectives on Psychological Science, 9, 6, (682), (2014).
  • , Why Publishing Everything Is More Effective than Selective Publishing of Statistically Significant Results, PLoS ONE, 9, 1, (e84896), (2014).
  • , A Duty to Describe, Perspectives on Psychological Science, 9, 6, (626), (2014).
  • , It is not just memory: Propositional thinking influences performance on the autobiographical IAT, Drug and Alcohol Dependence, 10.1016/j.drugalcdep.2014.10.008, 145, (150-155), (2014).
  • , Humanist Interpretation Versus Coding Text Samples, Qualitative Sociology, 37, 2, (173), (2014).
  • , Replicability and Models of Priming: What a Resource Computation Framework can Tell us About Expectations of Replicability, Social Cognition, 32, Supplement, (124), (2014).
  • , Pathological publishing: A new psychological disorder with legal consequences?, The European Journal of Psychology Applied to Legal Context, 10.1016/j.ejpal.2014.06.005, 6, 2, (91-97), (2014).
  • , Replication to Advance Science, Anesthesiology, 121, 2, (209), (2014).
  • , Wer kommt weiter? Vorhersage der Qualifikation zur Internationalen Biologie- und Chemie-Olympiade auf Grundlage des Leistungsmotivations-Modells von Eccles, Zeitschrift für Pädagogische Psychologie, 28, 3, (105), (2014).
  • , An open investigation of the reproducibility of cancer biology research, eLife, 3, (2014).
  • , Openness to Experience, Honesty–Humility and ideological attitudes: A fine-grained analysis, Personality and Individual Differences, 59, (116), (2014).
  • , Improving the Dependability of Research in Personality and Social Psychology, Personality and Social Psychology Review, 18, 1, (3), (2014).
  • , Expectations for Replications, Perspectives on Psychological Science, 9, 3, (305), (2014).
  • , Psychometric properties of the Brunel Mood Scale in Chinese adolescents and adults, Journal of Sports Sciences, (1), (2014).
  • , Outlier Removal and the Relation with Reporting Errors and Quality of Psychological Research, PLoS ONE, 9, 7, (e103360), (2014).
  • , Love withdrawal predicts electrocortical responses to emotional faces with performance feedback: a follow-up and extension, BMC Neuroscience, 15, 1, (68), (2014).
  • , Does Cleanliness Influence Moral Judgments?, Social Psychology, 45, 3, (209), (2014).
  • , Conflict resolution in sentence processing is the same for bilinguals and monolinguals: The role of confirmation bias in testing for bilingual advantages, Journal of Neurolinguistics, 27, 1, (50), (2014).
  • , The Value of Direct Replication, Perspectives on Psychological Science, 9, 1, (76), (2014).
  • , The Use of Google Trends in Health Care Research: A Systematic Review, PLoS ONE, 9, 10, (e109583), (2014).
  • , Playing off the curve - testing quantitative predictions of skill acquisition theories in development of chess performance, Frontiers in Psychology, 5, (2014).
  • , Replication in music psychology, Musicae Scientiae, 17, 3, (265), (2013).
  • , PsychDisclosure.org, Perspectives on Psychological Science, 8, 4, (424), (2013).
  • , Why Selective Publication of Statistically Significant Results Can Be Effective, PLoS ONE, 8, 6, (e66463), (2013).
  • , Personality and perceptions of situations from the Thematic Apperception Test, Journal of Research in Personality, 47, 6, (708), (2013).
  • , ScriptingRT: A Software Library for Collecting Response Latencies in Online Studies of Cognition, PLoS ONE, 8, 6, (e67769), (2013).
  • , The doping mindset – Part II: Potentials and pitfalls in capturing athletes’ doping attitudes with response-time methodology, Performance Enhancement & Health, 2, 4, (164), (2013).
  • , Science revolves around the data, Journal of Open Psychology Data, 1, 1, (e1), (2013).
  • , Behavioral Priming 2.0: Enter a Dynamical Systems Perspective, Frontiers in Psychology, 10.3389/fpsyg.2017.01204, 8, (2017).
  • , Associations between informant ratings of personality disorder traits, self‐reports of personality, and directly observed behavior, Journal of Personality, , (2018).
  • , The Subtle Influence of Check and X Marks: How Symbolic Markings Influence Judgment, Journal of Consumer Psychology, , (2018).
  • , Revisiting the rigor–relevance relationship: An institutional logics perspective, Human Resource Management, , (2018).