Volume 57, Issue 1

Behind the Curve: Clarifying the Best Approach to Calculating Predicted Probabilities and Marginal Effects from Limited Dependent Variable Models

First published: 18 July 2012
Citations: 300
Michael J. Hanmer is Associate Professor of Government and Politics, and Research Director at the Center for American Politics and Citizenship, University of Maryland, 3140 Tydings Hall, College Park, MD 20742 (E-mail address: mhanmer@umd.edu). Kerem Ozan Kalkan is Assistant Professor of Political Science and Public Administration, Middle East Technical University, Dumlupinar Bulvari No: 1, Cankaya 06800 Ankara Turkey (E-mail address: okalkan@metu.edu.tr).

Kalkan acknowledges the postdoctoral fellowship in quantitative methods he received from University of Oxford, Department of Politics and International Relations, between 2009 and 2010. For thoughtful and constructive comments on earlier versions of this work, we would like to thank Chris Achen, Mike Alvarez, Dave Armstrong, Brandon Bartels, Dan Biggers, Tom Carsey, Anne Cizmar, Dan Corstange, Sarah Croco, Jill Curry, Jim Curry, Ray Duch, Justin Esarey, Rob Franzese, Bill Greene, Kosuke Imai, Bill Jacoby, Karen Long Jusko, Gary King, Jon Ladd, Eric Lawrence, Geoff Layman, Scott Long, Irwin Morris, Irfan Nooruddin, Bill Reed, John Sides, Jeff Smith, Piotr Swistak, Ric Uslaner, Nick Valentino, and Chris Zorn. For research assistance, we thank Christina Heshmatpour and Ilya Kopysitsky. We also wish to thank the anonymous reviewers and the Editor for their close reading of the article, thoughtful suggestions, and guidance. All errors are our own.

Abstract

Models designed for limited dependent variables are increasingly common in political science. Researchers estimating such models often give little attention to the coefficient estimates and instead focus on marginal effects, predicted probabilities, predicted counts, etc. Since the models are nonlinear, the estimated effects are sensitive to how one generates the predictions. The most common approach involves estimating the effect for the “average case.” But this approach creates a weaker connection between the results and the larger goals of the research enterprise and is thus less preferable than the observed‐value approach. That is, rather than seeking to understand the effect for the average case, the goal is to obtain an estimate of the average effect in the population. In addition to the theoretical argument in favor of the observed‐value approach, we illustrate via an empirical example and Monte Carlo simulations that the two approaches can produce substantively different results.

Number of times cited according to CrossRef: 300

  • Urgent engagement in 9/11 pregnant widows and their infants: Transmission of trauma, Infancy, 10.1111/infa.12323, 25, 2, (165-189), (2020).
  • Aren't we all pursuing societal goals in our businesses? Defining “societal purpose” as pursued by social enterprises, Sustainable Development, 10.1002/sd.2039, 28, 3, (485-494), (2020).
  • Oppositional Strategies Between Cooperation and Conflict: An Analysis of Opposition Party Voting in the German Bundestag, 1949–2013, Continuity and Change of Party Democracies in Europe, 10.1007/978-3-658-28988-1_11, (309-342), (2020).
  • Illegal tobacco demand: The case of Western Balkan, Economic Analysis and Policy, 10.1016/j.eap.2020.04.001, (2020).
  • Forest damage by deer depends on cross‐scale interactions between climate, deer density and landscape structure, Journal of Applied Ecology, 10.1111/1365-2664.13622, 57, 7, (1376-1390), (2020).
  • , Curbing the Court, 10.1017/9781316979754, (2020).
  • ‘Going institutional’ to overcome obstruction: Explaining the suppression of minority rights in Western European parliaments, 1945−2010, European Journal of Political Research, 10.1111/1475-6765.12376, 59, 4, (886-909), (2020).
  • Energy poverty in Spain: an income approach analysis, Energy Sources, Part B: Economics, Planning, and Policy, 10.1080/15567249.2019.1710624, (1-14), (2020).
  • Policy design and public support for carbon tax: Evidence from a 2018 US national online survey experiment, Public Administration, 10.1111/padm.12657, 0, 0, (2020).
  • Advisors to Elites, Journal of Law and Courts, 10.1086/704740, (000-000), (2020).
  • The Impact of Electoral Arrangements on Minority Representation: District Magnitude and the Election of African American State Legislators, Election Law Journal: Rules, Politics, and Policy, 10.1089/elj.2019.0581, (2020).
  • Women, support for sovereignty, and feminism: the case of Quebec, Politics, Groups, and Identities, 10.1080/21565503.2020.1748070, (1-22), (2020).
  • The Structure of Appointment Politics: Consistency or Change?, Legislative Studies Quarterly, 10.1111/lsq.12282, 0, 0, (2020).
  • Policies, profits, networks, or duty?: Donors’ motivations for contributing to parties and interest groups, The Social Science Journal, 10.1080/03623319.2020.1727224, (1-16), (2020).
  • Veto power fosters cooperative behaviour: institutional incentives and government-opposition voting in the German Bundestag, West European Politics, 10.1080/01402382.2020.1739868, (1-25), (2020).
  • Once and Future Peacemakers: Continuity of Third-party Involvement in Civil War Peace Processes, International Peacekeeping, 10.1080/13533312.2020.1768074, (1-27), (2020).
  • Choice, Voice, and Exit: School Vouchers in Milwaukee, Journal of School Choice, 10.1080/15582159.2020.1764185, (1-27), (2020).
  • Do campaign posters trigger voting based on looks? Probing an explanation for why good-looking candidates win more votes, Acta Politica, 10.1057/s41269-020-00159-3, (2020).
  • What’s going on next door? Irregular leader change in neighboring countries, uncertainty, and civil war, Journal of Peace Research, 10.1177/0022343320913092, (002234332091309), (2020).
  • State Dependency and the Limits of Middle Class Support for Democracy, Comparative Political Studies, 10.1177/0010414020938085, (001041402093808), (2020).
  • Rethinking Civilizational Identity from the Bottom Up: A Case Study of Russia and a Research Agenda, Nationalities Papers, 10.1017/nps.2019.125, (1-18), (2020).
  • An extraordinary election? A longitudinal perspective of the Québec 2018 election, French Politics, 10.1057/s41253-020-00120-y, (2020).
  • Rock the Vote or Block the Vote? How the Cost of Voting Affects the Voting Behavior of American Youth, American Politics Research, 10.1177/1532673X20920265, (1532673X2092026), (2020).
  • Desigualdades e Interações de Classe Social na Saúde no Brasil, Dados, 10.1590/001152582020203, 63, 1, (2020).
  • Selection of Cases for Discussion, Journal of Law and Courts, 10.1086/709915, (000-000), (2020).
  • What Are the Consequences of Snap Elections on Citizens’ Voting Behavior?, Representation, 10.1080/00344893.2020.1804440, (1-14), (2020).
  • Ethnic and Gender Hierarchies in the Crucible of War, International Studies Quarterly, 10.1093/isq/sqaa031, (2020).
  • The Influence of Personalized Knowledge at the Supreme Court: How (Some) Former Law Clerks Have the Inside Track, Political Research Quarterly, 10.1177/1065912920948138, (106591292094813), (2020).
  • Demographic Context, Mass Deportation, and Latino Linked Fate, The Journal of Race, Ethnicity, and Politics, 10.1017/rep.2020.24, (1-28), (2020).
  • Taking it personal? Investigating regime personalization as an autocratic survival strategy, Democratization, 10.1080/13510347.2020.1737677, (1-19), (2020).
  • Democratic versus Authoritarian Coups: The Influence of External Actors on States’ Postcoup Political Trajectories, Journal of Conflict Resolution, 10.1177/0022002720935956, (002200272093595), (2020).
  • Have Europeans Grown Tired of Democracy? New Evidence from Eighteen Consolidated Democracies, 1981–2018, British Journal of Political Science, 10.1017/S0007123420000149, (1-13), (2020).
  • Gender Gaps in Equity Crowdfunding: Evidence from a Randomized Field Experiment, Management Science, 10.1287/mnsc.2020.3644, (2020).
  • To Intervene or Not to Intervene? Democratic Constraints on Third-Party Support in Civil Wars, Government and Opposition, 10.1017/gov.2020.19, (1-22), (2020).
  • O Partido dos Trabalhadores e as Instituições Participativas: a Influência da Dinâmica Intrapartidária na Adoção do Orçamento Participativo, Dados, 10.1590/dados.2020.63.3.202, 63, 3, (2020).
  • Bureaucratic Responsiveness to LGBT Americans, American Journal of Political Science, 10.1111/ajps.12493, 64, 3, (664-681), (2019).
  • Signalling issue salience: Explaining niche party support in second-order elections, Electoral Studies, 10.1016/j.electstud.2019.03.002, 60, (102026), (2019).
  • Trends in contraceptive prevalence rates in sub-Saharan Africa since the 2012 London Summit on Family Planning: results from repeated cross-sectional surveys, The Lancet Global Health, 10.1016/S2214-109X(19)30200-1, (2019).
  • Effect of Financial Bonus Size, Loss Aversion, and Increased Social Pressure on Physician Pay-for-Performance, JAMA Network Open, 10.1001/jamanetworkopen.2018.7950, 2, 2, (e187950), (2019).
  • Der Einfluss multipler Parteibindungen auf das Wahlverhalten, Wahrnehmung – Persönlichkeit – Einstellungen, 10.1007/978-3-658-21216-2, (205-234), (2019).
  • Soziale Identifikation vs. running tally: Der Einfluss des politischen Kontextes auf die Ausformung einer Parteiidentifikation, Identität - Identifikation - Ideologie, 10.1007/978-3-658-25604-3, (83-111), (2019).
  • , Who Wants What?, 10.1017/9781108681339, (2019).
  • BayesPostEst: An R Package to Generate Postestimation Quantities for Bayesian MCMC Estimation, Journal of Open Source Software, 10.21105/joss.01722, 4, 42, (1722), (2019).
  • Political Exclusion, Lost Autonomy, and Escalating Conflict over Self-Determination, SSRN Electronic Journal, 10.2139/ssrn.3433666, (2019).
  • Second‐Order Devolution or Local Activism? Local Air Agencies Revisited, Review of Policy Research, 10.1111/ropr.12361, 36, 6, (757-780), (2019).
  • Can We Use Wisdom‐of‐the‐Crowd to Assess Risk of Systems Engineering Failures?, INCOSE International Symposium, 10.1002/j.2334-5837.2019.00624.x, 29, 1, (620-635), (2019).
  • Bonding in Pursuit of Policy Goals: How MPs Choose Political Parties in the Legislative State of Nature, Legislative Studies Quarterly, 10.1111/lsq.12231, 44, 3, (455-486), (2019).
  • The Political Consequences of Nativism: The Impact of Nativist Sentiment on Party Support*, Social Science Quarterly, 10.1111/ssqu.12596, 100, 2, (466-479), (2019).
  • Why Georgia, Why? Peach State Residents’ Perceptions of Voting‐Related Improprieties and Their Impact on the 2018 Gubernatorial Election, Social Science Quarterly, 10.1111/ssqu.12655, 100, 5, (1828-1847), (2019).
  • Different Immigrants, Same Attitudes? Making Sense of the Association Between Two Immigrant Groups, Social Science Quarterly, 10.1111/ssqu.12706, 100, 6, (2369-2390), (2019).
  • Duality in User Entrepreneurs’ Prior Knowledge and Fundraising Performance: Evidence from a Randomized Field Experiment, SSRN Electronic Journal, 10.2139/ssrn.3452366, (2019).
  • Party Identification in an Encapsulated Party System: The Case of Postauthoritarian Chile, Journal of Politics in Latin America, 10.1177/1866802X1801000102, 10, 1, (29-68), (2019).
  • Bias in Self-reported Voting and How it Distorts Turnout Models: Disentangling Nonresponse Bias and Overreporting Among Danish Voters, Political Analysis, 10.1017/pan.2019.9, (1-9), (2019).
  • Palmetto Postmortem: Examining the Effects of the South Carolina Voter Identification Statute, Political Research Quarterly, 10.1177/1065912919837663, (106591291983766), (2019).
  • Different Words, Same Song: Advice for Substantively Interpreting Duration Models, PS: Political Science & Politics, 10.1017/S104909651900060X, (1-5), (2019).
  • Die Etablierung neuer Parlamentsparteien. Wählerpräferenzen als Erfolgsfaktor für die Alternative für Deutschland 2017 und die Grünen 1986Entry of new Parties into Parliament. Voter Preferences as a Precondition for the Success of the AfD in 1987, and the Greens in 1986, Politische Vierteljahresschrift, 10.1007/s11615-019-00150-4, (2019).
  • New political parties through the voters’ eyes, West European Politics, 10.1080/01402382.2019.1603940, (1-27), (2019).
  • Latino Judges on the Federal District Court: ¿Cómo Deciden?, American Politics Research, 10.1177/1532673X19867052, (1532673X1986705), (2019).
  • Acceptable in the EU? Why some immigration restrictionists support European Union mobility, European Union Politics, 10.1177/1465116519839782, (146511651983978), (2019).
  • Pack Your Politics! Assessing the Vote Choice of Latino Interstate Migrants, The Journal of Race, Ethnicity, and Politics, 10.1017/rep.2019.4, (1-36), (2019).
  • Conflict, Peace, and the Evolution of Women's Empowerment, International Organization, 10.1017/S0020818319000055, (1-35), (2019).
  • The Resistance as Role Model: Disillusionment and Protest Among American Adolescents After 2016, Political Behavior, 10.1007/s11109-019-09537-w, (2019).
  • Do Women Favor Foreign Direct Investment?, Politics & Gender, 10.1017/S1743923X18001058, (1-27), (2019).
  • The Partisan and Policy Motivations of Political Donors Seeking Surrogate Representation in House Elections, Political Behavior, 10.1007/s11109-019-09531-2, (2019).
  • Status characteristics and their intersectionality: majority opinion assignment in state supreme courts, Politics, Groups, and Identities, 10.1080/21565503.2019.1569538, (1-24), (2019).
  • Best Practices for Estimating, Interpreting, and Presenting Nonlinear Interaction Effects, Sociological Science, 10.15195/v6.a4, 6, (81-117), (2019).
  • How Dispositional Empathy Influences Political Ambition, The Journal of Politics, 10.1086/703381, (000-000), (2019).
  • The Lesser Evil? Corruption Voting and the Importance of Clean Alternatives, Comparative Political Studies, 10.1177/0010414019852697, (001041401985269), (2019).
  • Do Surveys Overestimate or Underestimate Socioeconomic Differences in Voter Turnout? Evidence from Administrative Registers, Public Opinion Quarterly, 10.1093/poq/nfz022, (2019).
  • International Influences on Nonviolent and Violent Contention, International Interactions, 10.1080/03050629.2019.1638375, (1-28), (2019).
  • Labor Market Institutions and Outward Foreign Direct Investment in OECD Countries, International Interactions, 10.1080/03050629.2019.1642885, (1-23), (2019).
  • Assessing U.S. Racial and Gender Differences in Happiness, 1972–2016: An Intersectional Approach, Journal of Happiness Studies, 10.1007/s10902-019-00103-z, (2019).
  • Implementing voter ID: lessons from Missouri, USA, Policy Studies, 10.1080/01442872.2019.1694653, (1-20), (2019).
  • Mandate type, electoral safety, and defections from the party line: The conditional mandate divide in the German Bundestag, 1949–2013, Party Politics, 10.1177/1354068819881637, (135406881988163), (2019).
  • The Perils of Peace: Civil War Peace Agreements and Military Coups, The Journal of Politics, 10.1086/705683, (000-000), (2019).
  • Subverting the Organizational Cartel: Explaining Cross-Party Leadership Selection in U.S. State Houses, American Politics Research, 10.1177/1532673X19892002, (1532673X1989200), (2019).
  • Comparing socio-economic inequalities in healthy ageing in the United States of America, England, China and Japan: evidence from four longitudinal studies of ageing, Ageing and Society, 10.1017/S0144686X19001740, (1-26), (2019).
  • How State Capacity Helps Autocrats win Elections, British Journal of Political Science, 10.1017/S0007123419000450, (1-18), (2019).
  • Enemy or Ally? Elites, Base Relations, and Partisanship in America, Public Opinion Quarterly, 10.1093/poq/nfz031, (2019).
  • Diversifying the Donor Pool: How Did Seattle's Democracy Voucher Program Reshape Participation in Municipal Campaign Finance?, Election Law Journal: Rules, Politics, and Policy, 10.1089/elj.2018.0534, (2019).
  • Who Are Your Neighbors? The Role of Ideology and Decline of Geographic Proximity in the Diffusion of Policy Innovations, Policy Studies Journal, 10.1111/psj.12351, 0, 0, (2019).
  • War Makes the Regime: Regional Rebellions and Political Militarization Worldwide, British Journal of Political Science, 10.1017/S0007123419000528, (1-22), (2019).
  • Self-Esteem and the Development of Partisan Identity, Political Research Quarterly, 10.1177/1065912919851556, (106591291985155), (2019).
  • Wire-Walking: Risk Management and Policy Experiments in China from a Comparative Perspective, Journal of Comparative Policy Analysis: Research and Practice, 10.1080/13876988.2019.1700672, (1-23), (2019).
  • Peace for our time? Examining the effect of power-sharing on postwar rebellions, Journal of Peace Research, 10.1177/0022343319883676, (002234331988367), (2019).
  • Covenants, Constitutions, and Distinct Law Types: Investigating Governments’ Restrictions on CSOs Using an Institutional Approach, VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations, 10.1007/s11266-019-00151-2, (2019).
  • The Effect of Civil Society Organizations and Democratization Aid on Civil War Onset, Journal of Conflict Resolution, 10.1177/0022002719888684, (002200271988868), (2019).
  • How Institutional Culture Trumps Tier Effects: Evidence from Government Responsiveness to FOI Requests, Journal of Public Administration Research and Theory, 10.1093/jopart/muy039, 29, 2, (210-226), (2018).
  • Killing for God? Factional Violence on the Transnational Stage, Journal of Conflict Resolution, 10.1177/0022002718763632, 63, 3, (617-643), (2018).
  • Power Sharing: Institutions, Behavior, and Peace, American Journal of Political Science, 10.1111/ajps.12407, 63, 1, (84-100), (2018).
  • State‐Dependent Transmission of Monetary Policy in the Euro Area, Journal of Money, Credit and Banking, 10.1111/jmcb.12592, 51, 7, (2053-2070), (2018).
  • Recalibrating social protection: Electoral competition and the new partisan politics of the welfare state, European Journal of Political Research, 10.1111/1475-6765.12308, 58, 2, (697-719), (2018).
  • Multinational Firms, Value Chains, and Trade Disputes: Explaining Dispute Onset at the World Trade Organization, SSRN Electronic Journal, 10.2139/ssrn.3169877, (2018).
  • The Racialized Effects of Social Programs in Brazil, Latin American Politics and Society, 10.1017/lap.2017.6, 60, 1, (52-75), (2018).
  • Growing Wealth Gaps in Education, Demography, 10.1007/s13524-018-0666-7, 55, 3, (1033-1068), (2018).
  • Effekte spezifischen politischen Wissens auf einstellungskongruente Wahlentscheidungen, , 10.1007/978-3-658-23787-5_10, (263-288), (2018).
  • Die Effekte von politischem Interesse und Wissen auf das Wahlverhalten euroskeptischer Bürger bei Europawahlen, , 10.1007/978-3-658-23787-5_9, (237-262), (2018).
  • How should unconventional oil and gas be regulated? The role of natural resource dependence and economic insecurity, Journal of Rural Studies, 10.1016/j.jrurstud.2018.11.005, (2018).
  • Colorism and classism confounded: Perceptions of discrimination in Latin America, Social Science Research, 10.1016/j.ssresearch.2018.12.019, (2018).
  • Believing Facts in the Fog of War: Identity, Media and Hot Cognition in Ukraine’s 2014 Odesa Tragedy, Geopolitics, 10.1080/14650045.2018.1465044, 23, 4, (851-881), (2018).
  • See more

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.