IDEAS home Printed from https://ideas.repec.org/a/sae/anname/v628y2010i1p200-208.html
   My bibliography  Save this article

Enough Already about “Black Box†Experiments: Studying Mediation Is More Difficult than Most Scholars Suppose

Author

Listed:
  • Donald P. Green

    (Yale University)

  • Shang E. Ha

    (Brooklyn College-City University of New York)

  • John G. Bullock

    (Yale University)

Abstract

The question of how causal effects are transmitted is fascinating and inevitably arises whenever experiments are presented. Social scientists cannot be faulted for taking a lively interest in “mediation,†the process by which causal influences are transmitted. However, social scientists frequently underestimate the difficulty of establishing causal pathways in a rigorous empirical manner. We argue that the statistical methods currently used to study mediation are flawed and that even sophisticated experimental designs cannot speak to questions of mediation without the aid of strong assumptions. The study of mediation is more demanding than most social scientists suppose and requires not one experimental study but rather an extensive program of experimental research.

Suggested Citation

  • Donald P. Green & Shang E. Ha & John G. Bullock, 2010. "Enough Already about “Black Box†Experiments: Studying Mediation Is More Difficult than Most Scholars Suppose," The ANNALS of the American Academy of Political and Social Science, , vol. 628(1), pages 200-208, March.
    • Handle: RePEc:sae:anname:v:628:y:2010:i:1:p:200-208
    DOI: 10.1177/0002716209351526
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0002716209351526
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0002716209351526?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gerber, Alan S. & Green, Donald P. & Larimer, Christopher W., 2008. "Social Pressure and Voter Turnout: Evidence from a Large-Scale Field Experiment," American Political Science Review, Cambridge University Press, vol. 102(1), pages 33-48, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Arunachalam, S. & Ramaswami, Sridhar N. & Patel, Pankaj C. & Chai, Linlin, 2022. "Innovation-based strategic flexibility (ISF): Role of CEO ties with marketing and R&D," International Journal of Research in Marketing, Elsevier, vol. 39(3), pages 927-946.
    2. Simone Busetti, 2023. "Causality is good for practice: policy design and reverse engineering," Policy Sciences, Springer;Society of Policy Sciences, vol. 56(2), pages 419-438, June.
    3. Sam C Lin & Zeljko Rezek & Aylar Abdolahzadeh & David R Braun & Tamara Dogandžić & George M Leader & Li Li & Shannon P McPherron, 2022. "The mediating effect of platform width on the size and shape of stone flakes," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-19, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cantoni, Enrico & Gazzè, Ludovica & Schafer, Jerome, 2021. "Turnout in concurrent elections: Evidence from two quasi-experiments in Italy," European Journal of Political Economy, Elsevier, vol. 70(C).
    2. León, Gianmarco, 2017. "Turnout, political preferences and information: Experimental evidence from Peru," Journal of Development Economics, Elsevier, vol. 127(C), pages 56-71.
    3. Mitchell Hoffman & Gianmarco Leon, 2011. "Social Networks and Voting," Working Papers 11-08, NET Institute, revised Nov 2011.
    4. Alan Gerber & Mitchell Hoffman & John Morgan & Collin Raymond, 2020. "One in a Million: Field Experiments on Perceived Closeness of the Election and Voter Turnout," American Economic Journal: Applied Economics, American Economic Association, vol. 12(3), pages 287-325, July.
    5. Alberto Chong & Gianmarco León‐Ciliotta & Vivian Roza & Martín Valdivia & Gabriela Vega, 2019. "Urbanization Patterns, Information Diffusion, and Female Voting in Rural Paraguay," American Journal of Political Science, John Wiley & Sons, vol. 63(2), pages 323-341, April.
    6. Bamieh, Omar & Cintolesi, Andrea, 2021. "Intergenerational transmission in regulated professions and the role of familism," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 857-879.
    7. Anya Savikhin & Roman Sheremeta, 2010. "Visibility of Contributions and Cost of Information: An Experiment on Public Goods," Working Papers 10-22, Chapman University, Economic Science Institute.
    8. Yoichi Hizen & Kengo Kurosaka, 2021. "Monetary Costs Versus Opportunity Costs in a Voting Experiment," Working Papers SDES-2021-1, Kochi University of Technology, School of Economics and Management, revised Feb 2021.
    9. Patricia Funk, 2012. "How accurate are surveyed preferences for public policies? Evidence from a unique institutional setup," Economics Working Papers 1334, Department of Economics and Business, Universitat Pompeu Fabra, revised Nov 2013.
    10. Fosco, Constanza & Laruelle, Annick & Sánchez, Angel, 2009. "Turnout Intention and Social Networks," IKERLANAK info:eu-repo/grantAgreeme, Universidad del País Vasco - Departamento de Fundamentos del Análisis Económico I.
    11. Hoffman, Mitchell & León, Gianmarco & Lombardi, María, 2017. "Compulsory voting, turnout, and government spending: Evidence from Austria," Journal of Public Economics, Elsevier, vol. 145(C), pages 103-115.
    12. Idunn Nørbech, 2024. "Does policy context matter for citizen engagement in policymaking? Evidence from the European Commission's public consultation regime," European Union Politics, , vol. 25(1), pages 130-150, March.
    13. Hillman, Arye L. & Metsuyanim, Kfir & Potrafke, Niklas, 2015. "Democracy with group identity," European Journal of Political Economy, Elsevier, vol. 40(PB), pages 274-287.
    14. Valentina A. Bali & Lindon J. Robison & Richard Winder, 2020. "What Motivates People to Vote? The Role of Selfishness, Duty, and Social Motives When Voting," SAGE Open, , vol. 10(4), pages 21582440209, October.
    15. Bhanot, Syon P., 2017. "Rank and response: A field experiment on peer information and water use behavior," Journal of Economic Psychology, Elsevier, vol. 62(C), pages 155-172.
    16. Kaytlynn Clemons & David B. Johnson & Amy Kiger & Janice Putnam, 2018. "Decreasing Campus Smoking With Punishments And Social Pressures," Contemporary Economic Policy, Western Economic Association International, vol. 36(4), pages 629-643, October.
    17. Brit Grosskopf & Graeme Pearce, 2020. "Do You Mind Me Paying Less? Measuring Other-Regarding Preferences in the Market for Taxis," Management Science, INFORMS, vol. 66(11), pages 5059-5074, November.
    18. Patricia Funk, 2016. "How Accurate Are Surveyed Preferences for Public Policies? Evidence from a Unique Institutional Setup," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 442-454, July.
    19. Kai Jäger, 2020. "When Do Campaign Effects Persist for Years? Evidence from a Natural Experiment," American Journal of Political Science, John Wiley & Sons, vol. 64(4), pages 836-851, October.
    20. Hager, Anselm & Hensel, Lukas & Hermle, Johannes & Roth, Christopher, 2020. "Does Party Competition Affect Political Activism?," CAGE Online Working Paper Series 488, Competitive Advantage in the Global Economy (CAGE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:anname:v:628:y:2010:i:1:p:200-208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.