IDEAS home Printed from https://ideas.repec.org/a/sae/jocore/v50y2006i5p757-776.html
   My bibliography  Save this article

Can We Generalize from Student Experiments to the Real World in Political Science, Military Affairs, and International Relations?

Author

Listed:
  • Alex Mintz

    (Department of Political Science, Texas A&M University, Interdisciplinary Center-Herzliya, Israel)

  • Steven B. Redd

    (Department of Political Science, University of Wisconsin-Milwaukee)

  • Arnold Vedlitz

    (Institute for Science, Technology and Public Policy, George Bush School of Government and Public Service, Texas A&M University)

Abstract

The authors conducted an experiment with a group of military officers and replicated it with a group of students at a public university in the United States. The experimental scenario dealt with a decision problem in the area of counterterrorism. The authors found that while more than one-third of students recommended doing nothing, the overwhelming majority of military officers (more than 90 percent) recommended doing something. Also, military officers exhibited less maximizing and more satisfacing decision making than students. The results show that relying on experiments with students “playing†the role of real-world national security policy makers may bias the results. The two groups are, in fact, very different. Based on student samples, it is possible to accept propositions that would not be found with samples of elite decision makers and reject propositions that may be right. However, it is possible that students can be assigned to experiments where they represent the “public†and not elites.

Suggested Citation

  • Alex Mintz & Steven B. Redd & Arnold Vedlitz, 2006. "Can We Generalize from Student Experiments to the Real World in Political Science, Military Affairs, and International Relations?," Journal of Conflict Resolution, Peace Science Society (International), vol. 50(5), pages 757-776, October.
    • Handle: RePEc:sae:jocore:v:50:y:2006:i:5:p:757-776
    DOI: 10.1177/0022002706291052
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0022002706291052
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0022002706291052?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ostrom, Charles W. & Job, Brian L., 1986. "The President and the Political Use of Force," American Political Science Review, Cambridge University Press, vol. 80(2), pages 541-566, June.
    2. Herbert A. Simon, 1955. "A Behavioral Model of Rational Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 69(1), pages 99-118.
    3. Frisch, Deborah, 1993. "Reasons for Framing Effects," Organizational Behavior and Human Decision Processes, Elsevier, vol. 54(3), pages 399-429, April.
    4. Palfrey, Thomas R. & Rosenthal, Howard, 1985. "Voter Participation and Strategic Uncertainty," American Political Science Review, Cambridge University Press, vol. 79(1), pages 62-78, March.
    5. McDermott, Rose, 2002. "Experimental Methodology in Political Science," Political Analysis, Cambridge University Press, vol. 10(4), pages 325-342.
    6. Mintz, Alex & Geva, Nehemia & Redd, Steven B. & Carnes, Amy, 1997. "The Effect of Dynamic and Static Choice Sets on Political Decision Making: An Analysis Using the Decision Board Platform," American Political Science Review, Cambridge University Press, vol. 91(3), pages 553-566, September.
    7. Rose McDermott & Jonathan A. Cowden, 2001. "The effects of uncertainty and sex in a crisis simulation game," International Interactions, Taylor & Francis Journals, vol. 27(4), pages 353-380, June.
    8. Ford, J. Kevin & Schmitt, Neal & Schechtman, Susan L. & Hults, Brian M. & Doherty, Mary L., 1989. "Process tracing methods: Contributions, problems, and neglected research questions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(1), pages 75-117, February.
    9. Forsythe, Robert & Forrest Nelson & George R. Neumann & Jack Wright, 1992. "Anatomy of an Experimental Political Stock Market," American Economic Review, American Economic Association, vol. 82(5), pages 1142-1161, December.
    10. Billings, Robert S. & Scherer, Lisa L., 1988. "The effects of response mode and importance on decision-making strategies: Judgment versus choice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 41(1), pages 1-19, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Iain Hardie & Dominic Johnson & Dominic Tierney, 2011. "Psychological Aspects of War," Chapters, in: Christopher J. Coyne & Rachel L. Mathers (ed.), The Handbook on the Political Economy of War, chapter 5, Edward Elgar Publishing.
    2. Heidi Hardt, 2018. "Who matters for memory: Sources of institutional memory in international organization crisis management," The Review of International Organizations, Springer, vol. 13(3), pages 457-482, September.
    3. Sean Nicholson-Crotty & Jill Nicholson-Crotty & Sean Webeck, 2019. "Are public managers more risk averse? Framing effects and status quo bias across the sectors," Journal of Behavioral Public Administration, Center for Experimental and Behavioral Public Administration, vol. 2(1).
    4. A. Burcu Bayram & Erin R. Graham, 2017. "Financing the United Nations: Explaining variation in how donors provide funding to the UN," The Review of International Organizations, Springer, vol. 12(3), pages 421-459, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Steven B. Redd, 2002. "The Influence of Advisers on Foreign Policy Decision Making," Journal of Conflict Resolution, Peace Science Society (International), vol. 46(3), pages 335-364, June.
    2. Alex Mintz, 2004. "Foreign Policy Decision Making in Familiar and Unfamiliar Settings," Journal of Conflict Resolution, Peace Science Society (International), vol. 48(1), pages 91-104, February.
    3. Carlson, Kurt A. & Guha, Abhijit, 2011. "Leader-focused search: The impact of an emerging preference on information search," Organizational Behavior and Human Decision Processes, Elsevier, vol. 115(1), pages 133-141, May.
    4. Costel Andonie & Daniel Diermeier, 2022. "Electoral Institutions with impressionable voters," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 59(3), pages 683-733, October.
    5. Alex Mintz, 2004. "How Do Leaders Make Decisions?," Journal of Conflict Resolution, Peace Science Society (International), vol. 48(1), pages 3-13, February.
    6. Eben J. Christensen & Steven B. Redd, 2004. "Bureaucrats Versus the Ballot Box in Foreign Policy Decision Making," Journal of Conflict Resolution, Peace Science Society (International), vol. 48(1), pages 69-90, February.
    7. Nehemia Geva & James Mayhar & J. Mark Skorick, 2000. "The Cognitive Calculus of Foreign Policy Decision Making," Journal of Conflict Resolution, Peace Science Society (International), vol. 44(4), pages 447-471, August.
    8. Sebastian Garmann, 2020. "Political efficacy and the persistence of turnout shocks," Economics and Politics, Wiley Blackwell, vol. 32(3), pages 411-429, November.
    9. Huizenga, Hilde M. & Wetzels, Ruud & van Ravenzwaaij, Don & Wagenmakers, Eric-Jan, 2012. "Four empirical tests of Unconscious Thought Theory," Organizational Behavior and Human Decision Processes, Elsevier, vol. 117(2), pages 332-340.
    10. Karl DeRouen Jr. & Christopher Sprecher, 2004. "Initial Crisis Reaction and Poliheuristic Theory," Journal of Conflict Resolution, Peace Science Society (International), vol. 48(1), pages 56-68, February.
    11. Jonathan W. Keller & Yi Edward Yang, 2008. "Leadership Style, Decision Context, and the Poliheuristic Theory of Decision Making: An Experimental Analysis," Journal of Conflict Resolution, Peace Science Society (International), vol. 52(5), pages 687-712, October.
    12. Yulian Ding & Michele M. Veeman & Wiktor L. Adamowicz, 2012. "The influence of attribute cutoffs on consumers' choices of a functional food," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 39(5), pages 745-769, December.
    13. Chang, Y.H.J. & Mosleh, A., 2007. "Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 4: IDAC causal model of operator problem-solving response," Reliability Engineering and System Safety, Elsevier, vol. 92(8), pages 1061-1075.
    14. Blom, Tannelie and Valentina Carraro, 2014. "An information processing approach to public organizations: The case of the European Union Fundamental Rights Agency," European Integration online Papers (EIoP), European Community Studies Association Austria (ECSA-A), vol. 18, February.
    15. Katsikopoulos, Konstantinos V., 2016. "On the role of psychological heuristics in operational research; and a demonstration in military stability operationsAuthor-Name: Keller, Niklas," European Journal of Operational Research, Elsevier, vol. 249(3), pages 1063-1073.
    16. Rothengatter, Marloes, 2016. "Insights in cognitive patterns : Essays on heuristics and identification," Other publications TiSEM 5f812a9d-8968-48b8-8d1b-0, Tilburg University, School of Economics and Management.
    17. Hámori, Balázs, 2003. "Kísérletek és kilátások Daniel Kahneman [Experiments and prospects - in connection with Daniel Kahneman’s Nobel Prize]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(9), pages 779-799.
    18. Zuschke, Nick, 2020. "The impact of task complexity and task motivation on in-store marketing effectiveness: An eye tracking analysis," Journal of Business Research, Elsevier, vol. 116(C), pages 337-350.
    19. Mark Heitmann & Andreas Herrmann & Christian Kaiser, 2007. "The effect of product variety on purchase probability," Review of Managerial Science, Springer, vol. 1(2), pages 111-131, August.
    20. Macintosh, Gerrard & Gentry, James W., 1995. "Cognitive process differences between discrete and relational exchange," International Business Review, Elsevier, vol. 4(4), pages 435-446.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jocore:v:50:y:2006:i:5:p:757-776. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://pss.la.psu.edu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.