IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v81y2012i1p1-8.html
   My bibliography  Save this article

Experimental methods: Between-subject and within-subject design

Author

Listed:
  • Charness, Gary
  • Gneezy, Uri
  • Kuhn, Michael A.

Abstract

In this article we explore the issues that surround within-subject and between-subject designs. We describe experiments in economics and in psychology that make comparisons using either of these designs (or both) that sometimes yield the same results and sometimes do not. The overall goal is to establish a framework for understanding which critical questions need to be asked about such experimental studies, what authors of such studies can do to ameliorate fears of confoundedness, and which scenarios are particularly susceptible to divergent results from the two approaches. Overall, we find that both designs have their merits, and the choice of designs should be carefully considered in the context of the question being studied and in terms of the practical implementation of the research study.

Suggested Citation

  • Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2012. "Experimental methods: Between-subject and within-subject design," Journal of Economic Behavior & Organization, Elsevier, vol. 81(1), pages 1-8.
  • Handle: RePEc:eee:jeborg:v:81:y:2012:i:1:p:1-8
    DOI: 10.1016/j.jebo.2011.08.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268111002289
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2011.08.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard Carson & Nicholas Flores & Norman Meade, 2001. "Contingent Valuation: Controversies and Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 19(2), pages 173-210, June.
    2. Andreoni, James & Samuelson, Larry, 2006. "Building rational cooperation," Journal of Economic Theory, Elsevier, vol. 127(1), pages 117-154, March.
    3. James Andreoni, 1995. "Warm-Glow versus Cold-Prickle: The Effects of Positive and Negative Framing on Cooperation in Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 1-21.
    4. Hsee, Christopher K., 1996. "The Evaluability Hypothesis: An Explanation for Preference Reversals between Joint and Separate Evaluations of Alternatives," Organizational Behavior and Human Decision Processes, Elsevier, vol. 67(3), pages 247-257, September.
    5. Kahneman, Daniel & Ritov, Ilana, 1994. "Determinants of Stated Willingness to Pay for Public Goods: A Study in the Headline Method," Journal of Risk and Uncertainty, Springer, vol. 9(1), pages 5-38, July.
    6. Budescu, David V. & Weiss, Wendy, 1987. "Reflection of transitive and intransitive preferences: A test of prospect theory," Organizational Behavior and Human Decision Processes, Elsevier, vol. 39(2), pages 184-202, April.
    7. R. Mark Isaac & James M. Walker, 1988. "Group Size Effects in Public Goods Provision: The Voluntary Contributions Mechanism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 103(1), pages 179-199.
    8. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    9. Brookshire, David S. & Ives, Berry C. & Schulze, William D., 1976. "The valuation of aesthetic preferences," Journal of Environmental Economics and Management, Elsevier, vol. 3(4), pages 325-346, December.
    10. Uri Gneezy, 2005. "Deception: The Role of Consequences," American Economic Review, American Economic Association, vol. 95(1), pages 384-394, March.
    11. Kahneman, Daniel & Knetsch, Jack L., 1992. "Valuing public goods: The purchase of moral satisfaction," Journal of Environmental Economics and Management, Elsevier, vol. 22(1), pages 57-70, January.
    12. Craig R. Fox & Amos Tversky, 1995. "Ambiguity Aversion and Comparative Ignorance," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(3), pages 585-603.
    13. Epley, Nicholas & Gneezy, Ayelet, 2007. "The framing of financial windfalls and implications for public policy," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 36(1), pages 36-47, February.
    14. Isaac, R Mark & Walker, James M, 1988. "Communication and Free-Riding Behavior: The Voluntary Contribution Mechanism," Economic Inquiry, Western Economic Association International, vol. 26(4), pages 585-608, October.
    15. Hsee, Christopher K & Leclerc, France, 1998. "Will Products Look More Attractive When Presented Separately or Together?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(2), pages 175-186, September.
    16. Simon Gachter & Ernst Fehr, 2000. "Cooperation and Punishment in Public Goods Experiments," American Economic Review, American Economic Association, vol. 90(4), pages 980-994, September.
    17. Tversky, Amos & Kahneman, Daniel, 1986. "Rational Choice and the Framing of Decisions," The Journal of Business, University of Chicago Press, vol. 59(4), pages 251-278, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard Carson & Nicholas Flores & Norman Meade, 2001. "Contingent Valuation: Controversies and Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 19(2), pages 173-210, June.
    2. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    3. Bogliacino, Francesco & Codagnone, Cristiano, 2021. "Microfoundations, behaviour, and evolution: Evidence from experiments," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 372-385.
    4. France Leclerc & Christopher K. Hsee & Joseph C. Nunes, 2005. "Narrow Focusing: Why the Relative Position of a Good in Its Category Matters More Than It Should," Marketing Science, INFORMS, vol. 24(2), pages 194-205, August.
    5. Matthew Rabin, 1998. "Psychology and Economics," Journal of Economic Literature, American Economic Association, vol. 36(1), pages 11-46, March.
    6. James Cox & Vjollca Sadiraj & Ulrich Schmidt, 2015. "Paradoxes and mechanisms for choice under risk," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 215-250, June.
    7. Jan Stoop & Charles N. Noussair & Daan van Soest, 2012. "From the Lab to the Field: Cooperation among Fishermen," Journal of Political Economy, University of Chicago Press, vol. 120(6), pages 1027-1056.
    8. Barron, Kai & Nurminen, Tuomas, 2018. "Nudging cooperation," Discussion Papers, Research Unit: Economics of Change SP II 2018-305, WZB Berlin Social Science Center.
    9. Bougherara, Douadia & Denant-Boemont, Laurent & Masclet, David, 2011. "Cooperation and framing effects in provision point mechanisms: Experimental evidence," Ecological Economics, Elsevier, vol. 70(6), pages 1200-1210, April.
    10. Li-Chen Hsu, 2013. "Tax Auditing as a Public Good Game: An Experimental Study on Punishment and Compliance," Pacific Economic Review, Wiley Blackwell, vol. 18(4), pages 475-501, October.
    11. Messer, Kent D. & Zarghamee, Homa & Kaiser, Harry M. & Schulze, William D., 2007. "New hope for the voluntary contributions mechanism: The effects of context," Journal of Public Economics, Elsevier, vol. 91(9), pages 1783-1799, September.
    12. Moore, Don A., 1999. "Order Effects in Preference Judgments: Evidence for Context Dependence in the Generation of Preferences, ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 78(2), pages 146-165, May.
    13. Franz Hackl & Gerald J. Pruckner, 2005. "Warm glow, free‐riding and vehicle neutrality in a health‐related contingent valuation study," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 293-306, March.
    14. McDaniels, Timothy L. & Gregory, Robin & Arvai, Joseph & Chuenpagdee, Ratana, 2003. "Decision structuring to alleviate embedding in environmental valuation," Ecological Economics, Elsevier, vol. 46(1), pages 33-46, August.
    15. Thomas Kourouxous & Thomas Bauer, 2019. "Violations of dominance in decision-making," Business Research, Springer;German Academic Association for Business Research, vol. 12(1), pages 209-239, April.
    16. A. Peter McGraw & Eldar Shafir & Alexander Todorov, 2010. "Valuing Money and Things: Why a $20 Item Can Be Worth More and Less Than $20," Management Science, INFORMS, vol. 56(5), pages 816-830, May.
    17. Fluet, Claude & Galbiati, Rpbertp, 2016. "Lois et normes : les enseignements de l'économie comportementale," L'Actualité Economique, Société Canadienne de Science Economique, vol. 92(1-2), pages 191-215, Mars-Juin.
    18. Veisten, Knut, 2007. "Contingent valuation controversies: Philosophic debates about economic theory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 36(2), pages 204-232, April.
    19. Bodo Sturm & Joachim Weimann, 2006. "Experiments in Environmental Economics and Some Close Relatives," Journal of Economic Surveys, Wiley Blackwell, vol. 20(3), pages 419-457, July.
    20. Bernd Irlenbusch & Janna Ter Meer, 2015. "Lying in public good games with and without punishment," Cologne Graduate School Working Paper Series 06-02, Cologne Graduate School in Management, Economics and Social Sciences.

    More about this item

    Keywords

    Within-subject; Between-subject; Experimental design and methodology;
    All these keywords.

    JEL classification:

    • B49 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Other
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:81:y:2012:i:1:p:1-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.