IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v134y2017icp48-59.html
   My bibliography  Save this article

Experimental methods: When and why contextual instructions are important

Author

Listed:
  • Alekseev, Aleksandr
  • Charness, Gary
  • Gneezy, Uri

Abstract

An important methodological issue in experimental research is the extent to which one should use context-rich or abstract language in the instructions for an experiment. The traditional use of abstract context in experimental economics is commonly viewed as a way to achieve experimental control. However, there are some advantages to using context-framed instructions, such as “employer and worker” instead of “player 1 and player 2.” Meaningful context can enhance understanding of an environment and reduce confusion among participants, particularly when a task requires sophisticated reasoning, and hence may yield responses of better quality. In emotionally-charged research questions, such as pollution or bribes, contextual instructions may affect behavior in the experiment, but this effect may be appropriate as it relates to the research question. Our review of the evidence from the literature indicates that in the great majority of cases meaningful language is either useful or produces no change in behavior. Nevertheless, a few important considerations are worth keeping in mind when using rich context. Finally, we see the choice of context as being an expansion of the experimenter’s toolkit and a factor to consider in experimental design.

Suggested Citation

  • Alekseev, Aleksandr & Charness, Gary & Gneezy, Uri, 2017. "Experimental methods: When and why contextual instructions are important," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 48-59.
  • Handle: RePEc:eee:jeborg:v:134:y:2017:i:c:p:48-59
    DOI: 10.1016/j.jebo.2016.12.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268116302876
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2016.12.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jehiel, Philippe, 2005. "Analogy-based expectation equilibrium," Journal of Economic Theory, Elsevier, vol. 123(2), pages 81-104, August.
    2. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    3. Klaus Abbink & Heike Hennig-Schmidt, 2006. "Neutral versus loaded instructions in a bribery experiment," Experimental Economics, Springer;Economic Science Association, vol. 9(2), pages 103-121, June.
    4. Heike Hennig-Schmidt & Bettina Rockenbach & Abdolkarim Sadrieh, 2010. "In Search Of Workers' Real Effort Reciprocity-A Field and a Laboratory Experiment," Journal of the European Economic Association, MIT Press, vol. 8(4), pages 817-837, June.
    5. Ellingsen, Tore & Johannesson, Magnus & Mollerstrom, Johanna & Munkhammar, Sara, 2012. "Social framing effects: Preferences or beliefs?," Games and Economic Behavior, Elsevier, vol. 76(1), pages 117-130.
    6. Rajna Gibson & Carmen Tanner & Alexander F. Wagner, 2013. "Preferences for Truthfulness: Heterogeneity among and within Individuals," American Economic Review, American Economic Association, vol. 103(1), pages 532-548, February.
    7. Alm, James & McClelland, Gary H. & Schulze, William D., 1992. "Why do people pay taxes?," Journal of Public Economics, Elsevier, vol. 48(1), pages 21-38, June.
    8. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2009. "Homo Reciprocans: Survey Evidence on Behavioural Outcomes," Economic Journal, Royal Economic Society, vol. 119(536), pages 592-612, March.
    9. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    10. Itzhak Gilboa & David Schmeidler, 1995. "Case-Based Decision Theory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(3), pages 605-639.
    11. Christoph Engel & Sebastian Goerg & Gaoneng Yu, 2012. "Symmetric vs. Asymmetric Punishment Regimes for Bribery," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2012_01, Max Planck Institute for Research on Collective Goods, revised May 2013.
    12. Andrei Bremzen & Elena Khokhlova & Anton Suvorov & Jeroen van de Ven, 2015. "Bad News: An Experimental Study on the Informational Effects Of Rewards," The Review of Economics and Statistics, MIT Press, vol. 97(1), pages 55-70, March.
    13. Berninghaus, Siegfried K. & Haller, Sven & Krüger, Tyll & Neumann, Thomas & Schosser, Stephan & Vogt, Bodo, 2013. "Risk attitude, beliefs, and information in a Corruption Game – An experimental analysis," Journal of Economic Psychology, Elsevier, vol. 34(C), pages 46-60.
    14. Cooper, David J. & Kagel, John H., 2003. "The impact of meaningful context on strategic play in signaling games," Journal of Economic Behavior & Organization, Elsevier, vol. 50(3), pages 311-337, March.
    15. Smith, Vernon L, 1976. "Experimental Economics: Induced Value Theory," American Economic Review, American Economic Association, vol. 66(2), pages 274-279, May.
    16. Burnham, Terence & McCabe, Kevin & Smith, Vernon L., 2000. "Friend-or-foe intentionality priming in an extensive form trust game," Journal of Economic Behavior & Organization, Elsevier, vol. 43(1), pages 57-73, September.
    17. Daniele Nosenzo, 2013. "Pay Secrecy And Effort Provision," Economic Inquiry, Western Economic Association International, vol. 51(3), pages 1779-1794, July.
    18. David J. Cooper, 1999. "Gaming against Managers in Incentive Systems: Experimental Results with Chinese Students and Chinese Managers," American Economic Review, American Economic Association, vol. 89(4), pages 781-804, September.
    19. Abbink, Klaus & Dasgupta, Utteeyo & Gangadharan, Lata & Jain, Tarun, 2014. "Letting the briber go free: An experiment on mitigating harassment bribes," Journal of Public Economics, Elsevier, vol. 111(C), pages 17-28.
    20. M. Fernanda Rivas, 2013. "An Experiment On Corruption And Gender," Bulletin of Economic Research, Wiley Blackwell, vol. 65(1), pages 10-42, January.
    21. Dufwenberg, Martin & Gächter, Simon & Hennig-Schmidt, Heike, 2011. "The framing of games and the psychology of play," Games and Economic Behavior, Elsevier, vol. 73(2), pages 459-478.
    22. Engel, Christoph & Rand, David G., 2014. "What does “clean” really mean? The implicit framing of decontextualized experiments," Economics Letters, Elsevier, vol. 122(3), pages 386-389.
    23. Cox, James C & Oaxaca, Ronald L, 1989. "Laboratory Experiments with a Finite-Horizon Job-Search Model," Journal of Risk and Uncertainty, Springer, vol. 2(3), pages 301-329, September.
    24. David J. Cooper & John H. Kagel, 2009. "The Role of Context and Team Play in Cross-Game Learning," Journal of the European Economic Association, MIT Press, vol. 7(5), pages 1101-1139, September.
    25. Elliott, Catherine S. & Hayward, Donald M. & Canon, Sebastian, 1998. "Institutional framing: Some experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 35(4), pages 455-464, May.
    26. Jordi Brandts & David Cooper, 2006. "Observability and overcoming coordination failure in organizations: An experimental study," Experimental Economics, Springer;Economic Science Association, vol. 9(4), pages 407-423, December.
    27. Li, Danyang & Hawley, Zackary & Schnier, Kurt, 2013. "Increasing organ donation via changes in the default choice or allocation rule," Journal of Health Economics, Elsevier, vol. 32(6), pages 1117-1129.
    28. Michael Kirchler & Jurgen Huber & Thomas Stockl, 2012. "Thar She Bursts: Reducing Confusion Reduces Bubbles," American Economic Review, American Economic Association, vol. 102(2), pages 865-883, April.
    29. Eileen Chou & Margaret McConnell & Rosemarie Nagel & Charles Plott, 2009. "The control of game form recognition in experiments: understanding dominant strategy failures in a simple two person “guessing” game," Experimental Economics, Springer;Economic Science Association, vol. 12(2), pages 159-179, June.
    30. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    31. repec:cup:judgdm:v:9:y:2014:i:5:p:360-372 is not listed on IDEAS
    32. Vivi Alatas & Lisa Cameron & Ananish Chaudhuri & Nisvan Erkal & Lata Gangadharan, 2009. "Gender, Culture, and Corruption: Insights from an Experimental Analysis," Southern Economic Journal, John Wiley & Sons, vol. 75(3), pages 663-680, January.
    33. Avrahami, Judith & Kareev, Yaakov & Todd, Peter M. & Silverman, Boaz, 2014. "Allocation of resources in asymmetric competitions: How do the weak maintain a chance of winning?," Journal of Economic Psychology, Elsevier, vol. 42(C), pages 161-174.
    34. Landeo, Claudia M. & Nikitin, Maxim & Babcock, Linda, 2007. "Split-awards and disputes: An experimental study of a strategic model of litigation," Journal of Economic Behavior & Organization, Elsevier, vol. 63(3), pages 553-572, July.
    35. Abigail Barr & Danila Serra, 2009. "The effects of externalities and framing on bribery in a petty corruption experiment," Experimental Economics, Springer;Economic Science Association, vol. 12(4), pages 488-503, December.
    36. Christine Harbring & Bernd Irlenbusch, 2011. "Sabotage in Tournaments: Evidence from a Laboratory Experiment," Management Science, INFORMS, vol. 57(4), pages 611-627, April.
    37. Jana Krajcova, 2008. "Testing Leniency Programs Experimentally: The Impact of Change in Parameterization," CERGE-EI Working Papers wp370, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    38. Samuelson, Charles D. & Allison, Scott T., 1994. "Cognitive Factors Affecting the Use of Social Decision Heuristics in Resource-Sharing Tasks," Organizational Behavior and Human Decision Processes, Elsevier, vol. 58(1), pages 1-27, April.
    39. Lambsdorff, Johann Graf & Frank, Björn, 2011. "Corrupt reciprocity - Experimental evidence on a men's game," International Review of Law and Economics, Elsevier, vol. 31(2), pages 116-125, June.
    40. Smith, Vernon L & Suchanek, Gerry L & Williams, Arlington W, 1988. "Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets," Econometrica, Econometric Society, vol. 56(5), pages 1119-1151, September.
    41. Ritwik Banerjee, 2016. "On the interpretation of bribery in a laboratory corruption game: moral frames and social norms," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 240-267, March.
    42. Pevnitskaya, Svetlana & Ryvkin, Dmitry, 2013. "Environmental context and termination uncertainty in games with a dynamic public bad," Environment and Development Economics, Cambridge University Press, vol. 18(1), pages 27-49, February.
    43. Jana Krajcova & Andreas Ortmann, 2008. "Testing Leniency Programs Experimentally: The Impact of “Natural” Framing," CERGE-EI Working Papers wp372, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Montero, Maria & Sheth, Jesal D., 2021. "Naivety about hidden information: An experimental investigation," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 92-116.
    2. Christoph Engel, 2016. "Experimental Criminal Law. A Survey of Contributions from Law, Economics and Criminology," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2016_07, Max Planck Institute for Research on Collective Goods.
    3. Jiménez-Jiménez, Francisca & Rodero-Cosano, Javier, 2023. "Conditioning competitive behaviour in experimental Bertrand markets through contextual frames," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    4. Yu‐Chin Hsiao & Simon Kemp & Maroš Servátka, 2020. "On the Importance of Context in Sequential Search," Southern Economic Journal, John Wiley & Sons, vol. 86(4), pages 1510-1530, April.
    5. Hsiao, Yu Chin & Kemp, Simon & Servátka, Maroš, 2019. "On the Importance of Context in Sequential Decision-Making," MPRA Paper 94027, University Library of Munich, Germany.
    6. Frank Björn & Li Sha & Bühren Christoph & Qin Haiying, 2015. "Group Decision Making in a Corruption Experiment: China and Germany Compared," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 235(2), pages 207-227, April.
    7. Banerjee, Ritwik, 2016. "Corruption, norm violation and decay in social capital," Journal of Public Economics, Elsevier, vol. 137(C), pages 14-27.
    8. Fahr, René & Djawadi, Behnud Mir, 2012. "The impact of risk perception and risk attitudes on corrupt behavior: Evidence from a petty corruption experiment," VfS Annual Conference 2012 (Goettingen): New Approaches and Challenges for the Labor Market of the 21st Century 62022, Verein für Socialpolitik / German Economic Association.
    9. Buckenmaier, Johannes & Dimant, Eugen & Mittone, Luigi, 2020. "Effects of institutional history and leniency on collusive corruption and tax evasion," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 296-313.
    10. Boly, Amadou & Gillanders, Robert, 2018. "Anti-corruption policy making, discretionary power and institutional quality: An experimental analysis," Journal of Economic Behavior & Organization, Elsevier, vol. 152(C), pages 314-327.
    11. Abbink, Klaus & Dasgupta, Utteeyo & Gangadharan, Lata & Jain, Tarun, 2014. "Letting the briber go free: An experiment on mitigating harassment bribes," Journal of Public Economics, Elsevier, vol. 111(C), pages 17-28.
    12. Maria Vittoria Levati & Chiara Nardi, 2019. "The power of words in a petty corruption experiment," Working Papers 18/2019, University of Verona, Department of Economics.
    13. Alice Guerra & Tatyana Zhuravleva, 2022. "Do women always behave as corruption cleaners?," Public Choice, Springer, vol. 191(1), pages 173-192, April.
    14. Banerjee, Ritwik & Mitra, Arnab, 2018. "On monetary and non-monetary interventions to combat corruption," Journal of Economic Behavior & Organization, Elsevier, vol. 149(C), pages 332-355.
    15. Banerjee, Ritwik, 2018. "On the interpretation of World Values Survey trust question - Global expectations vs. local beliefs," European Journal of Political Economy, Elsevier, vol. 55(C), pages 491-510.
    16. Vivi Alatas & Lisa Cameron & Ananish Chaudhuri & Nisvan Erkal & Lata Gangadharan, 2009. "Subject pool effects in a corruption experiment: A comparison of Indonesian public servants and Indonesian students," Experimental Economics, Springer;Economic Science Association, vol. 12(1), pages 113-132, March.
    17. Olivier Armantier & Amadou Boly, 2013. "Comparing Corruption in the Laboratory and in the Field in Burkina Faso and in Canada," Economic Journal, Royal Economic Society, vol. 123(12), pages 1168-1187, December.
    18. Masiliūnas, Aidas & Nax, Heinrich H., 2020. "Framing and repeated competition," Games and Economic Behavior, Elsevier, vol. 124(C), pages 604-619.
    19. Eric Cardella & Carl Kitchens, 2017. "The impact of award uncertainty on settlement negotiations," Experimental Economics, Springer;Economic Science Association, vol. 20(2), pages 333-367, June.
    20. Detkova, Polina & Tkachenko, Andrey & Yakovlev, Andrei, 2021. "Gender heterogeneity of bureaucrats in attitude to corruption: Evidence from list experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 217-233.

    More about this item

    Keywords

    Experiments; Methodology; Context; Meaningful language; Quality of responses;
    All these keywords.

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • C99 - Mathematical and Quantitative Methods - - Design of Experiments - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:134:y:2017:i:c:p:48-59. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.