IDEAS home Printed from https://ideas.repec.org/a/spr/jesaex/v7y2021i2d10.1007_s40881-021-00115-7.html
   My bibliography  Save this article

A case study of an experiment during the COVID-19 pandemic: online elicitation of subjective beliefs and economic preferences

Author

Listed:
  • Glenn W. Harrison

    (Robinson College of Business, Georgia State University
    Robinson College of Business, Georgia State University
    University of Cape Town)

  • Andre Hofmeyr

    (University of Cape Town
    University of Cape Town)

  • Harold Kincaid

    (University of Cape Town
    University of Cape Town)

  • Brian Monroe

    (University College Dublin)

  • Don Ross

    (Robinson College of Business, Georgia State University
    University of Cape Town
    University of Cape Town
    University College Cork)

  • Mark Schneider

    (Robinson College of Business, Georgia State University)

  • J. Todd Swarthout

    (Robinson College of Business, Georgia State University
    Georgia State University)

Abstract

We convey our experiences developing and implementing an online experiment to elicit subjective beliefs and economic preferences. The COVID-19 pandemic and associated closures of our laboratories required us to conduct an online experiment in order to collect beliefs and preferences associated with the pandemic in a timely manner. Since we had not previously conducted a similar multi-wave online experiment, we faced design and implementation considerations that are not present when running a typical laboratory experiment. By discussing these details more fully, we hope to contribute to the online experiment methodology literature at a time when many other researchers may be considering conducting an online experiment for the first time. We focus primarily on methodology; in a complementary study we focus on initial research findings.

Suggested Citation

  • Glenn W. Harrison & Andre Hofmeyr & Harold Kincaid & Brian Monroe & Don Ross & Mark Schneider & J. Todd Swarthout, 2021. "A case study of an experiment during the COVID-19 pandemic: online elicitation of subjective beliefs and economic preferences," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 194-209, December.
    • Handle: RePEc:spr:jesaex:v:7:y:2021:i:2:d:10.1007_s40881-021-00115-7
    DOI: 10.1007/s40881-021-00115-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40881-021-00115-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40881-021-00115-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Konrad, Markus, 2019. "oTree: Implementing experiments with dynamically determined data quantity," Journal of Behavioral and Experimental Finance, Elsevier, vol. 21(C), pages 58-60.
    2. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten I. & Rutström, E. Elisabet, 2014. "Discounting behavior: A reconsideration," European Economic Review, Elsevier, vol. 71(C), pages 15-33.
    3. Antonio A. Arechar & Simon Gächter & Lucas Molleman, 2018. "Conducting interactive experiments online," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 99-131, March.
    4. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    5. Glenn W. Harrison & Morten I. Lau & Hong Il Yoo, 2020. "Risk Attitudes, Sample Selection, and Attrition in a Longitudinal Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 552-568, July.
    6. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2018. "Multiattribute Utility Theory, Intertemporal Utility, And Correlation Aversion," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(2), pages 537-555, May.
    7. Chen, Daniel L. & Schonger, Martin & Wickens, Chris, 2016. "oTree—An open-source platform for laboratory, online, and field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 9(C), pages 88-97.
    8. Duch, Matthias L. & Grossmann, Max R.P. & Lauer, Thomas, 2020. "z-Tree unleashed: A novel client-integrating architecture for conducting z-Tree experiments over the Internet," Journal of Behavioral and Experimental Finance, Elsevier, vol. 28(C).
    9. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    10. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd & Ulm, Eric R., 2017. "Scoring rules for subjective probability distributions," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 430-448.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Glenn W. Harrison & Andre Hofmeyr & Harold Kincaid & Brian Monroe & Don Ross & Mark Schneider & J. Todd Swarthout, 2022. "Subjective beliefs and economic preferences during the COVID-19 pandemic," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 795-823, June.
    2. Glenn W. Harrison & Morten I. Lau & Hong Il Yoo, 2020. "Risk Attitudes, Sample Selection, and Attrition in a Longitudinal Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 552-568, July.
    3. Drichoutis, Andreas & Lusk, Jayson, 2012. "Risk preference elicitation without the confounding effect of probability weighting," MPRA Paper 37762, University Library of Munich, Germany.
    4. Glenn W. Harrison, 2019. "The behavioral welfare economics of insurance," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 44(2), pages 137-175, September.
    5. Stephen L. Cheung, 2020. "Eliciting utility curvature in time preference," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 493-525, June.
    6. Thiemann, Petra & Schulz, Jonathan & Sunde, Uwe & Thöni, Christian, 2022. "Selection into experiments: New evidence on the role of preferences, cognition, and recruitment protocols," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    7. Andreas C Drichoutis & Jayson L Lusk, 2014. "Judging Statistical Models of Individual Decision Making under Risk Using In- and Out-of-Sample Criteria," PLOS ONE, Public Library of Science, vol. 9(7), pages 1-13, July.
    8. Glenn W. Harrison & Andre Hofmeyr & Don Ross & J. Todd Swarthout, 2018. "Risk Preferences, Time Preferences, and Smoking Behavior," Southern Economic Journal, John Wiley & Sons, vol. 85(2), pages 313-348, October.
    9. Andreas C. Drichoutis & Rodolfo M. Nayga, 2022. "On the stability of risk and time preferences amid the COVID-19 pandemic," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 759-794, June.
    10. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    11. Glenn W. Harrison & Jia Min Ng, 2019. "Behavioral insurance and economic theory: A literature review," Risk Management and Insurance Review, American Risk and Insurance Association, vol. 22(2), pages 133-182, July.
    12. Glenn W. Harrison, 2024. "Risk preferences and risk perceptions in insurance experiments: some methodological challenges," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 49(1), pages 127-161, March.
    13. Andreas C. Drichoutis & Jayson L. Lusk, 2016. "What can multiple price lists really tell us about risk preferences?," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 89-106, December.
    14. David Scrogin, 2023. "Estimating risk and time preferences over public lotteries: Findings from the field and stream," Journal of Risk and Uncertainty, Springer, vol. 67(1), pages 73-106, August.
    15. Irene Maria Buso & Daniela Di Cagno & Lorenzo Ferrari & Vittorio Larocca & Luisa Lorè & Francesca Marazzi & Luca Panaccione & Lorenzo Spadoni, 2021. "Lab-like findings from online experiments," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 184-193, December.
    16. Meyer, Andrew G., 2015. "The impacts of elicitation mechanism and reward size on estimated rates of time preference," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 58(C), pages 132-148.
    17. Gauriot, Romain & Heger, Stephanie A. & Slonim, Robert, 2020. "Altruism or diminishing marginal utility?," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 24-48.
    18. Andreas Drichoutis & Phoebe Koundouri, 2011. "Estimating risk attitudes in conventional and artefactual lab experiments," DEOS Working Papers 1115, Athens University of Economics and Business.
    19. Fidanoski, Filip & Johnson, Timothy, 2023. "A z-Tree implementation of the Dynamic Experiments for Estimating Preferences [DEEP] method," Journal of Behavioral and Experimental Finance, Elsevier, vol. 38(C).
    20. Rodriguez-Lara, Ismael & Ponti, Giovanni, 2017. "Social motives vs social influence: An experiment on interdependent time preferences," Games and Economic Behavior, Elsevier, vol. 105(C), pages 177-194.

    More about this item

    Keywords

    Experimental economic methodology; Online incentivized experiment; Risk preferences; Time preferences; Subjective beliefs;
    All these keywords.

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D90 - Microeconomics - - Micro-Based Behavioral Economics - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jesaex:v:7:y:2021:i:2:d:10.1007_s40881-021-00115-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.