IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/24781.html
   My bibliography  Save this paper

Testing the Waters: Behavior across Participant Pools

Author

Listed:
  • Erik Snowberg
  • Leeat Yariv

Abstract

We leverage a large-scale incentivized survey eliciting behaviors from (almost) an entire university student population, a representative sample of the U.S. population, and Amazon Mechanical Turk (MTurk) to address concerns about the external validity of experiments with student participants. Behavior in the student population offers bounds on behaviors in other populations, and correlations between behaviors are largely similar across samples. Furthermore, non-student samples exhibit higher measurement error. Adding historical lab participation data, we find a small set of attributes over which lab participants differ from non-lab participants. Using an additional set of lab experiments, we see no evidence of observer effects.

Suggested Citation

  • Erik Snowberg & Leeat Yariv, 2018. "Testing the Waters: Behavior across Participant Pools," NBER Working Papers 24781, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:24781
    Note: AP CF DEV PE POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w24781.pdf
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Theodor Vladasel & Simon C. Parker & Randolph Sloof & Mirjam van Praag, 2024. "Revenue drift, incentives, and effort allocation in social enterprises," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 33(3), pages 630-651, August.
    2. Gary Bolton & Eugen Dimant & Ulrich Schmidt, 2018. "When a Nudge Backfires. Using Observation with Social and Economic Incentives to Promote Pro-Social Behavior," PPE Working Papers 0017, Philosophy, Politics and Economics, University of Pennsylvania.
    3. Dimant, Eugen & van Kleef, Gerben A. & Shalvi, Shaul, 2020. "Requiem for a Nudge: Framing effects in nudging honesty," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 247-266.
    4. Bicchieri, Cristina & Dimant, Eugen & Xiao, Erte, 2021. "Deviant or wrong? The effects of norm information on the efficacy of punishment," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 209-235.
    5. Engelmann, Dirk & Janeba, Eckhard & Mechtenberg, Lydia & Wehrhöfer, Nils, 2023. "Preferences over taxation of high-income individuals: Evidence from a survey experiment," European Economic Review, Elsevier, vol. 157(C).
    6. Page, Lionel & Sarkar, Dipanwita & Silva-Goncalves, Juliana, 2019. "Long-lasting effects of relative age at school," Journal of Economic Behavior & Organization, Elsevier, vol. 168(C), pages 166-195.
    7. Jonathan Schulz & Uwe Sunde & Petra Thiemann & Christian Thoeni, 2019. "Selection into Experiments: Evidence from a Population of Students," Discussion Papers 2019-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    8. John Ifcher & Homa Zarghamee & Dan Houser & Lina Diaz, 2020. "The relative income effect: an experiment," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1205-1234, December.
    9. Jonathan Chapman & Erik Snowberg & Stephanie Wang & Colin Camerer, 2018. "Loss Attitudes in the U.S. Population: Evidence from Dynamically Optimized Sequential Experimentation (DOSE)," NBER Working Papers 25072, National Bureau of Economic Research, Inc.
    10. Holger Herz & Deborah Kistler & Christian Zehnder & Christian Zihlmann, 2022. "Hindsight Bias and Trust in Government," CESifo Working Paper Series 9767, CESifo.
    11. Drichoutis, Andreas C. & Grimm, Veronika & Karakostas, Alexandros, 2020. "Bribing to Queue-Jump: An experiment on cultural differences in bribing attitudes among Greeks and Germans," MPRA Paper 102775, University Library of Munich, Germany.
    12. Goeschl, Timo & Kettner, Sara Elisa & Lohse, Johannes & Schwieren, Christiane, 2020. "How much can we learn about voluntary climate action from behavior in public goods games?," Ecological Economics, Elsevier, vol. 171(C).
    13. Stefano DellaVigna & Devin Pope, 2022. "Stability of Experimental Results: Forecasts and Evidence," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 889-925, August.
    14. Marcus Giamattei & Kyanoush Seyed Yahosseini & Simon Gächter & Lucas Molleman, 2020. "LIONESS Lab: a free web-based platform for conducting interactive experiments online," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(1), pages 95-111, June.
    15. Müller, Stephan & Rau, Holger A., 2021. "Economic preferences and compliance in the social stress test of the COVID-19 crisis," Journal of Public Economics, Elsevier, vol. 194(C).
    16. Potrafke, Niklas, 2019. "Risk aversion, patience and intelligence: Evidence based on macro data," Economics Letters, Elsevier, vol. 178(C), pages 116-120.
    17. Gagnon, Nickolas & Bosmans, Kristof & Riedl, Arno, 2020. "The Effect of Unfair Chances and Gender Discrimination on Labor Supply," Research Memorandum 005, Maastricht University, Graduate School of Business and Economics (GSBE).
    18. Salvatore Nunnari & Giovanni Montari, 2019. "Audi Alteram Partem: An Experiment on Selective Exposure to Information," Working Papers 650, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    19. Herz, Holger & Kistler, Deborah & Zehnder, Christian & Zihlmann, Christian, 2022. "Hindsight Bias and Trust in Government: Evidence from the United States," FSES Working Papers 526, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    20. Nathan Barrymore & Cristian L. Dezső & Benjamin C. King, 2022. "Gender and competitiveness when earning for others: Experimental evidence and implications for sponsorship," Strategic Management Journal, Wiley Blackwell, vol. 43(5), pages 905-934, May.
    21. Kaisa Kotakorpi & Satu Metsälampi & Topi Miettinen & Tuomas Nurminen, 2019. "The effect of reporting institutions on tax evasion:Evidence from the lab," Discussion Papers 127, Aboa Centre for Economics.
    22. Shachat, Jason & Walker, Matthew J. & Wei, Lijia, 2021. "How the onset of the Covid-19 pandemic impacted pro-social behaviour and individual preferences: Experimental evidence from China," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 480-494.
    23. Gary E. Bolton & Eugen Dimant & Ulrich Schmidt, 2020. "When a Nudge Backfires: Combining (Im)Plausible Deniability with Social and Economic Incentives to Promote Behavioral Change," CESifo Working Paper Series 8070, CESifo.
    24. Batrancea, Larissa M. & Kudła, Janusz & Błaszczak, Barbara & Kopyt, Mateusz, 2022. "Differences in tax evasion attitudes between students and entrepreneurs under the slippery slope framework," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 464-482.

    More about this item

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:24781. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.