IDEAS home Printed from https://ideas.repec.org/a/bla/buecrs/v74y2022i2p421-426.html
   My bibliography  Save this article

Self‐selection bias in a field experiment: Recruiting subjects under different payment schemes

Author

Listed:
  • Noemí Herranz‐Zarzoso
  • Nikolaos Georgantzis
  • Gerardo Sabater‐Grande

Abstract

We examine a potential self‐selection bias in different samples of experimental subjects depending on the payment scheme offered in the recruiting process. We ran four field experiments in which undergraduate students in a microeconomics course were invited to voluntarily set their own goal for the final exam. They were informed that they would be given a monetary reward (else nothing) if their actual grade were higher than or equal to their goal. Rewards were an increasing (quadratic) function of the goal. We aimed at studying whether subjects’ willingness to participate in the experiment depends on their expected performance under different advertised reward criteria, like a rank‐order tournament and piece‐rate pay. Given that judgments about future performance are closely tied to previous performance, the midterm exam scores from the current academic course are compared between participants and nonparticipants in order to analyze sample‐sorting effects. We find that when a rank‐order tournament is offered alone or in combination with another reward mechanism, high‐performing students are more likely than low‐performing ones to participate in the experiment.

Suggested Citation

  • Noemí Herranz‐Zarzoso & Nikolaos Georgantzis & Gerardo Sabater‐Grande, 2022. "Self‐selection bias in a field experiment: Recruiting subjects under different payment schemes," Bulletin of Economic Research, Wiley Blackwell, vol. 74(2), pages 421-426, April.
  • Handle: RePEc:bla:buecrs:v:74:y:2022:i:2:p:421-426
    DOI: 10.1111/boer.12302
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/boer.12302
    Download Restriction: no

    File URL: https://libkey.io/10.1111/boer.12302?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jennifer Brown, 2011. "Quitters Never Win: The (Adverse) Incentive Effects of Competing with Superstars," Journal of Political Economy, University of Chicago Press, vol. 119(5), pages 982-1013.
    2. Edwin Leuven & Hessel Oosterbeek & Joep Sonnemans & Bas van der Klaauw, 2011. "Incentives versus Sorting in Tournaments: Evidence from a Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 29(3), pages 637-658.
    3. Michal Krawczyk, 2011. "What brings your subjects to the lab? A field experiment," Natural Field Experiments 00694, The Field Experiments Website.
    4. Ghazala Azmat & Marc Möller, 2009. "Competition among contests," RAND Journal of Economics, RAND Corporation, vol. 40(4), pages 743-768, December.
    5. Michal Krawczyk, 2011. "What brings your subjects to the lab? A field experiment," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 482-489, November.
    6. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2013. "Opting-in: Participation bias in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 43-70.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Noemí Herranz-Zarzoso & Gerardo Sabater-Grande, 2020. "Self-selection bias in a field experiment: Recruiting subjects under different payment schemes," Working Papers 2020/13, Economics Department, Universitat Jaume I, Castellón (Spain).
    2. Ghazala Azmat & Marc Möller, 2018. "The Distribution of Talent Across Contests," Economic Journal, Royal Economic Society, vol. 128(609), pages 471-509, March.
    3. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    4. Linnemer, Laurent & Visser, Michael, 2016. "Self-selection in tournaments: The case of chess players," Journal of Economic Behavior & Organization, Elsevier, vol. 126(PA), pages 213-234.
    5. Jonathan Schulz & Uwe Sunde & Petra Thiemann & Christian Thoeni, 2019. "Selection into Experiments: Evidence from a Population of Students," Discussion Papers 2019-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    6. Thiemann, Petra & Schulz, Jonathan & Sunde, Uwe & Thöni, Christian, 2022. "Selection into experiments: New evidence on the role of preferences, cognition, and recruitment protocols," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    7. Pastoriza, David & Alegre, Inés & Canela, Miguel A., 2021. "Conditioning the effect of prize on tournament self-selection," Journal of Economic Psychology, Elsevier, vol. 86(C).
    8. Frijters, Paul & Kong, Tao Sherry & Liu, Elaine M., 2015. "Who is coming to the artefactual field experiment? Participation bias among Chinese rural migrants," Journal of Economic Behavior & Organization, Elsevier, vol. 114(C), pages 62-74.
    9. Schmidt, Robert & Schwieren, Christiane & Sproten, Alec N., 2020. "Norms in the lab: Inexperienced versus experienced participants," Journal of Economic Behavior & Organization, Elsevier, vol. 173(C), pages 239-255.
    10. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    11. Schmidt, Robert J. & Schwieren, Christiane & Sproten, Alec N., 2018. "Social Norm Perception in Economic Laboratory Experiments: Inexperienced versus Experienced Participants," Working Papers 0656, University of Heidelberg, Department of Economics.
    12. Tan, Hwee Cheng, 2019. "Using a structured collaborative learning approach in a case-based management accounting course," Journal of Accounting Education, Elsevier, vol. 49(C).
    13. Wang, Zhen & Vukina, Tomislav, 2017. "Sorting into Contests: Evidence from Production Contracts," ARE Working Papers 262930, North Carolina State University, Department of Agricultural and Resource Economics.
    14. Johannes Abeler & Daniele Nosenzo, 2015. "Self-selection into laboratory experiments: pro-social motives versus monetary incentives," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 195-214, June.
    15. Subhasish M. Chowdhury & Patricia Esteve‐González & Anwesha Mukherjee, 2023. "Heterogeneity, leveling the playing field, and affirmative action in contests," Southern Economic Journal, John Wiley & Sons, vol. 89(3), pages 924-974, January.
    16. Thomas Epper & Julien Senn & Ernst Fehr, 2023. "Social preferences across subject pools: students vs. general population," ECON - Working Papers 435, Department of Economics - University of Zurich, revised Jan 2024.
    17. Deutscher, Christian & Gürtler, Marc & Gürtler, Oliver & DeVaro, Jed, 2020. "Firm choice and career success - theory and evidence," European Economic Review, Elsevier, vol. 127(C).
    18. Amegashie, J. Atsu, 2019. "Quantity-cum-quality contests," European Journal of Political Economy, Elsevier, vol. 58(C), pages 289-297.
    19. Ori Weisel & Ro'i Zultan, 2013. "Social motives in intergroup conflict," Jena Economics Research Papers 2013-033, Friedrich-Schiller-University Jena.
    20. Zak, Uri & Avrahami, Judith & Kareev, Yaakov, 2019. "The lions–foxes dilemma: The case of chess tournaments," Journal of Economic Psychology, Elsevier, vol. 75(PB).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:buecrs:v:74:y:2022:i:2:p:421-426. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0307-3378 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.