IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v90y2021ics221480432030687x.html
   My bibliography  Save this article

Recruiting experimental subjects using WhatsApp

Author

Listed:
  • Jorrat, Diego

Abstract

The aim of many experiments is to estimate the effect of different interventions on subjects’ decision making. However, obtaining large samples and internal validity is challenging. This paper presents an alternative device at almost no cost that can easily provide a very large number of participants (700 in 1 hour). We asked 14 students to invite their WhatsApp contacts to participate in an online experiment. The students created a total of 80 diffusion groups with 25 contacts each. Using the diffusion groups as clusters, we ran a cluster randomization procedure in order to assign subjects to a framing experiment (treatment + control). We obtained the same level of attrition, duplicates and uninvited subjects across the treatment and control groups. Moreover, the experiment yielded consistent results in line with the framing literature.

Suggested Citation

  • Jorrat, Diego, 2021. "Recruiting experimental subjects using WhatsApp," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    • Handle: RePEc:eee:soceco:v:90:y:2021:i:c:s221480432030687x
    DOI: 10.1016/j.socec.2020.101644
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S221480432030687X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socec.2020.101644?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    2. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    3. James Andreoni, 1995. "Warm-Glow versus Cold-Prickle: The Effects of Positive and Negative Framing on Cooperation in Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 1-21.
    4. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    5. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    6. Christoph Engel, 2011. "Dictator games: a meta study," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 583-610, November.
    7. Antonio M. Espín & Dolores Moreno-Herrero & José Sánchez-Campillo & José A. Rodríguez Martín, 2018. "Do Envy and Compassion Pave the Way to Unhappiness? Social Preferences and Life Satisfaction in a Spanish City," Journal of Happiness Studies, Springer, vol. 19(2), pages 443-469, February.
    8. Smith, Vernon L, et al, 1982. "Competitive Market Institutions: Double Auctions vs. Sealed Bid-Offer Auctions," American Economic Review, American Economic Association, vol. 72(1), pages 58-77, March.
    9. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    10. Engel, Christoph & Rand, David G., 2014. "What does “clean” really mean? The implicit framing of decontextualized experiments," Economics Letters, Elsevier, vol. 122(3), pages 386-389.
    11. Williams, Arlington W, 1980. "Computerized Double-Auction Markets: Some Initial Experimental Results," The Journal of Business, University of Chicago Press, vol. 53(3), pages 235-258, July.
    12. Glewwe, Paul & Kremer, Michael & Moulin, Sylvie & Zitzewitz, Eric, 2004. "Retrospective vs. prospective analyses of school inputs: the case of flip charts in Kenya," Journal of Development Economics, Elsevier, vol. 74(1), pages 251-268, June.
    13. Coppinger, Vicki M & Smith, Vernon L & Titus, Jon A, 1980. "Incentives and Behavior in English, Dutch and Sealed-Bid Auctions," Economic Inquiry, Western Economic Association International, vol. 18(1), pages 1-22, January.
    14. Branas-Garza, Pablo, 2007. "Promoting helping behavior with framing in dictator games," Journal of Economic Psychology, Elsevier, vol. 28(4), pages 477-486, August.
    15. S.J. Rassenti & V.L. Smith & R.L. Bulfin, 1982. "A Combinatorial Auction Mechanism for Airport Time Slot Allocation," Bell Journal of Economics, The RAND Corporation, vol. 13(2), pages 402-417, Autumn.
    16. Capraro, Valerio & Rodriguez-Lara, Ismael & Ruiz-Martos, Maria J., 2020. "Preferences for efficiency, rather than preferences for morality, drive cooperation in the one-shot Stag-Hunt game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 86(C).
    17. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    18. Filippos Exadaktylos & Antonio M. Espin & Pablo Branas-Garza, 2012. "Experimental Subjects are Not Different," Working Papers 12-11, Chapman University, Economic Science Institute.
    19. Hoffman, Elizabeth & McCabe, Kevin & Smith, Vernon L, 1996. "Social Distance and Other-Regarding Behavior in Dictator Games," American Economic Review, American Economic Association, vol. 86(3), pages 653-660, June.
    20. Espín, Antonio M. & Correa, Manuel & Ruiz-Villaverde, Alberto, 2019. "Patience predicts cooperative synergy: The roles of ingroup bias and reciprocity," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 83(C).
    21. repec:cup:judgdm:v:13:y:2018:i:1:p:99-111 is not listed on IDEAS
    22. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Prissé, Benjamin & Jorrat, Diego, 2022. "Lab vs online experiments: No differences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    2. Lovász, Anna & Bat-Erdene, Boldmaa & Cukrowska-Torzewska, Ewa & Rigó, Mariann & Szabó-Morvai, Ágnes, 2023. "Competition, subjective feedback, and gender gaps in performance," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 102(C).
    3. Guo, Yiting & Shachat, Jason & Walker, Matthew J. & Wei, Lijia, 2023. "On the generalizability of using mobile devices to conduct economic experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 106(C).
    4. Alfonso-Costillo, Antonio & Brañas-Garza, Pablo & López-Martín, Ma Carmen, 2022. "Does the die-under-the-cup device exaggerate cheating?," Economics Letters, Elsevier, vol. 214(C).
    5. Melo, Grace & Sanhueza, Dérgica & Morales, Sarahi & Pena-Levano, Luis, 2021. "What does the Pandemic Mean for Experiential Learning? Lessons from Latin America," Applied Economics Teaching Resources (AETR), Agricultural and Applied Economics Association, vol. 3(3), September.
    6. Alfonso, Antonio & Brañas-Garza, Pablo & Jorrat, Diego & Lomas, Pablo & Prissé, Benjamin & Vasco, Mónica & Vázquez-De Francisco, María J., 2023. "The adventure of running experiments with teenagers," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 106(C).
    7. Prissé, Benjamin & Jorrat, Diego, 2021. "Lack of Control: An experiment," MPRA Paper 109918, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    2. Bruttel, Lisa & Stolley, Florian, 2020. "Getting a yes. An experiment on the power of asking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 86(C).
    3. DeScioli, Peter & Krishna, Siddhi, 2013. "Giving to whom? Altruism in different types of relationships," Journal of Economic Psychology, Elsevier, vol. 34(C), pages 218-228.
    4. Thorsten Chmura & Christoph Engel & Markus Englerth, 2013. "Selfishness As a Potential Cause of Crime. A Prison Experiment," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2013_05, Max Planck Institute for Research on Collective Goods.
    5. Peter G. Moffatt & Graciela Zevallos, 2021. "A Kuhn–Tucker model for behaviour in dictator games," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 226-243, December.
    6. Erik O. Kimbrough & Alexander Vostroknutov, 2016. "Norms Make Preferences Social," Journal of the European Economic Association, European Economic Association, vol. 14(3), pages 608-638, June.
    7. Dimant, Eugen, 2015. "On Peer Effects: Behavioral Contagion of (Un)Ethical Behavior and the Role of Social Identity," MPRA Paper 68732, University Library of Munich, Germany.
    8. Sebastian J. Goerg & David Rand & Gari Walkowitz, 2020. "Framing effects in the prisoner’s dilemma but not in the dictator game," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(1), pages 1-12, June.
    9. Jeannette Brosig-Koch & Thomas Riechmann & Joachim Weimann, 2017. "The dynamics of behavior in modified dictator games," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-18, April.
    10. Ockenfels, Axel & Schier, Uta K., 2020. "Games as frames," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 97-106.
    11. Jiménez-Jiménez, Francisca & Rodero-Cosano, Javier, 2015. "The effect of priming in a Bertrand competition game: An experimental study," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 58(C), pages 94-100.
    12. Korenok, Oleg & Millner, Edward L. & Razzolini, Laura, 2018. "Taking aversion," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 397-403.
      • Korenok Oleg & Edward L. Millner & Laura Razzolini, 2017. "Taking Aversion," Working Papers 1702, VCU School of Business, Department of Economics.
    13. Antonio Filippin & Manuela Raimondi, 2018. "The Patron Game: the Individual Provision of a Public Good," Games, MDPI, vol. 9(2), pages 1-20, June.
    14. repec:clg:wpaper:2014-43 is not listed on IDEAS
    15. Thorsten Chmura & Christoph Engel & Markus Englerth & Thomas Pitz, 2010. "At the Mercy of the Prisoner Next Door. Using an Experimental Measure of Selfishness as a Criminological Tool," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2010_27, Max Planck Institute for Research on Collective Goods.
    16. David Johnson & Sebastian Goerg & Jonathan Rogers, "undated". "Can't Touch This! Similarity And Willingness to Keep "Dirty Money"," Working Papers 2014-81, Department of Economics, University of Calgary, revised 10 Nov 2014.
    17. Lisa Bruttel & Florian Stolley, 2018. "Gender Differences in the Response to Decision Power and Responsibility—Framing Effects in a Dictator Game," Games, MDPI, vol. 9(2), pages 1-16, May.
    18. Yamada, Katsunori & Sato, Masayuki, 2013. "Another avenue for anatomy of income comparisons: Evidence from hypothetical choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 35-57.
    19. Nadine Chlaß & Peter G. Moffatt, 2017. "Giving in Dictator Games - Experimenter Demand Effect or Preference over the Rules of the Game?," Jena Economics Research Papers 2012-044, Friedrich-Schiller-University Jena.
    20. Sun-Ki Chai & Dolgorsuren Dorj & Katerina Sherstyuk, 2018. "Cultural Values and Behavior in Dictator, Ultimatum, and Trust Games: An Experimental Study," Research in Experimental Economics, in: Experimental Economics and Culture, volume 20, pages 89-166, Emerald Group Publishing Limited.
    21. Dickinson, David L. & Masclet, David & Villeval, Marie Claire, 2015. "Norm enforcement in social dilemmas: An experiment with police commissioners," Journal of Public Economics, Elsevier, vol. 126(C), pages 74-85.

    More about this item

    Keywords

    Recruiting; Online Experiments; Prisoner’s Dilemma; Randomization;
    All these keywords.

    JEL classification:

    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • C99 - Mathematical and Quantitative Methods - - Design of Experiments - - - Other
    • D70 - Microeconomics - - Analysis of Collective Decision-Making - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:90:y:2021:i:c:s221480432030687x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.