IDEAS home Printed from https://ideas.repec.org/a/cup/jexpos/v5y2018i03p217-229_00.html
   My bibliography  Save this article

Pay Rates and Subject Performance in Social Science Experiments Using Crowdsourced Online Samples

Author

Listed:
  • Andersen, David J.
  • Lau, Richard R.

Abstract

Mechanical Turk has become an important source of subjects for social science experiments, providing a low-cost alternative to the convenience of using undergraduates while avoiding the expense of drawing fully representative samples. However, we know little about how the rates we pay to “Turkers” for participating in social science experiments affects their participation. This study examines subject performance using two experiments – a short survey experiment and a longer dynamic process tracing study of political campaigns – that recruited Turkers at different rates of pay. Looking at demographics and using measures of attention, engagement and evaluation of the candidates, we find no effects of pay rates upon subject recruitment or participation. We conclude by discussing implications and ethical standards of pay.

Suggested Citation

  • Andersen, David J. & Lau, Richard R., 2018. "Pay Rates and Subject Performance in Social Science Experiments Using Crowdsourced Online Samples," Journal of Experimental Political Science, Cambridge University Press, vol. 5(3), pages 217-229, December.
    • Handle: RePEc:cup:jexpos:v:5:y:2018:i:03:p:217-229_00
    as

    Download full text from publisher

    File URL: https://www.cambridge.org/core/product/identifier/S2052263018000076/type/journal_article
    File Function: link to article abstract page
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cristina Bicchieri & Eugen Dimant, 2018. "It's Not A Lie If You Believe It. Lying and Belief Distortion Under Norm-Uncertainty," PPE Working Papers 0012, Philosophy, Politics and Economics, University of Pennsylvania.
    2. Bicchieri, Cristina & Dimant, Eugen & Sonderegger, Silvia, 2023. "It's not a lie if you believe the norm does not apply: Conditional norm-following and belief distortion," Games and Economic Behavior, Elsevier, vol. 138(C), pages 321-354.
    3. Irene Mussio & Angela C.M. de Oliveira, 2022. "The effect of additional background risk on mixed risk behavior," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 6(S1), pages 85-92, July.
    4. Irene Mussio & Maximiliano Sosa Andrés & Abdul H Kidwai, 2023. "Higher order risk attitudes in the time of COVID-19: an experimental study," Oxford Economic Papers, Oxford University Press, vol. 75(1), pages 163-182.
    5. Cristina Bicchieri & Eugen Dimant & Silvia Sonderegger, 2020. "It's Not a Lie If You Believe the Norm Does Not Apply: Conditional Norm-Following with Strategic Beliefs," CESifo Working Paper Series 8059, CESifo.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cup:jexpos:v:5:y:2018:i:03:p:217-229_00. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kirk Stebbing (email available below). General contact details of provider: https://www.cambridge.org/xps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.