IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v103y2023ics2214804323000125.html
   My bibliography  Save this article

Subject confusion and task non-completion: Methodological insights from an artefactual field experiment with adolescents in India

Author

Listed:
  • Pulickal, Anuvinda
  • Chakravarty, Sujoy

Abstract

In the behavioral and experimental economics literature, very few experiments measure and analyze subject confusion or the completion of laboratory tasks. In this paper, we examine pre-task quiz performance in our artefactual field experiment with an adolescent subject pool in India and find that females have a lower degree of confusion in comprehending task instructions as compared to males. Furthermore, economic status is negatively associated with subject comprehension and completion of incentivized experimental tasks. Academic ability is negatively associated with subject confusion and positively associated with task completion. Finally, we find a positive association between pre-task quiz performance and the completion of incentivized tasks. This suggests that unincentivized pre-task quiz scores may act as a signal for potential non-completion of incentivized tasks in experiments, particularly with non-standard subject pools.

Suggested Citation

  • Pulickal, Anuvinda & Chakravarty, Sujoy, 2023. "Subject confusion and task non-completion: Methodological insights from an artefactual field experiment with adolescents in India," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    • Handle: RePEc:eee:soceco:v:103:y:2023:i:c:s2214804323000125
    DOI: 10.1016/j.socec.2023.101986
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804323000125
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socec.2023.101986?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    2. Isabelle Brocas & Juan D. Carrillo & Stephanie W. Wang & Colin F. Camerer, 2014. "Imperfect Choice or Imperfect Attention? Understanding Strategic Thinking in Private Information Games," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 944-970.
    3. Matthias Sutter & Martin G. Kocher & Daniela Glätzle-Rützler & Stefan T. Trautmann, 2013. "Impatience and Uncertainty: Experimental Decisions Predict Adolescents' Field Behavior," American Economic Review, American Economic Association, vol. 103(1), pages 510-531, February.
    4. Andreoni, James, 1995. "Cooperation in Public-Goods Experiments: Kindness or Confusion?," American Economic Review, American Economic Association, vol. 85(4), pages 891-904, September.
    5. Kahneman, Daniel & Knetsch, Jack L & Thaler, Richard H, 1986. "Fairness and the Assumptions of Economics," The Journal of Business, University of Chicago Press, vol. 59(4), pages 285-300, October.
    6. Belot, Michele & Duch, Raymond & Miller, Luis, 2015. "A comprehensive comparison of students and non-students in classic experimental games," Journal of Economic Behavior & Organization, Elsevier, vol. 113(C), pages 26-33.
    7. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    8. Bindra, Parampreet Christopher & Glatzle-Rutzler, Daniela & Lergetporer, Philipp, 2020. "Discrimination at young age: Experimental evidence from preschool children," Munich Reprints in Economics 84742, University of Munich, Department of Economics.
    9. John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 251-299.
    10. Lukas Kiessling & Shyamal Chowdhury & Hannah Schildberg-Hörisch & Matthias Sutter, 2021. "Parental Paternalism and Patience," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2021_03, Max Planck Institute for Research on Collective Goods.
    11. Brocas, Isabelle & Carrillo, Juan D. & Combs, T. Dalton & Kodaverdian, Niree, 2019. "Consistency in simple vs. complex choices by younger and older adults," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 580-601.
    12. Ferraro Paul J & Vossler Christian A, 2010. "The Source and Significance of Confusion in Public Goods Experiments," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 10(1), pages 1-42, July.
    13. Hertz Tom & Jayasundera Tamara & Piraino Patrizio & Selcuk Sibel & Smith Nicole & Verashchagina Alina, 2008. "The Inheritance of Educational Inequality: International Comparisons and Fifty-Year Trends," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 7(2), pages 1-48, January.
    14. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    15. Bindra, Parampreet Christopher & Glätzle-Rützler, Daniela & Lergetporer, Philipp, 2020. "Discrimination at young age: Experimental evidence from preschool children," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 55-70.
    16. Chandler, Dana & Kapelner, Adam, 2013. "Breaking monotony with meaning: Motivation in crowdsourcing markets," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 123-133.
    17. Fehr, Ernst & Glätzle-Rützler, Daniela & Sutter, Matthias, 2013. "The development of egalitarianism, altruism, spite and parochialism in childhood and adolescence," European Economic Review, Elsevier, vol. 64(C), pages 369-383.
    18. Callen, Mike & Isaqzadeh, Mohammad & Long, James D. & Sprenger, Charles, 2014. "Violence and risk preference: experimental evidence from Afghanistan," LSE Research Online Documents on Economics 102932, London School of Economics and Political Science, LSE Library.
    19. Matthias Benz & Stephan Meier, 2008. "Do people behave in experiments as in the field?—evidence from donations," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 268-281, September.
    20. Yongxiang Chen & Liqi Zhu & Zhe Chen, 2013. "Family Income Affects Children’s Altruistic Behavior in the Dictator Game," PLOS ONE, Public Library of Science, vol. 8(11), pages 1-1, November.
    21. Boosey, Luke & Mark Isaac, R. & Norton, Douglas & Stinn, Joseph, 2020. "Cooperation, contributor types, and control questions," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 85(C).
    22. David T. Burkam & Valerie E. Lee, 1998. "Effects of Monotone and Nonmonotone Attrition on Parameter Estimates in Regression Models with Educational Data: Demographic Effects on Achievement, Aspirations, and Attitudes," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 555-574.
    23. Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
    24. Laury, Susan K. & Taylor, Laura O., 2008. "Altruism spillovers: Are behaviors in context-free experiments predictive of altruism toward a naturally occurring public good," Journal of Economic Behavior & Organization, Elsevier, vol. 65(1), pages 9-29, January.
    25. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    26. Fehr, Ernst & Schmidt, Klaus M., 2006. "The Economics of Fairness, Reciprocity and Altruism - Experimental Evidence and New Theories," Handbook on the Economics of Giving, Reciprocity and Altruism, in: S. Kolm & Jean Mercier Ythier (ed.), Handbook of the Economics of Giving, Altruism and Reciprocity, edition 1, volume 1, chapter 8, pages 615-691, Elsevier.
    27. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521853408.
    28. Michael Callen & Mohammad Isaqzadeh & James D. Long & Charles Sprenger, 2014. "Violence and Risk Preference: Experimental Evidence from Afghanistan," American Economic Review, American Economic Association, vol. 104(1), pages 123-148, January.
    29. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521618618.
    30. William Greene, 2009. "Discrete Choice Modeling," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 11, pages 473-556, Palgrave Macmillan.
    31. Bigoni, M. & Dragone, D., 2012. "Effective and efficient experimental instructions," Economics Letters, Elsevier, vol. 117(2), pages 460-463.
    32. Jay L. Zagorsky, 1999. "Young Baby Boomers' Wealth," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 45(2), pages 135-156, June.
    33. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2013. "Opting-in: Participation bias in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 43-70.
    34. repec:bla:revinw:v:45:y:1999:i:2:p:135-56 is not listed on IDEAS
    35. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    36. Desai, Sonalde & Dubey, Amaresh & Joshi, Brij Lal & Sen, Mitali & Sharif, Abusaleh & Vanneman, Reeve, 2010. "Human Development in India: Challenges for a Society in Transition," OUP Catalogue, Oxford University Press, number 9780198065128.
    37. Greene, William, 2008. "Functional forms for the negative binomial model for count data," Economics Letters, Elsevier, vol. 99(3), pages 585-590, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    2. Islam, Asad & Mahanta, Ratul & Mandal, Raju & Nath, Hiranya K. & Ouch, Chandarany & Sarkar, Dipanwita, 2023. "Long-term impact of exposure to violent conflict: Are there gender differences?," Journal of Economic Behavior & Organization, Elsevier, vol. 208(C), pages 120-139.
    3. Meier, Stephan & Pierce, Lamar & Vaccaro, Antonino & La Cara, Barbara, 2016. "Trust and in-group favoritism in a culture of crime," Journal of Economic Behavior & Organization, Elsevier, vol. 132(PA), pages 78-92.
    4. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    5. Gangadharan, Lata & Islam, Asad & Ouch, Chandarany & Wang, Liang Choon, 2022. "The long-term effects of genocide on antisocial preferences," World Development, Elsevier, vol. 160(C).
    6. María Alejandra Vélez & Carlos Andres Trujillo & Lina Moros & Clemente Forero, 2016. "Prosocial Behavior and Subjective Insecurity in Violent Contexts: Field Experiments," PLOS ONE, Public Library of Science, vol. 11(7), pages 1-23, July.
    7. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    8. Fabrice Murtin & Lara Fleischer & Vincent Siegerink & Arnstein Aassve & Yann Algan & Romina Boarini & Santiago Gonzalez & Zsuzsanna Lonti & Ulrich Schmidt & Gianluca Grimalda & Rafael Hortala Vallve &, 2018. "Trust and its determinants," Sciences Po publications 89, Sciences Po.
      • Fabrice Murtin & Lara Fleischer & Vincent Siegerink & Arnstein Aassve & Yann Algan & Romina Boarini & Santiago Gonzalez & Zsuzsanna Lonti & Ulrich Schmidt & Gianluca Grimalda & Rafael Hortala Vallve &, 2018. "Trust and its determinants," SciencePo Working papers hal-03596480, HAL.
      • Fabrice Murtin & Lara Fleischer & Vincent Siegerink & Arnstein Aassve & Yann Algan & Romina Boarini & Santiago Gonzalez & Zsuzsanna Lonti & Ulrich Schmidt & Gianluca Grimalda & Rafael Hortala Vallve &, 2018. "Trust and its determinants," Working Papers hal-03596480, HAL.
    9. repec:hal:spmain:info:hdl:2441/h44c7ona088fb5o9b5dq3nt9u is not listed on IDEAS
    10. Fabrice Murtin & Lara Fleischer & Vincent Siegerink & Arnstein Aassve & Yann Algan & Romina Boarini & Santiago Gonzalez & Zsuzsanna Lonti & Ulrich Schmidt & Gianluca Grimalda & Rafael Hortala Vallve &, 2018. "Trust and its determinants," Working Papers hal-03596480, HAL.
      • Fabrice Murtin & Lara Fleischer & Vincent Siegerink & Arnstein Aassve & Yann Algan & Romina Boarini & Santiago Gonzalez & Zsuzsanna Lonti & Ulrich Schmidt & Gianluca Grimalda & Rafael Hortala Vallve &, 2018. "Trust and its determinants," SciencePo Working papers Main hal-03596480, HAL.
    11. Johannes Abeler & Armin Falk & Fabian Kosse, 2021. "Malleability of Preferences for Honesty," CESifo Working Paper Series 9033, CESifo.
    12. Kai Barron & Heike Harmgart & Steffen Huck & Sebastian O. Schneider & Matthias Sutter, 2023. "Discrimination, Narratives, and Family History: An Experiment with Jordanian Host and Syrian Refugee Children," The Review of Economics and Statistics, MIT Press, vol. 105(4), pages 1008-1016, July.
    13. Zizzo, Daniel John, 2013. "Claims and confounds in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 93(C), pages 186-195.
    14. Bartoš, Vojtěch, 2021. "Seasonal scarcity and sharing norms," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 303-316.
    15. Grüner Sven, 2020. "Sample Size Calculation in Economic Experiments," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 240(6), pages 791-823, December.
    16. Martin G. Kocher, 2015. "How Trust in Social Dilemmas Evolves with Age," CESifo Working Paper Series 5447, CESifo.
    17. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    18. Bogliacino, Francesco & Codagnone, Cristiano, 2021. "Microfoundations, behaviour, and evolution: Evidence from experiments," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 372-385.
    19. Nikoloz Kudashvili & Philipp Lergetporer, 2019. "Do Minorities Misrepresent Their Ethnicity to Avoid Discrimination?," CESifo Working Paper Series 7861, CESifo.
    20. Etienne Dagorn & David Masclet & Thierry Penard, 2022. "The Behavioral Determinants of School Achievement: A Lab in the Field Experiment in Middle School," Economics Working Paper Archive (University of Rennes & University of Caen) 2022-05, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS.
    21. Saldarriaga-Isaza, Adrian & Villegas-Palacio, Clara & Arango, Santiago, 2019. "Chipping in for a cleaner technology: Experimental evidence from a framed threshold public good game with students and artisanal miners," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 78(C), pages 10-16.

    More about this item

    Keywords

    Subject confusion; Task completion; Artefactual field experiment; Adolescent;
    All these keywords.

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:103:y:2023:i:c:s2214804323000125. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.