IDEAS home Printed from https://ideas.repec.org/p/aoz/wpaper/214.html
   My bibliography  Save this paper

The Adventure of Running Experiments with Teenagers

Author

Listed:
  • Antonio Alfonso-Costillo

    (Universidad Loyola)

  • Pablo Brañas-Garza

    (Universidad Loyola)

  • Diego Jorrat

    (Universidad Loyola)

  • Pablo Lomas

    (Universidad Loyola)

  • Benjamin Prissé

    (Universidad Loyola)

  • Mónica Vasco

    (Universidad Loyola)

Abstract

Economists are increasingly interested in how to conduct experiments with teenagers. This paper evaluates whether different methodological factors impact the answers of teenagers to standard experimental tasks on measuring time preferences, risk preferences, cognitive abilities and financial abilities, among others. Results show: i) the recruitment process matters depending on whether the school includes the experiment as an institutional activity or the teachers led the process particularly for their class; the dropout rate reduced significantly from the first to the third experimental wave, when the school was responsible for organizingthe experiment; ii) hypothetical payments elicits similar results than monetary payments; iii) adding visual elements to the experiment’s interface improves the quality of answers; and iv) the type of electronic device on which subjects answer the tasks does not influence results, while administrating the experiment by school teachers does affect the answers. We conclude by giving three suggestions to researchers interested in conducting experiments with teenagers: first, run the experiment as a school-programmed activity; second, it is not necessary the use of real payments which increases the cost and complicates the recruitment; and third, integratevisual components to the task

Suggested Citation

  • Antonio Alfonso-Costillo & Pablo Brañas-Garza & Diego Jorrat & Pablo Lomas & Benjamin Prissé & Mónica Vasco, 2023. "The Adventure of Running Experiments with Teenagers," Working Papers 214, Red Nacional de Investigadores en Economía (RedNIE).
  • Handle: RePEc:aoz:wpaper:214
    as

    Download full text from publisher

    File URL: https://rednie.eco.unc.edu.ar/files/DT/214.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Melanie Lührmann & Marta Serra-Garcia & Joachim Winter, 2018. "The Impact of Financial Education on Adolescents' Intertemporal Choices," American Economic Journal: Economic Policy, American Economic Association, vol. 10(3), pages 309-332, August.
    2. Matthias Sutter & Martin G. Kocher & Daniela Glätzle-Rützler & Stefan T. Trautmann, 2013. "Impatience and Uncertainty: Experimental Decisions Predict Adolescents' Field Behavior," American Economic Review, American Economic Association, vol. 103(1), pages 510-531, February.
    3. Adeline Delavande & Hans-Peter Kohler, 2009. "Subjective expectations in the context of HIV/AIDS in Malawi," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 20(31), pages 817-875.
    4. James Andreoni & Charles Sprenger, 2012. "Risk Preferences Are Not Time Preferences," American Economic Review, American Economic Association, vol. 102(7), pages 3357-3376, December.
    5. Pablo Brañas-Garza & Diego Jorrat & Antonio M. Espín & Angel Sánchez, 2023. "Paid and hypothetical time preferences are the same: lab, field and online evidence," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 412-434, April.
    6. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    7. Brocas, Isabelle & Carrillo, Juan D., 2020. "The development of social strategic ignorance and other regarding behavior from childhood to adulthood," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 85(C).
    8. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    9. Marco Castillo & Jeffrey L Jordan & Ragan Petrie, 2019. "Discount Rates of Children and High School Graduation," The Economic Journal, Royal Economic Society, vol. 129(619), pages 1153-1181.
    10. Brocas, Isabelle & Carrillo, Juan D. & Combs, T. Dalton & Kodaverdian, Niree, 2019. "The development of consistent decision-making across economic domains," Games and Economic Behavior, Elsevier, vol. 116(C), pages 217-240.
    11. Brocas, Isabelle & Carrillo, Juan D., 2020. "The evolution of choice and learning in the two-person beauty contest game from kindergarten to adulthood," Games and Economic Behavior, Elsevier, vol. 120(C), pages 132-143.
    12. Brocas, Isabelle & Carrillo, Juan D., 2020. "Introduction to special issue “Understanding Cognition and Decision Making by Children.” Studying decision-making in children: Challenges and opportunities," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 777-783.
    13. Brañas-Garza, Pablo & Estepa-Mohedano, Lorenzo & Jorrat, Diego & Orozco, Victor & Rascón-Ramírez, Ericka, 2021. "To pay or not to pay: Measuring risk preferences in lab and field," Judgment and Decision Making, Cambridge University Press, vol. 16(5), pages 1290-1313, September.
    14. Castillo, Marco & Jordan, Jeffrey L. & Petrie, Ragan, 2018. "Children’s rationality, risk attitudes and field behavior," European Economic Review, Elsevier, vol. 102(C), pages 62-81.
    15. Samek, Anya & Gray, Andre & Datar, Ashlesha & Nicosia, Nancy, 2021. "Adolescent time and risk preferences: Measurement, determinants and field consequences," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 460-488.
    16. Andreoni, James & Kuhn, Michael A. & List, John A. & Samek, Anya & Sokal, Kevin & Sprenger, Charles, 2019. "Toward an understanding of the development of time preferences: Evidence from field experiments," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    17. Glenn W. Harrison & E. Elisabet Rutström, 2008. "Risk Aversion in the Laboratory," Research in Experimental Economics, in: Risk Aversion in Experiments, pages 41-196, Emerald Group Publishing Limited.
    18. Prissé, Benjamin & Jorrat, Diego, 2022. "Lab vs online experiments: No differences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    19. William T. Harbaugh & Kate Krause & Timothy R. Berry, 2001. "GARP for Kids: On the Development of Rational Choice Behavior," American Economic Review, American Economic Association, vol. 91(5), pages 1539-1545, December.
    20. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    21. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    22. Sule Alan & Seda Ertac, 2018. "Fostering Patience in the Classroom: Results from Randomized Educational Intervention," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 1865-1911.
    23. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    24. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    25. Andreoni, James & Di Girolamo, Amalia & List, John A. & Mackevicius, Claire & Samek, Anya, 2020. "Risk preferences of children and adolescents in relation to gender, cognitive skills, soft skills, and executive functions," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 729-742.
    26. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    27. Tymula, Agnieszka, 2019. "An experimental study of adolescent behavior under peer observation: Adolescents are more impatient and inconsistent, not more risk-taking, when observed by peers," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 735-750.
    28. Christopher Chabris & David Laibson & Carrie Morris & Jonathon Schuldt & Dmitry Taubinsky, 2008. "Individual laboratory-measured discount rates predict field behavior," Journal of Risk and Uncertainty, Springer, vol. 37(2), pages 237-269, December.
    29. repec:cup:judgdm:v:11:y:2016:i:1:p:99-113 is not listed on IDEAS
    30. Alberto Abadie & Guido W. Imbens, 2016. "Matching on the Estimated Propensity Score," Econometrica, Econometric Society, vol. 84, pages 781-807, March.
    31. Castillo, Marco & Ferraro, Paul J. & Jordan, Jeffrey L. & Petrie, Ragan, 2011. "The today and tomorrow of kids: Time preferences and educational outcomes of children," Journal of Public Economics, Elsevier, vol. 95(11), pages 1377-1385.
    32. Jorrat, Diego, 2021. "Recruiting experimental subjects using WhatsApp," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    33. Jørgensen, Lotte Kofoed & Piovesan, Marco & Willadsen, Helene, 2022. "Gender differences in competitiveness: Friends matter," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 101(C).
    34. Mograbi, Eli, 2022. "Decision-makers are more impulsive on smartphones than on computers," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    35. Isabelle Brocas & Juan D. Carrillo, 2022. "The development of randomization and deceptive behavior in mixed strategy games," Quantitative Economics, Econometric Society, vol. 13(2), pages 825-862, May.
    36. Brocas, Isabelle & Carrillo, Juan D., 2021. "Self-serving, altruistic and spiteful lying in the schoolyard," Journal of Economic Behavior & Organization, Elsevier, vol. 187(C), pages 159-175.
    37. Isabelle Brocas & Juan D. Carrillo, 2021. "Steps of Reasoning in Children and Adolescents," Journal of Political Economy, University of Chicago Press, vol. 129(7), pages 2067-2111.
    38. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    39. Bettinger, Eric & Slonim, Robert, 2007. "Patience among children," Journal of Public Economics, Elsevier, vol. 91(1-2), pages 343-363, February.
    40. Catherine Eckel & Philip Grossman & Cathleen Johnson & Angela Oliveira & Christian Rojas & Rick Wilson, 2012. "School environment and risk preferences: Experimental evidence," Journal of Risk and Uncertainty, Springer, vol. 45(3), pages 265-292, December.
    41. repec:cup:judgdm:v:16:y:2021:i:5:p:1290-1313 is not listed on IDEAS
    42. Stoklosa, Michal & Shuval, Kerem & Drope, Jeffrey & Tchernis, Rusty & Pachucki, Mark & Yaroch, Amy & Harding, Matthew, 2018. "The intergenerational transmission of obesity: The role of time preferences and self-control," Economics & Human Biology, Elsevier, vol. 28(C), pages 92-106.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. No title
      by maximorossi in NEP-LTV blog on 2023-02-27 18:50:57

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Antonio Alfonso & Pablo Brañas-Garza & Diego Jorrat & Benjamín Prissé & María José Vázquez-De Francisco, 2024. "The Baking of Preferences throughout the High School," Working Papers 316, Red Nacional de Investigadores en Economía (RedNIE).
    2. Caserta, Maurizio & Distefano, Rosaria & Ferrante, Livio & Reito, Francesco, 2023. "The Good of Rules: A pilot study on prosocial behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antonio Alfonso & Pablo Brañas-Garza & Diego Jorrat & Benjamín Prissé & María José Vázquez-De Francisco, 2024. "The Baking of Preferences throughout the High School," Working Papers 316, Red Nacional de Investigadores en Economía (RedNIE).
    2. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    3. Pablo Brañas-Garza & Diego Jorrat & Antonio M. Espín & Angel Sánchez, 2023. "Paid and hypothetical time preferences are the same: lab, field and online evidence," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 412-434, April.
    4. Islam, Asad & Lee, Wang-Sheng & Nicholas, Aaron, 2021. "The Effects of Chess Instruction on Academic and Non-cognitive Outcomes: Field Experimental Evidence from a Developing Country," Journal of Development Economics, Elsevier, vol. 150(C).
    5. Backes-Gellner, Uschi & Herz, Holger & Kosfeld, Michael & Oswald, Yvonne, 2021. "Do preferences and biases predict life outcomes? Evidence from education and labor market entry decisions," European Economic Review, Elsevier, vol. 134(C).
    6. Samek, Anya & Gray, Andre & Datar, Ashlesha & Nicosia, Nancy, 2021. "Adolescent time and risk preferences: Measurement, determinants and field consequences," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 460-488.
    7. Marco Castillo & John A. List & Ragan Petrie & Anya Samek, 2020. "Detecting Drivers of Behavior at an Early Age: Evidence from a Longitudinal Field Experiment," NBER Working Papers 28288, National Bureau of Economic Research, Inc.
    8. Datar, Ashlesha & Nicosia, Nancy & Samek, Anya, 2023. "Heterogeneity in place effects on health: The case of time preferences and adolescent obesity," Economics & Human Biology, Elsevier, vol. 49(C).
    9. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    10. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    11. Daniel Horn & Hubert Janos Kiss, 2018. "Which preferences associate with school performance?—Lessons from an exploratory study with university students," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-32, February.
    12. Zimmermann, Klaus F. & Chowdhury, Shyamal & Sutter, Matthias, 2020. "Economic preferences across generations and family clusters: A large-scale experiment," CEPR Discussion Papers 14998, C.E.P.R. Discussion Papers.
    13. Thomas, Ranjeeta & Galizzi, Matteo M. & Moorhouse, Louisa & Nyamukapa, Constance & Hallett, Timothy B., 2024. "Do risk, time and prosocial preferences predict risky sexual behaviour of youths in a low-income, high-risk setting?," Journal of Health Economics, Elsevier, vol. 93(C).
    14. Andreoni, James & Di Girolamo, Amalia & List, John A. & Mackevicius, Claire & Samek, Anya, 2020. "Risk preferences of children and adolescents in relation to gender, cognitive skills, soft skills, and executive functions," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 729-742.
    15. Andreoni, James & Kuhn, Michael A. & List, John A. & Samek, Anya & Sokal, Kevin & Sprenger, Charles, 2019. "Toward an understanding of the development of time preferences: Evidence from field experiments," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    16. Shyamal Chowdhury & Matthias Sutter & Klaus F. Zimmermann, 2018. "Evaluating Intergenerational Persistence of Economic Preferences: A Large Scale Experiment with Families in Bangladesh," CESifo Working Paper Series 6914, CESifo.
    17. Non, Arjan & Tempelaar, Dirk, 2016. "Time preferences, study effort, and academic performance," Economics of Education Review, Elsevier, vol. 54(C), pages 36-61.
    18. Matthias Sutter & Michael Weyland & Anna Untertrifaller & Manuel Froitzheim, 2020. "Financial literacy, risk and time preferences - Results from a randomized educational intervention," Working Papers 2020-27, Faculty of Economics and Statistics, Universität Innsbruck.
    19. Silvia Angerer & Jana Bolvashenkova & Daniela Glätzle-Rützler & Philipp Lergetporer & Matthias Sutter, 2021. "Children’s patience and school-track choices several years later: Linking experimental and field data," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2021_12, Max Planck Institute for Research on Collective Goods.
    20. Sutter, Matthias & Weyland, Michael & Untertrifaller, Anna & Froitzheim, Manuel & Schneider, Sebastian O., 2023. "Financial Literacy, Experimental Preference Measures and Field Behavior – A Randomized Educational Intervention," IZA Discussion Papers 16102, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    developmental decision-making; field experiments; economic preferences; teenagers;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aoz:wpaper:214. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Laura Inés D Amato (email available below). General contact details of provider: https://edirc.repec.org/data/redniar.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.