IDEAS home Printed from https://ideas.repec.org/p/feb/natura/00673.html
   My bibliography  Save this paper

Exploring encouragement, treatment and spillover effects using principal stratification, with application to a field experiment on teens' museum attendance

Author

Listed:
  • Laura Forastiere
  • Patrizia Lattarulo
  • Marco Mariani
  • Fabrizia Mealli
  • Laura Razzolini

Abstract

This paper revisits results from a field experiment conducted in Florence, Italy to study the effects of incentives offered to high school teens to motivate them to visit art museums and to identify best practices to transform this behavior into a long run cultural consumption. Students belonging to a first group of classes receive a flier with basic information and opening hours of a main museum in Florence, Palazzo Vecchio. Students in a second group of classes receive the flyer and a short presentation conducted by an art expert. Students in a third group of classes, in addition to the flyer and the presentation, receive also a nonfinancial reward in the form of extra-credit points towards their school grade. Taking a Principal Stratification approach, we explore the causal pathways that may lead students to increase their future museum attendance. Within the strata defined by compliance to the three forms of encouragement, we estimate associative and dissociative principal causal effects, that is, effects of the encouragement on the primary outcome, long run cultural consumption, that are associative or dissociative with respect to the effects of the encouragements on the Palazzo Vecchio visit. This analysis allows to interpret these effects as ascribable either to the encouragements, or to the museum visits, or to classroom spillovers. To face identification issues, estimation is performed with Bayesian inferential methods using hierarchical models to account for clustering. The main findings of the analysis are as follows: what seems to matter the most is the motivational incentive (i.e., the presentation), rather than the induced experience, i.e., the Palazzo Vecchio visit.

Suggested Citation

  • Laura Forastiere & Patrizia Lattarulo & Marco Mariani & Fabrizia Mealli & Laura Razzolini, 2019. "Exploring encouragement, treatment and spillover effects using principal stratification, with application to a field experiment on teens' museum attendance," Natural Field Experiments 00673, The Field Experiments Website.
  • Handle: RePEc:feb:natura:00673
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00673.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    2. Sobel, Michael E., 2006. "What Do Randomized Studies of Housing Mobility Demonstrate?: Causal Inference in the Face of Interference," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1398-1407, December.
    3. Tamer, Elie, 2010. "Partial Identification in Econometrics," Scholarly Articles 34728615, Harvard University Department of Economics.
    4. Gustafson Paul, 2010. "Bayesian Inference for Partially Identified Models," The International Journal of Biostatistics, De Gruyter, vol. 6(2), pages 1-20, March.
    5. Hong, Guanglei & Raudenbush, Stephen W., 2006. "Evaluating Kindergarten Retention Policy: A Case Study of Causal Inference for Multilevel Observational Data," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 901-910, September.
    6. Patrizia Lattarulo & Marco Mariani & Laura Razzolini, 2017. "Nudging museums attendance: a field experiment with high school teens," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 41(3), pages 259-277, August.
    7. Laura Forastiere & Fabrizia Mealli & Tyler J. VanderWeele, 2016. "Identification and Estimation of Causal Mechanisms in Clustered Encouragement Designs: Disentangling Bed Nets Using Bayesian Principal Stratification," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 510-525, April.
    8. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    9. Fabrizia Mealli & Barbara Pacini, 2013. "Using Secondary Outcomes to Sharpen Inference in Randomized Experiments With Noncompliance," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 1120-1131, September.
    10. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    11. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    12. VanderWeele Tyler J, 2011. "Principal Stratification -- Uses and Limitations," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-14, July.
    13. VanderWeele, Tyler J., 2008. "Simple relations between principal stratification and direct and indirect effects," Statistics & Probability Letters, Elsevier, vol. 78(17), pages 2957-2962, December.
    14. Elie Tamer, 2010. "Partial Identification in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 167-195, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Silvia Noirjean & Mario Biggeri & Laura Forastiere & Fabrizia Mealli & Maria Nannini, 2023. "Estimating causal effects of community health financing via principal stratification," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(4), pages 1317-1350, October.
    2. Silvia Noirjean & Marco Mariani & Alessandra Mattei & Fabrizia Mealli, 2020. "Exploiting network information to disentangle spillover effects in a field experiment on teens' museum attendance," Papers 2011.11023, arXiv.org, revised May 2022.
    3. Giulio Grossi & Marco Mariani & Alessandra Mattei & Patrizia Lattarulo & Ozge Oner, 2020. "Direct and spillover effects of a new tramway line on the commercial vitality of peripheral streets. A synthetic-control approach," Papers 2004.05027, arXiv.org, revised Nov 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Silvia Noirjean & Marco Mariani & Alessandra Mattei & Fabrizia Mealli, 2020. "Exploiting network information to disentangle spillover effects in a field experiment on teens' museum attendance," Papers 2011.11023, arXiv.org, revised May 2022.
    2. Huber, Martin & Steinmayr, Andreas, 2017. "A Framework for Separating Individual Treatment Effects from Spillover, Interaction, and General Equilibrium Effects," IZA Discussion Papers 10648, Institute of Labor Economics (IZA).
    3. Chanmin Kim & Lucas R. F. Henneman & Christine Choirat & Corwin M. Zigler, 2020. "Health effects of power plant emissions through ambient air quality," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1677-1703, October.
    4. Laura Forastiere & Fabrizia Mealli & Tyler J. VanderWeele, 2016. "Identification and Estimation of Causal Mechanisms in Clustered Encouragement Designs: Disentangling Bed Nets Using Bayesian Principal Stratification," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 510-525, April.
    5. Zhichao Jiang & Shu Yang & Peng Ding, 2022. "Multiply robust estimation of causal effects under principal ignorability," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1423-1445, September.
    6. Silvia Noirjean & Mario Biggeri & Laura Forastiere & Fabrizia Mealli & Maria Nannini, 2023. "Estimating causal effects of community health financing via principal stratification," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(4), pages 1317-1350, October.
    7. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    8. Chiba, Yasutaka, 2012. "A note on bounds for the causal infectiousness effect in vaccine trials," Statistics & Probability Letters, Elsevier, vol. 82(7), pages 1422-1429.
    9. Bartalotti, Otávio & Kédagni, Désiré & Possebom, Vitor, 2023. "Identifying marginal treatment effects in the presence of sample selection," Journal of Econometrics, Elsevier, vol. 234(2), pages 565-584.
    10. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    11. Tyler J. VanderWeele, 2010. "Direct and Indirect Effects for Neighborhood-Based Clustered and Longitudinal Data," Sociological Methods & Research, , vol. 38(4), pages 515-544, May.
    12. Fan Yang & Dylan S. Small, 2016. "Using post-outcome measurement information in censoring-by-death problems," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 299-318, January.
    13. Tadao Hoshino & Takahide Yanagi, 2021. "Causal Inference with Noncompliance and Unknown Interference," Papers 2108.07455, arXiv.org, revised Oct 2023.
    14. Giovanni Cerulli, 2014. "ntreatreg: a Stata module for estimation of treatment effects in the presence of neighborhood interactions," United Kingdom Stata Users' Group Meetings 2014 15, Stata Users Group.
    15. Mealli Fabrizia & Mattei Alessandra, 2012. "A Refreshing Account of Principal Stratification," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-19, April.
    16. Brian J. Reich & Shu Yang & Yawen Guan & Andrew B. Giffin & Matthew J. Miller & Ana Rappold, 2021. "A Review of Spatial Causal Inference Methods for Environmental and Epidemiological Applications," International Statistical Review, International Statistical Institute, vol. 89(3), pages 605-634, December.
    17. Martin Huber & Mark Schelker & Anthony Strittmatter, 2022. "Direct and Indirect Effects based on Changes-in-Changes," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(1), pages 432-443, January.
    18. Vitor Possebom, 2021. "Crime and Mismeasured Punishment: Marginal Treatment Effect with Misclassification," Papers 2106.00536, arXiv.org, revised Jul 2023.
    19. Andrea Mercatanti & Fan Li, 2017. "Do debit cards decrease cash demand?: causal inference and sensitivity analysis using principal stratification," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(4), pages 759-776, August.
    20. Lukáš Lafférs, 2019. "Identification in Models with Discrete Variables," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 657-696, February.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:natura:00673. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesca Pagnotta (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.