IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v35y2011i6p673-722.html
   My bibliography  Save this article

Evaluating Free-Choice Climate Education Interventions Applying Propensity Score Matching

Author

Listed:
  • Hansjoerg Gaus
  • Christoph Emanuel Mueller

Abstract

Background and objectives . The majority of environmental education takes place in informal settings, of which so-called free-choice learning is typical. What is understood by this is a kind of learning which is self-determined and driven by the needs and interests of the learner. The voluntariness of participation in interventions and the fact that they take place in turbulent action settings lead to formidable challenges for impact evaluation, particularly because often no randomized control trials (RCTs) or before-and-after measurements can be carried out. In this article, the evaluation of five different interventions from a large-scale program on consumer climate education provides the empirical background for illustrating the problems confronting quasi-experimental impact analyses in a free-choice context and presenting a possible solution based on propensity score matching (PSM). Method . In a quasi-experimental control-group design, intervention participants and nonparticipants filled out questionnaires featuring the same behavioral intentions. The challenges due to selection processes were met with radius matching on the basis of sociodemographic characteristics as covariates. Sensitivity analyses on the basis of Rosenbaum Bounds and the Hodges-Lehmann point estimator were used for assessing the robustness of treatment effects against unobserved confounding variables. Results . The analyses show that all the interventions under study positively influenced intentions to seek further advice or information on the topics covered. Furthermore, for all the interventions, significant positive effects on the intentions relating directly to climate-friendly behavior could be identified. In this context, PSM and sensitivity analyses proved to be effective methods. However, there were several limitations due to conceptual and methodological issues, and these are discussed below.

Suggested Citation

  • Hansjoerg Gaus & Christoph Emanuel Mueller, 2011. "Evaluating Free-Choice Climate Education Interventions Applying Propensity Score Matching," Evaluation Review, , vol. 35(6), pages 673-722, December.
  • Handle: RePEc:sae:evarev:v:35:y:2011:i:6:p:673-722
    DOI: 10.1177/0193841X12439703
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X12439703
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0193841X12439703?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ajzen, Icek, 1991. "The theory of planned behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 50(2), pages 179-211, December.
    2. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    3. Shadish, William R. & Clark, M. H. & Steiner, Peter M., 2008. "Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1334-1344.
    4. Geller, E Scott, 1981. "Evaluating Energy Conservation Programs: Is Verbal Report Enough?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 8(3), pages 331-335, December.
    5. Heimlich, Joe E., 2010. "Environmental education evaluation: Reinterpreting education as a strategy for meeting mission," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 180-185, May.
    6. Juan Jose Diaz & Sudhanshu Handa, 2006. "An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator: Evidence from Mexico’s PROGRESA Program," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gonzalo Nunez-Chaim & Henry G. Overman & Capucine Riom, 2024. "Does subsidising business advice improve firm performance? Evidence from a large RCT," CEP Discussion Papers dp1977, Centre for Economic Performance, LSE.
    2. Lim, E.A & Manohar, M. & Aziz, Azlizam & Zakaria, M., 2016. "Influencing secondary school STUDENTS’ conservation behavior intention through an interpretive education program on the malayan tapir," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 60-69.
    3. Solomon, S. & Ketema, M., 2015. "Impact of Irrigation Technologies on Rural Households’ Poverty Status: the Case of Fogera District, North-Western Ethiopia," AGRIS on-line Papers in Economics and Informatics, Czech University of Life Sciences Prague, Faculty of Economics and Management, vol. 7(1), pages 1-9, March.
    4. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    5. Anna Haskins, 2013. "Mass Imprisonment and the Intergenerational Transmission of Disadvantage: Paternal Incarceration and Children’s Cognitive Skill Development," Working Papers wp13-15-ff, Princeton University, School of Public and International Affairs, Center for Research on Child Wellbeing..
    6. Kua, H.W. & Wong, S.E., 2012. "Lessons for integrated household energy conservation policies from an intervention study in Singapore," Energy Policy, Elsevier, vol. 47(C), pages 49-56.
    7. Inna Cintina & Inessa Love, 2014. "The Miracle of Microfinance Revisited: Evidence from Propensity Score Matching," Working Papers 201424, University of Hawaii at Manoa, Department of Economics.
    8. Gerhard Krug, 2017. "Augmenting propensity score equations to avoid misspecification bias – Evidence from a Monte Carlo simulation [Erweiterung der Propensity Score Gleichung zur Vermeidung von Fehlspezifikationen? Ein," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 11(3), pages 205-231, December.
    9. Yu-Shan Chen & Shu-Tzu Hung & Ting-Yu Wang & A-Fen Huang & Yen-Wen Liao, 2017. "The Influence of Excessive Product Packaging on Green Brand Attachment: The Mediation Roles of Green Brand Attitude and Green Brand Image," Sustainability, MDPI, vol. 9(4), pages 1-15, April.
    10. Dridi, Ichrak & Boughrara, Adel, 2021. "On the effect of full-fledged IT adoption on stock returns and their conditional volatility: Evidence from propensity score matching," The Quarterly Review of Economics and Finance, Elsevier, vol. 80(C), pages 179-194.
    11. Geng, Jichao & Long, Ruyin & Chen, Hong, 2016. "Impact of information intervention on travel mode choice of urban residents with different goal frames: A controlled trial in Xuzhou, China," Transportation Research Part A: Policy and Practice, Elsevier, vol. 91(C), pages 134-147.
    12. Seonho Shin, 2022. "Evaluating the Effect of the Matching Grant Program for Refugees: An Observational Study Using Matching, Weighting, and the Mantel-Haenszel Test," Journal of Labor Research, Springer, vol. 43(1), pages 103-133, March.
    13. Melba V. Tutor, 2014. "The impact of the PhilippinesÕ conditional cash transfer program on consumption," Philippine Review of Economics, University of the Philippines School of Economics and Philippine Economic Society, vol. 51(1), pages 117-161, June.
    14. Rentocchini, Francesco & D'Este, Pablo & Manjarrés-Henríquez, Liney & Grimaldi, Rosa, 2014. "The relationship between academic consulting and research performance: Evidence from five Spanish universities," International Journal of Industrial Organization, Elsevier, vol. 32(C), pages 70-83.
    15. Halldén, Karin & Stenberg, Anders, 2013. "The Relationship between Hours of Domestic Services and Female Earnings: Panel Register Data Evidence from a Reform," Working Paper Series 4/2013, Stockholm University, Swedish Institute for Social Research.
    16. Anders Stenberg & Olle Westerlund, 2015. "The long-term earnings consequences of general vs. specific training of the unemployed," IZA Journal of European Labor Studies, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-26, December.
    17. Ashimwe, Olive, 2016. "An Economic Analysis Of Impact Of Weather Index-Based Crop Insurance On Household Income In Huye District Of Rwanda," Research Theses 276460, Collaborative Masters Program in Agricultural and Applied Economics.
    18. Ashimwe, Olive, 2016. "An Economic Analysis Of Impact Of Weather Index-Based Crop Insurance On Household Income In Huye District Of Rwanda," Research Theses 265675, Collaborative Masters Program in Agricultural and Applied Economics.
    19. Anders Stenberg & Xavier Luna & Olle Westerlund, 2014. "Does Formal Education for Older Workers Increase Earnings? — Evidence Based on Rich Data and Long-term Follow-up," LABOUR, CEIS, vol. 28(2), pages 163-189, June.
    20. Nikolova, Milena & Graham, Carol, 2015. "In transit: The well-being of migrants from transition and post-transition countries," Journal of Economic Behavior & Organization, Elsevier, vol. 112(C), pages 164-186.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:35:y:2011:i:6:p:673-722. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.