IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v103y2020ics0095069620300607.html
   My bibliography  Save this article

Causal forest estimation of heterogeneous and time-varying environmental policy effects

Author

Listed:
  • Miller, Steve

Abstract

Empirically evaluating environmental policies requires grappling with impacts that exhibit not only cross-sectional heterogeneity, but also variation across time. Phased policy roll-outs offer opportunities for improvement across cohorts and policy effects can grow or decay, especially when natural processes are involved. Focusing on a subset of these factors can lead to erroneous inference, while considering them jointly magnifies specification challenges. To address these challenges, I extend and apply causal forests, a nonparametric method for estimating heterogeneous treatment effects, to simultaneously examine how effects vary across time. I first adapt causal forests to a panel setting with staggered policy introduction by incorporating dynamic selection assumptions and estimators. After illustrating the method's performance on simulated data, I use it to reanalyze how individual quota programs have affected fisheries catches around the world. Estimates reveal substantial heterogeneity and time dependencies and suggest that longer policy exposure may be less beneficial than previously thought. More generally, the approach has potential value for evaluating impacts of a range of environmental policies as well as environmental shocks.

Suggested Citation

  • Miller, Steve, 2020. "Causal forest estimation of heterogeneous and time-varying environmental policy effects," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
  • Handle: RePEc:eee:jeeman:v:103:y:2020:i:c:s0095069620300607
    DOI: 10.1016/j.jeem.2020.102337
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069620300607
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeem.2020.102337?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Racine, Jeff & Li, Qi, 2004. "Nonparametric estimation of regression functions with both categorical and continuous data," Journal of Econometrics, Elsevier, vol. 119(1), pages 99-130, March.
    2. Burlig, Fiona & Preonas, Louis & Woerman, Matt, 2020. "Panel data and experimental design," Journal of Development Economics, Elsevier, vol. 144(C).
    3. Lu Tian & Ash A. Alizadeh & Andrew J. Gentles & Robert Tibshirani, 2014. "A Simple Method for Estimating Interactions Between a Treatment and a Large Number of Covariates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1517-1532, December.
    4. Auffhammer, Maximilian & Bento, Antonio M. & Lowe, Scott E., 2009. "Measuring the effects of the Clean Air Act Amendments on ambient PM10 concentrations: The critical importance of a spatially disaggregated analysis," Journal of Environmental Economics and Management, Elsevier, vol. 58(1), pages 15-26, July.
    5. Guido W. Imbens, 2015. "Matching Methods in Practice: Three Examples," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 373-419.
    6. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
    7. Gallagher, Kelly Sims & Muehlegger, Erich, 2011. "Giving green to get green? Incentives and consumer adoption of hybrid vehicle technology," Journal of Environmental Economics and Management, Elsevier, vol. 61(1), pages 1-15, January.
    8. Christopher Costello & Corbett A. Grainger, 2018. "Property Rights, Regulatory Capture, and Exploitation of Natural Resources," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 5(2), pages 441-479.
    9. Jason Abrevaya & Yu-Chin Hsu & Robert P. Lieli, 2015. "Estimating Conditional Average Treatment Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 485-505, October.
    10. G. Kapetanios, 2008. "A bootstrap procedure for panel data sets with many cross-sectional units," Econometrics Journal, Royal Economic Society, vol. 11(2), pages 377-395, July.
    11. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
    12. Maximilian Auffhammer & Ryan Kellogg, 2011. "Clearing the Air? The Effects of Gasoline Content Regulation on Air Quality," American Economic Review, American Economic Association, vol. 101(6), pages 2687-2722, October.
    13. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9-10), pages 1082-1095, October.
    14. Alan Barreca & Karen Clay & Olivier Deschenes & Michael Greenstone & Joseph S. Shapiro, 2016. "Adapting to Climate Change: The Remarkable Decline in the US Temperature-Mortality Relationship over the Twentieth Century," Journal of Political Economy, University of Chicago Press, vol. 124(1), pages 105-159.
    15. Jonathan M.V. Davis & Sara B. Heller, 2017. "Using Causal Forests to Predict Treatment Heterogeneity: An Application to Summer Jobs," American Economic Review, American Economic Association, vol. 107(5), pages 546-550, May.
    16. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    17. Reed, William J., 1979. "Optimal escapement levels in stochastic and deterministic harvesting models," Journal of Environmental Economics and Management, Elsevier, vol. 6(4), pages 350-363, December.
    18. Hunt Allcott & Todd Rogers, 2014. "The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation," American Economic Review, American Economic Association, vol. 104(10), pages 3003-3037, October.
    19. Costello, Christopher & Polasky, Stephen, 2008. "Optimal harvesting of stochastic spatial resources," Journal of Environmental Economics and Management, Elsevier, vol. 56(1), pages 1-18, July.
    20. Matt Taddy & Matt Gardner & Liyun Chen & David Draper, 2016. "A Nonparametric Bayesian Analysis of Heterogenous Treatment Effects in Digital Experimentation," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 661-672, October.
    21. Meredith Fowlie, 2010. "Emissions Trading, Electricity Restructuring, and Investment in Pollution Abatement," American Economic Review, American Economic Association, vol. 100(3), pages 837-869, June.
    22. Peter Hall & Qi Li & Jeffrey S. Racine, 2007. "Nonparametric Estimation of Regression Functions in the Presence of Irrelevant Regressors," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 784-789, November.
    23. Benjamin Handel & Jonathan Kolstad, 2017. "Wearable Technologies and Health Behaviors: New Data and New Methods to Understand Population Health," American Economic Review, American Economic Association, vol. 107(5), pages 481-485, May.
    24. Grafton, R Quentin & Squires, Dale & Fox, Kevin J, 2000. "Private Property and Economic Efficiency: A Study of a Common-Pool Resource," Journal of Law and Economics, University of Chicago Press, vol. 43(2), pages 679-713, October.
    25. Michael Lechner & Ruth Miquel, 2010. "Identification of the effects of dynamic treatments by sequential conditional independence assumptions," Empirical Economics, Springer, vol. 39(1), pages 111-137, August.
    26. Corey White, 2017. "The Dynamic Relationship between Temperature and Morbidity," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(4), pages 1155-1198.
    27. Pinkerton, Evelyn & Edwards, Danielle N., 2009. "The elephant in the room: The hidden costs of leasing individual transferable fishing quotas," Marine Policy, Elsevier, vol. 33(4), pages 707-713, July.
    28. Steve Martin & Nicholas Rivers, 2018. "Information Provision, Market Incentives, and Household Electricity Consumption: Evidence from a Large-Scale Field Deployment," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 5(1), pages 207-231.
    29. Sam Asher & Denis Nekipelov & Paul Novosad & Stephen P. Ryan, 2016. "Classification Trees for Heterogeneous Moment-Based Models," NBER Working Papers 22976, National Bureau of Economic Research, Inc.
    30. Grooms, Katherine K., 2015. "Enforcing the Clean Water Act: The effect of state-level corruption on compliance," Journal of Environmental Economics and Management, Elsevier, vol. 73(C), pages 50-78.
    31. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9), pages 1082-1095.
    32. Elisabeth Thuestad Isaksen & Andries Richter, 2019. "Tragedy, Property Rights, and the Commons: Investigating the Causal Relationship from Institutions to Ecosystem Collapse," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 6(4), pages 741-781.
    33. Paul J. Ferraro & Juan Jose Miranda & Michael K. Price, 2011. "The Persistence of Treatment Effects with Norm-Based Policy Instruments: Evidence from a Randomized Environmental Policy Experiment," American Economic Review, American Economic Association, vol. 101(3), pages 318-322, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hayakawa, Kazunobu & Keola, Souknilanh & Silaphet, Korrakoun & Yamanouchi, Kenta, 2022. "Estimating the impacts of international bridges on foreign firm locations: a machine learning approach," IDE Discussion Papers 847, Institute of Developing Economies, Japan External Trade Organization(JETRO).
    2. Chang Cai & Sandy Dall’Erba, 2021. "On the evaluation of heterogeneous climate change impacts on US agriculture: does group membership matter?," Climatic Change, Springer, vol. 167(1), pages 1-23, July.
    3. Axenbeck, Janna & Berner, Anne & Kneib, Thomas, 2022. "What drives the relationship between digitalization and industrial energy demand? Exploring firm-level heterogeneity," ZEW Discussion Papers 22-059, ZEW - Leibniz Centre for European Economic Research.
    4. Marco Letta & Pierluigi Montalbano & Adriana Paolantonio, 2024. "Climate Immobility Traps: A Household-Level Test," Papers 2403.09470, arXiv.org.
    5. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    6. Christian Stetter & Philipp Mennig & Johannes Sauer, 2022. "Using Machine Learning to Identify Heterogeneous Impacts of Agri-Environment Schemes in the EU: A Case Study," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(4), pages 723-759.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kayo Murakami & Hideki Shimada & Yoshiaki Ushifusa & Takanori Ida, 2022. "Heterogeneous Treatment Effects Of Nudge And Rebate: Causal Machine Learning In A Field Experiment On Electricity Conservation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1779-1803, November.
    2. Lechner, Michael, 2018. "Modified Causal Forests for Estimating Heterogeneous Causal Effects," IZA Discussion Papers 12040, Institute of Labor Economics (IZA).
    3. Michael C Knaus & Michael Lechner & Anthony Strittmatter, 2021. "Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 134-161.
    4. Michael Lechner & Jana Mareckova, 2022. "Modified Causal Forest," Papers 2209.03744, arXiv.org.
    5. Andor, Mark A. & Gerster, Andreas & Peters, Jörg, 2022. "Information campaigns for residential energy conservation," European Economic Review, Elsevier, vol. 144(C).
    6. Céline Nauges & Dale Whittington, 2019. "Social Norms Information Treatments in the Municipal Water Supply Sector: Some New Insights on Benefits and Costs," Water Economics and Policy (WEP), World Scientific Publishing Co. Pte. Ltd., vol. 5(03), pages 1-40, July.
    7. Joshua Henkel & Georg Schwesinger, 2020. "Establishing Sustainable Consumption - How Future Policies Can Channel Consumer Preferences," Bremen Papers on Economics & Innovation 2007, University of Bremen, Faculty of Business Studies and Economics.
    8. Cattaneo, Cristina & D’Adda, Giovanna & Tavoni, Massimo & Bonan, Jacopo, 2019. "Can We Make Social Information Programs More Effective? The Role of Identity and Values," RFF Working Paper Series 19-21, Resources for the Future.
    9. Denis Hilton & Nicolas Treich & Gaetan Lazzara & Philippe Tendil, 2018. "Designing effective nudges that satisfy ethical constraints: the case of environmentally responsible behaviour," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 17(1), pages 27-38, November.
    10. Mekonnen, Alemu & Hassen, Sied & Jaime, Marcela & Toman, Michael & Zhang, Xiao-Bing, 2023. "The effect of information and subsidy on adoption of solar lanterns: An application of the BDM bidding mechanism in rural Ethiopia," Energy Economics, Elsevier, vol. 124(C).
    11. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    12. Uddin, Main & Wang, Liang Choon & Smyth, Russell, 2021. "Do government-initiated energy comparison sites encourage consumer search and lower prices? Evidence from an online randomized controlled experiment in Australia," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 167-182.
    13. Bhanot, Syon P., 2017. "Rank and response: A field experiment on peer information and water use behavior," Journal of Economic Psychology, Elsevier, vol. 62(C), pages 155-172.
    14. Jason Delaney & Sarah Jacobson, 2016. "Payments or Persuasion: Common Pool Resource Management with Price and Non-price Measures," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(4), pages 747-772, December.
    15. Holladay, Scott & LaRiviere, Jacob & Novgorodsky, David & Price, Michael, 2019. "Prices versus nudges: What matters for search versus purchase of energy investments?," Journal of Public Economics, Elsevier, vol. 172(C), pages 151-173.
    16. Daniel A. Brent & Corey Lott & Michael Taylor & Joseph Cook & Kimberly Rollins & Shawn Stoddard, 2020. "What Causes Heterogeneous Responses to Social Comparison Messages for Water Conservation?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 77(3), pages 503-537, November.
    17. Kandul, Serhiy & Lanz, Bruno, 2021. "Public good provision, in-group cooperation and out-group descriptive norms: A lab experiment," Journal of Economic Psychology, Elsevier, vol. 85(C).
    18. Phillip Heiler & Michael C. Knaus, 2021. "Effect or Treatment Heterogeneity? Policy Evaluation with Aggregated and Disaggregated Treatments," Papers 2110.01427, arXiv.org, revised Aug 2023.
    19. Todd D. Gerarden & Richard G. Newell & Robert N. Stavins, 2017. "Assessing the Energy-Efficiency Gap," Journal of Economic Literature, American Economic Association, vol. 55(4), pages 1486-1525, December.
    20. Andor, Mark A. & Fels, Katja M., 2018. "Behavioral Economics and Energy Conservation – A Systematic Review of Non-price Interventions and Their Causal Effects," Ecological Economics, Elsevier, vol. 148(C), pages 178-210.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:103:y:2020:i:c:s0095069620300607. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.