IDEAS home Printed from https://ideas.repec.org/a/eee/jfpoli/v90y2020ics0306919219306128.html
   My bibliography  Save this article

Estimating the effects of agri-environmental measures using difference-in-difference coarsened exact matching

Author

Listed:
  • Bertoni, Danilo
  • Curzi, Daniele
  • Aletti, Giacomo
  • Olper, Alessandro

Abstract

This paper studies the effect of agri-environmental measures (AEMs) in improving greener farming practices. We focus on the quantification of the effectiveness of AEMs implemented in the Rural Development Programme of the Lombardy Region, during the 2007–2013 programming period. Our work attempts to address the well-known potential failures of these kinds of policy instruments – such as adverse selection effects – by relying on an innovative matching procedure, the coarsened exact matching (CEM). This methodology presents a number of interesting properties that are worth considering in policy-evaluation analyses. Our empirical analysis focuses on three AEM schemes protecting and enhancing the environment, Crops diversification, Grassland maintenance and Organic farming. Overall, our results suggest that AEMs were apparently effective in improving the farms’ environmental performances. However, our preliminary cost-benefit analysis highlights that the costs of implementing this policy, when compared to the additional results obtained, tend to be quite large.

Suggested Citation

  • Bertoni, Danilo & Curzi, Daniele & Aletti, Giacomo & Olper, Alessandro, 2020. "Estimating the effects of agri-environmental measures using difference-in-difference coarsened exact matching," Food Policy, Elsevier, vol. 90(C).
    • Handle: RePEc:eee:jfpoli:v:90:y:2020:i:c:s0306919219306128
    DOI: 10.1016/j.foodpol.2019.101790
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306919219306128
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.foodpol.2019.101790?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alfons Oude Lansink & Ky–sti Pietola, 2002. "Effciency and productivity of conventional and organic farms in Finland 1994--1997," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 29(1), pages 51-66, March.
    2. Garrone, Maria & Emmers, Dorien & Olper, Alessandro & Swinnen, Johan, 2019. "Jobs and agricultural policy: Impact of the common agricultural policy on EU agricultural employment," Food Policy, Elsevier, vol. 87(C), pages 1-1.
    3. Baylis, Kathy & Peplow, Stephen & Rausser, Gordon & Simon, Leo, 2008. "Agri-environmental policies in the EU and United States: A comparison," Ecological Economics, Elsevier, vol. 65(4), pages 753-764, May.
    4. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    5. Andrea Pufahl & Christoph R. Weiss, 2009. "Evaluating the effects of farm programmes: results from propensity score matching," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 36(1), pages 79-101, March.
    6. Canton, Joan & De Cara, Stéphane & Jayet, Pierre-Alain, 2009. "Agri-environmental schemes: Adverse selection, information structure and delegation," Ecological Economics, Elsevier, vol. 68(7), pages 2114-2121, May.
    7. Stefano Iacus & Gary King & Giuseppe Porro, 2008. "Matching for Causal Inference Without Balance Checking," UNIMI - Research Papers in Economics, Business, and Statistics unimi-1073, Universitá degli Studi di Milano.
    8. Chabé-Ferret, Sylvain & Subervie, Julie, 2013. "How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 12-27.
    9. Edi Defrancesco & Paola Gatto & Ford Runge & Samuele Trestini, 2008. "Factors Affecting Farmers’ Participation in Agri‐environmental Measures: A Northern Italian Perspective," Journal of Agricultural Economics, Wiley Blackwell, vol. 59(1), pages 114-131, February.
    10. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2011. "Multivariate Matching Methods That Are Monotonic Imbalance Bounding," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 345-361.
    11. Pacini, G. Cesare & Merante, Paolo & Lazzerini, Giulio & Van Passel, Steven, 2015. "Increasing the cost-effectiveness of EU agri-environment policy measures through evaluation of farm and field-level environmental and economic performance," Agricultural Systems, Elsevier, vol. 136(C), pages 70-78.
    12. Alessandro Olper & Valentina Raimondi & Daniele Cavicchioli & Mauro Vigani, 2014. "Do CAP payments reduce farm labour migration? A panel data analysis across EU regions," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 41(5), pages 843-873.
    13. Bertoni, Danilo & Cavicchioli, Daniele & Pretolani, Roberto & Olper, Alessandro, 2008. "Agri-Environmental Measures Adoption: New Evidence From Lombardy Region," 109th Seminar, November 20-21, 2008, Viterbo, Italy 44848, European Association of Agricultural Economists.
    14. Yann Desjeux & Pierre Dupraz & Tom Kuhlman & Maria Luisa Paracchini & Rolf Michels & Élise Maigné & Stijn Reinhard, 2015. "Evaluating the impact of rural development measures on nature value indicators at different spatial levels: Application to France and The Netherlands," Post-Print hal-02638882, HAL.
    15. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2019. "A Theory of Statistical Inference for Matching Methods in Causal Research," Political Analysis, Cambridge University Press, vol. 27(1), pages 46-68, January.
    16. Balana, Bedru Babulo & Vinten, Andy & Slee, Bill, 2011. "A review on cost-effectiveness analysis of agri-environmental measures related to the EU WFD: Key issues, methods, and applications," Ecological Economics, Elsevier, vol. 70(6), pages 1021-1031, April.
    17. Marita Laukkanen & Céline Nauges, 2014. "Evaluating Greening Farm Policies: A Structural Model for Assessing Agri-environmental Subsidies," Land Economics, University of Wisconsin Press, vol. 90(3), pages 458-481.
    18. Rob Hart, 2005. "Combating moral hazard in agri-environmental schemes: a multiple-agent approach," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 32(1), pages 75-91, March.
    19. Isabel Vanslembrouck & Guido Van Huylenbroeck & Wim Verbeke, 2002. "Determinants of the Willingness of Belgian Farmers to Participate in Agri‐environmental Measures," Journal of Agricultural Economics, Wiley Blackwell, vol. 53(3), pages 489-511, November.
    20. Engel, Stefanie & Pagiola, Stefano & Wunder, Sven, 2008. "Designing payments for environmental services in theory and practice: An overview of the issues," Ecological Economics, Elsevier, vol. 65(4), pages 663-674, May.
    21. Linda Arata & Paolo Sckokai, 2016. "The Impact of Agri-environmental Schemes on Farm Performance in Five E.U. Member States: A DID-Matching Approach," Land Economics, University of Wisconsin Press, vol. 92(1), pages 167-186.
    22. Stephen Hynes & Eoghan Garvey, 2009. "Modelling Farmers’ Participation in an Agri‐environmental Scheme using Panel Data: An Application to the Rural Environment Protection Scheme in Ireland," Journal of Agricultural Economics, Wiley Blackwell, vol. 60(3), pages 546-562, September.
    23. Sébastien Mary, 2013. "Assessing the Impacts of Pillar 1 and 2 Subsidies on TFP in French Crop Farms," Journal of Agricultural Economics, Wiley Blackwell, vol. 64(1), pages 133-144, February.
    24. Unay-Gailhard, İlkay & Bojnec, Štefan, 2015. "Farm size and participation in agri-environmental measures: Farm-level evidence from Slovenia," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 46, pages 273-282.
    25. Paracchini, Maria Luisa & Bulgheroni, Claudia & Borreani, Giorgio & Tabacco, Ernesto & Banterle, Alessandro & Bertoni, Danilo & Rossi, Graziano & Parolo, Gilberto & Origgi, Roberto & De Paola, Claudio, 2015. "A diagnostic system to assess sustainability at a farm level: The SOSTARE model," Agricultural Systems, Elsevier, vol. 133(C), pages 35-53.
    26. Bryson, Alex & Dorsett, Richard & Purdon, Susan, 2002. "The use of propensity score matching in the evaluation of active labour market policies," LSE Research Online Documents on Economics 4993, London School of Economics and Political Science, LSE Library.
    27. Martin Petrick & Patrick Zier, 2011. "Regional employment impacts of Common Agricultural Policy measures in Eastern Germany: a difference‐in‐differences approach," Agricultural Economics, International Association of Agricultural Economists, vol. 42(2), pages 183-193, March.
    28. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2012. "Causal Inference without Balance Checking: Coarsened Exact Matching," Political Analysis, Cambridge University Press, vol. 20(1), pages 1-24, January.
    29. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    30. Jack Peerlings & Nico Polman, 2008. "Agri-environmental contracting of Dutch dairy farms: the role of manure policies and the occurrence of lock-in," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 35(2), pages 167-191, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Simpson, Katherine & Armsworth, Paul R. & Dallimer, Martin & Nthambi, Mary & de Vries, Frans P. & Hanley, Nick, 2023. "Improving the ecological and economic performance of agri-environment schemes: Payment by modelled results versus payment for actions," Land Use Policy, Elsevier, vol. 130(C).
    2. Matthew C. LaFevor & Alexandra G. Ponette-González & Rebecca Larson & Leah M. Mungai, 2021. "Spatial Targeting of Agricultural Support Measures: Indicator-Based Assessment of Coverages and Leakages," Land, MDPI, vol. 10(7), pages 1-17, July.
    3. Carmelo Díaz-Poblete & María Carmen García-Cortijo & Juan Sebastián Castillo-Valero, 2021. "Is the Greening Instrument a Valid Precedent for the New Green Architecture of the CAP? The Case of Spain," Sustainability, MDPI, vol. 13(10), pages 1-11, May.
    4. Amer Ait Sidhoum & Carolin Canessa & Johannes Sauer, 2023. "Effects of agri‐environment schemes on farm‐level eco‐efficiency measures: Empirical evidence from EU countries," Journal of Agricultural Economics, Wiley Blackwell, vol. 74(2), pages 551-569, June.
    5. Federico Antonioli & Simone Severini & Mauro Vigani, 2023. "Visa for competitiveness: foreign workforce and Italian dairy farms’ performance," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 50(1), pages 115-150.
    6. Kabubo-Mariara, Jane & Machio, Phyllis Mumia & Njoroge, Michael Murigi & Chemengich, Margaret, 2023. "Links between firm registration and performance: Does it pay to register?," World Development, Elsevier, vol. 169(C).
    7. Maldonado, Joana Elisa & De Witte, Kristof, 2021. "The impact of information provision to parents: Experimental evidence on student outcomes," Journal of Behavioral and Experimental Finance, Elsevier, vol. 31(C).
    8. Uehleke, Reinhard & Petrick, Martin & Hüttel, Silke, 2022. "Evaluations of agri-environmental schemes based on observational farm data: The importance of covariate selection," Land Use Policy, Elsevier, vol. 114(C).
    9. Xiao, De & Yu, Fan & Guo, Chenhao, 2023. "The impact of China's pilot carbon ETS on the labor income share: Based on an empirical method of combining PSM with staggered DID," Energy Economics, Elsevier, vol. 124(C).
    10. Qiumei Li & Hayat Khan & Zuominyang Zhang & Ling Lin & Ke Huang, 2022. "The Impact of the Belt and Road Initiative on Corporate Excessive Debt Mechanism: Evidence from Difference-in-Difference Equation Model," Sustainability, MDPI, vol. 15(1), pages 1-19, December.
    11. Barreiro-Hurle, Jesus & Dessart, Francois J. & Rommel, Jens & Czajkowski, Mikołaj & Espinosa-Goded, Maria & Rodriguez-Entrena, Macario & Thomas, Fabian & Zagorska, Katarzyna, 2023. "Willing or complying? The delicate interplay between voluntary and mandatory interventions to promote farmers' environmental behavior," Food Policy, Elsevier, vol. 120(C).
    12. Adenuga, Adewale H. & Jack, Claire & Ashfield, Austen & Wallace, Michael, 2022. "Impact of Membership of Dairy Participatory Extension Group on Farm Income: An Application of a Difference-in-Differences Coarsened Exact Matching Approach," 96th Annual Conference, April 4-6, 2022, K U Leuven, Belgium 321170, Agricultural Economics Society - AES.
    13. Tsakiridis, Andreas & O’Donoghue, Cathal & Ryan, Mary & Cullen, Paula & Ó hUallacháin, Daire & Sheridan, Helen & Stout, Jane, 2022. "Examining the relationship between farmer participation in an agri-environment scheme and the quantity and quality of semi-natural habitats on Irish farms," Land Use Policy, Elsevier, vol. 120(C).
    14. Boga, Rubén & Paül, Valerià, 2023. "‘Because of its size, it’s not worth it!’: The viability of small-scale geographical indication schemes," Food Policy, Elsevier, vol. 121(C).
    15. Christian Stetter & Philipp Mennig & Johannes Sauer, 2022. "Using Machine Learning to Identify Heterogeneous Impacts of Agri-Environment Schemes in the EU: A Case Study," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(4), pages 723-759.
    16. Tsakiridis, Andreas & O’Donoghue, Cathal & Ryan, Mary & Cullen, Paula & ÓhUallacháin, Daire & Sheridan, Helen & Stout, Jane, 2021. "Examining the relationship between farmer participation in an agri-environment scheme and the quantity and quality of semi-natural habitats on farms - An Irish case study," 2021 Conference, August 17-31, 2021, Virtual 315280, International Association of Agricultural Economists.
    17. Jianing Xu & Weidong Li, 2023. "High-Speed Rail and Industrial Agglomeration: Evidence from China’s Urban Agglomerations," Land, MDPI, vol. 12(8), pages 1-18, August.
    18. Biedny, Christina & Whitacre, Brian & Gallardo, Roberto, 2022. "Do ‘dig once’ and permitting policies improve fiber availability?," Telecommunications Policy, Elsevier, vol. 46(5).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bertoni, D. & Curzi, D. & Iacus, S. & Olper, A., 2018. "Estimating the Causal Effect of Green Payments in Agriculture: The Coarsened Exact Matching," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 277381, International Association of Agricultural Economists.
    2. Michalek, Jerzy, 2022. "Environmental and farm impacts of the EU RDP agri-environmental measures: Evidence from Slovak regions," Land Use Policy, Elsevier, vol. 113(C).
    3. Cisilino, Federica & Bodini, Antonella & Zanoli, Agostina, 2019. "Rural development programs’ impact on environment: An ex-post evaluation of organic faming," Land Use Policy, Elsevier, vol. 85(C), pages 454-462.
    4. Uehleke, Reinhard & Petrick, Martin & Hüttel, Silke, 2022. "Evaluations of agri-environmental schemes based on observational farm data: The importance of covariate selection," Land Use Policy, Elsevier, vol. 114(C).
    5. Ito, Junichi & Feuer, Hart N. & Kitano, Shinichi & Asahi, Haruka, 2019. "Assessing the effectiveness of Japan's community-based direct payment scheme for hilly and mountainous areas," Ecological Economics, Elsevier, vol. 160(C), pages 62-75.
    6. Arata, Linda & Sckokai, P., 2013. "Impact of Agri-environmental Schemes on Farm Performances in five EU Member States," 2013 Second Congress, June 6-7, 2013, Parma, Italy 149771, Italian Association of Agricultural and Applied Economics (AIEAA).
    7. Amer Ait Sidhoum & Philipp Mennig & Johannes Sauer, 2023. "Do agri-environment measures help improve environmental and economic efficiency? Evidence from Bavarian dairy farmers," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 50(3), pages 918-953.
    8. Danilo Bertoni & Daniele Cavicchioli & Franco Donzelli & Giovanni Ferrazzi & Dario G. Frisio & Roberto Pretolani & Elena Claire Ricci & Vera Ventura, 2018. "Recent Contributions of Agricultural Economics Research in the Field of Sustainable Development," Agriculture, MDPI, vol. 8(12), pages 1-20, December.
    9. AJ A. Bostian & Moriah B. Bostian & Marita Laukkanen & Antti Simola, 2020. "Assessing the productivity consequences of agri-environmental practices when adoption is endogenous," Journal of Productivity Analysis, Springer, vol. 53(2), pages 141-162, April.
    10. Federico Antonioli & Simone Severini & Mauro Vigani, 2023. "Visa for competitiveness: foreign workforce and Italian dairy farms’ performance," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 50(1), pages 115-150.
    11. Zimmermann, Andrea & Britz, Wolfgang, 2014. "European Farms’ Participation in Agri-environmental Measures," 2014 International Congress, August 26-29, 2014, Ljubljana, Slovenia 183073, European Association of Agricultural Economists.
    12. Laure Kuhfuss & Julie Subervie, 2015. "Do agri-environmental schemes help reduce herbicide use? Evidence from a natural experiment in France," Post-Print hal-01199067, HAL.
    13. Sánchez-Braza, Antonio & Pablo-Romero, María del P., 2014. "Evaluation of property tax bonus to promote solar thermal systems in Andalusia (Spain)," Energy Policy, Elsevier, vol. 67(C), pages 832-843.
    14. Cisilino, Federica & Bodini, Antonella & Zanoli, Agostina & Lasorella, Maria Valentina, 2018. "Exploring Agri-environmental effectiveness using counterfactual analysis," 162nd Seminar, April 26-27, 2018, Budapest, Hungary 271958, European Association of Agricultural Economists.
    15. Cristina SALVIONI & Dario SCIULLI, 2018. "Rural development policy in Italy: the impact of growth-oriented measures on farm outcomes," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 64(3), pages 115-130.
    16. Reinhard Uehleke & Heidi Leonhardt & Silke Hüttel, 2024. "Counterfactual evaluation of two Austrian agri‐environmental schemes in 2014–2018," Agricultural Economics, International Association of Agricultural Economists, vol. 55(1), pages 27-40, January.
    17. Amer Ait Sidhoum & Carolin Canessa & Johannes Sauer, 2023. "Effects of agri‐environment schemes on farm‐level eco‐efficiency measures: Empirical evidence from EU countries," Journal of Agricultural Economics, Wiley Blackwell, vol. 74(2), pages 551-569, June.
    18. Kuhfuss, Laure & Subervie, Julie, 2018. "Do European Agri-environment Measures Help Reduce Herbicide Use? Evidence From Viticulture in France," Ecological Economics, Elsevier, vol. 149(C), pages 202-211.
    19. Christian Stetter & Philipp Mennig & Johannes Sauer, 2022. "Using Machine Learning to Identify Heterogeneous Impacts of Agri-Environment Schemes in the EU: A Case Study," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(4), pages 723-759.
    20. Bostian, AJ & Bostian, Moriah & Laukkanen, Marita & Simola, Antti Mikko, 2017. "Assessing The Impact Of Agri-Environmental Management Practices On Farm Productivity When Adoption Is Endogenous," 2017 International Congress, August 28-September 1, 2017, Parma, Italy 261154, European Association of Agricultural Economists.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jfpoli:v:90:y:2020:i:c:s0306919219306128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/foodpol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.