IDEAS home Printed from https://ideas.repec.org/p/ipt/iptwpa/jrc72060.html
   My bibliography  Save this paper

Counterfactual impact evaluation of EU rural development programmes - Propensity Score Matching methodology applied to selected EU Member States. Volume 2: A regional approach

Author

Listed:

Abstract

objective of this study is to analyze the impact of EU RD programmes on rural regions. Aggregated effects of a given RD programme at regional levels are estimated using the Rural Development Index (RDI) a proxy describing the overall quality of life in individual rural areas. The impacts of individual RD measures are analysed by means of a counterfactual analysis by applying combination of the Propensity Score Matching (PSM) (e.g. Kernel matching) and difference-in-differences (DID) methods (i.e. by comparing supported regions and matched control group, prior to the programme and after it). Evaluation of programme effects (by programme measures) at regional level is carried out on the basis of the estimated policy parameters: Average Treatment Effects (ATE), Average Treatment on Treated (ATT) and Average Treatment on Untreated (ATU) effects by using the RDI Index and unemployment ratios as impact indicators. Given information on regional intensity to programme exposure (financial input flows by regions) the overall impact of obtained support via a given RD programme is estimated by means of a dose-response function and derivative dose-response function within the framework of a generalized propensity score matching (GPS). Furthermore, sensitivity analysis (Rosenbaum bounds) is carried out in order to assess a possible influence of unobservables on obtained results (under a binary PSM methodology). Above methodologies are empirically applied to evaluation of the impact of the SAPARD programme in Poland and Slovakia in years 2002-2005 at NUTS-4 level. Results show a full applicability of proposed approach to the measurement of the impact of rural development and structural programmes.

Suggested Citation

  • Jerzy Michalek, 2012. "Counterfactual impact evaluation of EU rural development programmes - Propensity Score Matching methodology applied to selected EU Member States. Volume 2: A regional approach," JRC Research Reports JRC72060, Joint Research Centre.
    • Handle: RePEc:ipt:iptwpa:jrc72060
    as

    Download full text from publisher

    File URL: https://publications.jrc.ec.europa.eu/repository/handle/JRC72060
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paul R. Rosenbaum, 2004. "Design sensitivity in observational studies," Biometrika, Biometrika Trust, vol. 91(1), pages 153-164, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Roberto Cagliero & Francesco Licciardo & Marzia Legnini, 2021. "The Evaluation Framework in the New CAP 2023–2027: A Reflection in the Light of Lessons Learned from Rural Development," Sustainability, MDPI, vol. 13(10), pages 1-18, May.
    2. Lajos Baráth & Imre Fertő & Štefan Bojnec, 2020. "The Effect of Investment, LFA and Agri‐environmental Subsidies on the Components of Total Factor Productivity: The Case of Slovenian Farms," Journal of Agricultural Economics, Wiley Blackwell, vol. 71(3), pages 853-876, September.
    3. Riccardo D’Alberto & Matteo Zavalloni & Meri Raggi & Davide Viaggi, 2018. "AES Impact Evaluation With Integrated Farm Data: Combining Statistical Matching and Propensity Score Matching," Sustainability, MDPI, vol. 10(11), pages 1-24, November.
    4. Zoltán Bakucs & Imre Fertő & Zsófia Benedek, 2019. "Success or Waste of Taxpayer Money? Impact Assessment of Rural Development Programs in Hungary," Sustainability, MDPI, vol. 11(7), pages 1-23, April.
    5. repec:zbw:iamodp:327297 is not listed on IDEAS
    6. Roberto Cagliero & Andrea Arzeni & Federica Cisilino & Alessandro Montelelone & Patrizia Borsotto, 2021. "Ten years after: Diffusion, criticism and potential improvements in the use of FADN for Rural Development assessment in Italy," Economia agro-alimentare, FrancoAngeli Editore, vol. 23(3), pages 1-24.
    7. Lillemets, Jüri & Fertő, Imre & Viira, Ants-Hannes, 2022. "The socioeconomic impacts of the CAP: Systematic literature review," Land Use Policy, Elsevier, vol. 114(C).
    8. Esposti, Roberto, 2014. "The Impact of the 2005 CAP-First Pillar Reform as a Multivalued Treatment Effect -Alternative Estimation Approaches," 2014 Third Congress, June 25-27, 2014, Alghero, Italy 173005, Italian Association of Agricultural and Applied Economics (AIEAA).
    9. Javier Castaño & Maria Blanco & Pilar Martinez, 2019. "Reviewing Counterfactual Analyses to Assess Impacts of EU Rural Development Programmes: What Lessons Can Be Learned from the 2007–2013 Ex-Post Evaluations?," Sustainability, MDPI, vol. 11(4), pages 1-22, February.
    10. Fresenbet Zeleke & Girma T. Kassie & Jema Haji & Belaineh Legesse, 2021. "Would Market Sheds Improve Market Participation and Earnings of Small Ruminant Keepers? Evidence from Ethiopia," Journal of Agricultural Economics, Wiley Blackwell, vol. 72(2), pages 470-485, June.
    11. Bakucs, Zoltan, 2018. "Convergence or Divergence? Analysis of Regional Development Convergence in Hungary," 92nd Annual Conference, April 16-18, 2018, Warwick University, Coventry, UK 273487, Agricultural Economics Society.
    12. Yoomi Kim & Katsuya Tanaka & Shunji Matsuoka, 2020. "Environmental and economic effectiveness of the Kyoto Protocol," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-15, July.
    13. Ondřej Dvouletý & Ivana Blažková, 2019. "Assessing the microeconomic effects of public subsidies on the performance of firms in the czech food processing industry: A counterfactual impact evaluation," Agribusiness, John Wiley & Sons, Ltd., vol. 35(3), pages 394-422, July.
    14. Fuhong Zhang & Apurbo Sarkar & Hongyu Wang, 2021. "Does Internet and Information Technology Help Farmers to Maximize Profit: A Cross-Sectional Study of Apple Farmers in Shandong, China," Land, MDPI, vol. 10(4), pages 1-18, April.
    15. Schwarz, Gerald & Wolff, Anne & Offermann, Frank & Osterburg, Bernhard & Aalders, Inge & Miller, David & Morrice, Jane & Vlahos, George & Smyrniotopoulou, Alexandra & Artell, Janne & Aakkula, Jyrki & , 2014. "ENVIEVAL Development and application of new methodological frameworks for the evaluation of environmental impacts of EU rural development programmes," 2014 International Congress, August 26-29, 2014, Ljubljana, Slovenia 182933, European Association of Agricultural Economists.
    16. Möllers, Judith & Herzfeld, Thomas & Batereanu, Lucia & Arapi-Gjini, Arjola, 2022. "An analysis of farm support measures in the Republic of Moldova," IAMO Discussion Papers 327297, Institute of Agricultural Development in Transition Economies (IAMO).
    17. Krzysztof Piotr Pawłowski & Wawrzyniec Czubak & Jagoda Zmyślona, 2021. "Regional Diversity of Technical Efficiency in Agriculture as a Results of an Overinvestment: A Case Study from Poland," Energies, MDPI, vol. 14(11), pages 1-20, June.
    18. Bakucs Zoltán & Fertő Imre, 2019. "Convergence or Divergence? Analysis of Regional Development Convergence in Hungary," Eastern European Countryside, Sciendo, vol. 25(1), pages 121-143, December.
    19. Wawrzyniec Czubak & Krzysztof Piotr Pawłowski, 2020. "Sustainable Economic Development of Farms in Central and Eastern European Countries Driven by Pro-investment Mechanisms of the Common Agricultural Policy," Agriculture, MDPI, vol. 10(4), pages 1-19, March.
    20. Marin Kukoc & Bruno Skrinjaric & Josip Juracak, 2020. "The Impact Assessment of the EU Pre-Accession Funds on Agriculture and Food Companies: The Croatian Case," Working Papers 2002, The Institute of Economics, Zagreb.
    21. Roberto ESPOSTI, 2014. "To match, not to match, how to match: Estimating the farm-level impact of the CAP-first pillar reform (or: How to Apply Treatment-Effect Econometrics when the Real World is;a Mess)," Working Papers 403, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    22. Fertő, Imre & Bakucs, Zoltán & Varga, Ágnes, 2016. "Impact of EU subsidies on the of rural areas in Hungary," 160th Seminar, December 1-2, 2016, Warsaw, Poland 249826, European Association of Agricultural Economists.
    23. Bakucs, Z. & Ferto, I., 2018. "Analysis of Regional Development Convergence at Sub-National Level. The Case of Hungary," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 277230, International Association of Agricultural Economists.
    24. Esposti, Roberto, 2015. "To match, not to matchm how to match: Estimating the farm-level impact of the 2005 CAP-first pillar reform," 2015 Conference, August 9-14, 2015, Milan, Italy 211625, International Association of Agricultural Economists.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frida Skog, 2019. "Sibling Effects on Adult Earnings Among Poor and Wealthy Children Evidence from Sweden," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 12(3), pages 917-942, June.
    2. Kwonsang Lee & Dylan S. Small & Paul R. Rosenbaum, 2018. "A powerful approach to the study of moderate effect modification in observational studies," Biometrics, The International Biometric Society, vol. 74(4), pages 1161-1170, December.
    3. Paul R. Rosenbaum, 2015. "Bahadur Efficiency of Sensitivity Analyses in Observational Studies," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 205-217, March.
    4. Armstrong, Christopher S. & Guay, Wayne R. & Weber, Joseph P., 2010. "The role of information and financial reporting in corporate governance and debt contracting," Journal of Accounting and Economics, Elsevier, vol. 50(2-3), pages 179-234, December.
    5. Nicholas T. Longford, 2020. "Performance assessment as an application of causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1363-1385, October.
    6. Paul R. Rosenbaum & Dylan S. Small, 2017. "An adaptive Mantel–Haenszel test for sensitivity analysis in observational studies," Biometrics, The International Biometric Society, vol. 73(2), pages 422-430, June.
    7. Siyu Heng & Hyunseung Kang & Dylan S. Small & Colin B. Fogarty, 2021. "Increasing power for observational studies of aberrant response: An adaptive approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(3), pages 482-504, July.
    8. Nuoo‐Ting Molitor & Nicky Best & Chris Jackson & Sylvia Richardson, 2009. "Using Bayesian graphical models to model biases in observational studies and to combine multiple sources of data: application to low birth weight and water disinfection by‐products," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(3), pages 615-637, June.
    9. Paul R. Rosenbaum, 2013. "Impact of Multiple Matched Controls on Design Sensitivity in Observational Studies," Biometrics, The International Biometric Society, vol. 69(1), pages 118-127, March.
    10. Paul R. Rosenbaum, 2011. "A New u-Statistic with Superior Design Sensitivity in Matched Observational Studies," Biometrics, The International Biometric Society, vol. 67(3), pages 1017-1027, September.
    11. Samuel D. Pimentel & Dylan S. Small & Paul R. Rosenbaum, 2016. "Constructed Second Control Groups and Attenuation of Unmeasured Biases," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(515), pages 1157-1167, July.
    12. Xuran Wang & Yang Jiang & Nancy R. Zhang & Dylan S. Small, 2018. "Sensitivity analysis and power for instrumental variable studies," Biometrics, The International Biometric Society, vol. 74(4), pages 1150-1160, December.

    More about this item

    Keywords

    Economic analysis; impact assessment; Common Agricultural Policy; agricultural trade; agricultural markets; competitiveness; modelling tools; price volatility; database;
    All these keywords.

    JEL classification:

    • Q12 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Micro Analysis of Farm Firms, Farm Households, and Farm Input Markets
    • Q18 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Agricultural Policy; Food Policy; Animal Welfare Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ipt:iptwpa:jrc72060. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Publication Officer (email available below). General contact details of provider: https://edirc.repec.org/data/ipjrces.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.