IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-01416121.html
   My bibliography  Save this paper

Economic Experiments as a Tool for Agricultural Policy Evaluation: Insights from the European CAP

Author

Listed:
  • Liesbeth Colen

    (IPTS - JRC Institute for Prospective Technological Studies - JRC - European Commission - Joint Research Centre [Seville])

  • Sergio Gomez y Paloma

    (IPTS - JRC Institute for Prospective Technological Studies - JRC - European Commission - Joint Research Centre [Seville])

  • Uwe Latacz-Lohmann

    (KU Leuven - Catholic University of Leuven = Katholieke Universiteit Leuven, School of Agricultural and Resource Economics, University of Western Australia - UWA - The University of Western Australia)

  • Marianne Lefebvre

    (GRANEM - Groupe de Recherche Angevin en Economie et Management - UA - Université d'Angers - AGROCAMPUS OUEST - Institut National de l'Horticulture et du Paysage)

  • Raphaële Préget

    (LAMETA - Laboratoire Montpelliérain d'Économie Théorique et Appliquée - UM1 - Université Montpellier 1 - UPVM - Université Paul-Valéry - Montpellier 3 - INRA - Institut National de la Recherche Agronomique - Montpellier SupAgro - Centre international d'études supérieures en sciences agronomiques - UM - Université de Montpellier - CNRS - Centre National de la Recherche Scientifique - Montpellier SupAgro - Institut national d’études supérieures agronomiques de Montpellier)

  • Sophie Thoyer

    (LAMETA - Laboratoire Montpelliérain d'Économie Théorique et Appliquée - UM1 - Université Montpellier 1 - UPVM - Université Paul-Valéry - Montpellier 3 - INRA - Institut National de la Recherche Agronomique - Montpellier SupAgro - Centre international d'études supérieures en sciences agronomiques - UM - Université de Montpellier - CNRS - Centre National de la Recherche Scientifique - Montpellier SupAgro - Institut national d’études supérieures agronomiques de Montpellier)

Abstract

This article assesses the potential contribution of economic experiments to evidence-based policy making in the field of agriculture, with a special focus on the EU's Common Agricultural Policy (CAP). CAP evaluation mostly relies on standard tools such as farm and market simulation models, calibrated with EU-wide statistical data; statistical and econometric analysis of survey data; and a range of qualitative methods such as interviews with stakeholders, focus group or internet-based public consultation. Yet, the CAP has changed considerably over the past decades, requiring adaptations of its evaluation toolbox. A detailed review of existing studies using economic experiments for designing and evaluating agricultural policies provides the backbone for a comprehensive assessment of the complementarity of experimental approaches with standard evaluation tools. The article further provides recommendations aiming at facilitating inclusion of economic experiments into the CAP evaluation toolbox based on conclusions drawn from a workshop organized with experts, academics, and policy makers of Directorate-General for Agriculture and Rural Development of the European Commission.

Suggested Citation

  • Liesbeth Colen & Sergio Gomez y Paloma & Uwe Latacz-Lohmann & Marianne Lefebvre & Raphaële Préget & Sophie Thoyer, 2016. "Economic Experiments as a Tool for Agricultural Policy Evaluation: Insights from the European CAP," Post-Print hal-01416121, HAL.
  • Handle: RePEc:hal:journl:hal-01416121
    DOI: 10.1111/cjag.12107
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    2. Gneezy, Uri & Rustichini, Aldo, 2000. "A Fine is a Price," The Journal of Legal Studies, University of Chicago Press, vol. 29(1), pages 1-17, January.
    3. Nagler, Amy M. & Menkhaus, Dale J. & Bastian, Christopher T. & Ehmke, Mariah D. & Coatney, Kalyn T., 2013. "Subsidy Incidence in Factor Markets: An Experimental Approach," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 45(1), pages 1-17, February.
    4. repec:mpr:mprres:7879 is not listed on IDEAS
    5. Dean Karlan & Robert Osei & Isaac Osei-Akoto & Christopher Udry, 2014. "Agricultural Decisions after Relaxing Credit and Risk Constraints," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(2), pages 597-652.
    6. Maria Espinosa‐Goded & Jesús Barreiro‐Hurlé & Eric Ruto, 2010. "What Do Farmers Want From Agri‐Environmental Scheme Design? A Choice Experiment Approach," Journal of Agricultural Economics, Wiley Blackwell, vol. 61(2), pages 259-273, June.
    7. Ronald G. Cummings & Charles A. Holt & Susan K. Laury, 2004. "Using laboratory experiments for policymaking: An example from the Georgia irrigation reduction auction," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 23(2), pages 341-363.
    8. Hellerstein, Daniel & Higgins, Nathaniel & Roberts, Michael, 2015. "Options for Improving Conservation Programs: Insights From Auction Theory and Economic Experiments," Amber Waves:The Economics of Food, Farming, Natural Resources, and Rural America, United States Department of Agriculture, Economic Research Service, issue 01, pages 1-1, February.
    9. Latacz-Lohmann, Uwe & Schulz, Norbert & Breustedt, Gunnar, 2014. "Assessing Farmers' Willingness to Accept "Greening": Insights from a Discrete Choice Experiment in Gremany," 88th Annual Conference, April 9-11, 2014, AgroParisTech, Paris, France 170560, Agricultural Economics Society.
    10. Timothy N. Cason & Lata Gangadharan, 2005. "A Laboratory Comparison of Uniform and Discriminative Price Auctions for Reducing Non-point Source Pollution," Land Economics, University of Wisconsin Press, vol. 81(1).
    11. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
    12. Charles R. Plott, 1997. "Laboratory Experimental Testbeds: Application to the PCS Auction," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 6(3), pages 605-638, September.
    13. Chabé-Ferret, Sylvain & Subervie, Julie, 2013. "How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 12-27.
    14. Syster C. Maart-Noelck & Oliver Musshoff & Moritz Maack, 2013. "The impact of price floors on farmland investments: a real options based experimental analysis," Applied Economics, Taylor & Francis Journals, vol. 45(35), pages 4872-4882, December.
    15. McIntosh, Christopher R. & Shogren, Jason F. & Dohlman, Erik, 2007. "AJAE Appendix: Supply Response to Counter-cyclical Payments and Base Acre Updating under Uncertainty: An Experimental Study," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 89(4), pages 1-12, November.
    16. Parkhurst, Gregory M. & Shogren, Jason F. & Bastian, Chris & Kivi, Paul & Donner, Jennifer & Smith, Rodney B. W., 2002. "Agglomeration bonus: an incentive mechanism to reunite fragmented habitat for biodiversity conservation," Ecological Economics, Elsevier, vol. 41(2), pages 305-328, May.
    17. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, September.
    18. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    19. Stine Broch & Suzanne Vedel, 2012. "Using Choice Experiments to Investigate the Policy Relevance of Heterogeneity in Farmer Agri-Environmental Contract Preferences," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 561-581, April.
    20. Loi, Massimo & Rodrigues, Margarida, 2012. "A note on the impact evaluation of public policies: the counterfactual analysis," MPRA Paper 42444, University Library of Munich, Germany.
    21. Norbert Schulz & Gunnar Breustedt & Uwe Latacz-Lohmann, 2014. "Assessing Farmers' Willingness to Accept “Greening”: Insights from a Discrete Choice Experiment in Germany," Journal of Agricultural Economics, Wiley Blackwell, vol. 65(1), pages 26-48, January.
    22. Macours, Karen & Bouguen, Adrien & Filmer, Deon & Naudeau, Sophie, 2014. "Preschools and early childhood development in a second best world: Evidence from a scaled-up experiment in Cambodia," CEPR Discussion Papers 10170, C.E.P.R. Discussion Papers.
    23. Xavier Gine & Jessica Goldberg & Dean Yang, 2012. "Credit Market Consequences of Improved Personal Identification: Field Experimental Evidence from Malawi," American Economic Review, American Economic Association, vol. 102(6), pages 2923-2954, October.
    24. Randall Blair & Kenneth Fortson & Joanne Lee & Anu Rangarajan, "undated". "Should Foreign Aid Fund Agricultural Training? Evidence from Armenia," Mathematica Policy Research Reports 74d16d1a54bd430eb39d64979, Mathematica Policy Research.
    25. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    26. Brian E. Roe & David R. Just, 2009. "Internal and External Validity in Economics Research: Tradeoffs between Experiments, Field Experiments, Natural Experiments, and Field Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1266-1271.
    27. Plott, Charles R., 1989. "An updated review of industrial organization: Applications of experimental methods," Handbook of Industrial Organization, in: R. Schmalensee & R. Willig (ed.), Handbook of Industrial Organization, edition 1, volume 2, chapter 19, pages 1109-1176, Elsevier.
    28. Gro Steine & Kari Kolstad, 2006. "Consumers' Willingness to Pay for the Color of Salmon: A Choice Experiment with Real Economic Incentives," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 88(4), pages 1050-1061.
    29. Jayson L. Lusk & Ted C. Schroeder, 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(2), pages 467-482.
    30. Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
    31. Gary Burtless, 1995. "The Case for Randomized Field Trials in Economic and Policy Research," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 63-84, Spring.
    32. repec:feb:artefa:0086 is not listed on IDEAS
    33. René van Bavel & Nuria Rodríguez-Priego & Ioannis Maghiros, 2015. "Seven Points to Remember when Conducting Behavioural Studies in Support of EU Policy-making," JRC Research Reports JRC96525, Joint Research Centre.
    34. Stéphane J. Baele, 2013. "The ethics of New Development Economics: is the Experimental Approach to Development Economics morally wrong?," The Journal of Philosophical Economics, Bucharest Academy of Economic Studies, The Journal of Philosophical Economics, vol. 7(1), November.
    35. Lars Brink, 2013. "Making Agricultural Economics Research Relevant for Policy Advice," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 61(1), pages 15-36, March.
    36. Lips, Markus & Gazzarin, Christian, 2008. "What are the preferences of Dairy Farmers regarding their Work? A Discrete Choice Experiment in the Eastern Part of Switzerland," 2008 International Congress, August 26-29, 2008, Ghent, Belgium 44132, European Association of Agricultural Economists.
    37. Steven D. Levitt & John A. List, 2009. "Can Field Experiments Return Agricultural Economics to the Glory Days?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1259-1265.
    38. John A. List, 2011. "Why Economists Should Conduct Field Experiments and 14 Tips for Pulling One Off," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 3-16, Summer.
    39. Enno Bahrs & Stephan Kroll & Matthias Sutter, 2008. "Trading Agricultural Payment Entitlements: An Experimental Investigation of Bilateral Negotiations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(5), pages 1201-1207.
    40. repec:feb:artefa:0110 is not listed on IDEAS
    41. Glenn W. Harrison, 2014. "Cautionary notes on the use of field experiments to address policy issues," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 30(4), pages 753-763.
    42. R. Schmalensee & R. Willig (ed.), 1989. "Handbook of Industrial Organization," Handbook of Industrial Organization, Elsevier, edition 1, volume 2, number 2.
    43. Alfnes, Frode & Guttormsen, Atle G. & Steine, Gro & Kolstad, Kari, 2006. "Ajae Appendix: Consumers’ Willingness To Pay For The Color Of Salmon: A Choice Experiment With Real Economic Incentives," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 88(4), pages 1-8, November.
    44. R. Schmalensee & R. Willig (ed.), 1989. "Handbook of Industrial Organization," Handbook of Industrial Organization, Elsevier, edition 1, volume 1, number 1.
    45. Erwin Bulte & Gonne Beekman & Salvatore Di Falco & Joseph Hella & Pan Lei, 2014. "Behavioral Responses and the Impact of New Agricultural Technologies: Evidence from a Double-blind Field Experiment in Tanzania," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 96(3), pages 813-830.
    46. Christopher R. McIntosh & Jason F. Shogren & Erik Dohlman, 2007. "Supply Response to Countercyclical Payments and Base Acre Updating under Uncertainty: An Experimental Study," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(4), pages 1046-1057.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liesbeth Colen & Sergio Gomez y Paloma & Uwe Latacz-Lohmann & Marianne Lefebvre & Raphaële Préget & Sophie S. Thoyer, 2015. "(How) can economic experiments inform EU agricultural policy?," Post-Print hal-02519194, HAL.
    2. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    3. Chèze, Benoît & David, Maia & Martinet, Vincent, 2020. "Understanding farmers' reluctance to reduce pesticide use: A choice experiment," Ecological Economics, Elsevier, vol. 167(C).
    4. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    5. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    6. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    7. Greiner, Romy, 2014. "Willingness of north Australian pastoralists and graziers to participate in contractual biodiversity conservation," 2014 Conference (58th), February 4-7, 2014, Port Macquarie, Australia 165839, Australian Agricultural and Resource Economics Society.
    8. Stephanie Rosch & Sharon Raszap Skorbiansky & Collin Weigel & Kent D. Messer & Daniel Hellerstein, 2021. "Barriers to Using Economic Experiments in Evidence‐Based Agricultural Policymaking," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(2), pages 531-555, June.
    9. Zhai, Qianqian & Kassas, Bachir & Zhao, Shuoli & Chen, Lijun & Chen, Chao, 2020. "Investigating Preference Inconsistencies in Incentive Structures that Account for House Money Effects," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304584, Agricultural and Applied Economics Association.
    10. Villamayor-Tomas, Sergio & Sagebiel, Julian & Olschewski, Roland, 2019. "Bringing the neighbors in: A choice experiment on the influence of coordination and social norms on farmers’ willingness to accept agro-environmental schemes across Europe," Land Use Policy, Elsevier, vol. 84(C), pages 200-215.
    11. Kesternich, Iris & Heiss, Florian & McFadden, Daniel & Winter, Joachim, 2013. "Suit the action to the word, the word to the action: Hypothetical choices and real decisions in Medicare Part D," Journal of Health Economics, Elsevier, vol. 32(6), pages 1313-1324.
    12. Mohammed H. Alemu & Søren Bøye Olsen & Suzanne E. Vedel & John Kinyuru & Kennedy O. Pambo, 2016. "Integrating sensory evaluations in incentivized discrete choice experiments to assess consumer demand for cricket flour buns in Kenya," IFRO Working Paper 2016/02, University of Copenhagen, Department of Food and Resource Economics.
    13. Bjorn Van Campenhout & David J. Spielman & Els Lecoutere, 2021. "Information and Communication Technologies to Provide Agricultural Advice to Smallholder Farmers: Experimental Evidence from Uganda," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 317-337, January.
    14. Ana I. Sanjuán‐López & Helena Resano‐Ezcaray, 2020. "Labels for a Local Food Speciality Product: The Case of Saffron," Journal of Agricultural Economics, Wiley Blackwell, vol. 71(3), pages 778-797, September.
    15. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    16. Villanueva, Anastasio J. & Rodriguez-Entrena, Macario & Arriaza, Manuel & Gomez-Limon, Jose A., 2015. "Matching supply-side and demand-side analyses for the assessment of agri-environmental schemes: The case of irrigated olive groves of southern Spain," 2015 Conference, August 9-14, 2015, Milan, Italy 211919, International Association of Agricultural Economists.
    17. Christoph Schulze & Katarzyna Zagórska & Kati Häfner & Olimpia Markiewicz & Mikołaj Czajkowski & Bettina Matzdorf, 2024. "Using farmers' ex ante preferences to design agri‐environmental contracts: A systematic review," Journal of Agricultural Economics, Wiley Blackwell, vol. 75(1), pages 44-83, February.
    18. Van Loo, Ellen J. & Caputo, Vincenzina & Lusk, Jayson L., 2020. "Consumer preferences for farm-raised meat, lab-grown meat, and plant-based meat alternatives: Does information or brand matter?," Food Policy, Elsevier, vol. 95(C).
    19. Celine Michaud & Daniel Llerena & Iragael Joly, 2013. "Willingness to pay for environmental attributes of non-food agricultural products: a real choice experiment," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 40(2), pages 313-329, March.
    20. Belot, Michèle & James, Jonathan, 2016. "Partner selection into policy relevant field experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 123(C), pages 31-56.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-01416121. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.