IDEAS home Printed from https://ideas.repec.org/a/bla/canjag/v64y2016i4p667-694.html
   My bibliography  Save this article

Economic Experiments as a Tool for Agricultural Policy Evaluation: Insights from the European CAP

Author

Listed:
  • Liesbeth Colen
  • Sergio Gomez y Paloma
  • Uwe Latacz-Lohmann
  • Marianne Lefebvre
  • Raphaële Préget
  • Sophie Thoyer

Abstract

This article assesses the potential contribution of economic experiments to evidence-based policy making in the field of agriculture, with a special focus on the EU's Common Agricultural Policy (CAP). CAP evaluation mostly relies on standard tools such as farm and market simulation models, calibrated with EU-wide statistical data; statistical and econometric analysis of survey data; and a range of qualitative methods such as interviews with stakeholders, focus group or internet-based public consultation. Yet, the CAP has changed considerably over the past decades, requiring adaptations of its evaluation toolbox. A detailed review of existing studies using economic experiments for designing and evaluating agricultural policies provides the backbone for a comprehensive assessment of the complementarity of experimental approaches with standard evaluation tools. The article further provides recommendations aiming at facilitating inclusion of economic experiments into the CAP evaluation toolbox based on conclusions drawn from a workshop organized with experts, academics, and policy makers of Directorate-General for Agriculture and Rural Development of the European Commission.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Liesbeth Colen & Sergio Gomez y Paloma & Uwe Latacz-Lohmann & Marianne Lefebvre & Raphaële Préget & Sophie Thoyer, 2016. "Economic Experiments as a Tool for Agricultural Policy Evaluation: Insights from the European CAP," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 64(4), pages 667-694, December.
  • Handle: RePEc:bla:canjag:v:64:y:2016:i:4:p:667-694
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/cjag.2016.64.issue-4
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gneezy, Uri & Rustichini, Aldo, 2000. "A Fine is a Price," The Journal of Legal Studies, University of Chicago Press, vol. 29(1), pages 1-17, January.
    2. Maria Espinosa‐Goded & Jesús Barreiro‐Hurlé & Eric Ruto, 2010. "What Do Farmers Want From Agri‐Environmental Scheme Design? A Choice Experiment Approach," Journal of Agricultural Economics, Wiley Blackwell, vol. 61(2), pages 259-273, June.
    3. Dean Karlan & Robert Osei & Isaac Osei-Akoto & Christopher Udry, 2014. "Agricultural Decisions after Relaxing Credit and Risk Constraints," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(2), pages 597-652.
    4. Timothy N. Cason & Lata Gangadharan, 2005. "A Laboratory Comparison of Uniform and Discriminative Price Auctions for Reducing Non-point Source Pollution," Land Economics, University of Wisconsin Press, vol. 81(1).
    5. Charles R. Plott, 1997. "Laboratory Experimental Testbeds: Application to the PCS Auction," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 6(3), pages 605-638, September.
    6. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    7. Xavier Gine & Jessica Goldberg & Dean Yang, 2012. "Credit Market Consequences of Improved Personal Identification: Field Experimental Evidence from Malawi," American Economic Review, American Economic Association, vol. 102(6), pages 2923-2954, October.
    8. Jayson L. Lusk & Ted C. Schroeder, 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(2), pages 467-482.
    9. Gary Burtless, 1995. "The Case for Randomized Field Trials in Economic and Policy Research," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 63-84, Spring.
    10. repec:feb:artefa:0086 is not listed on IDEAS
    11. Lips, Markus & Gazzarin, Christian, 2008. "What are the preferences of Dairy Farmers regarding their Work? A Discrete Choice Experiment in the Eastern Part of Switzerland," 2008 International Congress, August 26-29, 2008, Ghent, Belgium 44132, European Association of Agricultural Economists.
    12. Steven D. Levitt & John A. List, 2009. "Can Field Experiments Return Agricultural Economics to the Glory Days?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1259-1265.
    13. Enno Bahrs & Stephan Kroll & Matthias Sutter, 2008. "Trading Agricultural Payment Entitlements: An Experimental Investigation of Bilateral Negotiations," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 90(5), pages 1201-1207.
    14. Chabé-Ferret, Sylvain & Subervie, Julie, 2013. "How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 12-27.
    15. John A. List, 2011. "Why Economists Should Conduct Field Experiments and 14 Tips for Pulling One Off," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 3-16, Summer.
    16. Glenn W. Harrison, 2014. "Cautionary notes on the use of field experiments to address policy issues," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 30(4), pages 753-763.
    17. Alfnes, Frode & Guttormsen, Atle G. & Steine, Gro & Kolstad, Kari, 2006. "Ajae Appendix: Consumers’ Willingness To Pay For The Color Of Salmon: A Choice Experiment With Real Economic Incentives," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 88(4), pages 1-8, November.
    18. Hellerstein, Daniel & Higgins, Nathaniel & Roberts, Michael, 2015. "Options for Improving Conservation Programs: Insights From Auction Theory and Economic Experiments," Amber Waves:The Economics of Food, Farming, Natural Resources, and Rural America, United States Department of Agriculture, Economic Research Service, issue 01, pages 1-1, February.
    19. Parkhurst, Gregory M. & Shogren, Jason F. & Bastian, Chris & Kivi, Paul & Donner, Jennifer & Smith, Rodney B. W., 2002. "Agglomeration bonus: an incentive mechanism to reunite fragmented habitat for biodiversity conservation," Ecological Economics, Elsevier, vol. 41(2), pages 305-328, May.
    20. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, September.
    21. Stine Broch & Suzanne Vedel, 2012. "Using Choice Experiments to Investigate the Policy Relevance of Heterogeneity in Farmer Agri-Environmental Contract Preferences," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 51(4), pages 561-581, April.
    22. Randall Blair & Kenneth Fortson & Joanne Lee & Anu Rangarajan, "undated". "Should Foreign Aid Fund Agricultural Training? Evidence from Armenia," Mathematica Policy Research Reports 74d16d1a54bd430eb39d64979, Mathematica Policy Research.
    23. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    24. Gro Steine & Kari Kolstad, 2006. "Consumers' Willingness to Pay for the Color of Salmon: A Choice Experiment with Real Economic Incentives," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 88(4), pages 1050-1061.
    25. Nagler, Amy M. & Menkhaus, Dale J. & Bastian, Christopher T. & Ehmke, Mariah D. & Coatney, Kalyn T., 2013. "Subsidy Incidence in Factor Markets: An Experimental Approach," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 45(1), pages 17-33, February.
    26. R. Schmalensee & R. Willig (ed.), 1989. "Handbook of Industrial Organization," Handbook of Industrial Organization, Elsevier, edition 1, volume 2, number 2.
    27. Erwin Bulte & Gonne Beekman & Salvatore Di Falco & Joseph Hella & Pan Lei, 2014. "Behavioral Responses and the Impact of New Agricultural Technologies: Evidence from a Double-blind Field Experiment in Tanzania," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 96(3), pages 813-830.
    28. Christopher R. McIntosh & Jason F. Shogren & Erik Dohlman, 2007. "Supply Response to Countercyclical Payments and Base Acre Updating under Uncertainty: An Experimental Study," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 89(4), pages 1046-1057.
    29. repec:mpr:mprres:7879 is not listed on IDEAS
    30. Ronald G. Cummings & Charles A. Holt & Susan K. Laury, 2004. "Using laboratory experiments for policymaking: An example from the Georgia irrigation reduction auction," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 23(2), pages 341-363.
    31. McIntosh, Christopher R. & Shogren, Jason F. & Dohlman, Erik, 2007. "AJAE Appendix: Supply Response to Counter-cyclical Payments and Base Acre Updating under Uncertainty: An Experimental Study," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 89(4), pages 1-12, November.
    32. Loi, Massimo & Rodrigues, Margarida, 2012. "A note on the impact evaluation of public policies: the counterfactual analysis," MPRA Paper 42444, University Library of Munich, Germany.
    33. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
    34. Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
    35. Stéphane J. Baele, 2013. "The ethics of New Development Economics: is the Experimental Approach to Development Economics morally wrong?," The Journal of Philosophical Economics, Bucharest Academy of Economic Studies, The Journal of Philosophical Economics, vol. 7(1), November.
    36. repec:feb:artefa:0110 is not listed on IDEAS
    37. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    38. R. Schmalensee & R. Willig (ed.), 1989. "Handbook of Industrial Organization," Handbook of Industrial Organization, Elsevier, edition 1, volume 1, number 1.
    39. Latacz-Lohmann, Uwe & Schulz, Norbert & Breustedt, Gunnar, 2014. "Assessing Farmers' Willingness to Accept "Greening": Insights from a Discrete Choice Experiment in Gremany," 88th Annual Conference, April 9-11, 2014, AgroParisTech, Paris, France 170560, Agricultural Economics Society.
    40. Syster C. Maart-Noelck & Oliver Musshoff & Moritz Maack, 2013. "The impact of price floors on farmland investments: a real options based experimental analysis," Applied Economics, Taylor & Francis Journals, vol. 45(35), pages 4872-4882, December.
    41. Norbert Schulz & Gunnar Breustedt & Uwe Latacz-Lohmann, 2014. "Assessing Farmers' Willingness to Accept “Greening”: Insights from a Discrete Choice Experiment in Germany," Journal of Agricultural Economics, Wiley Blackwell, vol. 65(1), pages 26-48, January.
    42. Macours, Karen & Bouguen, Adrien & Filmer, Deon & Naudeau, Sophie, 2014. "Preschools and early childhood development in a second best world: Evidence from a scaled-up experiment in Cambodia," CEPR Discussion Papers 10170, C.E.P.R. Discussion Papers.
    43. Brian E. Roe & David R. Just, 2009. "Internal and External Validity in Economics Research: Tradeoffs between Experiments, Field Experiments, Natural Experiments, and Field Data," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1266-1271.
    44. Plott, Charles R., 1989. "An updated review of industrial organization: Applications of experimental methods," Handbook of Industrial Organization, in: R. Schmalensee & R. Willig (ed.), Handbook of Industrial Organization, edition 1, volume 2, chapter 19, pages 1109-1176, Elsevier.
    45. René van Bavel & Nuria Rodríguez-Priego & Ioannis Maghiros, 2015. "Seven Points to Remember when Conducting Behavioural Studies in Support of EU Policy-making," JRC Research Reports JRC96525, Joint Research Centre.
    46. Lars Brink, 2013. "Making Agricultural Economics Research Relevant for Policy Advice," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 61(1), pages 15-36, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liesbeth Colen & Sergio Gomez y Paloma & Uwe Latacz-Lohmann & Marianne Lefebvre & Raphaële Préget & Sophie S. Thoyer, 2015. "(How) can economic experiments inform EU agricultural policy?," Post-Print hal-02519194, HAL.
    2. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    3. Chèze, Benoît & David, Maia & Martinet, Vincent, 2020. "Understanding farmers' reluctance to reduce pesticide use: A choice experiment," Ecological Economics, Elsevier, vol. 167(C).
    4. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    5. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    6. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    7. Greiner, Romy, 2014. "Willingness of north Australian pastoralists and graziers to participate in contractual biodiversity conservation," 2014 Conference (58th), February 4-7, 2014, Port Macquarie, Australia 165839, Australian Agricultural and Resource Economics Society.
    8. Stephanie Rosch & Sharon Raszap Skorbiansky & Collin Weigel & Kent D. Messer & Daniel Hellerstein, 2021. "Barriers to Using Economic Experiments in Evidence‐Based Agricultural Policymaking," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(2), pages 531-555, June.
    9. Zhai, Qianqian & Kassas, Bachir & Zhao, Shuoli & Chen, Lijun & Chen, Chao, 2020. "Investigating Preference Inconsistencies in Incentive Structures that Account for House Money Effects," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304584, Agricultural and Applied Economics Association.
    10. Villamayor-Tomas, Sergio & Sagebiel, Julian & Olschewski, Roland, 2019. "Bringing the neighbors in: A choice experiment on the influence of coordination and social norms on farmers’ willingness to accept agro-environmental schemes across Europe," Land Use Policy, Elsevier, vol. 84(C), pages 200-215.
    11. Kesternich, Iris & Heiss, Florian & McFadden, Daniel & Winter, Joachim, 2013. "Suit the action to the word, the word to the action: Hypothetical choices and real decisions in Medicare Part D," Journal of Health Economics, Elsevier, vol. 32(6), pages 1313-1324.
    12. Bjorn Van Campenhout & David J. Spielman & Els Lecoutere, 2021. "Information and Communication Technologies to Provide Agricultural Advice to Smallholder Farmers: Experimental Evidence from Uganda," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 317-337, January.
    13. Ana I. Sanjuán‐López & Helena Resano‐Ezcaray, 2020. "Labels for a Local Food Speciality Product: The Case of Saffron," Journal of Agricultural Economics, Wiley Blackwell, vol. 71(3), pages 778-797, September.
    14. Villanueva, Anastasio J. & Rodriguez-Entrena, Macario & Arriaza, Manuel & Gomez-Limon, Jose A., 2015. "Matching supply-side and demand-side analyses for the assessment of agri-environmental schemes: The case of irrigated olive groves of southern Spain," 2015 Conference, August 9-14, 2015, Milan, Italy 211919, International Association of Agricultural Economists.
    15. Christoph Schulze & Katarzyna Zagórska & Kati Häfner & Olimpia Markiewicz & Mikołaj Czajkowski & Bettina Matzdorf, 2024. "Using farmers' ex ante preferences to design agri‐environmental contracts: A systematic review," Journal of Agricultural Economics, Wiley Blackwell, vol. 75(1), pages 44-83, February.
    16. Van Loo, Ellen J. & Caputo, Vincenzina & Lusk, Jayson L., 2020. "Consumer preferences for farm-raised meat, lab-grown meat, and plant-based meat alternatives: Does information or brand matter?," Food Policy, Elsevier, vol. 95(C).
    17. Celine Michaud & Daniel Llerena & Iragael Joly, 2013. "Willingness to pay for environmental attributes of non-food agricultural products: a real choice experiment," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 40(2), pages 313-329, March.
    18. Belot, Michèle & James, Jonathan, 2016. "Partner selection into policy relevant field experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 123(C), pages 31-56.
    19. Luc Behaghel & Karen Macours & Julie Subervie, 2019. "How can randomised controlled trials help improve the design of the common agricultural policy?," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 46(3), pages 473-493.
    20. Abby Kelly & Kalyn T. Coatney & Xiaofei Li & Keith H. Coble, 2020. "Subsidy Incidence in the Presence of Bertrand Suppliers of Complementary Inputs: A U.S. Agricultural Example," Journal of Industry, Competition and Trade, Springer, vol. 20(3), pages 479-501, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:canjag:v:64:y:2016:i:4:p:667-694. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/caefmea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.