IDEAS home Printed from https://ideas.repec.org/a/wly/apecpp/v43y2021i2p556-572.html
   My bibliography  Save this article

Challenges in Recruiting U.S. Farmers for Policy‐Relevant Economic Field Experiments

Author

Listed:
  • Collin Weigel
  • Laura A. Paul
  • Paul J. Ferraro
  • Kent D. Messer

Abstract

To develop evidence‐based agricultural policies, researchers increasingly use insights from economic field experiments. These insights are often limited by the challenges of recruiting large and representative samples of farmers. To improve the effectiveness and cost efficiency of farmer recruitment, researchers should apply the same experimental methods to the recruitment process that they apply to their main research questions. Here we experimentally evaluate ten recruiting strategies in two large‐scale, high stakes experiments. We find that monetary incentives and reminders are effective, but costly. Costless strategies, such as prominently citing a well‐known institution as the sponsor, had positive but small, effects on recruitment.

Suggested Citation

  • Collin Weigel & Laura A. Paul & Paul J. Ferraro & Kent D. Messer, 2021. "Challenges in Recruiting U.S. Farmers for Policy‐Relevant Economic Field Experiments," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(2), pages 556-572, June.
  • Handle: RePEc:wly:apecpp:v:43:y:2021:i:2:p:556-572
    DOI: 10.1002/aepp.13066
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/aepp.13066
    Download Restriction: no

    File URL: https://libkey.io/10.1002/aepp.13066?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Higgins, Nathaniel & Hellerstein, Daniel & Wallander, Steven & Lynch, Lori, 2017. "Economic Experiments for Policy Analysis and Program Design: A Guide for Agricultural Decisionmakers," Economic Research Report 262456, United States Department of Agriculture, Economic Research Service.
    2. Michael S. Haigh & John A. List, 2005. "Do Professional Traders Exhibit Myopic Loss Aversion? An Experimental Analysis," Journal of Finance, American Finance Association, vol. 60(1), pages 523-534, February.
    3. Ronald G. Cummings & Charles A. Holt & Susan K. Laury, 2004. "Using laboratory experiments for policymaking: An example from the Georgia irrigation reduction auction," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 23(2), pages 341-363.
    4. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    5. Joost M.E. Pennings & Scott H. Irwin & Darrel L. Good, 2002. "Surveying Farmers: A Case Study," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 24(1), pages 266-277.
    6. David H. Herberich & John A. List, 2012. "Digging into Background Risk: Experiments with Farmers and Students," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(2), pages 457-463.
    7. Steven Levitt & John List & David Reiley, 2010. "What happens in the field stays in the field: Professionals do not play minimax in laboratory experiments," Artefactual Field Experiments 00080, The Field Experiments Website.
    8. Christoph Bartneck & Andreas Duenser & Elena Moltchanova & Karolina Zawieska, 2015. "Comparing the Similarity of Responses Received from Studies in Amazon’s Mechanical Turk to Studies Conducted Online and with Direct Recruitment," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-23, April.
    9. Jeffrey Carpenter & Erika Seki, 2011. "Do Social Preferences Increase Productivity? Field Experimental Evidence From Fishermen In Toyama Bay," Economic Inquiry, Western Economic Association International, vol. 49(2), pages 612-630, April.
    10. Steven D. Levitt & John A. List & David H. Reiley, 2010. "What Happens in the Field Stays in the Field: Exploring Whether Professionals Play Minimax in Laboratory Experiments," Econometrica, Econometric Society, vol. 78(4), pages 1413-1434, July.
    11. Steven Wallander & Paul Ferraro & Nathaniel Higgins, 2017. "Addressing Participant Inattention in Federal Programs: A Field Experiment with The Conservation Reserve Program," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 99(4), pages 914-931.
    12. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    13. Timothy N. Cason & Steven Y. Wu, 2019. "Subject Pools and Deception in Agricultural and Resource Economics Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 743-758, July.
    14. Syster C. Maart-Noelck & Oliver Musshoff, 2014. "Measuring the risk attitude of decision-makers: are there differences between groups of methods and persons?," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 58(3), pages 336-352, July.
    15. Van Essen, Matt & Wooders, John, 2015. "Blind stealing: Experience and expertise in a mixed-strategy poker experiment," Games and Economic Behavior, Elsevier, vol. 91(C), pages 186-206.
    16. repec:feb:artefa:0094 is not listed on IDEAS
    17. repec:feb:artefa:0087 is not listed on IDEAS
    18. Wu, JunJie, 2014. "The Oxford Handbook of Land Economics," OUP Catalogue, Oxford University Press, number 9780199763740 edited by Duke, Joshua M..
    19. Erika Deserranno, 2019. "Financial Incentives as Signals: Experimental Evidence from the Recruitment of Village Promoters in Uganda," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 277-317, January.
    20. Jordan F. Suter & Christian A. Vossler, 2014. "Towards an Understanding of the Performance of Ambient Tax Mechanisms in the Field: Evidence from Upstate New York Dairy Farmers," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 96(1), pages 92-107.
    21. R. C. Buse, 1973. "Increasing Response Rates in Mailed Questionnaires," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 55(3), pages 503-508.
    22. Armstrong, J. Scott, 1975. "Monetary incentives in mail surveys," MPRA Paper 81695, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michels, Marius & Luo, Hao & Weller von Ahlefeld, Paul Johann & Mußhoff, Oliver, 2023. "Compliance with pre-harvest interval rules in apple production—A comparative analysis of green nudges among fruit growers and agricultural students in Germany," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 102(C).
    2. Palm-Forster, Leah H. & Taylor, Mykel & Banerjee, Simanti & Xie, Lusi, 2023. "Factors influencing enrollment of leased cropland in the Conservation Stewardship Program in Kansas," Land Use Policy, Elsevier, vol. 135(C).
    3. Wallander, Steven & Paul, Laura A. & Ferraro, Paul J. & Messer, Kent D. & Iovanna, Richard, 2023. "Informational nudges in conservation auctions: A field experiment with U.S. farmers," Food Policy, Elsevier, vol. 120(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stephanie Rosch & Sharon Raszap Skorbiansky & Collin Weigel & Kent D. Messer & Daniel Hellerstein, 2021. "Barriers to Using Economic Experiments in Evidence‐Based Agricultural Policymaking," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(2), pages 531-555, June.
    2. Leah H. Palm-Forster & Paul J. Ferraro & Nicholas Janusch & Christian A. Vossler & Kent D. Messer, 2019. "Behavioral and Experimental Agri-Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 719-742, July.
    3. Timothy N. Cason & Steven Y. Wu, 2019. "Subject Pools and Deception in Agricultural and Resource Economics Experiments," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 743-758, July.
    4. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    5. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2013. "Experimental methods: Extra-laboratory experiments-extending the reach of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 91(C), pages 93-100.
    6. Omar Al-Ubaydli & John A. List, 2013. "On the Generalizability of Experimental Results in Economics: With a Response to Commentors," CESifo Working Paper Series 4543, CESifo.
    7. Etan A. Green & Justin M. Rao & David Rothschild, 2019. "A Sharp Test of the Portability of Expertise," Management Science, INFORMS, vol. 67(6), pages 2820-2831, June.
    8. Omar Al-Ubaydli & John List, 2013. "On the Generalizability of Experimental Results in Economics: With A Response To Camerer," Artefactual Field Experiments j0001, The Field Experiments Website.
    9. Peth, Denise & Mußhoff, Oliver, 2018. "Comparing compliance behaviour of students and farmers: Implications for agricultural policy impact analysis," DARE Discussion Papers 1809, Georg-August University of Göttingen, Department of Agricultural Economics and Rural Development (DARE).
    10. Emara, Noha & Owens, David & Smith, John & Wilmer, Lisa, 2017. "Serial correlation in National Football League play calling and its effects on outcomes," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 69(C), pages 125-132.
    11. Janusch, Nicholas & Palm-Forster, Leah H. & Messer, Kent D. & Ferraro, Paul J., 2017. "Behavioral Insights for Agri-Environmental Program and Policy Design," 2018 Allied Social Sciences Association (ASSA) Annual Meeting, January 5-7, 2018, Philadelphia, Pennsylvania 266299, Agricultural and Applied Economics Association.
    12. Marianne Lefebvre & Estelle Midler & Philippe Bontems, 2020. "Adoption of Environment-Friendly Agricultural Practices with Background Risk: Experimental Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 76(2), pages 405-428, July.
    13. Geng, Sen & Peng, Yujia & Shachat, Jason & Zhong, Huizhen, 2015. "Adolescents, cognitive ability, and minimax play," Economics Letters, Elsevier, vol. 128(C), pages 54-58.
    14. Sven Grüner & Mira Lehberger & Norbert Hirschauer & Oliver Mußhoff, 2022. "How (un)informative are experiments with students for other social groups? A study of agricultural students and farmers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(3), pages 471-504, July.
    15. Van Essen, Matt & Wooders, John, 2015. "Blind stealing: Experience and expertise in a mixed-strategy poker experiment," Games and Economic Behavior, Elsevier, vol. 91(C), pages 186-206.
    16. Duffy, Sean & Naddeo, JJ & Owens, David & Smith, John, 2016. "Cognitive load and mixed strategies: On brains and minimax," MPRA Paper 71878, University Library of Munich, Germany.
    17. Martin G. Kocher & Marc V. Lenz & Matthias Sutter, 2012. "Psychological Pressure in Competitive Environments: New Evidence from Randomized Natural Experiments," Management Science, INFORMS, vol. 58(8), pages 1585-1591, August.
    18. Guillermo Alves & Pablo Blanchard & Gabriel Burdin & Mariana Chávez & Andrés Dean, 2019. "The Economic Preferences of Cooperative Managers," Documentos de Trabajo (working papers) 19-08, Instituto de Economía - IECON.
    19. Buchholz, Matthias & Holst, Gesa & Musshoff, Oliver, 2015. "Water and irrigation policy impact assessment using business simulation games: evidence from northern Germany," Department of Agricultural and Rural Development (DARE) Discussion Papers 260781, Georg-August-Universitaet Goettingen, Department of Agricultural Economics and Rural Development (DARE).
    20. Leonidas Spiliopoulos, 2018. "Randomization and serial dependence in professional tennis matches: Do strategic considerations, player rankings and match characteristics matter?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 13(5), pages 413-427, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:apecpp:v:43:y:2021:i:2:p:556-572. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2040-5804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.