IDEAS home Printed from https://ideas.repec.org/a/eee/jeeman/v125y2024ics0095069624000639.html
   My bibliography  Save this article

Efficacy of hypothetical bias mitigation techniques: A cross-country comparison

Author

Listed:
  • Penn, Jerrod
  • Hu, Wuyang
  • Ye, Tao

Abstract

Hypothetical Bias (HB) remains challenging for practitioners of stated preference approaches. One elusive idea is the extent to which country and culture may affect HB's magnitude and the efficacy of mitigation methods. This paper implements both real and hypothetical elicitation in the United States and China in the context of a field survey and experiment for battery recycling containers to establish the extent of HB. It compares multiple HB mitigation strategies, namely Cheap Talk, Ex Ante Consequentiality, and Certainty Follow-up in the two countries. Results show that a significant amount of actual HB exists. The ex ante methods are ineffective at reducing HB in both countries. The Certainty Follow-up method can be effective but can overcorrect, especially for the Chinese sample. Results also indicate that comparing the efficacy of different mitigation strategies based on only hypothetical scenarios (potential HB) across countries may lead to erroneous conclusions. This study calls for treating country and cultural differences more seriously when conducting international valuation work.

Suggested Citation

  • Penn, Jerrod & Hu, Wuyang & Ye, Tao, 2024. "Efficacy of hypothetical bias mitigation techniques: A cross-country comparison," Journal of Environmental Economics and Management, Elsevier, vol. 125(C).
  • Handle: RePEc:eee:jeeman:v:125:y:2024:i:c:s0095069624000639
    DOI: 10.1016/j.jeem.2024.102989
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0095069624000639
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeem.2024.102989?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. W. Michael Hanemann, 1989. "Welfare Evaluations in Contingent Valuation Experiments with Discrete Response Data: Reply," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(4), pages 1057-1061.
    2. Patrick Lloyd-Smith & Wiktor Adamowicz & Diane Dupont, 2019. "Incorporating Stated Consequentiality Questions in Stated Preference Research," Land Economics, University of Wisconsin Press, vol. 95(3), pages 293-306.
    3. Jerrod M Penn & Wuyang Hu, 2018. "Understanding Hypothetical Bias: An Enhanced Meta-Analysis," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1186-1206.
    4. Carlsson, Fredrik & Kataria, Mitesh & Krupnick, Alan & Lampi, Elina & Löfgren, Åsa & Qin, Ping & Sterner, Thomas, 2013. "The truth, the whole truth, and nothing but the truth—A multiple country test of an oath script," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 105-121.
    5. repec:hal:pseose:halshs-00731244 is not listed on IDEAS
    6. Whitehead, John C. & Cherry, Todd L., 2007. "Willingness to pay for a Green Energy program: A comparison of ex-ante and ex-post hypothetical bias mitigation approaches," Resource and Energy Economics, Elsevier, vol. 29(4), pages 247-261, November.
    7. Brown, Thomas C. & Ajzen, Icek & Hrubes, Daniel, 2003. "Further tests of entreaties to avoid hypothetical bias in referendum contingent valuation," Journal of Environmental Economics and Management, Elsevier, vol. 46(2), pages 353-361, September.
    8. Jacquemet, Nicolas & Joule, Robert-Vincent & Luchini, Stéphane & Shogren, Jason F., 2013. "Preference elicitation under oath," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 110-132.
    9. Richard Carson & Theodore Groves, 2007. "Incentive and informational properties of preference questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 37(1), pages 181-210, May.
    10. Dominique Ami & Frédéric Aprahamian & Olivier Chanel & Stéphane Luchini, 2011. "A Test of Cheap Talk in Different Hypothetical Contexts: The Case of Air Pollution," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(1), pages 111-130, September.
    11. Kelly Giraud & John Loomis & Joseph Cooper, 2001. "A Comparison of Willingness to Pay Estimation Techniques From Referendum Questions," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(4), pages 331-346, December.
    12. Interis, Matthew & Petrolia, Daniel, 2014. "The Effects of Consequentiality in Binary- and Multinomial-Choice Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(2), pages 1-16.
    13. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2006. "Does Culture Affect Economic Outcomes?," Journal of Economic Perspectives, American Economic Association, vol. 20(2), pages 23-48, Spring.
    14. F. Bailey Norwood & Jayson L. Lusk, 2011. "Social Desirability Bias in Real, Hypothetical, and Inferred Valuation Experiments," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(2), pages 528-534.
    15. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    16. Gregory L. Poe & Kelly L. Giraud & John B. Loomis, 2005. "Computational Methods for Measuring the Difference of Empirical Distributions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 353-365.
    17. Karen Blumenschein & Magnus Johannesson & Glenn C. Blomquist & Bengt Liljas & Richard M. O'Conor, 1998. "Experimental Results on Expressed Certainty and Hypothetical Bias in Contingent Valuation," Southern Economic Journal, John Wiley & Sons, vol. 65(1), pages 169-177, July.
    18. Christopher G. Leggett & Naomi S. Kleckner & Kevin J. Boyle & John W. Dufield & Robert Cameron Mitchell, 2003. "Social Desirability Bias in Contingent Valuation Surveys Administered Through In-Person Interviews," Land Economics, University of Wisconsin Press, vol. 79(4), pages 561-575.
    19. Herriges, Joseph & Kling, Catherine & Liu, Chih-Chen & Tobias, Justin, 2010. "What are the consequences of consequentiality?," Journal of Environmental Economics and Management, Elsevier, vol. 59(1), pages 67-81, January.
    20. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    21. Manuel Frondel & Stephan Sommer & Lukas Tomberg, 2021. "WTA-WTP Disparity: The Role of Perceived Realism of the Valuation Setting," Land Economics, University of Wisconsin Press, vol. 97(1), pages 196-206.
    22. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    23. Glenn Blomquist & Karen Blumenschein & Magnus Johannesson, 2009. "Eliciting Willingness to Pay without Bias using Follow-up Certainty Statements: Comparisons between Probably/Definitely and a 10-point Certainty Scale," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 43(4), pages 473-502, August.
    24. Vossler, Christian A. & Watson, Sharon B., 2013. "Understanding the consequences of consequentiality: Testing the validity of stated preferences in the field," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 137-147.
    25. Mariah D. Ehmke & Jayson L. Lusk & John A. List, 2008. "Is Hypothetical Bias a Universal Phenomenon? A Multinational Investigation," Land Economics, University of Wisconsin Press, vol. 84(3), pages 489-500.
    26. Aadland, David & Caplan, Arthur J., 2006. "Cheap talk reconsidered: New evidence from CVM," Journal of Economic Behavior & Organization, Elsevier, vol. 60(4), pages 562-578, August.
    27. Hu, Wuyang, 2006. "Use of Spike Models in Measuring Consumers' Willingness to Pay for Non-GM Oil," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 38(3), pages 1-14, December.
    28. Bulte, Erwin & Gerking, Shelby & List, John A. & de Zeeuw, Aart, 2005. "The effect of varying the causes of environmental problems on stated WTP values: evidence from a field study," Journal of Environmental Economics and Management, Elsevier, vol. 49(2), pages 330-342, March.
    29. Lewis, Karen E. & Grebitus, Carola & Nayga, Rodolfo M., 2016. "U.S. consumers’ preferences for imported and genetically modified sugar: Examining policy consequentiality in a choice experiment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 65(C), pages 1-8.
    30. David Aadland & Arthur J. Caplan, 2003. "Willingness to Pay for Curbside Recycling with Detection and Mitigation of Hypothetical Bias," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 85(2), pages 492-502.
    31. Johannesson, Magnus & Blomquist, Glenn C. & Blumenschein, Karen & Johansson, Per-olov & Liljas, Bengt & O'Conor, Richard M., 1999. "Calibrating Hypothetical Willingness to Pay Responses," Journal of Risk and Uncertainty, Springer, vol. 18(1), pages 21-32, April.
    32. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    33. Van Houtven, George & Mansfield, Carol & Phaneuf, Daniel J. & von Haefen, Roger & Milstead, Bryan & Kenney, Melissa A. & Reckhow, Kenneth H., 2014. "Combining expert elicitation and stated preference methods to value ecosystem services from improved lake water quality," Ecological Economics, Elsevier, vol. 99(C), pages 40-52.
    34. John Loomis & Thomas Brown & Beatrice Lucero & George Peterson, 1997. "Evaluating the Validity of the Dichotomous Choice Question Format in Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 10(2), pages 109-123, September.
    35. Karen Blumenschein & Magnus Johannesson & Glenn C. Blomquist & Bengt Liljas & Richard M. O’Conor, 1998. "Experimental Results on Expressed Certainty and Hypothetical Bias in Contingent Valuation," Southern Economic Journal, John Wiley & Sons, vol. 65(1), pages 169-177, July.
    36. Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    2. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.
    3. Penn, Jerrod & Hu, Wuyang & Ye, Tao, 2018. "Cheap Talk, Consequentiality, and Certainty Follow-up as Hypothetical Bias Mitigation Techniques: A Cross Country Comparison," 2018 Annual Meeting, August 5-7, Washington, D.C. 274018, Agricultural and Applied Economics Association.
    4. Jiang, Qi & Penn, Jerrod & Hu, Wuyang, 2022. "Real payment priming to reduce potential hypothetical bias," Journal of choice modelling, Elsevier, vol. 45(C).
    5. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    6. Penn, Jerrod & Hu, Wuyang, 2019. "Cheap talk efficacy under potential and actual Hypothetical Bias: A meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 22-35.
    7. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    8. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    9. Donfouet, Hermann Pythagore Pierre & Mohamed, Shukri F. & Otieno, Peter & Wambiya, Elvis & Mutua, Martin Kavao & Danaei, Goodarz, 2020. "Economic valuation of setting up a social health enterprise in urban poor-resource setting in Kenya," Social Science & Medicine, Elsevier, vol. 266(C).
    10. Crastes dit Sourd, Romain & Zawojska, Ewa & Mahieu, Pierre-Alexandre & Louviere, Jordan, 2018. "Mitigating strategic misrepresentation of values in open-ended stated preference surveys by using negative reinforcement," Journal of choice modelling, Elsevier, vol. 28(C), pages 153-166.
    11. Pengfei Liu & Xiaohui Tian, 2021. "Downward Hypothetical Bias in the Willingness to Accept Measure for Private Goods: Evidence from a Field Experiment," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(5), pages 1679-1699, October.
    12. Mohammed H. Alemu & Søren B. Olsen, 2017. "Can a Repeated Opt-Out Reminder remove hypothetical bias in discrete choice experiments? An application to consumer valuation of novel food products," IFRO Working Paper 2017/05, University of Copenhagen, Department of Food and Resource Economics.
    13. Dominique Ami & Frédéric Aprahamian & Olivier Chanel & Stéphane Luchini, 2011. "A Test of Cheap Talk in Different Hypothetical Contexts: The Case of Air Pollution," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 50(1), pages 111-130, September.
    14. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2020. "Ex-ante and ex-post measures to mitigate hypothetical bias. Are they alternative or complementary tools to increase the reliability and validity of DCE estimates?," Working Papers 2020-20, Faculty of Economic Sciences, University of Warsaw.
    15. Sergio Colombo & Wiktor Budziński & Mikołaj Czajkowski & Klaus Glenk, 2022. "The relative performance of ex‐ante and ex‐post measures to mitigate hypothetical and strategic bias in a stated preference study," Journal of Agricultural Economics, Wiley Blackwell, vol. 73(3), pages 845-873, September.
    16. Wei, Xuan & Khachatryan, Hayk, 2023. "How consequential is policy consequentiality? Evidence from online discrete choice experiment with ornamental plants," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    17. Dardanoni, Valentino & Guerriero, Carla, 2021. "Young people' s willingness to pay for environmental protection," Ecological Economics, Elsevier, vol. 179(C).
    18. Penn, Jerrod & Hu, Wuyang, 2016. "Making the Most of Cheap Talk in an Online Survey," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236171, Agricultural and Applied Economics Association.
    19. Qin, Botao, 2020. "Does a promise script work to reduce the hypothetical bias? Evidence from an induced value experiment," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 14, pages 1-15.
    20. Stephane Bergeron & Maurice Doyon & Laurent Muller, 2019. "Strategic response: A key to understand how cheap talk works," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 67(1), pages 75-83, March.

    More about this item

    Keywords

    Country differences; Hypothetical bias; Mitigation methods; Real payment;
    All these keywords.

    JEL classification:

    • Q53 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Air Pollution; Water Pollution; Noise; Hazardous Waste; Solid Waste; Recycling
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeeman:v:125:y:2024:i:c:s0095069624000639. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622870 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.