IDEAS home Printed from https://ideas.repec.org/a/spr/eujhec/v20y2019i1d10.1007_s10198-018-0983-1.html
   My bibliography  Save this article

Mitigating hypothetical bias in willingness to pay studies: post-estimation uncertainty and anchoring on irrelevant information

Author

Listed:
  • Ana Bobinac

    (University of Rijeka)

Abstract

One possible source of hypothetical bias in willingness to pay (WTP) estimates is response uncertainty, referring to subject’s uncertainty about the value of the good under assessment. It has been argued that uncertainty can be measured using the post-valuation ‘certainty question’ that asks: ‘How certain are you about your stated WTP?’ and marks the degree of certainty on a quantitative or a qualitative scale. Research has shown that the self-reported certainty evaluations can help mitigate hypothetical bias and obtain increasingly accurate WTP estimates. These study reports present a simple test of reliability of post-valuation certainty assessment and then looks at the empirical evidence for clues regarding the general usefulness of certainty adjustment in mitigating hypothetical bias in WTP studies. We find that the post-estimation uncertainty scores are malleable, i.e., significantly correlated with entirely irrelevant information. We conclude that more robust evidence could justify the routine inclusion of certainty evaluation in WTP studies although in the meantime the interpretation of certainty-adjusted WTP values should be approached cautiously.

Suggested Citation

  • Ana Bobinac, 2019. "Mitigating hypothetical bias in willingness to pay studies: post-estimation uncertainty and anchoring on irrelevant information," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 75-82, February.
  • Handle: RePEc:spr:eujhec:v:20:y:2019:i:1:d:10.1007_s10198-018-0983-1
    DOI: 10.1007/s10198-018-0983-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10198-018-0983-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10198-018-0983-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Boyle Kevin J. & Desvousges William H. & Johnson F. Reed & Dunford Richard W. & Hudson Sara P., 1994. "An Investigation of Part-Whole Biases in Contingent-Valuation Studies," Journal of Environmental Economics and Management, Elsevier, vol. 27(1), pages 64-83, July.
    2. Lars Hultkrantz & Gunnar Lindberg & Camilla Andersson, 2006. "The value of improved road safety," Journal of Risk and Uncertainty, Springer, vol. 32(2), pages 151-170, March.
    3. Karen Blumenschein & GlennC. Blomquist & Magnus Johannesson & Nancy Horn & Patricia Freeman, 2008. "Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 118(525), pages 114-137, January.
    4. Karen Blumenschein & Magnus Johannesson & Glenn C. Blomquist & Bengt Liljas & Richard M. O’Conor, 1998. "Experimental Results on Expressed Certainty and Hypothetical Bias in Contingent Valuation," Southern Economic Journal, John Wiley & Sons, vol. 65(1), pages 169-177, July.
    5. Bergman, Oscar & Ellingsen, Tore & Johannesson, Magnus & Svensson, Cicek, 2010. "Anchoring and cognitive ability," Economics Letters, Elsevier, vol. 107(1), pages 66-68, April.
    6. Samnaliev, Mihail & Stevens, Thomas H. & More, Thomas, 2006. "A comparison of alternative certainty calibration techniques in contingent valuation," Ecological Economics, Elsevier, vol. 57(3), pages 507-519, May.
    7. Richard Carson & Nicholas Flores & Norman Meade, 2001. "Contingent Valuation: Controversies and Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 19(2), pages 173-210, June.
    8. Ana Bobinac & Job Exel & Frans Rutten & Werner Brouwer, 2014. "The Value of a QALY: Individual Willingness to Pay for Health Gains Under Risk," PharmacoEconomics, Springer, vol. 32(1), pages 75-86, January.
    9. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    10. Loomis, John & Ekstrand, Earl, 1998. "Alternative approaches for incorporating respondent uncertainty when estimating willingness to pay: the case of the Mexican spotted owl," Ecological Economics, Elsevier, vol. 27(1), pages 29-41, October.
    11. List, John A. & Shogren, Jason F., 1998. "Calibration of the difference between actual and hypothetical valuations in a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 37(2), pages 193-205, October.
    12. James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    13. Whynes, David K. & Frew, Emma & Wolstenholme, Jane L., 2003. "A comparison of two methods for eliciting contingent valuations of colorectal cancer screening," Journal of Health Economics, Elsevier, vol. 22(4), pages 555-574, July.
    14. Norwood, F. Bailey, 2005. "Can Calibration Reconcile Stated and Observed Preferences?," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 37(1), pages 237-248, April.
    15. Glenn Blomquist & Karen Blumenschein & Magnus Johannesson, 2009. "Eliciting Willingness to Pay without Bias using Follow-up Certainty Statements: Comparisons between Probably/Definitely and a 10-point Certainty Scale," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 43(4), pages 473-502, August.
    16. Champ, Patricia A. & Moore, Rebecca & Bishop, Richard C., 2009. "A Comparison of Approaches to Mitigate Hypothetical Bias," Agricultural and Resource Economics Review, Cambridge University Press, vol. 38(2), pages 166-180, October.
    17. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    18. Opaluch, James J. & Segerson, Kathleen, 1989. "Rational Roots Of "Irrational" Behavior: New Theories Of Economic Decision-Making," Northeastern Journal of Agricultural and Resource Economics, Northeastern Agricultural and Resource Economics Association, vol. 18(2), pages 1-15, October.
    19. John C. Whitehead, 1995. "Willingness to Pay for Quality Improvements: Comparative Statics and Interpretation of Contingent Valuation Results," Land Economics, University of Wisconsin Press, vol. 71(2), pages 207-215.
    20. Christian A. Vossler & Robert G. Ethier & Gregory L. Poe & Michael P. Welsh, 2003. "Payment Certainty in Discrete Choice Contingent Valuation Responses: Results from a Field Validity Test," Southern Economic Journal, John Wiley & Sons, vol. 69(4), pages 886-902, April.
    21. Vossler, Christian A. & Kerkvliet, Joe, 2003. "A criterion validity test of the contingent valuation method: comparing hypothetical and actual voting behavior for a public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 45(3), pages 631-649, May.
    22. Ana Bedate & Luis Herrero & José Sanz, 2009. "Economic valuation of a contemporary art museum: correction of hypothetical bias using a certainty question," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 185-199, August.
    23. repec:ebl:ecbull:v:3:y:2004:i:6:p:1-13 is not listed on IDEAS
    24. Robert G. Ethier & Gregory L. Poe & William D. Schulze & Jeremy Clark, 2000. "Comparison of Hypothetical Phone and Mail Contingent Valuation Responses for Green-Pricing Electricity Programs," Land Economics, University of Wisconsin Press, vol. 76(1), pages 54-67.
    25. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    26. F. Reed Johnson & Richard W. Dunford & William H. Desvousges & Melissa Ruby Banzhaf, 2001. "Role of Knowledge in Assessing Nonuse Values for Natural Resource Damages," Growth and Change, Wiley Blackwell, vol. 32(1), pages 43-68.
    27. Christian Vossler & Michael McKee, 2006. "Induced-Value Tests of Contingent Valuation Elicitation Mechanisms," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 35(2), pages 137-168, October.
    28. Magnus Johannesson & David Meltzer, 1998. "Editorial: Some reflections on cost‐effectiveness analysis," Health Economics, John Wiley & Sons, Ltd., vol. 7(1), pages 1-7, February.
    29. Li Chuan-Zhong & Mattsson Leif, 1995. "Discrete Choice under Preference Uncertainty: An Improved Structural Model for Contingent Valuation," Journal of Environmental Economics and Management, Elsevier, vol. 28(2), pages 256-269, March.
    30. Akter, Sonia & Bennett, Jeff & Akhter, Sanzida, 2008. "Preference uncertainty in contingent valuation," Ecological Economics, Elsevier, vol. 67(3), pages 345-351, October.
    31. Shaikh, Sabina L. & Sun, Lili & Cornelis van Kooten, G., 2007. "Treating respondent uncertainty in contingent valuation: A comparison of empirical treatments," Ecological Economics, Elsevier, vol. 62(1), pages 115-125, April.
    32. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    33. Joseph T. King Jr. & Joel Tsevat & Judith R. Lave & Mark S. Roberts, 2005. "Willingness to Pay for a Quality-Adjusted Life Year: Implications for Societal Health Care Resource Allocation," Medical Decision Making, , vol. 25(6), pages 667-677, November.
    34. Johannesson, Magnus & Blomquist, Glenn C. & Blumenschein, Karen & Johansson, Per-olov & Liljas, Bengt & O'Conor, Richard M., 1999. "Calibrating Hypothetical Willingness to Pay Responses," Journal of Risk and Uncertainty, Springer, vol. 18(1), pages 21-32, April.
    35. Champ, Patricia A. & Moore, Rebecca & Bishop, Richard C., 2009. "A Comparison of Approaches to Mitigate Hypothetical Bias," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 38(2), pages 1-15, October.
    36. Joseph Little & Robert Berrens, 2004. "Explaining Disparities between Actual and Hypothetical Stated Values: Further Investigation Using Meta-Analysis," Economics Bulletin, AccessEcon, vol. 3(6), pages 1-13.
    37. Berrens, Robert P. & Jenkins-Smith, Hank & Bohara, Alok K. & Silva, Carol L., 2002. "Further Investigation of Voluntary Contribution Contingent Valuation: Fair Share, Time of Contribution, and Respondent Uncertainty," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 144-168, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Giannouchos, Theodoros V. & Ukert, Benjamin & Vozikis, Athanassios & Steletou, Evangelia & Souliotis, Kyriakos, 2021. "Informal out-of-pocket payments experience and individuals’ willingness-to-pay for healthcare services in Greece," Health Policy, Elsevier, vol. 125(6), pages 693-700.
    2. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    3. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods," Papers 2102.02945, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ana Bedate & Luis Herrero & José Sanz, 2009. "Economic valuation of a contemporary art museum: correction of hypothetical bias using a certainty question," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 185-199, August.
    2. Sund, Björn, 2009. "Certainty calibration in contingent valuation - exploring the within-difference between dichotomous choice and open-ended answers as a certainty measure," Working Papers 2009:1, Örebro University, School of Business.
    3. Richard C. Ready & Patricia A. Champ & Jennifer L. Lawton, 2010. "Using Respondent Uncertainty to Mitigate Hypothetical Bias in a Stated Choice Experiment," Land Economics, University of Wisconsin Press, vol. 86(2), pages 363-381.
    4. Jinkwon Lee & Uk Hwang, 2016. "Hypothetical Bias in Risk Preferences as a Driver of Hypothetical Bias in Willingness to Pay: Experimental Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(4), pages 789-811, December.
    5. Voltaire, Louinord & Pirrone, Claudio & Bailly, Denis, 2013. "Dealing with preference uncertainty in contingent willingness to pay for a nature protection program: A new approach," Ecological Economics, Elsevier, vol. 88(C), pages 76-85.
    6. Fifer, Simon & Rose, John M., 2016. "Can you ever be certain? Reducing hypothetical bias in stated choice experiments via respondent reported choice certaintyAuthor-Name: Beck, Matthew J," Transportation Research Part B: Methodological, Elsevier, vol. 89(C), pages 149-167.
    7. Rebecca Moore & Richard C. Bishop & Bill Provencher & Patricia A. Champ, 2010. "Accounting for Respondent Uncertainty to Improve Willingness‐to‐Pay Estimates," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 58(3), pages 381-401, September.
    8. Jerrod Penn & Wuyang Hu, 2023. "Adjusting and Calibrating Elicited Values Based on Follow-up Certainty Questions: A Meta-analysis," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 84(4), pages 919-946, April.
    9. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    10. Atozou, Baoubadi & Tamini, Lota D. & Bergeronm, Stephane & Doyon, Maurice, 2020. "Factors Explaining the Hypothetical Bias: How to Improve Models for Meta-Analyses," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 45(2), March.
    11. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 33(2), pages 1-11, October.
    12. Moore, Rebecca & Bishop, Richard C. & Provencher, Bill & Champ, Patricia A., 2009. "Accounting for Respondent Uncertainty to Improve Willingness-to-Pay Estimates," Staff Papers 92233, University of Wisconsin-Madison, Department of Agricultural and Applied Economics.
    13. Fifer, Simon & Rose, John & Greaves, Stephen, 2014. "Hypothetical bias in Stated Choice Experiments: Is it a problem? And if so, how do we deal with it?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 61(C), pages 164-177.
    14. Glenn Blomquist & Karen Blumenschein & Magnus Johannesson, 2009. "Eliciting Willingness to Pay without Bias using Follow-up Certainty Statements: Comparisons between Probably/Definitely and a 10-point Certainty Scale," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 43(4), pages 473-502, August.
    15. Kanya, Lucy & Saghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: a systematic review and meta-analysis of the evidence," LSE Research Online Documents on Economics 100741, London School of Economics and Political Science, LSE Library.
    16. Nikita Lyssenko & Roberto Mart󹑺-Espiñeira, 2012. "Respondent uncertainty in contingent valuation: the case of whale conservation in Newfoundland and Labrador," Applied Economics, Taylor & Francis Journals, vol. 44(15), pages 1911-1930, May.
    17. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    18. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.
    19. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    20. Johnston, Robert J., 2006. "Is hypothetical bias universal? Validating contingent valuation responses using a binding public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 469-481, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:eujhec:v:20:y:2019:i:1:d:10.1007_s10198-018-0983-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.