IDEAS home Printed from https://ideas.repec.org/a/kap/enreec/v30y2005i3p313-325.html
   My bibliography  Save this article

A Meta-analysis of Hypothetical Bias in Stated Preference Valuation

Author

Listed:
  • James Murphy
  • P. Allen
  • Thomas Stevens
  • Darryl Weatherhead

Abstract

Individuals are widely believed to overstate their economic valuation of a good by a factor of two or three. This paper reports the results of a meta-analysis of hypothetical bias in 28 stated preference valuation studies that report monetary willingness-to-pay and used the same mechanism for eliciting both hypothetical and actual values. The papers generated 83 observations with a median ratio of hypothetical to actual value of only 1.35, and the distribution has severe positive skewness. We find that a choice-based elicitation mechanism is important in reducing bias. We provide some evidence that the use of student subjects may be a source of bias, but since this variable is highly correlated with group experimental settings, firm conclusions cannot be drawn. There is some weak evidence that bias increases when public goods are being valued, and that some calibration methods may be effective at reducing bias. However, results are quite sensitive to model specification, which will remain a problem until a comprehensive theory of hypothetical bias is developed. Copyright Springer 2005

Suggested Citation

  • James Murphy & P. Allen & Thomas Stevens & Darryl Weatherhead, 2005. "A Meta-analysis of Hypothetical Bias in Stated Preference Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 30(3), pages 313-325, March.
    • Handle: RePEc:kap:enreec:v:30:y:2005:i:3:p:313-325
    DOI: 10.1007/s10640-004-3332-z
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10640-004-3332-z
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10640-004-3332-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jack A. Sinden, 1988. "Empirical Tests Of Hypothetical Bias In Consumers' Surplus Surveys," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 32(2-3), pages 98-112, 08-12.
    2. Carlsson, Fredrik & Martinsson, Peter, 2001. "Do Hypothetical and Actual Marginal Willingness to Pay Differ in Choice Experiments?: Application to the Valuation of the Environment," Journal of Environmental Economics and Management, Elsevier, vol. 41(2), pages 179-192, March.
    3. Edward Balistreri & Gary McClelland & Gregory Poe & William Schulze, 2001. "Can Hypothetical Questions Reveal True Values? A Laboratory Comparison of Dichotomous Choice and Open-Ended Contingent Values with Auction Values," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 18(3), pages 275-292, March.
    4. Vossler, Christian A. & Kerkvliet, Joe & Polasky, Stephen & Gainutdinova, Olesya, 2003. "Externally validating contingent valuation: an open-space survey and referendum in Corvallis, Oregon," Journal of Economic Behavior & Organization, Elsevier, vol. 51(2), pages 261-277, June.
    5. Peter Frykblom, 2000. "Willingness to pay and the choice of question format: experimental results," Applied Economics Letters, Taylor & Francis Journals, vol. 7(10), pages 665-667.
    6. Helen R. Neill & Ronald G. Cummings & Philip T. Ganderton & Glenn W. Harrison & Thomas McGuckin, 1994. "Hypothetical Surveys and Real Economic Commitments," Land Economics, University of Wisconsin Press, vol. 70(2), pages 145-154.
    7. List, John A, 2003. "Using Random nth Price Auctions to Value Non-market Goods and Services," Journal of Regulatory Economics, Springer, vol. 23(2), pages 193-205, March.
    8. Smith, V. Kerry & Mansfield, Carol, 1998. "Buying Time: Real and Hypothetical Offers," Journal of Environmental Economics and Management, Elsevier, vol. 36(3), pages 209-224, November.
    9. Cummings, Ronald G & Harrison, Glenn W & Rutstrom, E Elisabet, 1995. "Homegrown Values and Hypothetical Surveys: Is the Dichotomous Choice Approach Incentive-Compatible?," American Economic Review, American Economic Association, vol. 85(1), pages 260-266, March.
    10. Spencer, Michael A. & Swallow, Stephen K. & Miller, Christopher J., 1998. "Valuing Water Quality Monitoring: A Contingent Valuation Experiment Involving Hypothetical and Real Payments," Agricultural and Resource Economics Review, Cambridge University Press, vol. 27(1), pages 28-42, April.
    11. Vivien Foster & Ian J. Bateman & David Harley, 1998. "Real and hypothetical willingness to pay for environmental preservation: a non-experimental comparison," Chapters, in: Melinda Acutt & Pamela Mason (ed.), Environmental Valuation, Economic Policy and Sustainability, chapter 3, pages 35-50, Edward Elgar Publishing.
    12. W. Michael Hanemann, 1984. "Welfare Evaluations in Contingent Valuation Experiments with Discrete Responses," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 66(3), pages 332-341.
    13. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    14. Blumenschein, Karen & Johannesson, Magnus & Blomquist, Glenn C. & Liljas, Bengt & O'Conor, Richard M., 1997. "Hypothetical versus real payments in Vickrey auctions," Economics Letters, Elsevier, vol. 56(2), pages 177-180, October.
    15. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    16. Cameron, Trudy Ann & Poe, Gregory L. & Ethier, Robert G. & Schulze, William D., 2002. "Alternative Non-market Value-Elicitation Methods: Are the Underlying Preferences the Same?," Journal of Environmental Economics and Management, Elsevier, vol. 44(3), pages 391-425, November.
    17. John Loomis & Thomas Brown & Beatrice Lucero & George Peterson, 1996. "Improving Validity Experiments of Contingent Valuation Methods: Results of Efforts to Reduce the Disparity of Hypothetical and Actual Willingness to Pay," Land Economics, University of Wisconsin Press, vol. 72(4), pages 450-461.
    18. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    19. Don L. Coursey & John L. Hovis & William D. Schulze, 1987. "The Disparity Between Willingness to Accept and Willingness to Pay Measures of Value," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 102(3), pages 679-690.
    20. Brown, Kelly M. & Taylor, Laura O., 2000. "Do as you say, say as you do: evidence on gender differences in actual and stated contributions to public goods," Journal of Economic Behavior & Organization, Elsevier, vol. 43(1), pages 127-139, September.
    21. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    22. Bohm, Peter, 1972. "Estimating demand for public goods: An experiment," European Economic Review, Elsevier, vol. 3(2), pages 111-130.
    23. List, John A. & Shogren, Jason F., 1998. "Calibration of the difference between actual and hypothetical valuations in a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 37(2), pages 193-205, October.
    24. Sinden, Jack A., 1988. "Empirical Tests Of Hypothetical Bias In Consumers' Surplus Surveys," Australian Journal of Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 32(2-3), pages 1-15, August.
    25. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    26. Magnus Johannesson & Bengt Liljas & Per-Olov Johansson, 1998. "An experimental comparison of dichotomous choice contingent valuation questions and real purchase decisions," Applied Economics, Taylor & Francis Journals, vol. 30(5), pages 643-647.
    27. McClelland, Gary H & Schulze, William D & Coursey, Don L, 1993. "Insurance for Low-Probability Hazards: A Bimodal Response to Unlikely Events," Journal of Risk and Uncertainty, Springer, vol. 7(1), pages 95-116, August.
    28. Frykblom, Peter, 1997. "Hypothetical Question Modes and Real Willingness to Pay," Journal of Environmental Economics and Management, Elsevier, vol. 34(3), pages 275-287, November.
    29. Vossler, Christian A. & Kerkvliet, Joe, 2003. "A criterion validity test of the contingent valuation method: comparing hypothetical and actual voting behavior for a public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 45(3), pages 631-649, May.
    30. List, John A. & Shogren, Jason F., 2002. "Calibration of Willingness-to-Accept," Journal of Environmental Economics and Management, Elsevier, vol. 43(2), pages 219-233, March.
    31. John Loomis & Thomas Brown & Beatrice Lucero & George Peterson, 1997. "Evaluating the Validity of the Dichotomous Choice Question Format in Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 10(2), pages 109-123, September.
    32. Irwin, Julie R & Slovic, Paul & Lichtenstein, Sarah & McClelland, Gary H., 1993. "Preference Reversals and the Measurement of Environmental Values," Journal of Risk and Uncertainty, Springer, vol. 6(1), pages 5-18, January.
    33. Mary Jo Kealy & John F. Dovidio & Mark L. Rockel, 1988. "Accuracy in Valuation Is a Matter of Degree," Land Economics, University of Wisconsin Press, vol. 64(2), pages 158-171.
    34. Anabela Botelho & Ligia Costa Pinto, 2002. "Hypothetical, real, and predicted real willingness to pay in open-ended surveys: experimental results," Applied Economics Letters, Taylor & Francis Journals, vol. 9(15), pages 993-996.
    35. Thomas C. Brown, 1984. "The Concept of Value in Resource Allocation," Land Economics, University of Wisconsin Press, vol. 60(3), pages 231-246.
    36. Thomas C. Brown & Patricia A. Champ & Richard C. Bishop & Daniel W. McCollum, 1996. "Which Response Format Reveals the Truth about Donations to a Public Good?," Land Economics, University of Wisconsin Press, vol. 72(2), pages 152-166.
    37. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    38. Bishop, Richard C. & Heberlein, Thomas A., 1979. "Measuring Values Of Extramarket Goods: Are Indirect Measures Biased?," 1979 Annual Meeting, July 29-August 1, Pullman, Washington 277818, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    39. Peter Bohm, 1972. "Estimating the demand for public goods: An experiment," Framed Field Experiments 00126, The Field Experiments Website.
    40. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    41. Boyce, Rebecca R, et al, 1992. "An Experimental Examination of Intrinsic Values as a," American Economic Review, American Economic Association, vol. 82(5), pages 1366-1373, December.
    42. Magnus Johannesson, 1997. "Some further experimental results on hypothetical versus real willingness to pay," Applied Economics Letters, Taylor & Francis Journals, vol. 4(8), pages 535-536.
    43. Blumenschein, Karen & Johannesson, Magnus & Yokoyama, Krista K. & Freeman, Patricia R., 2001. "Hypothetical versus real willingness to pay in the health care sector: results from a field experiment," Journal of Health Economics, Elsevier, vol. 20(3), pages 441-457, May.
    44. Brookshire, David S & Coursey, Don L, 1987. "Measuring the Value of a Public Good: An Empirical Comparison of Elicitation Procedures," American Economic Review, American Economic Association, vol. 77(4), pages 554-566, September.
    45. Kealy, Mary Jo & Montgomery, Mark & Dovidio, John F., 1990. "Reliability and predictive validity of contingent values: Does the nature of the good matter?," Journal of Environmental Economics and Management, Elsevier, vol. 19(3), pages 244-263, November.
    46. Richard C. Bishop & Thomas A. Heberlein, 1979. "Measuring Values of Extramarket Goods: Are Indirect Measures Biased?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 61(5), pages 926-930.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kanya, Lucy & Sanghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: A systematic review and meta-analysis of the evidence," Social Science & Medicine, Elsevier, vol. 232(C), pages 238-261.
    2. List, John A. & Shogren, Jason F., 2002. "Calibration of Willingness-to-Accept," Journal of Environmental Economics and Management, Elsevier, vol. 43(2), pages 219-233, March.
    3. Kanya, Lucy & Saghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: a systematic review and meta-analysis of the evidence," LSE Research Online Documents on Economics 100741, London School of Economics and Political Science, LSE Library.
    4. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    5. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    6. Shogren, Jason F., 2006. "Experimental Methods and Valuation," Handbook of Environmental Economics, in: K. G. Mäler & J. R. Vincent (ed.), Handbook of Environmental Economics, edition 1, volume 2, chapter 19, pages 969-1027, Elsevier.
    7. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Cambridge University Press, vol. 33(2), pages 182-192, October.
    8. Liljas, Bengt & Blumenschein, Karen, 2000. "On hypothetical bias and calibration in cost-benefit studies," Health Policy, Elsevier, vol. 52(1), pages 53-70, May.
    9. Gubanova, Tatiana & Adamowicz, Wiktor L. & McMillan, Melville, 2009. "'Pocket and Pot': Hypothetical Bias in a No-Free-Riding Public Contribution Game," Staff Paper Series 91403, University of Alberta, Department of Resource Economics and Environmental Sociology.
    10. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    11. Johnston, Robert J., 2006. "Is hypothetical bias universal? Validating contingent valuation responses using a binding public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 469-481, July.
    12. Jinkwon Lee & Uk Hwang, 2016. "Hypothetical Bias in Risk Preferences as a Driver of Hypothetical Bias in Willingness to Pay: Experimental Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(4), pages 789-811, December.
    13. Svensson, Mikael, 2006. "The Value of a Statistical Life in Sweden Estimates from Two Studies using the "Certainty Approach" Calibration," Working Papers 2006:6, Örebro University, School of Business, revised 12 May 2009.
    14. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    15. Whitehead, John C. & Cherry, Todd L., 2007. "Willingness to pay for a Green Energy program: A comparison of ex-ante and ex-post hypothetical bias mitigation approaches," Resource and Energy Economics, Elsevier, vol. 29(4), pages 247-261, November.
    16. Ana Bedate & Luis Herrero & José Sanz, 2009. "Economic valuation of a contemporary art museum: correction of hypothetical bias using a certainty question," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 185-199, August.
    17. Veisten, Knut, 2007. "Contingent valuation controversies: Philosophic debates about economic theory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 36(2), pages 204-232, April.
    18. Hensher, David A., 2010. "Hypothetical bias, choice experiments and willingness to pay," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 735-752, July.
    19. Karen Blumenschein & GlennC. Blomquist & Magnus Johannesson & Nancy Horn & Patricia Freeman, 2008. "Eliciting Willingness to Pay Without Bias: Evidence from a Field Experiment," Economic Journal, Royal Economic Society, vol. 118(525), pages 114-137, January.
    20. Loomis, John B., 2014. "2013 WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 39(1), pages 1-13, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:enreec:v:30:y:2005:i:3:p:313-325. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.