IDEAS home Printed from https://ideas.repec.org/a/spr/patien/v1y2008i4p283-298.html
   My bibliography  Save this article

Validity and Reliability of Willingness-to-Pay Estimates

Author

Listed:
  • Harry Telser
  • Karolin Becker
  • Peter Zweifel

Abstract

Background: Discrete-choice experiments (DCEs), while becoming increasingly popular, have rarely been tested for validity and reliability. Objective: To address the issues of validity and reliability of willingness-to-accept (WTA) values obtained from DCEs. In particular, to examine whether differences in the attribute set describing a hypothetical product have an influence on preferences and willingness-to-pay (WTP) values of respondents. Methods: Two DCEs were designed, featuring hypothetical insurance contracts for Swiss healthcare. The contract attributes were pre-selzected in expert sessions with representatives of the Swiss healthcare system, and their relevance was checked in a pre-test. Experiment A contained rather radical health system reform options, while experiment B concentrated on more familiar elements such as copayment and the benefit catalogue. Three attributes were present in both experiments: delayed access to innovation (‘innovation’), restricted drug benefit (‘generics’), and the change in the monthly premium (‘premium’). The issue to be addressed was whether WTA values for the overlapping attributes were similar, even though they were embedded in widely differing choice sets. Two representative telephone surveys with 1000 people aged >25 years were conducted independently in the German and French parts of Switzerland during September 2003. Socioeconomic variables collected included age, sex, education, total household income, place of residence, occupation, and household size. Three models were estimated (a simple linear model, a model allowing interaction of the price attribute with socioeconomic characteristics, and a model with a full set of interaction terms). Results: The socioeconomic characteristics of the two samples were very similar. Theoretical validity tends to receive empirical support in both experiments in all cases where economic theory makes predictions concerning differences between socioeconomic groups. However, a systematic inappropriate influence on measured WTA seems to be present in at least one experiment. This is likely to be experiment A, in which respondents were far less familiar with proposed alternatives than in experiment B. Conclusions: Measuring preferences for major, little-known innovations in a reliable way seems to present particular challenges for experimental research. Copyright Adis Data Information BV 2008

Suggested Citation

  • Harry Telser & Karolin Becker & Peter Zweifel, 2008. "Validity and Reliability of Willingness-to-Pay Estimates," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 1(4), pages 283-298, October.
    • Handle: RePEc:spr:patien:v:1:y:2008:i:4:p:283-298
    DOI: 10.2165/1312067-200801040-00010
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.2165/1312067-200801040-00010
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.2165/1312067-200801040-00010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James Andreoni, 1995. "Warm-Glow versus Cold-Prickle: The Effects of Positive and Negative Framing on Cooperation in Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 1-21.
    2. Peter Zweifel & Harry Telser & Stephan Vaterlaus, 2006. "Consumer Resistance Against Regulation: The Case of Health Care," Journal of Regulatory Economics, Springer, vol. 29(3), pages 319-332, May.
    3. Cairns, John & van der Pol, Marjon, 2004. "Repeated follow-up as a method for reducing non-trading behaviour in discrete choice experiments," Social Science & Medicine, Elsevier, vol. 58(11), pages 2211-2218, June.
    4. Nick Hanley & Mandy Ryan & Robert Wright, 2003. "Estimating the monetary value of health care: lessons from environmental economics," Health Economics, John Wiley & Sons, Ltd., vol. 12(1), pages 3-16, January.
    5. Joseph Cook & Dale Whittington & Do Gia Canh & F. Reed Johnson & Andrew Nyamete, 2007. "Reliability Of Stated Preferences For Cholera And Typhoid Vaccines With Time To Think In Hue, Vietnam," Economic Inquiry, Western Economic Association International, vol. 45(1), pages 100-114, January.
    6. DeShazo, J. R. & Fermo, German, 2002. "Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency," Journal of Environmental Economics and Management, Elsevier, vol. 44(1), pages 123-143, July.
    7. Horowitz, John K. & McConnell, Kenneth E., 2002. "A Review of WTA/WTP Studies," Journal of Environmental Economics and Management, Elsevier, vol. 44(3), pages 426-447, November.
    8. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, January.
    9. Andreoni, James, 1989. "Giving with Impure Altruism: Applications to Charity and Ricardian Equivalence," Journal of Political Economy, University of Chicago Press, vol. 97(6), pages 1447-1458, December.
    10. Daniel McFadden, 2001. "Economic Choices," American Economic Review, American Economic Association, vol. 91(3), pages 351-378, June.
    11. Scott, Anthony, 2001. "Eliciting GPs' preferences for pecuniary and non-pecuniary job characteristics," Journal of Health Economics, Elsevier, vol. 20(3), pages 329-347, May.
    12. Mandy Ryan & Sarah Wordsworth, 2000. "Sensitivity of Willingness to Pay Estimates to the Level of Attributes in Discrete Choice Experiments," Scottish Journal of Political Economy, Scottish Economic Society, vol. 47(5), pages 504-524, November.
    13. Karolin Becker & Peter Zweifel, 2008. "Age and Choice in Health Insurance," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 1(1), pages 27-40, January.
    14. Mandy Ryan & Emma McIntosh & Phil Shackley, 1998. "Methodological issues in the application of conjoint analysis in health care," Health Economics, John Wiley & Sons, Ltd., vol. 7(4), pages 373-378, June.
    15. Andrew J Lloyd, 2003. "Threats to the estimation of benefit: are preference elicitation methods accurate?," Health Economics, John Wiley & Sons, Ltd., vol. 12(5), pages 393-402, May.
    16. Samuelson, William & Zeckhauser, Richard, 1988. "Status Quo Bias in Decision Making," Journal of Risk and Uncertainty, Springer, vol. 1(1), pages 7-59, March.
    17. Mandy Ryan & Fernando San Miguel, 2003. "Revisiting the axiom of completeness in health care," Health Economics, John Wiley & Sons, Ltd., vol. 12(4), pages 295-307, April.
    18. repec:bla:scotjp:v:46:y:1999:i:2:p:111-34 is not listed on IDEAS
    19. Fernando San Miguel & Mandy Ryan & Emma McIntosh, 2000. "Applying conjoint analysis in economic evaluations: an application to menorrhagia," Applied Economics, Taylor & Francis Journals, vol. 32(7), pages 823-833.
    20. Anna Merino, 2003. "Demand for pharmaceutical drugs: A choice modelling experiment," Working Papers, Research Center on Health and Economics 704, Department of Economics and Business, Universitat Pompeu Fabra.
    21. Johnson, F. Reed & Desvousges, William H., 1997. "Estimating Stated Preferences with Rated-Pair Data: Environmental, Health, and Employment Effects of Energy Programs," Journal of Environmental Economics and Management, Elsevier, vol. 34(1), pages 79-99, September.
    22. repec:bla:scotjp:v:47:y:2000:i:5:p:504-24 is not listed on IDEAS
    23. Anna Merino, 2003. "Demand for pharmaceutical drugs: A choice modelling experiment," Economics Working Papers 704, Department of Economics and Business, Universitat Pompeu Fabra.
    24. Anthony Scott & Sandra Vick, 1999. "Patients, Doctors and Contracts: An Application of Principal‐Agent Theory to the Doctor‐Patient Relationship," Scottish Journal of Political Economy, Scottish Economic Society, vol. 46(2), pages 111-134, May.
    25. Harry Telser & Peter Zweifel, 2007. "Validity of discrete-choice experiments evidence for health risk reduction," Applied Economics, Taylor & Francis Journals, vol. 39(1), pages 69-78.
    26. Mandy Ryan, 2004. "A comparison of stated preference methods for estimating monetary values," Health Economics, John Wiley & Sons, Ltd., vol. 13(3), pages 291-296, March.
    27. Tara Maddala & Kathryn A. Phillips & F. Reed Johnson, 2003. "An experiment on simplifying conjoint analysis designs for measuring preferences," Health Economics, John Wiley & Sons, Ltd., vol. 12(12), pages 1035-1047, December.
    28. Harry Telser & Peter Zweifel, 2002. "Measuring willingness‐to‐pay for risk reduction: an application of conjoint analysis," Health Economics, John Wiley & Sons, Ltd., vol. 11(2), pages 129-139, March.
    29. Manski, Charles F & Lerman, Steven R, 1977. "The Estimation of Choice Probabilities from Choice Based Samples," Econometrica, Econometric Society, vol. 45(8), pages 1977-1988, November.
    30. Joseph Cook, 2007. "Reliability Of Stated Preferences For Cholera And Typhoid Vaccines With Time To Think In Hue, Vietnam," EEPSEA Special and Technical Paper sp200701s1, Economy and Environment Program for Southeast Asia (EEPSEA), revised Jan 2007.
    31. Stirling Bryan & Lisa Gold & Rob Sheldon & Martin Buxton, 2000. "Preference measurement using conjoint methods: an empirical investigation of reliability," Health Economics, John Wiley & Sons, Ltd., vol. 9(5), pages 385-395, July.
    32. Mandy Ryan & Angela Bate, 2001. "Testing the assumptions of rationality, continuity and symmetry when applying discrete choice experiments in health care," Applied Economics Letters, Taylor & Francis Journals, vol. 8(1), pages 59-63.
    33. Scott, Anthony, 2002. "Identifying and analysing dominant preferences in discrete choice experiments: An application in health care," Journal of Economic Psychology, Elsevier, vol. 23(3), pages 383-398, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Charles Cunningham & Ken Deal & Yvonne Chen, 2010. "Adaptive Choice-Based Conjoint Analysis," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 3(4), pages 257-273, December.
    2. Axel Mühlbacher & Uwe Junker & Christin Juhnke & Edgar Stemmler & Thomas Kohlmann & Friedhelm Leverkus & Matthias Nübling, 2015. "Chronic pain patients’ treatment preferences: a discrete-choice experiment," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 16(6), pages 613-628, July.
    3. Axel Mühlbacher & Matthias Nübling, 2010. "Analysis of Patients’ Preferences," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 3(4), pages 285-294, December.
    4. Anna Alberini & Milan Ščasný, 2021. "On the validity of the estimates of the VSL from contingent valuation: Evidence from the Czech Republic," Journal of Risk and Uncertainty, Springer, vol. 62(1), pages 55-87, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karolin Becker & Peter Zweifel, 2008. "Age and Choice in Health Insurance," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 1(1), pages 27-40, January.
    2. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    3. Karolin Becker & Peter Zweifel, 2005. "Cost Sharing in Health Insurance: An Instrument for Risk Selection?," SOI - Working Papers 0513, Socioeconomic Institute - University of Zurich.
    4. Harry Telser & Peter Zweifel, 2006. "A New Role For Consumers’ Preferences In The Provision Of Healthcare," Economic Affairs, Wiley Blackwell, vol. 26(3), pages 4-9, September.
    5. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    6. Stirling Bryan & Paul Dolan, 2004. "Discrete choice experiments in health economics," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 5(3), pages 199-202, September.
    7. Semra Özdemir & Ateesha F. Mohamed & F. Reed Johnson & A. Brett Hauber, 2010. "Who pays attention in stated‐choice surveys?," Health Economics, John Wiley & Sons, Ltd., vol. 19(1), pages 111-118, January.
    8. Mickael Bech & Trine Kjaer & Jørgen Lauridsen, 2011. "Does the number of choice sets matter? Results from a web survey applying a discrete choice experiment," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 273-286, March.
    9. Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Threats’ to and hopes for estimating benefits," Health Economics, John Wiley & Sons, Ltd., vol. 14(6), pages 609-619, June.
    10. Poulos, Christine & Yang, Jui-Chen & Levin, Carol & Van Minh, Hoang & Giang, Kim Bao & Nguyen, Diep, 2011. "Mothers' preferences and willingness to pay for HPV vaccines in Vinh Long Province, Vietnam," Social Science & Medicine, Elsevier, vol. 73(2), pages 226-234, July.
    11. F. Reed Johnson & Ateesha F. Mohamed & Semra Özdemir & Deborah A. Marshall & Kathryn A. Phillips, 2011. "How does cost matter in health‐care discrete‐choice experiments?," Health Economics, John Wiley & Sons, Ltd., vol. 20(3), pages 323-330, March.
    12. Maurus Rischatsch & Peter Zweifel, 2013. "What do physicians dislike about managed care? Evidence from a choice experiment," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 14(4), pages 601-613, August.
    13. Fernando San Miguel & Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Irrational’ stated preferences: a quantitative and qualitative investigation," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 307-322, March.
    14. Nick Hanley & Mandy Ryan & Robert Wright, 2003. "Estimating the monetary value of health care: lessons from environmental economics," Health Economics, John Wiley & Sons, Ltd., vol. 12(1), pages 3-16, January.
    15. Nicolas Krucien & Amiram Gafni & Nathalie Pelletier‐Fleury, 2015. "Empirical Testing of the External Validity of a Discrete Choice Experiment to Determine Preferred Treatment Option: The Case of Sleep Apnea," Health Economics, John Wiley & Sons, Ltd., vol. 24(8), pages 951-965, August.
    16. Hiselius, Lena Winslott, 2005. "Preferences regarding road transports of hazardous materials using choice experiments - any sign of biases?," Working Papers 2005:30, Lund University, Department of Economics.
    17. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    18. Neuman, Tzahi & Neuman, Einat & Neuman, Shoshana, 2010. "Explorations of the effect of experience on preferences for a health-care service," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(3), pages 407-419, June.
    19. Lim, Jennifer N.W. & Edlin, Richard, 2009. "Preferences of older patients and choice of treatment location in the UK: A binary choice experiment," Health Policy, Elsevier, vol. 91(3), pages 252-257, August.
    20. Peter Zweifel & Harry Telser & Stephan Vaterlaus, 2006. "Consumer Resistance Against Regulation: The Case of Health Care," Journal of Regulatory Economics, Springer, vol. 29(3), pages 319-332, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:patien:v:1:y:2008:i:4:p:283-298. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.