IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0111805.html
   My bibliography  Save this article

The Effect of Including an Opt-Out Option in Discrete Choice Experiments

Author

Listed:
  • Jorien Veldwijk
  • Mattijs S Lambooij
  • Esther W de Bekker-Grob
  • Henriëtte A Smit
  • G Ardine de Wit

Abstract

Objective: to determine to what extent the inclusion of an opt-out option in a DCE may have an effect on choice behaviour and therefore might influence the attribute level estimates, the relative importance of the attributes and calculated trade-offs. Methods: 781 Dutch Type 2 Diabetes Mellitus patients completed a questionnaire containing nine choice tasks with an opt-out option and nice forced choice tasks. Mixed-logit models were used to estimate the relative importance of the five lifestyle program related attributes that were included. Willingness to pay (WTP) values were calculated and it was tested whether results differed between respondents who answered the choice tasks with an opt-out option in the first or second part of the questionnaire. Results: 21.4% of the respondents always opted out. Respondents who were given the opt-out option in the first part of the questionnaire as well as lower educated respondents significantly more often opted out. For both the forced and unforced choice model, different attributes showed significant estimates, the relative importance of the attributes was equal. However, due to differences in relative importance weights, the WTP values for the PA schedule differed significantly between both datasets. Conclusions: Results show differences in opting out based on the location of the opt-out option and respondents' educational level; this resulted in small differences between the forced and unforced choice model. Since respondents seem to learn from answering forced choice tasks, a dual response design might result in higher data quality compared to offering a direct opt-out option. Future research should empirically explore how choice sets should be presented to make them as easy and less complex as possible in order to reduce the proportion of respondents that opts-out due to choice task complexity. Moreover, future research should debrief respondents to examine the reasons for choosing the opt-out alternative.

Suggested Citation

  • Jorien Veldwijk & Mattijs S Lambooij & Esther W de Bekker-Grob & Henriëtte A Smit & G Ardine de Wit, 2014. "The Effect of Including an Opt-Out Option in Discrete Choice Experiments," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-9, November.
  • Handle: RePEc:plo:pone00:0111805
    DOI: 10.1371/journal.pone.0111805
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0111805
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0111805&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0111805?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jürgen Meyerhoff & Ulf Liebe, 2009. "Status Quo Effect in Choice Experiments: Empirical Evidence on Attitudes and Choice Task Complexity," Land Economics, University of Wisconsin Press, vol. 85(3), pages 515-528.
    2. Boxall, Peter C. & Adamowicz, Wiktor L. & Moon, Amanda, 2009. "Complexity in choice experiments: choice of the status quo alternative and implications for welfare measurement," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 53(4), pages 1-17.
    3. Emily Lancsar & Jordan Louviere, 2008. "Conducting Discrete Choice Experiments to Inform Healthcare Decision Making," PharmacoEconomics, Springer, vol. 26(8), pages 661-677, August.
    4. Ennio Cascetta, 2009. "Random Utility Theory," Springer Optimization and Its Applications, in: Transportation Systems Analysis, chapter 0, pages 89-167, Springer.
    5. Dhar, Ravi, 1997. "Consumer Preference for a No-Choice Option," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 24(2), pages 215-231, September.
    6. Mickael Bech & Dorte Gyrd‐Hansen, 2005. "Effects coding in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 14(10), pages 1079-1083, October.
    7. Joseph Cook & Dale Whittington & Do Gia Canh & F. Reed Johnson & Andrew Nyamete, 2007. "Reliability Of Stated Preferences For Cholera And Typhoid Vaccines With Time To Think In Hue, Vietnam," Economic Inquiry, Western Economic Association International, vol. 45(1), pages 100-114, January.
    8. Ennio Cascetta, 2009. "Transportation Systems Analysis," Springer Optimization and Its Applications, Springer, number 978-0-387-75857-2, June.
    9. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D., 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, September.
    10. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    11. Fernando San Miguel & Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Irrational’ stated preferences: a quantitative and qualitative investigation," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 307-322, March.
    12. Luce, Mary Frances, 1998. "Choosing to Avoid: Coping with Negatively Emotion-Laden Consumer Decisions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 24(4), pages 409-433, March.
    13. Karni, Edi & Schwartz, Aba, 1977. "Search theory: The case of search with uncertain recall," Journal of Economic Theory, Elsevier, vol. 16(1), pages 38-52, October.
    14. David Revelt & Kenneth Train, 1998. "Mixed Logit With Repeated Choices: Households' Choices Of Appliance Efficiency Level," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 647-657, November.
    15. Daniel Kahneman & Jack L. Knetsch & Richard H. Thaler, 1991. "Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias," Journal of Economic Perspectives, American Economic Association, vol. 5(1), pages 193-206, Winter.
    16. Deborah A. Marshall & F. Reed Johnson & Nathalie A. Kulin & Semra Özdemir & Judith M. E. Walsh & John K. Marshall & Stephanie Van Bebber & Kathryn A. Phillips, 2009. "How do physician assessments of patient preferences for colorectal cancer screening tests differ from actual preferences? A comparison in Canada and the United States using a stated‐choice survey," Health Economics, John Wiley & Sons, Ltd., vol. 18(12), pages 1420-1439, December.
    17. Emily Lancsar & Jordan Louviere, 2006. "Deleting ‘irrational’ responses from discrete choice experiments: a case of investigating or imposing preferences?," Health Economics, John Wiley & Sons, Ltd., vol. 15(8), pages 797-811, August.
    18. Nowlis, Stephen M & Kahn, Barbara E & Dhar, Ravi, 2002. "Coping with Ambivalence: The Effect of Removing a Neutral Option on Consumer Attitude and Preference Judgments," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 29(3), pages 319-334, December.
    19. Jeff Brazell & Christopher Diener & Ekaterina Karniouchina & William Moore & Válerie Séverin & Pierre-Francois Uldry, 2006. "The no-choice option and dual response choice designs," Marketing Letters, Springer, vol. 17(4), pages 255-268, December.
    20. Mandy Ryan & Verity Watson & Vikki Entwistle, 2009. "Rationalising the ‘irrational’: a think aloud study of discrete choice experiment responses," Health Economics, John Wiley & Sons, Ltd., vol. 18(3), pages 321-336, March.
    21. Jordan J. Louviere & Towhidul Islam & Nada Wasi & Deborah Street & Leonie Burgess, 2008. "Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(2), pages 360-375, March.
    22. Roger H. von Haefen & D. Matthew Massey & Wiktor L. Adamowicz, 2005. "Serial Nonparticipation in Repeated Discrete Choice Models," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(4), pages 1061-1076.
    23. Joseph Cook, 2007. "Reliability Of Stated Preferences For Cholera And Typhoid Vaccines With Time To Think In Hue, Vietnam," EEPSEA Special and Technical Paper sp200701s1, Economy and Environment Program for Southeast Asia (EEPSEA), revised Jan 2007.
    24. Ritov, Ilana & Baron, Jonathan, 1992. "Status-Quo and Omission Biases," Journal of Risk and Uncertainty, Springer, vol. 5(1), pages 49-61, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Esther W. de Bekker‐Grob & Mandy Ryan & Karen Gerard, 2012. "Discrete choice experiments in health economics: a review of the literature," Health Economics, John Wiley & Sons, Ltd., vol. 21(2), pages 145-172, February.
    2. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    3. Mandy Ryan & Karen Gerard & Gillian Currie, 2012. "Using Discrete Choice Experiments in Health Economics," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 41, Edward Elgar Publishing.
    4. Ladenburg, Jacob & Olsen, Søren Bøye, 2014. "Augmenting short Cheap Talk scripts with a repeated Opt-Out Reminder in Choice Experiment surveys," Resource and Energy Economics, Elsevier, vol. 37(C), pages 39-63.
    5. Krah, Kwabena & Michelson, Hope & Perge, Emilie & Jindal, Rohit, 2019. "Constraints to adopting soil fertility management practices in Malawi: A choice experiment approach," World Development, Elsevier, vol. 124(C), pages 1-1.
    6. Mehdi Ammi & Christine Peyron, 2016. "Heterogeneity in general practitioners’ preferences for quality improvement programs: a choice experiment and policy simulation in France," Health Economics Review, Springer, vol. 6(1), pages 1-11, December.
    7. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part II. Conceptualisation of external validity, sources and explanations of bias and effectiveness of mitigation methods," Journal of choice modelling, Elsevier, vol. 41(C).
    8. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    9. Ida, Takanori & Takemura, Kosuke & Sato, Masayuki, 2015. "Inner conflict between nuclear power generation and electricity rates: A Japanese case study," Energy Economics, Elsevier, vol. 48(C), pages 61-69.
    10. Chiara Seghieri & Alessandro Mengoni & Sabina Nuti, 2014. "Applying discrete choice modelling in a priority setting: an investigation of public preferences for primary care models," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 15(7), pages 773-785, September.
    11. Milad Haghani & Michiel C. J. Bliemer & John M. Rose & Harmen Oppewal & Emily Lancsar, 2021. "Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity," Papers 2102.02940, arXiv.org.
    12. Tobias Holmsgaard Larsen & Thomas Lundhede & Søren Bøye Olsen, 2020. "Assessing the value of surface water and groundwater quality improvements when time lags and outcome uncertainty exist: Results from a choice experiment survey across four different countries," IFRO Working Paper 2020/12, University of Copenhagen, Department of Food and Resource Economics.
    13. Emily Lancsar & Peter Burge, 2014. "Choice modelling research in health economics," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 28, pages 675-687, Edward Elgar Publishing.
    14. Mesfin G. Genie & Nicolas Krucien & Mandy Ryan, 2021. "Weighting or aggregating? Investigating information processing in multi‐attribute choices," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1291-1305, June.
    15. Murwirapachena, Genius & Dikgang, Johane, 2018. "An empirical examination of reducing status quo bias in heterogeneous populations: evidence from the South African water sector," MPRA Paper 91549, University Library of Munich, Germany.
    16. Barr, Rhona F. & Mourato, Susana, 2014. "Investigating fishers' preferences for the design of marine Payments for Environmental Services schemes," Ecological Economics, Elsevier, vol. 108(C), pages 91-103.
    17. Mamine, Fateh & Fares, M'hand & Minviel, Jean Joseph, 2020. "Contract Design for Adoption of Agrienvironmental Practices: A Meta-analysis of Discrete Choice Experiments," Ecological Economics, Elsevier, vol. 176(C).
    18. Marta Trapero-Bertran & Beatriz Rodríguez-Martín & Julio López-Bastida, 2019. "What attributes should be included in a discrete choice experiment related to health technologies? A systematic literature review," PLOS ONE, Public Library of Science, vol. 14(7), pages 1-15, July.
    19. Bruno Lanz & Allan Provins, 2015. "Using discrete choice experiments to regulate the provision of water services: do status quo choices reflect preferences?," Journal of Regulatory Economics, Springer, vol. 47(3), pages 300-324, June.
    20. Alessandro Mengoni & Chiara Seghieri & Sabina Nuti, 2013. "The application of discrete choice experiments in health economics: a systematic review of the literature," Working Papers 201301, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0111805. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.