IDEAS home Printed from https://ideas.repec.org/a/spr/patien/v13y2020i3d10.1007_s40271-019-00406-6.html
   My bibliography  Save this article

Empirical Investigation of Ranking vs Best–Worst Scaling Generated Preferences for Attributes of Quality of Life: One and the Same or Differentiable?

Author

Listed:
  • Julie Ratcliffe

    (Flinders University)

  • Billingsley Kaambwa

    (Flinders University)

  • Claire Hutchinson

    (Flinders University)

  • Emily Lancsar

    (Australian National University)

Abstract

Objectives The objective of this study was to investigate the degree of inconsistency in quality-of-life attribute preference orderings generated via successive best–worst scaling (a form of ranking whereby the respondent chooses the best and worst attributes from a choice set, these attributes are then eliminated and the best and worst attributes from the reduced choice set are then chosen and this process is continued until all presented attributes are eliminated) and conventional ranking methods (whereby the respondent chooses the best, second best and third best from a choice set until all presented attributes are eliminated). Methods An on-line survey was developed for administration to two general population samples comprising younger people (aged 18–64 years) and older people (aged 65 years and above). Data were analysed in STATA through an empirical examination of the relative level of choice inconsistency (randomness in responses or the variability in choice outcomes not explained by attributes and their associated preference weights) for successive best–worst in comparison with the conventional ranking method for the younger and older person samples. Results For the younger person sample, both methods were found to be similarly consistent. In contrast, for the older person sample, ranking performed relatively worse than best–worst scaling with more inconsistent responses (tau = 0.515, p

Suggested Citation

  • Julie Ratcliffe & Billingsley Kaambwa & Claire Hutchinson & Emily Lancsar, 2020. "Empirical Investigation of Ranking vs Best–Worst Scaling Generated Preferences for Attributes of Quality of Life: One and the Same or Differentiable?," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 13(3), pages 307-315, June.
    • Handle: RePEc:spr:patien:v:13:y:2020:i:3:d:10.1007_s40271-019-00406-6
    DOI: 10.1007/s40271-019-00406-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40271-019-00406-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40271-019-00406-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Caroline M. Vass & Stuart Wright & Michael Burton & Katherine Payne, 2018. "Scale Heterogeneity in Healthcare Discrete Choice Experiments: A Primer," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 11(2), pages 167-173, April.
    2. Lancsar, Emily & Louviere, Jordan & Donaldson, Cam & Currie, Gillian & Burgess, Leonie, 2013. "Best worst discrete choice experiments in health: Methods and an application," Social Science & Medicine, Elsevier, vol. 76(C), pages 74-82.
    3. Wiseman, V. & Mooney, G. & Berry, G. & Tang, K. C., 2003. "Involving the general public in priority setting: experiences from Australia," Social Science & Medicine, Elsevier, vol. 56(5), pages 1001-1012, March.
    4. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    5. Stuart J. Wright & Caroline M. Vass & Gene Sim & Michael Burton & Denzil G. Fiebig & Katherine Payne, 2018. "Accounting for Scale Heterogeneity in Healthcare-Related Discrete Choice Experiments when Comparing Stated Preferences: A Systematic Review," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 11(5), pages 475-488, October.
    6. Gu, Yuanyuan & Lancsar, Emily & Ghijben, Peter & Butler, James RG & Donaldson, Cam, 2015. "Attributes and weights in health care priority setting: A systematic review of what counts and to what extent," Social Science & Medicine, Elsevier, vol. 146(C), pages 41-52.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Samare P. I. Huls & Emily Lancsar & Bas Donkers & Jemimah Ride, 2022. "Two for the price of one: If moving beyond traditional single‐best discrete choice experiments, should we use best‐worst, best‐best or ranking for preference elicitation?," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2630-2647, December.
    2. Rowen, Donna & Powell, Philip A. & Hole, Arne Risa & Aragon, Maria-Jose & Castelli, Adriana & Jacobs, Rowena, 2022. "Valuing quality in mental healthcare: A discrete choice experiment eliciting preferences from mental healthcare service users, mental healthcare professionals and the general population," Social Science & Medicine, Elsevier, vol. 301(C).
    3. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    4. Buckell, John & Hess, Stephane, 2019. "Stubbing out hypothetical bias: improving tobacco market predictions by combining stated and revealed preference data," Journal of Health Economics, Elsevier, vol. 65(C), pages 93-102.
    5. Seda Erdem & Danny Campbell, 2017. "Preferences for public involvement in health service decisions: a comparison between best-worst scaling and trio-wise stated preference elicitation techniques," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 18(9), pages 1107-1123, December.
    6. Mesfin G. Genie & Nicolas Krucien & Mandy Ryan, 2021. "Weighting or aggregating? Investigating information processing in multi‐attribute choices," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1291-1305, June.
    7. David J. Mott & Laura Ternent & Luke Vale, 2023. "Do preferences differ based on respondent experience of a health issue and its treatment? A case study using a public health intervention," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(3), pages 413-423, April.
    8. Genie, Mesfin G. & Ryan, Mandy & Krucien, Nicolas, 2021. "To pay or not to pay? Cost information processing in the valuation of publicly funded healthcare," Social Science & Medicine, Elsevier, vol. 276(C).
    9. Jeff Round & Mike Paulden, 2018. "Incorporating equity in economic evaluations: a multi-attribute equity state approach," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(4), pages 489-498, May.
    10. Nicolas Jacquemet & Stéphane Luchini & Jason F. Shogren & Verity Watson, 2019. "Discrete Choice under Oaths," Documents de travail du Centre d'Economie de la Sorbonne 19007, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    11. Ricardo A. Daziano, 2022. "A choice experiment assessment of stated early response to COVID-19 vaccines in the USA," Health Economics Review, Springer, vol. 12(1), pages 1-16, December.
    12. Anna Nicolet & Antoinette D I van Asselt & Karin M Vermeulen & Paul F M Krabbe, 2020. "Value judgment of new medical treatments: Societal and patient perspectives to inform priority setting in The Netherlands," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-18, July.
    13. Brouwers, Jonas & Cox, Bianca & Van Wilder, Astrid & Claessens, Fien & Bruyneel, Luk & De Ridder, Dirk & Eeckloo, Kristof & Vanhaecht, Kris, 2021. "The future of hospital quality of care policy: A multi-stakeholder discrete choice experiment in Flanders, Belgium," Health Policy, Elsevier, vol. 125(12), pages 1565-1573.
    14. Hannah Christensen & Hareth Al-Janabi & Pierre Levy & Maarten J. Postma & David E. Bloom & Paolo Landa & Oliver Damm & David M. Salisbury & Javier Diez-Domingo & Adrian K. Towse & Paula K. Lorgelly & , 2020. "Economic evaluation of meningococcal vaccines: considerations for the future," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(2), pages 297-309, March.
    15. Ozdemir, Semra & Gonzalez, Juan Marcos & Bansal, Prateek & Huynh, Vinh Anh & Sng, Ban Leong & Finkelstein, Eric, 2024. "Getting it right with discrete choice experiments: Are we hot or cold?," Social Science & Medicine, Elsevier, vol. 348(C).
    16. Kettlewell, Nathan & Walker, Matthew J. & Yoo, Hong Il, 2024. "Alternative Models of Preference Heterogeneity for Elicited Choice Probabilities," IZA Discussion Papers 16821, Institute of Labor Economics (IZA).
    17. Anders Dugstad & Kristine Grimsrud & Gorm Kipperberg & Henrik Lindhjem & Ståle Navrud, 2020. "Scope elasticity and economic significance in discrete choice experiments," Discussion Papers 942, Statistics Norway, Research Department.
    18. Shimelis Araya Geda & Rainer Kühl, 2021. "Exploring Smallholder Farmers’ Preferences for Climate-Smart Seed Innovations: Empirical Evidence from Southern Ethiopia," Sustainability, MDPI, vol. 13(5), pages 1-17, March.
    19. Ahumada-Canale, Antonio & Jeet, Varinder & Bilgrami, Anam & Seil, Elizabeth & Gu, Yuanyuan & Cutler, Henry, 2023. "Barriers and facilitators to implementing priority setting and resource allocation tools in hospital decisions: A systematic review," Social Science & Medicine, Elsevier, vol. 322(C).
    20. Pestana, Joana & Frutuoso, João & Costa, Eduardo & Fonseca, Filipa, 2024. "Heterogeneity in physician's job preferences in a dual practice context – Evidence from a DCE," Social Science & Medicine, Elsevier, vol. 343(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:patien:v:13:y:2020:i:3:d:10.1007_s40271-019-00406-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.