IDEAS home Printed from https://ideas.repec.org/a/spr/patien/v13y2020i3d10.1007_s40271-019-00406-6.html
   My bibliography  Save this article

Empirical Investigation of Ranking vs Best–Worst Scaling Generated Preferences for Attributes of Quality of Life: One and the Same or Differentiable?

Author

Listed:
  • Julie Ratcliffe

    (Flinders University)

  • Billingsley Kaambwa

    (Flinders University)

  • Claire Hutchinson

    (Flinders University)

  • Emily Lancsar

    (Australian National University)

Abstract

Objectives The objective of this study was to investigate the degree of inconsistency in quality-of-life attribute preference orderings generated via successive best–worst scaling (a form of ranking whereby the respondent chooses the best and worst attributes from a choice set, these attributes are then eliminated and the best and worst attributes from the reduced choice set are then chosen and this process is continued until all presented attributes are eliminated) and conventional ranking methods (whereby the respondent chooses the best, second best and third best from a choice set until all presented attributes are eliminated). Methods An on-line survey was developed for administration to two general population samples comprising younger people (aged 18–64 years) and older people (aged 65 years and above). Data were analysed in STATA through an empirical examination of the relative level of choice inconsistency (randomness in responses or the variability in choice outcomes not explained by attributes and their associated preference weights) for successive best–worst in comparison with the conventional ranking method for the younger and older person samples. Results For the younger person sample, both methods were found to be similarly consistent. In contrast, for the older person sample, ranking performed relatively worse than best–worst scaling with more inconsistent responses (tau = 0.515, p

Suggested Citation

  • Julie Ratcliffe & Billingsley Kaambwa & Claire Hutchinson & Emily Lancsar, 2020. "Empirical Investigation of Ranking vs Best–Worst Scaling Generated Preferences for Attributes of Quality of Life: One and the Same or Differentiable?," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 13(3), pages 307-315, June.
    • Handle: RePEc:spr:patien:v:13:y:2020:i:3:d:10.1007_s40271-019-00406-6
    DOI: 10.1007/s40271-019-00406-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40271-019-00406-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40271-019-00406-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Caroline M. Vass & Stuart Wright & Michael Burton & Katherine Payne, 2018. "Scale Heterogeneity in Healthcare Discrete Choice Experiments: A Primer," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 11(2), pages 167-173, April.
    2. Lancsar, Emily & Louviere, Jordan & Donaldson, Cam & Currie, Gillian & Burgess, Leonie, 2013. "Best worst discrete choice experiments in health: Methods and an application," Social Science & Medicine, Elsevier, vol. 76(C), pages 74-82.
    3. Wiseman, V. & Mooney, G. & Berry, G. & Tang, K. C., 2003. "Involving the general public in priority setting: experiences from Australia," Social Science & Medicine, Elsevier, vol. 56(5), pages 1001-1012, March.
    4. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    5. Stuart J. Wright & Caroline M. Vass & Gene Sim & Michael Burton & Denzil G. Fiebig & Katherine Payne, 2018. "Accounting for Scale Heterogeneity in Healthcare-Related Discrete Choice Experiments when Comparing Stated Preferences: A Systematic Review," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 11(5), pages 475-488, October.
    6. Gu, Yuanyuan & Lancsar, Emily & Ghijben, Peter & Butler, James RG & Donaldson, Cam, 2015. "Attributes and weights in health care priority setting: A systematic review of what counts and to what extent," Social Science & Medicine, Elsevier, vol. 146(C), pages 41-52.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David J. Mott & Laura Ternent & Luke Vale, 2023. "Do preferences differ based on respondent experience of a health issue and its treatment? A case study using a public health intervention," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(3), pages 413-423, April.
    2. Samare P. I. Huls & Emily Lancsar & Bas Donkers & Jemimah Ride, 2022. "Two for the price of one: If moving beyond traditional single‐best discrete choice experiments, should we use best‐worst, best‐best or ranking for preference elicitation?," Health Economics, John Wiley & Sons, Ltd., vol. 31(12), pages 2630-2647, December.
    3. Rowen, Donna & Powell, Philip A. & Hole, Arne Risa & Aragon, Maria-Jose & Castelli, Adriana & Jacobs, Rowena, 2022. "Valuing quality in mental healthcare: A discrete choice experiment eliciting preferences from mental healthcare service users, mental healthcare professionals and the general population," Social Science & Medicine, Elsevier, vol. 301(C).
    4. Vikas Soekhai & Esther W. Bekker-Grob & Alan R. Ellis & Caroline M. Vass, 2019. "Discrete Choice Experiments in Health Economics: Past, Present and Future," PharmacoEconomics, Springer, vol. 37(2), pages 201-226, February.
    5. Buckell, John & Hess, Stephane, 2019. "Stubbing out hypothetical bias: improving tobacco market predictions by combining stated and revealed preference data," Journal of Health Economics, Elsevier, vol. 65(C), pages 93-102.
    6. Genie, Mesfin G. & Ryan, Mandy & Krucien, Nicolas, 2021. "To pay or not to pay? Cost information processing in the valuation of publicly funded healthcare," Social Science & Medicine, Elsevier, vol. 276(C).
    7. Seda Erdem & Danny Campbell, 2017. "Preferences for public involvement in health service decisions: a comparison between best-worst scaling and trio-wise stated preference elicitation techniques," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 18(9), pages 1107-1123, December.
    8. Mesfin G. Genie & Nicolas Krucien & Mandy Ryan, 2021. "Weighting or aggregating? Investigating information processing in multi‐attribute choices," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1291-1305, June.
    9. Jeff Round & Mike Paulden, 2018. "Incorporating equity in economic evaluations: a multi-attribute equity state approach," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(4), pages 489-498, May.
    10. Óscar Brito Fernandes & Márta Péntek & Dionne Kringos & Niek Klazinga & László Gulácsi & Petra Baji, 2020. "Eliciting preferences for outpatient care experiences in Hungary: A discrete choice experiment with a national representative sample," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-15, July.
    11. Ivan Tzintzun & Jonathan Sicsic & Lise Rochaix, 2023. "Into the Far West? Investigating Health Policy-Makers' Willingness to Adopt Decrementally Cost-Effective Innovations Using a DCE Approach," PSE Working Papers halshs-04154933, HAL.
    12. Nikita Arora & Matthew Quaife & Kara Hanson & Mylene Lagarde & Dorka Woldesenbet & Abiy Seifu & Romain Crastes dit Sourd, 2022. "Discrete choice analysis of health worker job preferences in Ethiopia: Separating attribute non‐attendance from taste heterogeneity," Health Economics, John Wiley & Sons, Ltd., vol. 31(5), pages 806-819, May.
    13. Nicolas Jacquemet & Stephane Luchini & Jason Shogren & Verity Watson, 2019. "Discrete Choice under Oaths," Post-Print halshs-02136103, HAL.
    14. McHugh, Neil & Pinto-Prades, José Luis & Baker, Rachel & Mason, Helen & Donaldson, Cam, 2020. "Exploring the relative value of end of life QALYs: Are the comparators important?," Social Science & Medicine, Elsevier, vol. 245(C).
    15. Ricardo A. Daziano, 2022. "A choice experiment assessment of stated early response to COVID-19 vaccines in the USA," Health Economics Review, Springer, vol. 12(1), pages 1-16, December.
    16. Anna Nicolet & Antoinette D I van Asselt & Karin M Vermeulen & Paul F M Krabbe, 2020. "Value judgment of new medical treatments: Societal and patient perspectives to inform priority setting in The Netherlands," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-18, July.
    17. John Buckell & Vrinda Vasavada & Sarah Wordsworth & Dean A. Regier & Matthew Quaife, 2022. "Utility maximization versus regret minimization in health choice behavior: Evidence from four datasets," Health Economics, John Wiley & Sons, Ltd., vol. 31(2), pages 363-381, February.
    18. Conti, G.; & Giustinelli, P.;, 2022. "For Better or Worse? Subjective Expectations and Cost-Benefit Trade-Offs in Health Behavior: An Application to Lockdown Compliance in the United Kingdom," Health, Econometrics and Data Group (HEDG) Working Papers 22/14, HEDG, c/o Department of Economics, University of York.
    19. Burns, J.G. & Glenk, K. & Eory, V. & Simm, G. & Wall, E., 2021. "Preferences of European dairy stakeholders in breeding for resilient and efficient cattle: a Best-Worst Scaling approach," 95th Annual Conference, March 29-30, 2021, Warwick, UK (Hybrid) 311092, Agricultural Economics Society - AES.
    20. Brouwers, Jonas & Cox, Bianca & Van Wilder, Astrid & Claessens, Fien & Bruyneel, Luk & De Ridder, Dirk & Eeckloo, Kristof & Vanhaecht, Kris, 2021. "The future of hospital quality of care policy: A multi-stakeholder discrete choice experiment in Flanders, Belgium," Health Policy, Elsevier, vol. 125(12), pages 1565-1573.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:patien:v:13:y:2020:i:3:d:10.1007_s40271-019-00406-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.