IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v15y2006i8p835-848.html
   My bibliography  Save this article

Relative risk of a shuffled deck: a generalizable logical consistency criterion for sample selection in health state valuation studies

Author

Listed:
  • Benjamin M. Craig
  • Sulabha Ramachandran

Abstract

In a health state valuation study, respondents may be asked to rank a deck of cards, with each card representing a particular health state. A logical inconsistency occurs when a more severe health state card is ranked higher than a less severe card. Occasional inconsistencies may be justified by errors in judgment or measurement. However, when respondents return shuffled decks, their responses must be removed from the sample; otherwise, valuation estimates will be biased toward the median. In this paper, we present a logical consistency criterion for sample selection in health state valuation studies. This statistical criterion is based on the relative risk of a shuffled deck and generalizable to all health state classification systems, subsets (or decks) of health states, and valuation techniques. We applied the criterion to secondary data collected from 4048 United States and 3395 United Kingdom respondents. In both studies, respondents evaluated 12‐card decks of EQ‐5D health states using time trade‐off and visual analog scale techniques. Among the UK respondents, a small portion (approximately 5%) did not satisfy the criterion; their exclusion significantly changed the sample characteristics and the mean value estimates of the EQ‐5D health states. Similar results were found among the US respondents. Copyright © 2006 John Wiley & Sons, Ltd.

Suggested Citation

  • Benjamin M. Craig & Sulabha Ramachandran, 2006. "Relative risk of a shuffled deck: a generalizable logical consistency criterion for sample selection in health state valuation studies," Health Economics, John Wiley & Sons, Ltd., vol. 15(8), pages 835-848, August.
    • Handle: RePEc:wly:hlthec:v:15:y:2006:i:8:p:835-848
    DOI: 10.1002/hec.1108
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.1108
    Download Restriction: no
    File URL: https://libkey.io/10.1002/hec.1108?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Brazier, John & Roberts, Jennifer & Deverill, Mark, 2002. "The estimation of a preference-based measure of health from the SF-36," Journal of Health Economics, Elsevier, vol. 21(2), pages 271-292, March.
    2. Badia, Xavier & Roset, Monserrat & Herdman, Michael, 1999. "Inconsistent responses in three preference-elicitation methods for health states," Social Science & Medicine, Elsevier, vol. 49(7), pages 943-950, October.
    3. Claire Gudex, 1994. "Time trade-off user manual: props and self-completion methods," Working Papers 020cheop, Centre for Health Economics, University of York.
    4. Robinson, Angela & Dolan, Paul & Williams, Alan, 1997. "Valuing health status using VAS and TTO: What lies behind the numbers?," Social Science & Medicine, Elsevier, vol. 45(8), pages 1289-1297, October.
    5. repec:bla:ausecr:v:37:y:2004:i:1:p:62-88 is not listed on IDEAS
    6. Dolan, P. & Gudex, C. & Kind, P. & Williams, A., 1996. "Valuing health states: A comparison of methods," Journal of Health Economics, Elsevier, vol. 15(2), pages 209-231, April.
    7. Friedman,Daniel & Sunder,Shyam, 1994. "Experimental Methods," Cambridge Books, Cambridge University Press, number 9780521456821, January.
    8. Kenkel, Donald S, 1991. "Health Behavior, Health Knowledge, and Schooling," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 287-305, April.
    9. Groot, Wim, 2000. "Adaptation and scale of reference bias in self-assessments of quality of life," Journal of Health Economics, Elsevier, vol. 19(3), pages 403-420, May.
    10. Dolan, Paul & Kind, Paul, 1996. "Inconsistency and health state valuations," Social Science & Medicine, Elsevier, vol. 42(4), pages 609-615, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lidia Engel & Nick Bansback & Stirling Bryan & Mary M. Doyle-Waters & David G. T. Whitehurst, 2016. "Exclusion Criteria in National Health State Valuation Studies," Medical Decision Making, , vol. 36(7), pages 798-810, October.
    2. Bansback, Nick & Hole, Arne Risa & Mulhern, Brendan & Tsuchiya, Aki, 2014. "Testing a discrete choice experiment including duration to value health states for large descriptive systems: Addressing design and sampling issues," Social Science & Medicine, Elsevier, vol. 114(C), pages 38-48.
    3. Benjamin M. Craig & Jan J. V. Busschbach, 2011. "Toward a more universal approach in health valuation," Health Economics, John Wiley & Sons, Ltd., vol. 20(7), pages 864-875, July.
    4. Eve Wittenberg & Lisa Prosser, 2011. "Ordering errors, objections and invariance in utility survey responses," Applied Health Economics and Health Policy, Springer, vol. 9(4), pages 225-241, July.
    5. Benjamin Matthew Craig & Maksat Jumamyradov & Oliver Rivero-Arias, 2024. "The Performance of Kaizen Tasks Across Three Online Discrete Choice Experiment Surveys: An Evidence Synthesis," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 17(6), pages 635-644, November.
    6. Mônica Viegas Andrade & Kenya Noronha & Paul Kind & Carla de Barros Reis & Lucas Resende de Carvalho, 2016. "Logical Inconsistencies in 3 Preference Elicitation Methods for EQ-5D Health States," Medical Decision Making, , vol. 36(2), pages 242-252, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mônica Viegas Andrade & Kenya Noronha & Paul Kind & Carla de Barros Reis & Lucas Resende de Carvalho, 2016. "Logical Inconsistencies in 3 Preference Elicitation Methods for EQ-5D Health States," Medical Decision Making, , vol. 36(2), pages 242-252, February.
    2. Garry Barton & Tracey Sach & Michael Doherty & Anthony Avery & Claire Jenkinson & Kenneth Muir, 2008. "An assessment of the discriminative ability of the EQ-5D index , SF-6D, and EQ VAS, using sociodemographic factors and clinical conditions," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 9(3), pages 237-249, August.
    3. Benjamin M. Craig, 2009. "The duration effect: a link between TTO and VAS values," Health Economics, John Wiley & Sons, Ltd., vol. 18(2), pages 217-225, February.
    4. Garry R. Barton & Tracey H. Sach & Anthony J. Avery & Claire Jenkinson & Michael Doherty & David K. Whynes & Kenneth R. Muir, 2008. "A comparison of the performance of the EQ‐5D and SF‐6D for individuals aged ≥ 45 years," Health Economics, John Wiley & Sons, Ltd., vol. 17(7), pages 815-832, July.
    5. Samuel Aballéa & Aki Tsuchiya, 2007. "Seeing for yourself: feasibility study towards valuing visual impairment using simulation spectacles," Health Economics, John Wiley & Sons, Ltd., vol. 16(5), pages 537-543, May.
    6. Eve Wittenberg & Lisa Prosser, 2011. "Ordering errors, objections and invariance in utility survey responses," Applied Health Economics and Health Policy, Springer, vol. 9(4), pages 225-241, July.
    7. Eva Rodríguez Míguez & José María Abellán Perpiñán & José Carlos Álvarez Villamarín & José Manuel González Martínez & Antonio Rodríguez Sampayo, 2013. "Development of a new preference-based instrument to measure dependency," Working Papers 1301, Universidade de Vigo, Departamento de Economía Aplicada.
    8. Brazier, J, 2005. "Current state of the art in preference-based measures of health and avenues for further research," MPRA Paper 29762, University Library of Munich, Germany.
    9. Groot, Wim & Maassen van den Brink, Henriette, 2007. "The health effects of education," Economics of Education Review, Elsevier, vol. 26(2), pages 186-200, April.
    10. Carl Tilling & Nancy Devlin & Aki Tsuchiya & Ken Buckingham, 2010. "Protocols for Time Tradeoff Valuations of Health States Worse than Dead: A Literature Review," Medical Decision Making, , vol. 30(5), pages 610-619, September.
    11. Tsuchiya, Aki & Brazier, John & Roberts, Jennifer, 2006. "Comparison of valuation methods used to generate the EQ-5D and the SF-6D value sets," Journal of Health Economics, Elsevier, vol. 25(2), pages 334-346, March.
    12. Paul Dolan & Claire Gudex & Paul Kind & Alan Williams, 1995. "A social tariff for EuroQol: results from a UK general population survey," Working Papers 138chedp, Centre for Health Economics, University of York.
    13. Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Threats’ to and hopes for estimating benefits," Health Economics, John Wiley & Sons, Ltd., vol. 14(6), pages 609-619, June.
    14. Vick, Sandra & Scott, Anthony, 1998. "Agency in health care. Examining patients' preferences for attributes of the doctor-patient relationship," Journal of Health Economics, Elsevier, vol. 17(5), pages 587-605, October.
    15. Petter Lundborg, 0000. "The Health Returns to Education - What can we learn from Twins?," Tinbergen Institute Discussion Papers 08-027/3, Tinbergen Institute.
    16. Katharine S. Gries & Dean A. Regier & Scott D. Ramsey & Donald L. Patrick, 2017. "Utility Estimates of Disease-Specific Health States in Prostate Cancer from Three Different Perspectives," Applied Health Economics and Health Policy, Springer, vol. 15(3), pages 375-384, June.
    17. Brazier, John & Rowen, Donna & Tsuchiya, Aki & Yang, Yaling & Young, Tracy A., 2011. "The impact of adding an extra dimension to a preference-based measure," Social Science & Medicine, Elsevier, vol. 73(2), pages 245-253, July.
    18. Stavros Petrou & Christine Hockley, 2005. "An investigation into the empirical validity of the EQ‐5D and SF‐6D based on hypothetical preferences in a general population," Health Economics, John Wiley & Sons, Ltd., vol. 14(11), pages 1169-1189, November.
    19. Yang, Y & Tsuchiya, A & Brazier, J & Young, Tracey A., 2007. "Estimating a preference-based single index from the Asthma Quality of Life Questionnaire (AQLQ)," MPRA Paper 29804, University Library of Munich, Germany.
    20. Mandy Ryan & Verity Watson & Vikki Entwistle, 2009. "Rationalising the ‘irrational’: a think aloud study of discrete choice experiment responses," Health Economics, John Wiley & Sons, Ltd., vol. 18(3), pages 321-336, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:15:y:2006:i:8:p:835-848. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.