IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v15y2006i8p835-848.html
   My bibliography  Save this article

Relative risk of a shuffled deck: a generalizable logical consistency criterion for sample selection in health state valuation studies

Author

Listed:
  • Benjamin M. Craig
  • Sulabha Ramachandran

Abstract

In a health state valuation study, respondents may be asked to rank a deck of cards, with each card representing a particular health state. A logical inconsistency occurs when a more severe health state card is ranked higher than a less severe card. Occasional inconsistencies may be justified by errors in judgment or measurement. However, when respondents return shuffled decks, their responses must be removed from the sample; otherwise, valuation estimates will be biased toward the median. In this paper, we present a logical consistency criterion for sample selection in health state valuation studies. This statistical criterion is based on the relative risk of a shuffled deck and generalizable to all health state classification systems, subsets (or decks) of health states, and valuation techniques. We applied the criterion to secondary data collected from 4048 United States and 3395 United Kingdom respondents. In both studies, respondents evaluated 12‐card decks of EQ‐5D health states using time trade‐off and visual analog scale techniques. Among the UK respondents, a small portion (approximately 5%) did not satisfy the criterion; their exclusion significantly changed the sample characteristics and the mean value estimates of the EQ‐5D health states. Similar results were found among the US respondents. Copyright © 2006 John Wiley & Sons, Ltd.

Suggested Citation

  • Benjamin M. Craig & Sulabha Ramachandran, 2006. "Relative risk of a shuffled deck: a generalizable logical consistency criterion for sample selection in health state valuation studies," Health Economics, John Wiley & Sons, Ltd., vol. 15(8), pages 835-848, August.
    • Handle: RePEc:wly:hlthec:v:15:y:2006:i:8:p:835-848
    DOI: 10.1002/hec.1108
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.1108
    Download Restriction: no
    File URL: https://libkey.io/10.1002/hec.1108?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Claire Gudex, 1994. "Time trade-off user manual: props and self-completion methods," Working Papers 020cheop, Centre for Health Economics, University of York.
    2. Robinson, Angela & Dolan, Paul & Williams, Alan, 1997. "Valuing health status using VAS and TTO: What lies behind the numbers?," Social Science & Medicine, Elsevier, vol. 45(8), pages 1289-1297, October.
    3. Friedman,Daniel & Sunder,Shyam, 1994. "Experimental Methods," Cambridge Books, Cambridge University Press, number 9780521456821, November.
    4. Kenkel, Donald S, 1991. "Health Behavior, Health Knowledge, and Schooling," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 287-305, April.
    5. Jeff Richardson & Neil Atherton Day & Stuart Peacock & Angelo Iezzi, 2004. "Measurement of the Quality of Life for Economic Evaluation and the Assessment of Quality of Life (AQoL) Mark 2 Instrument," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 37(1), pages 62-88, March.
    6. Brazier, John & Roberts, Jennifer & Deverill, Mark, 2002. "The estimation of a preference-based measure of health from the SF-36," Journal of Health Economics, Elsevier, vol. 21(2), pages 271-292, March.
    7. Dolan, Paul & Kind, Paul, 1996. "Inconsistency and health state valuations," Social Science & Medicine, Elsevier, vol. 42(4), pages 609-615, February.
    8. Dolan, P. & Gudex, C. & Kind, P. & Williams, A., 1996. "Valuing health states: A comparison of methods," Journal of Health Economics, Elsevier, vol. 15(2), pages 209-231, April.
    9. Badia, Xavier & Roset, Monserrat & Herdman, Michael, 1999. "Inconsistent responses in three preference-elicitation methods for health states," Social Science & Medicine, Elsevier, vol. 49(7), pages 943-950, October.
    10. Groot, Wim, 2000. "Adaptation and scale of reference bias in self-assessments of quality of life," Journal of Health Economics, Elsevier, vol. 19(3), pages 403-420, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Benjamin M. Craig & Jan J. V. Busschbach, 2011. "Toward a more universal approach in health valuation," Health Economics, John Wiley & Sons, Ltd., vol. 20(7), pages 864-875, July.
    2. Eve Wittenberg & Lisa Prosser, 2011. "Ordering errors, objections and invariance in utility survey responses," Applied Health Economics and Health Policy, Springer, vol. 9(4), pages 225-241, July.
    3. Lidia Engel & Nick Bansback & Stirling Bryan & Mary M. Doyle-Waters & David G. T. Whitehurst, 2016. "Exclusion Criteria in National Health State Valuation Studies," Medical Decision Making, , vol. 36(7), pages 798-810, October.
    4. Mônica Viegas Andrade & Kenya Noronha & Paul Kind & Carla de Barros Reis & Lucas Resende de Carvalho, 2016. "Logical Inconsistencies in 3 Preference Elicitation Methods for EQ-5D Health States," Medical Decision Making, , vol. 36(2), pages 242-252, February.
    5. Bansback, Nick & Hole, Arne Risa & Mulhern, Brendan & Tsuchiya, Aki, 2014. "Testing a discrete choice experiment including duration to value health states for large descriptive systems: Addressing design and sampling issues," Social Science & Medicine, Elsevier, vol. 114(C), pages 38-48.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mônica Viegas Andrade & Kenya Noronha & Paul Kind & Carla de Barros Reis & Lucas Resende de Carvalho, 2016. "Logical Inconsistencies in 3 Preference Elicitation Methods for EQ-5D Health States," Medical Decision Making, , vol. 36(2), pages 242-252, February.
    2. Garry R. Barton & Tracey H. Sach & Anthony J. Avery & Claire Jenkinson & Michael Doherty & David K. Whynes & Kenneth R. Muir, 2008. "A comparison of the performance of the EQ‐5D and SF‐6D for individuals aged ≥ 45 years," Health Economics, John Wiley & Sons, Ltd., vol. 17(7), pages 815-832, July.
    3. Carl Tilling & Nancy Devlin & Aki Tsuchiya & Ken Buckingham, 2010. "Protocols for Time Tradeoff Valuations of Health States Worse than Dead: A Literature Review," Medical Decision Making, , vol. 30(5), pages 610-619, September.
    4. Samuel Aballéa & Aki Tsuchiya, 2007. "Seeing for yourself: feasibility study towards valuing visual impairment using simulation spectacles," Health Economics, John Wiley & Sons, Ltd., vol. 16(5), pages 537-543, May.
    5. Eve Wittenberg & Lisa Prosser, 2011. "Ordering errors, objections and invariance in utility survey responses," Applied Health Economics and Health Policy, Springer, vol. 9(4), pages 225-241, July.
    6. Eva Rodríguez Míguez & José María Abellán Perpiñán & José Carlos Álvarez Villamarín & José Manuel González Martínez & Antonio Rodríguez Sampayo, 2013. "Development of a new preference-based instrument to measure dependency," Working Papers 1301, Universidade de Vigo, Departamento de Economía Aplicada.
    7. Garry Barton & Tracey Sach & Michael Doherty & Anthony Avery & Claire Jenkinson & Kenneth Muir, 2008. "An assessment of the discriminative ability of the EQ-5D index , SF-6D, and EQ VAS, using sociodemographic factors and clinical conditions," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 9(3), pages 237-249, August.
    8. Brazier, J, 2005. "Current state of the art in preference-based measures of health and avenues for further research," MPRA Paper 29762, University Library of Munich, Germany.
    9. Benjamin M. Craig, 2009. "The duration effect: a link between TTO and VAS values," Health Economics, John Wiley & Sons, Ltd., vol. 18(2), pages 217-225, February.
    10. Nancy J. Devlin & Paul Hansen & Paul Kind & Alan Williams, 2003. "Logical inconsistencies in survey respondents' health state valuations ‐ a methodological challenge for estimating social tariffs," Health Economics, John Wiley & Sons, Ltd., vol. 12(7), pages 529-544, July.
    11. Leida M. Lamers & Peep F. M. Stalmeier & Paul F. M. Krabbe & Jan J. V. Busschbach, 2006. "Inconsistencies in TTO and VAS Values for EQ-5D Health States," Medical Decision Making, , vol. 26(2), pages 173-181, March.
    12. Groot, Wim & Maassen van den Brink, Henriette, 2007. "The health effects of education," Economics of Education Review, Elsevier, vol. 26(2), pages 186-200, April.
    13. Trude Arnesen & Mari Trommald, 2005. "Are QALYs based on time trade‐off comparable? – A systematic review of TTO methodologies," Health Economics, John Wiley & Sons, Ltd., vol. 14(1), pages 39-53, January.
    14. Rachel Baker & Angela Robinson, 2004. "Responses to standard gambles: are preferences ‘well constructed’?," Health Economics, John Wiley & Sons, Ltd., vol. 13(1), pages 37-48, January.
    15. P. Wang & M. Li & G. Liu & J. Thumboo & N. Luo, 2015. "Do Chinese have similar health-state preferences? A comparison of mainland Chinese and Singaporean Chinese," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 16(8), pages 857-863, November.
    16. Tsuchiya, Aki & Brazier, John & Roberts, Jennifer, 2006. "Comparison of valuation methods used to generate the EQ-5D and the SF-6D value sets," Journal of Health Economics, Elsevier, vol. 25(2), pages 334-346, March.
    17. Marie-Josée Dion & Pierre Tousignant & Jean Bourbeau & Dick Menzies & Kevin Schwartzman, 2002. "Measurement of Health Preferences among Patients with Tuberculous Infection and Disease," Medical Decision Making, , vol. 22(1_suppl), pages 102-114, September.
    18. Ayse Kuspinar & Nancy Mayo, 2014. "A Review of the Psychometric Properties of Generic Utility Measures in Multiple Sclerosis," PharmacoEconomics, Springer, vol. 32(8), pages 759-773, August.
    19. Paul Dolan & Claire Gudex & Paul Kind & Alan Williams, 1995. "A social tariff for EuroQol: results from a UK general population survey," Working Papers 138chedp, Centre for Health Economics, University of York.
    20. Mandy Ryan & Mabelle Amaya‐Amaya, 2005. "‘Threats’ to and hopes for estimating benefits," Health Economics, John Wiley & Sons, Ltd., vol. 14(6), pages 609-619, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:15:y:2006:i:8:p:835-848. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.