IDEAS home Printed from https://ideas.repec.org/p/ran/wpaper/wr-501.html
   My bibliography  Save this paper

Validating the Use of Vignettes for Subjective Threshold Scales

Author

Listed:
  • Arthur Van Soest
  • Liam Delaney
  • Colm Harmon
  • Arie Kapteyn
  • James P. Smith

Abstract

Comparing self-assessed indicators of subjective outcomes such as health, work disability, political efficacy, job satisfaction, etc. across countries or socio-economic groups is often hampered by the fact that different groups use systematically different response scales. Anchoring vignettes have been introduced as an effective tool to correct for such differences. This paper develops an integrated framework in which objective measurements are used to validate the vignette based corrections. The framework is applied to vignettes and objective and subjective self-assessments of drinking behavior by students in Ireland. Model comparisons using the Akaike information criterion favor a specification with response consistency and vignette corrected response scales. Put differently, vignette based corrections appear quite effective in bringing objective and subjective measures closer together.

Suggested Citation

  • Arthur Van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," Working Papers WR-501, RAND Corporation.
    • Handle: RePEc:ran:wpaper:wr-501
    as

    Download full text from publisher

    File URL: https://www.rand.org/content/dam/rand/pubs/working_papers/2007/RAND_WR501.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    2. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    3. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    4. Lindeboom, Maarten & van Doorslaer, Eddy, 2004. "Cut-point shift and index shift in self-reported health," Journal of Health Economics, Elsevier, vol. 23(6), pages 1083-1099, November.
    5. Arie Kapteyn & James P. Smith & Arthur VanSoest, 2005. "Vignettes and Self Reported Work Disability," Labor and Demography 0511005, University Library of Munich, Germany.
    6. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2004. "Self-reported Work Disability in the US and The Netherlands," Working Papers WR-206, RAND Corporation.
    7. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fontaine, Xavier & Haywood, Luke, 2018. "On the comparison of group inequalities using subjective data," Economics Letters, Elsevier, vol. 163(C), pages 17-21.
    2. Nigel Rice & Silvana Robone & Peter C. Smith, 2012. "Vignettes and health systems responsiveness in cross‐country comparative analyses," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 337-369, April.
    3. Laura Rossouw & Teresa Bago d’Uva & Eddy Doorslaer, 2018. "Poor Health Reporting? Using Anchoring Vignettes to Uncover Health Disparities by Wealth and Race," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1935-1956, October.
    4. Johnston, David W. & Propper, Carol & Shields, Michael A., 2009. "Comparing subjective and objective measures of health: Evidence from hypertension for the income/health gradient," Journal of Health Economics, Elsevier, vol. 28(3), pages 540-552, May.
    5. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    6. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    7. Jorge E. Araña & Carmelo J. León, 2012. "Scale-perception bias in the valuation of environmental risks," Applied Economics, Taylor & Francis Journals, vol. 44(20), pages 2607-2617, July.
    8. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    9. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    10. Zhang, Hao & Bago d’Uva, Teresa & van Doorslaer, Eddy, 2015. "The gender health gap in China: A decomposition analysis," Economics & Human Biology, Elsevier, vol. 18(C), pages 13-26.
    11. Rachel J. Knott & Nicole Black & Bruce Hollingsworth & Paula K. Lorgelly, 2017. "Response‐Scale Heterogeneity in the EQ‐5D," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 387-394, March.
    12. Aparajita Dasgupta, 2018. "Systematic measurement error in self-reported health: is anchoring vignettes the way out?," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-30, December.
    13. Liam Delaney & Arie Kapteyn & James P Smith, 2008. "Why do some Irish drink so much?," Working Papers 200809, School of Economics, University College Dublin.
    14. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2013. "Are A mericans Really Less Happy with Their Incomes?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59(1), pages 44-65, March.
    15. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    16. Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Social Contacts of Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 273-292, January.
    17. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    18. Franco Peracchi & Claudio Rossetti, 2012. "Heterogeneity in health responses and anchoring vignettes," Empirical Economics, Springer, vol. 42(2), pages 513-538, April.
    19. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2012. "Age, Health and Life Satisfaction Among Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 293-308, January.
    20. Greene, William & Harris, Mark N. & Knott, Rachel & Rice, Nigel, 2023. "Reporting heterogeneity in modeling self-assessed survey outcomes," Economic Modelling, Elsevier, vol. 124(C).

    More about this item

    Keywords

    anchoring vignettes; reporting bias; hopit model;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • I12 - Health, Education, and Welfare - - Health - - - Health Behavior

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ran:wpaper:wr-501. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benson Wong (email available below). General contact details of provider: https://edirc.repec.org/data/lpranus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.