IDEAS home Printed from https://ideas.repec.org/p/yor/hectdg/19-18.html
   My bibliography  Save this paper

Specification and testing of hierarchical ordered response models with anchoring vignettes

Author

Listed:
  • Greene, W.H.;
  • Harris, M.N.;
  • Knott, R.;
  • Rice, N.;

Abstract

Anchoring vignettes have been proposed as a way to correct for differential item functioning when individuals self-assess their health, or other aspects of their circumstances on an ordered categorical scale. The model relies on two key underlying assumptions of response consistency and vignette equivalence. Adopting a modified specification of the boundary equations in the compound hierarchical ordered probit model this paper develops joint and separate tests of these assumptions based on a score approach. Monte Carlo simulations show that the tests have good size and power properties in finite samples. We provide an application of the test to data from the Survey of Health, Aging and Retirement in Europe (SHARE, using self-reported data on pain. The tests are easy to implement, only requiring estimation of the restricted model under the null hypothesis.

Suggested Citation

  • Greene, W.H.; & Harris, M.N.; & Knott, R.; & Rice, N.;, 2019. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 19/18, HEDG, c/o Department of Economics, University of York.
    • Handle: RePEc:yor:hectdg:19/18
    as

    Download full text from publisher

    File URL: https://www.york.ac.uk/media/economics/documents/hedg/workingpapers/1918.pdf
    File Function: Main text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    2. Stefan Boes & Rainer Winkelmann, 2006. "Ordered Response Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 12, pages 167-181, Springer.
    3. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2013. "Are A mericans Really Less Happy with Their Incomes?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59(1), pages 44-65, March.
    4. Greene, William & McKenzie, Colin, 2015. "An LM test based on generalized residuals for random effects in a nonlinear model," Economics Letters, Elsevier, vol. 127(C), pages 47-50.
    5. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    6. Antonio Afonso & Pedro Gomes & Philipp Rother, 2009. "Ordered response models for sovereign debt ratings," Applied Economics Letters, Taylor & Francis Journals, vol. 16(8), pages 769-773.
    7. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    8. Davidson, Russell & MacKinnon, James G, 1987. "Implicit Alternatives and the Local Power of Test Statistics," Econometrica, Econometric Society, vol. 55(6), pages 1305-1329, November.
    9. Nigel Rice & Silvana Robone & Peter Smith, 2011. "Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(2), pages 141-162, April.
    10. Arie Kapteyn & James P. Smith & Arthur Van Soest & Hana Vonkova, 2011. "Anchoring Vignettes and Response Consistency," Working Papers WR-840, RAND Corporation.
    11. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    12. Francesco Bartolucci & Silvia Bacci & Fulvia Pennoni, 2014. "Longitudinal analysis of self-reported health status by mixture latent auto-regressive models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(2), pages 267-288, February.
    13. Corrado, L. & Weeks, M., 2010. "Identification Strategies in Survey Response Using Vignettes," Cambridge Working Papers in Economics 1031, Faculty of Economics, University of Cambridge.
    14. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2014. "Do Danes and Italians Rate Life Satisfaction in the Same Way? Using Vignettes to Correct for Individual-Specific Scale Biases," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 643-666, October.
    15. Franco Peracchi & Claudio Rossetti, 2012. "Heterogeneity in health responses and anchoring vignettes," Empirical Economics, Springer, vol. 42(2), pages 513-538, April.
    16. Omar Paccagnella, 2011. "Anchoring vignettes with sample selection due to non‐response," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 665-687, July.
    17. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    18. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    19. Groseclose, Tim & Levitt, Steven D. & Snyder, James M., 1999. "Comparing Interest Group Scores across Time and Chambers: Adjusted ADA Scores for the U.S. Congress," American Political Science Review, Cambridge University Press, vol. 93(1), pages 33-50, March.
    20. Arthur van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2011. "Validating the use of anchoring vignettes for the correction of response scale differences in subjective questions," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 575-595, July.
    21. Stephen Pudney & Michael Shields, 2000. "Gender, race, pay and promotion in the British nursing profession: estimation of a generalized ordered probit model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(4), pages 367-399.
    22. Rossi P. E & Gilula Z. & Allenby G. M, 2001. "Overcoming Scale Usage Heterogeneity: A Bayesian Hierarchical Approach," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 20-31, March.
    23. Nicolas Sirven & Brigitte Santos-Eggimann & Jacques Spagnoli, 2012. "Comparability of Health Care Responsiveness in Europe," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 255-271, January.
    24. Datta Gupta, Nabanita & Kristensen, Nicolai & Pozzoli, Dario, 2010. "External validation of the use of vignettes in cross-country health studies," Economic Modelling, Elsevier, vol. 27(4), pages 854-865, July.
    25. Greene,William H. & Hensher,David A., 2010. "Modeling Ordered Choices," Cambridge Books, Cambridge University Press, number 9780521194204, January.
    26. Hana Voňková & Patrick Hullegie, 2011. "Is the anchoring vignette method sensitive to the domain and choice of the vignette?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 597-620, July.
    27. Viola Angelini & Danilo Cavapozzi & Omar Paccagnella, 2011. "Dynamics of reporting work disability in Europe," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 621-638, July.
    28. Arie Kapteyn & James P. Smith & Arthur Van Soest & Hana Vonkova, 2011. "Anchoring Vignettes and Response Consistency," Working Papers 840, RAND Corporation.
    29. Greene, William & Harris, Mark N. & Hollingsworth, Bruce & Maitra, Pushkar, 2014. "A latent class model for obesity," Economics Letters, Elsevier, vol. 123(1), pages 1-5.
    30. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2012. "Age, Health and Life Satisfaction Among Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 293-308, January.
    31. Arthur van Soest & Hana Vonkova, 2014. "Testing the specification of parametric models by using anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 177(1), pages 115-133, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    2. Andrew M. Jones; Nigel Rice, Silvana Robone; & Nigel Rice; & Silvana Robone:, 2012. "A comparison of parametric and non-parametric adjustments using vignettes for self-reported data," Health, Econometrics and Data Group (HEDG) Working Papers 12/10, HEDG, c/o Department of Economics, University of York.
    3. Hana Vonkova, 2019. "Life Satisfaction among Different Groups of Children: Self-Reports, Differential Scale Usage and Anchoring Vignettes," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 12(6), pages 2111-2136, December.
    4. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    5. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    6. Knott, Rachel J. & Lorgelly, Paula K. & Black, Nicole & Hollingsworth, Bruce, 2017. "Differential item functioning in quality of life measurement: An analysis using anchoring vignettes," Social Science & Medicine, Elsevier, vol. 190(C), pages 247-255.
    7. Rachel J. Knott & Nicole Black & Bruce Hollingsworth & Paula K. Lorgelly, 2017. "Response‐Scale Heterogeneity in the EQ‐5D," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 387-394, March.
    8. Omar Paccagnella, 2011. "Anchoring vignettes with sample selection due to non‐response," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 665-687, July.
    9. Raskina, Yulia & Podkorytova, Olga & Kuchakov, Ruslan, 2022. "Health determinants and the reporting heterogeneity bias in Russia: Anchoring vignettes approach," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 66, pages 118-143.
    10. Zhang, Hao & Bago d’Uva, Teresa & van Doorslaer, Eddy, 2015. "The gender health gap in China: A decomposition analysis," Economics & Human Biology, Elsevier, vol. 18(C), pages 13-26.
    11. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    12. Arthur van Soest & Hana Vonkova, 2014. "Testing the specification of parametric models by using anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 177(1), pages 115-133, January.
    13. Corrado, L. & Weeks, M., 2010. "Identification Strategies in Survey Response Using Vignettes," Cambridge Working Papers in Economics 1031, Faculty of Economics, University of Cambridge.
    14. Molina, Teresa, 2017. "Adjusting for heterogeneous response thresholds in cross-country comparisons of self-reported health," The Journal of the Economics of Ageing, Elsevier, vol. 10(C), pages 1-20.
    15. Montgomery, Mallory, 2022. "Reversing the gender gap in happiness," Journal of Economic Behavior & Organization, Elsevier, vol. 196(C), pages 65-78.
    16. Hendrik Jürges & Joachim Winter, 2013. "Are Anchoring Vignettes Ratings Sensitive To Vignette Age And Sex?," Health Economics, John Wiley & Sons, Ltd., vol. 22(1), pages 1-13, January.
    17. Aparajita Dasgupta, 2018. "Systematic measurement error in self-reported health: is anchoring vignettes the way out?," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-30, December.
    18. Daniel J. Benjamin & Kristen Cooper & Ori Heffetz & Miles S. Kimball, 2023. "From Happiness Data to Economic Conclusions," NBER Working Papers 31727, National Bureau of Economic Research, Inc.
    19. Laura Rossouw & Teresa Bago d’Uva & Eddy Doorslaer, 2018. "Poor Health Reporting? Using Anchoring Vignettes to Uncover Health Disparities by Wealth and Race," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1935-1956, October.
    20. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2012. "Age, Health and Life Satisfaction Among Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 293-308, January.

    More about this item

    Keywords

    ordered response models; anchoring vignettes; differential item functioning; self-assessments; score test; CHOPIT;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:yor:hectdg:19/18. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jane Rawlings (email available below). General contact details of provider: https://edirc.repec.org/data/deyoruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.