IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v38y2013i5p522-547.html
   My bibliography  Save this article

A Two-Decision Model for Responses to Likert-Type Items

Author

Listed:
  • Anne Thissen-Roe

    (Kronos, Inc.)

  • David Thissen

    (University of North Carolina)

Abstract

Extreme response set, the tendency to prefer the lowest or highest response option when confronted with a Likert-type response scale, can lead to misfit of item response models such as the generalized partial credit model. Recently, a series of intrinsically multidimensional item response models have been hypothesized, wherein tendency toward extreme response set is simultaneously estimated alongside one or more psychological constructs of interest. The multidimensional nominal response model (MNRM) is a divide-by-total model that allows person parameters for response sets, including extreme response set. The proportional thresholds model (PTM) is a difference model with response set parameters. The present study introduces a two-decision model (TDM) as an alternative to the MNRM and PTM and compares all three on data from assessments used in employee selection.

Suggested Citation

  • Anne Thissen-Roe & David Thissen, 2013. "A Two-Decision Model for Responses to Likert-Type Items," Journal of Educational and Behavioral Statistics, , vol. 38(5), pages 522-547, October.
    • Handle: RePEc:sae:jedbes:v:38:y:2013:i:5:p:522-547
    DOI: 10.3102/1076998613481500
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998613481500
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998613481500?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Thissen, 1982. "Marginal maximum likelihood estimation for the one-parameter logistic model," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 175-186, June.
    2. Rossi P. E & Gilula Z. & Allenby G. M, 2001. "Overcoming Scale Usage Heterogeneity: A Bayesian Hierarchical Approach," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 20-31, March.
    3. Li Cai, 2010. "A Two-Tier Full-Information Item Factor Analysis Model with Applications," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 581-612, December.
    4. David Thissen & Lynne Steinberg, 1986. "A taxonomy of item response models," Psychometrika, Springer;The Psychometric Society, vol. 51(4), pages 567-577, December.
    5. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    6. Guy Moors, 2003. "Diagnosing Response Style Behavior by Means of a Latent-Class Factor Approach. Socio-Demographic Correlates of Gender Role Attitudes and Perceptions of Ethnic Discrimination Reexamined," Quality & Quantity: International Journal of Methodology, Springer, vol. 37(3), pages 277-302, August.
    7. De Boeck, Paul & Partchev, Ivailo, 2012. "IRTrees: Tree-Based Item Response Models of the GLMM Family," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(c01).
    8. Youngsuk Suh & Daniel Bolt, 2010. "Nested Logit Models for Multiple-Choice Item Response Data," Psychometrika, Springer;The Psychometric Society, vol. 75(3), pages 454-473, September.
    9. Timothy R. Johnson & Daniel M. Bolt, 2010. "On the Use of Factor-Analytic Multinomial Logit Item Response Models to Account for Individual Differences in Response Style," Journal of Educational and Behavioral Statistics, , vol. 35(1), pages 92-114, February.
    10. Timothy Johnson, 2007. "Discrete Choice Models for Ordinal Response Variables: A Generalization of the Stereotype Model," Psychometrika, Springer;The Psychometric Society, vol. 72(4), pages 489-504, December.
    11. R. Darrell Bock, 1972. "Estimating item parameters and latent ability when responses are scored in two or more nominal categories," Psychometrika, Springer;The Psychometric Society, vol. 37(1), pages 29-51, March.
    12. B. Weijters & M. Geuens & N. Schillewaert, 2008. "The Stability of Individual Response Styles," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 08/547, Ghent University, Faculty of Economics and Business Administration.
    13. van Herk, H. & Poortinga, Y.H. & Verhallen, T.M.M., 2004. "Response styles in rating scales : Evidence of method bias in data from 6 EU countries," Other publications TiSEM c8befc7a-f2f4-44cf-b2fc-b, Tilburg University, School of Economics and Management.
    14. Timothy Johnson, 2003. "On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response style," Psychometrika, Springer;The Psychometric Society, vol. 68(4), pages 563-583, December.
    15. Daniel Bolt & James Wollack & Youngsuk Suh, 2012. "Application of a Multidimensional Nested Logit Model to Multiple-Choice Test Items," Psychometrika, Springer;The Psychometric Society, vol. 77(2), pages 339-357, April.
    16. Peter Lenk & Michel Wedel & Ulf Böckenholt, 2006. "Bayesian Estimation of Circumplex Models Subject to Prior Theory Constraints and Scale-Usage Bias," Psychometrika, Springer;The Psychometric Society, vol. 71(1), pages 33-55, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerhard Tutz & Moritz Berger, 2016. "Response Styles in Rating Scales," Journal of Educational and Behavioral Statistics, , vol. 41(3), pages 239-268, June.
    2. Timothy R. Johnson & Daniel M. Bolt, 2010. "On the Use of Factor-Analytic Multinomial Logit Item Response Models to Account for Individual Differences in Response Style," Journal of Educational and Behavioral Statistics, , vol. 35(1), pages 92-114, February.
    3. Singh, Jagdip, 2004. "Tackling measurement problems with Item Response Theory: Principles, characteristics, and assessment, with an illustrative example," Journal of Business Research, Elsevier, vol. 57(2), pages 184-208, February.
    4. Javier Revuelta, 2010. "Estimating Difficulty from Polytomous Categorical Data," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 331-350, June.
    5. Ulf Böckenholt, 2012. "The Cognitive-Miser Response Model: Testing for Intuitive and Deliberate Reasoning," Psychometrika, Springer;The Psychometric Society, vol. 77(2), pages 388-399, April.
    6. Albert Maydeu-Olivares & Harry Joe, 2006. "Limited Information Goodness-of-fit Testing in Multidimensional Contingency Tables," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 713-732, December.
    7. Yang Liu & Jan Hannig, 2017. "Generalized Fiducial Inference for Logistic Graded Response Models," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1097-1125, December.
    8. Yoshio Takane & Jan Leeuw, 1987. "On the relationship between item response theory and factor analysis of discretized variables," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 393-408, September.
    9. Yingbin Zhang & Zhaoxi Yang & Yehui Wang, 2022. "The Impact of Extreme Response Style on the Mean Comparison of Two Independent Samples," SAGE Open, , vol. 12(2), pages 21582440221, June.
    10. Daniel Bolt & James Wollack & Youngsuk Suh, 2012. "Application of a Multidimensional Nested Logit Model to Multiple-Choice Test Items," Psychometrika, Springer;The Psychometric Society, vol. 77(2), pages 339-357, April.
    11. Dylan Molenaar, 2015. "Heteroscedastic Latent Trait Models for Dichotomous Data," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 625-644, September.
    12. Yang Liu & Weimeng Wang, 2022. "Semiparametric Factor Analysis for Item-Level Response Time Data," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 666-692, June.
    13. Chalmers, R. Philip, 2016. "Generating Adaptive and Non-Adaptive Test Interfaces for Multidimensional Item Response Theory Applications," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 71(i05).
    14. Andersson, Björn & Jin, Shaobo & Zhang, Maoxin, 2023. "Fast estimation of multiple group generalized linear latent variable models for categorical observed variables," Computational Statistics & Data Analysis, Elsevier, vol. 182(C).
    15. Javier Revuelta, 2009. "Identifiability and Equivalence of GLLIRM Models," Psychometrika, Springer;The Psychometric Society, vol. 74(2), pages 257-272, June.
    16. Cees Glas, 1999. "Modification indices for the 2-PL and the nominal response model," Psychometrika, Springer;The Psychometric Society, vol. 64(3), pages 273-294, September.
    17. Alberto Maydeu-Olivares & Rosa Montaño, 2013. "How Should We Assess the Fit of Rasch-Type Models? Approximating the Power of Goodness-of-Fit Statistics in Categorical Data Analysis," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 116-133, January.
    18. Michelle M. LaMar, 2018. "Markov Decision Process Measurement Model," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 67-88, March.
    19. Bas Hemker & Klaas Sijtsma & Ivo Molenaar & Brian Junker, 1996. "Polytomous IRT models and monotone likelihood ratio of the total score," Psychometrika, Springer;The Psychometric Society, vol. 61(4), pages 679-693, December.
    20. Björn Andersson & Tao Xin, 2021. "Estimation of Latent Regression Item Response Theory Models Using a Second-Order Laplace Approximation," Journal of Educational and Behavioral Statistics, , vol. 46(2), pages 244-265, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:38:y:2013:i:5:p:522-547. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.