IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v84y2019i4d10.1007_s11336-019-09680-7.html
   My bibliography  Save this article

Contextual Responses to Affirmative and/or Reversed-Worded Items

Author

Listed:
  • Ulf Böckenholt

    (Northwestern University, Kellogg School of Management)

Abstract

This paper presents a systematic investigation of how affirmative and polar-opposite items presented either jointly or separately affect yea-saying tendencies. We measure these yea-saying tendencies with item response models that estimate a respondent’s tendency to give a “yea”-response that may be unrelated to the target trait. In a re-analysis of the Zhang et al. (PLoS ONE, 11:1–15, 2016) data, we find that yea-saying tendencies depend on whether items are presented as part of a scale that contains affirmative and/or polar-opposite items. Yea-saying tendencies are stronger for affirmative than for polar-opposite items. Moreover, presenting polar-opposite items together with affirmative items creates lower yea-saying tendencies for polar-opposite items than when presented in isolation. IRT models that do not account for these yea-saying effects arrive at a two-dimensional representation of the target trait. These findings demonstrate that the contextual information provided by an item scale can serve as a determinant of differential item functioning.

Suggested Citation

  • Ulf Böckenholt, 2019. "Contextual Responses to Affirmative and/or Reversed-Worded Items," Psychometrika, Springer;The Psychometric Society, vol. 84(4), pages 986-999, December.
  • Handle: RePEc:spr:psycho:v:84:y:2019:i:4:d:10.1007_s11336-019-09680-7
    DOI: 10.1007/s11336-019-09680-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-019-09680-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11336-019-09680-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    2. Xijuan Zhang & Ramsha Noor & Victoria Savalei, 2016. "Examining the Effect of Reverse Worded Items on the Factor Structure of the Need for Cognition Scale," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-15, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ying Cheng & Ke-Hai Yuan, 2010. "The Impact of Fallible Item Parameter Estimates on Latent Trait Recovery," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 280-291, June.
    2. Alexander Robitzsch, 2024. "Bias-Reduced Haebara and Stocking–Lord Linking," J, MDPI, vol. 7(3), pages 1-12, September.
    3. Joel A. Martínez-Regalado & Cinthia Leonora Murillo-Avalos & Purificación Vicente-Galindo & Mónica Jiménez-Hernández & José Luis Vicente-Villardón, 2021. "Using HJ-Biplot and External Logistic Biplot as Machine Learning Methods for Corporate Social Responsibility Practices for Sustainable Development," Mathematics, MDPI, vol. 9(20), pages 1-16, October.
    4. Vitoratou, Silia & Ntzoufras, Ioannis & Moustaki, Irini, 2016. "Explaining the behavior of joint and marginal Monte Carlo estimators in latent variable models with independence assumptions," LSE Research Online Documents on Economics 57685, London School of Economics and Political Science, LSE Library.
    5. Michela Battauz & Ruggero Bellio, 2011. "Structural Modeling of Measurement Error in Generalized Linear Models with Rasch Measures as Covariates," Psychometrika, Springer;The Psychometric Society, vol. 76(1), pages 40-56, January.
    6. Melissa Gladstone & Gillian Lancaster & Gareth McCray & Vanessa Cavallera & Claudia R. L. Alves & Limbika Maliwichi & Muneera A. Rasheed & Tarun Dua & Magdalena Janus & Patricia Kariger, 2021. "Validation of the Infant and Young Child Development (IYCD) Indicators in Three Countries: Brazil, Malawi and Pakistan," IJERPH, MDPI, vol. 18(11), pages 1-19, June.
    7. Björn Andersson & Tao Xin, 2021. "Estimation of Latent Regression Item Response Theory Models Using a Second-Order Laplace Approximation," Journal of Educational and Behavioral Statistics, , vol. 46(2), pages 244-265, April.
    8. Norman Cliff, 1989. "Ordinal consistency and ordinal true scores," Psychometrika, Springer;The Psychometric Society, vol. 54(1), pages 75-91, March.
    9. Tim Kaiser & Luis Oberrauch & Günther Seeber, 2020. "Measuring economic competence of secondary school students in Germany," The Journal of Economic Education, Taylor & Francis Journals, vol. 51(3-4), pages 227-242, August.
    10. Eijffinger, Sylvester & Mahieu, Ronald & Raes, Louis, 2018. "Inferring hawks and doves from voting records," European Journal of Political Economy, Elsevier, vol. 51(C), pages 107-120.
    11. C. Glas & Anna Dagohoy, 2007. "A Person Fit Test For Irt Models For Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 159-180, June.
    12. Michael Edwards, 2010. "A Markov Chain Monte Carlo Approach to Confirmatory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 75(3), pages 474-497, September.
    13. Yang Liu, 2020. "A Riemannian Optimization Algorithm for Joint Maximum Likelihood Estimation of High-Dimensional Exploratory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 439-468, June.
    14. Cees Glas, 1988. "The derivation of some tests for the rasch model from the multinomial distribution," Psychometrika, Springer;The Psychometric Society, vol. 53(4), pages 525-546, December.
    15. Begoña A. Farizo & John Joyce & Mario Soliño, 2014. "Dealing with Heterogeneous Preferences Using Multilevel Mixed Models," Land Economics, University of Wisconsin Press, vol. 90(1), pages 181-198.
    16. Christian A. Gregory, 2020. "Are We Underestimating Food Insecurity? Partial Identification with a Bayesian 4-Parameter IRT Model," Journal of Classification, Springer;The Classification Society, vol. 37(3), pages 632-655, October.
    17. Javier Revuelta, 2004. "Analysis of distractor difficulty in multiple-choice items," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 217-234, June.
    18. Gregory Camilli & Jean-Paul Fox, 2015. "An Aggregate IRT Procedure for Exploratory Factor Analysis," Journal of Educational and Behavioral Statistics, , vol. 40(4), pages 377-401, August.
    19. Haruhiko Ogasawara, 2003. "Asymptotic standard errors of irt observed-score equating methods," Psychometrika, Springer;The Psychometric Society, vol. 68(2), pages 193-211, June.
    20. Li Cai, 2010. "A Two-Tier Full-Information Item Factor Analysis Model with Applications," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 581-612, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:84:y:2019:i:4:d:10.1007_s11336-019-09680-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.