IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v14y2024i1p21582440241230363.html
   My bibliography  Save this article

Does the Number of Response Categories Impact Validity Evidence in Self-Report Measures? A Scoping Review

Author

Listed:
  • Mohammed A. A. Abulela
  • Mustafa Ali Khalaf

Abstract

The optimal number of responses categories (NRC) is among the most discussed, yet least decided, topic in self-report measures. In addition, there is a dearth of scoping reviews that summarize its impact on validity evidence (e.g., evidence-based on internal structure). To that end, we conducted a scoping review of methodological literature to provide self-report measures developers and applied researchers with evidence-based recommendations when selecting the optimal NRC. Given the inconsistent results reported in previous research, a key recommendation, when conducting cognitive interviews, is to investigate the interpretation of response options by a sample of potential participants who have varying perspectives. This procedure is paramount to ascertain that response options are accurately interpreted and function as intended. The present scoping review is expected to become a valuable resource for applied researchers and practitioners to make informed decisions about the optimal NRC, taking into account validity evidence, and therefore contributes to the literature of educational and psychological measurement and research methods.

Suggested Citation

  • Mohammed A. A. Abulela & Mustafa Ali Khalaf, 2024. "Does the Number of Response Categories Impact Validity Evidence in Self-Report Measures? A Scoping Review," SAGE Open, , vol. 14(1), pages 21582440241, February.
    • Handle: RePEc:sae:sagope:v:14:y:2024:i:1:p:21582440241230363
    DOI: 10.1177/21582440241230363
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/21582440241230363
    Download Restriction: no
    File URL: https://libkey.io/10.1177/21582440241230363?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Natalja Menold & Christof Wolf & Kathrin Bogner, 2018. "Design aspects of rating scales in questionnaires," Mathematical Population Studies, Taylor & Francis Journals, vol. 25(2), pages 63-65, April.
    2. J. Ramsay, 1973. "The effect of number of categories in rating scales on precision of estimation of scale values," Psychometrika, Springer;The Psychometric Society, vol. 38(4), pages 513-532, December.
    3. Nowlis, Stephen M & Kahn, Barbara E & Dhar, Ravi, 2002. "Coping with Ambivalence: The Effect of Removing a Neutral Option on Consumer Attitude and Preference Judgments," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 29(3), pages 319-334, December.
    4. Natacha Borgers & Dirk Sikkel & Joop Hox, 2004. "Response Effects in Surveys on Children and Adolescents: The Effect of Number of Response Options, Negative Wording, and Neutral Mid-Point," Quality & Quantity: International Journal of Methodology, Springer, vol. 38(1), pages 17-33, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heleen van der Meulen & Rinaldo Kühne & Suzanna J. Opree, 2018. "Validating the Material Values Scale for Children (MVS-c) for Use in Early Childhood," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 11(4), pages 1201-1216, August.
    2. Sánchez, Gonzalo E. & Rhodes, Lauren A. & Espinoza, Nereyda E. & Borja, Viviana, 2022. "Assessing the Gap between Social and Individual Perceptions of Sexual Harassment," MPRA Paper 112711, University Library of Munich, Germany.
    3. Reich, Taly & Fulmer, Alexander G. & Dhar, Ravi, 2022. "In the face of self-threat: Why ambivalence heightens people’s willingness to act," Organizational Behavior and Human Decision Processes, Elsevier, vol. 168(C).
    4. Duane F. Alwin, 1997. "Feeling Thermometers Versus 7-Point Scales," Sociological Methods & Research, , vol. 25(3), pages 318-340, February.
    5. Carla Heloisa de Faria Domingues & João Augusto Rossi Borges & Clandio Favarini Ruviaro & Diego Gomes Freire Guidolin & Juliana Rosa Mauad Carrijo, 2020. "Understanding the factors influencing consumer willingness to accept the use of insects to feed poultry, cattle, pigs and fish in Brazil," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-11, April.
    6. Weijters, Bert & Cabooter, Elke & Schillewaert, Niels, 2010. "The effect of rating scale format on response styles: The number of response categories and response category labels," International Journal of Research in Marketing, Elsevier, vol. 27(3), pages 236-247.
    7. Anne Hamby & Cristel Russell, 2022. "How does ambivalence affect young consumers’ response to risky products?," Journal of the Academy of Marketing Science, Springer, vol. 50(4), pages 841-863, July.
    8. Mayur Taneja & Vikas Nath & Noopur Saxena, 2024. "Factors Influencing Behavioral Intention Toward Using Travel Mobile Application: Examining the Mediating Role of Reviews and Ratings," Jindal Journal of Business Research, , vol. 13(2), pages 162-180, December.
    9. J. Vera & Rodrigo Macías & Willem Heiser, 2009. "A Latent Class Multidimensional Scaling Model for Two-Way One-Mode Continuous Rating Dissimilarity Data," Psychometrika, Springer;The Psychometric Society, vol. 74(2), pages 297-315, June.
    10. Robert O'Brien & Pamela Homer, 1987. "Corrections for coarsely categorized measures: LISREL's polyserial and polychoric correlations," Quality & Quantity: International Journal of Methodology, Springer, vol. 21(4), pages 349-360, December.
    11. Audrezet, Alice & Parguel, Béatrice, 2018. "Using the Evaluative Space Grid to better capture manifest ambivalence in customer satisfaction surveys," Journal of Retailing and Consumer Services, Elsevier, vol. 43(C), pages 285-295.
    12. Kivilcim Dogerlioglu-Demir & Cenk Koçaş & Nilsah Cavdar Aksoy, 2023. "The role of presentation order in consumer choice: the abrupt disparity effect," Marketing Letters, Springer, vol. 34(2), pages 251-268, June.
    13. Robert Cummins, 1995. "On the trail of the gold standard for subjective well-being," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 35(2), pages 179-200, June.
    14. Dolnicar, Sara & Grün, Bettina, 2009. "Does one size fit all? The suitability of answer formats for different constructs measured," Australasian marketing journal, Elsevier, vol. 17(1), pages 58-64.
    15. DeWeaver, Mark A. & Shannon, Randall, 2010. "Waning vigilance and the disposition effect: Evidence from Thailand on individual investor decision making," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(1), pages 18-23, January.
    16. Dekel Omer & Schurr Amos, 2014. "Cognitive Biases in Government Procurement – An Experimental Study," Review of Law & Economics, De Gruyter, vol. 10(2), pages 169-200, July.
    17. Joan Batista-Foguet & Willem Saris, 1992. "A new measurement procedure for attitudinal research. Analysis of its psychometric and informational properties," Quality & Quantity: International Journal of Methodology, Springer, vol. 26(2), pages 127-146, May.
    18. Yang, Xue & Liu, Na & Teo, Hock Hai, 2017. "How do users cope with trial restrictions? A field experiment on free trial software," International Journal of Information Management, Elsevier, vol. 37(4), pages 339-349.
    19. Rasmus Riad & Mara Westling Allodi & Eva Siljehag & Carina Wikman & Tamsin Ford & Sven Bölte, 2021. "How I Feel About My School—Adaptation and Validation of an Educational Well-Being Measure among Young Children in Sweden," IJERPH, MDPI, vol. 18(10), pages 1-14, May.
    20. Toepoel, V. & Dillman, D.A., 2008. "Words, Numbers and Visual Heuristics in Web Surveys : Is there a Hierarchy of Importance?," Other publications TiSEM 21fbcc01-3c5d-4942-b41c-7, Tilburg University, School of Economics and Management.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:14:y:2024:i:1:p:21582440241230363. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.