IDEAS home Printed from https://ideas.repec.org/p/sza/wpaper/wpapers364.html
   My bibliography  Save this paper

Negative Item Response Bias in Education-Based Surveys - a Factor Modelling Approach

Author

Listed:
  • Alexander O’riordan

    (Stellenbosch University Economics Department & RESEP)

Abstract

In applied survey-based research, it is common to encounter responses based on both positively and negatively worded questions. In practice, responses are typically recoded to ensure that the numerical values attached to the responses of positively and negatively worded questions are aligned. This is done under the assumption that the responses to negatively worded questions are perfectly reversed reflections of responses to identical or similar positively worded questions - that the variation is inversed. This paper tests this assumption within a framework of factor modelling using South African Grade 4 TIMSS data. It finds significant differences in the degree to which the different question orientations capture information about single latent constructs that a specific group of questions is designed to capture. And thus, a failure of the assumption.

Suggested Citation

  • Alexander O’riordan, 2021. "Negative Item Response Bias in Education-Based Surveys - a Factor Modelling Approach," Working Papers 04/2021, Stellenbosch University, Department of Economics.
    • Handle: RePEc:sza:wpaper:wpapers364
    as

    Download full text from publisher

    File URL: https://www.ekon.sun.ac.za/wpapers/2021/wp042021/wp042021.pdf
    File Function: First version, 2021
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lee Cronbach, 1951. "Coefficient alpha and the internal structure of tests," Psychometrika, Springer;The Psychometric Society, vol. 16(3), pages 297-334, September.
    2. Henry Kaiser, 1974. "An index of factorial simplicity," Psychometrika, Springer;The Psychometric Society, vol. 39(1), pages 31-36, March.
    3. Wong, Nancy & Rindfleisch, Aric & Burroughs, James E, 2003. "Do Reverse-Worded Items Confound Measures in Cross-Cultural Consumer Research? The Case of the Material Values Scale," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(1), pages 72-91, June.
    4. Louis Guttman, 1945. "A basis for analyzing test-retest reliability," Psychometrika, Springer;The Psychometric Society, vol. 10(4), pages 255-282, December.
    5. Nicholas Spaull, 2012. "Poverty & Privilege: Primary School Inequality in South Africa," Working Papers 13/2012, Stellenbosch University, Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marianela Denegri & María Baeza & Natalia Salinas-Oñate & Verónica Peñaloza & Horacio Miranda & Ligia Orellana, 2014. "Materialism in Pedagogy Students in Chile," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(2), pages 505-521, June.
    2. Klaas Sijtsma, 2012. "Future of Psychometrics: Ask What Psychometrics Can Do for Psychology," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 4-20, January.
    3. Jayaram, Jayanth & Tan, Keah-Choon, 2010. "Supply chain integration with third-party logistics providers," International Journal of Production Economics, Elsevier, vol. 125(2), pages 262-271, June.
    4. Eunice Kabahinda & Rogers Mwesigwa, 2023. "Trust Mediates the Relationship Between Stakeholder Behavior and Stakeholder Management of Public Private Partnership Projects in Uganda," Public Organization Review, Springer, vol. 23(1), pages 245-263, March.
    5. Dyego Carlos Souza Anacleto de Araújo & Sylmara Nayara Pereira & Willian Melo dos Santos & Pedro Wlisses dos Santos Menezes & Kérilin Stancine dos Santos Rocha & Sabrina Cerqueira-Santos & André Faro , 2021. "Brazilian version of the Personal Report of Communication Apprehension: Cross-cultural adaptation and psychometric evaluation among healthcare students," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-13, February.
    6. Jaime Martín-Martín & Bella Pajares-Hachero & Emilio Alba-Conejo & Nuria Ribelles & Antonio I. Cuesta-Vargas & Cristina Roldán-Jiménez, 2023. "Validation of the Upper Limb Functional Index on Breast Cancer Survivor," IJERPH, MDPI, vol. 20(6), pages 1-10, March.
    7. Kanishka Gupta & Abdul Wajid & Dolly Gaur, 2024. "Determinants of continuous intention to use FinTech services: the moderating role of COVID-19," Journal of Financial Services Marketing, Palgrave Macmillan, vol. 29(2), pages 536-552, June.
    8. Hauck, Jana & Suess-Reyes, Julia & Beck, Susanne & Prügl, Reinhard & Frank, Hermann, 2016. "Measuring socioemotional wealth in family-owned and -managed firms: A validation and short form of the FIBER Scale," Journal of Family Business Strategy, Elsevier, vol. 7(3), pages 133-148.
    9. Hasnan Baber, 2020. "FinTech, Crowdfunding and Customer Retention in Islamic Banks," Vision, , vol. 24(3), pages 260-268, September.
    10. Fen Ren & Kexin Wang, 2022. "Modeling of the Chinese Dating App Use Motivation Scale According to Item Response Theory and Classical Test Theory," IJERPH, MDPI, vol. 19(21), pages 1-15, October.
    11. Jos Berge & Gregor Sočan, 2004. "The greatest lower bound to the reliability of a test and the hypothesis of unidimensionality," Psychometrika, Springer;The Psychometric Society, vol. 69(4), pages 613-625, December.
    12. Ernest Bielinis & Jianzhong Xu & Aneta Anna Omelan, 2020. "A Novel Anti-Environmental Forest Experience Scale to Predict Preferred Pleasantness Associated with Forest Environments," IJERPH, MDPI, vol. 17(18), pages 1-18, September.
    13. Nguyen Ba Chien & Nguyen Nghi Thanh, 2022. "The Impact of Good Governance on the People’s Satisfaction with Public Administrative Services in Vietnam," Administrative Sciences, MDPI, vol. 12(1), pages 1-12, February.
    14. Raveenajit Kaur A. P. & Kalvant Singh & Alberto Luis August, 2021. "Exploring the Factor Structure of the Constructs of Technological, Pedagogical, and Content Knowledge (TPACK): An Exploratory Factor Analysis Based on the Perceptions of TESOL Pre-Service Teachers at ," Research Journal of Education, Academic Research Publishing Group, vol. 7(2), pages 103-115, 06-2021.
    15. Ricardo Figueiredo Belchior & Roisin Lyons, 2021. "Explaining entrepreneurial intentions, nascent entrepreneurial behavior and new business creation with social cognitive career theory – a 5-year longitudinal analysis," International Entrepreneurship and Management Journal, Springer, vol. 17(4), pages 1945-1972, December.
    16. Cemil Kuzey, 2018. "Impact of Health Care Employees Job Satisfaction on Organizational Performance Support Vector Machine Approach," Journal of Economics and Financial Analysis, Tripal Publishing House, vol. 2(1), pages 45-68.
    17. Katharina Fellnhofer & Kaisu Puumalainen & Helena Sjögrén, 0. "Entrepreneurial orientation in work groups – effects of individuals and group characteristics," International Entrepreneurship and Management Journal, Springer, vol. 0, pages 1-37.
    18. Jesús Antonio López Cabrera & Francisco Gabriel Villarreal & Diego Cardoso López, 2023. "Una propuesta de medición de la inclusión financiera en México," Remef - Revista Mexicana de Economía y Finanzas Nueva Época REMEF (The Mexican Journal of Economics and Finance), Instituto Mexicano de Ejecutivos de Finanzas, IMEF, vol. 18(3), pages 1-41, Julio - S.
    19. Silvia Mariela Méndez-Prado & Vanessa Rodriguez & Kevin Peralta-Rizzo & Patricia Everaert & Martin Valcke, 2023. "An Assessment Tool to Identify the Financial Literacy Level of Financial Education Programs Participants’ Executed by Ecuadorian Financial Institutions," Sustainability, MDPI, vol. 15(2), pages 1-24, January.
    20. Walter Kristof, 1974. "Estimation of reliability and true score variance from a split of a test into three arbitrary parts," Psychometrika, Springer;The Psychometric Society, vol. 39(4), pages 491-499, December.

    More about this item

    Keywords

    Latent Construct Estimation; Negatively Item Response; Confirmatory Factor Analysis; Hierarchical Cluster Analysis;
    All these keywords.

    JEL classification:

    • A21 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Pre-college
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sza:wpaper:wpapers364. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Melt van Schoor (email available below). General contact details of provider: https://edirc.repec.org/data/desunza.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.