IDEAS home Printed from https://ideas.repec.org/a/gam/jscscx/v9y2020i4p38-d340182.html
   My bibliography  Save this article

Investigating Some Construct Validity Threats to TALIS 2018 Teacher Job Satisfaction Scale: Implications for Social Science Researchers and Practitioners

Author

Listed:
  • Yusuf F. Zakariya

    (Department of Mathematical Science, University of Agder, 4630 Kristiansand, Norway)

Abstract

The credibility of findings ensuing from cross-sectional survey research depends largely on the validity and reliability of the research instruments. Critical attention to the quality of such instruments will ensure logical and valid results. The purpose of this article is to provide evidence for two methodological issues observed that are potential threats to construct validity of widely used Teaching and Learning International Survey (TALIS) 2018 data on teacher job satisfaction scale (TJSS). The first issue concerns reverse recoding of some items necessary to obtain a coherence covariance between these items and other items on the same subscale. The second issue concerns the addition of item cross-loading necessary to improve the fit of the TJSS. Both conceptual and empirical arguments are provided in the current article to substantiate these observations. A series of structural equation modeling tests are evaluated to assess the measurement model of the TJSS across 27 randomly selected countries/economies that participated in the survey. The results reveal gross misspecifications in the measurement model if these issues are not addressed. An alternative two-factor structure with an item cross-loading is proposed and evaluated for TJSS and found acceptable across the countries/economies. Some implications of findings for methodologists and practitioners are presented.

Suggested Citation

  • Yusuf F. Zakariya, 2020. "Investigating Some Construct Validity Threats to TALIS 2018 Teacher Job Satisfaction Scale: Implications for Social Science Researchers and Practitioners," Social Sciences, MDPI, vol. 9(4), pages 1-13, April.
  • Handle: RePEc:gam:jscscx:v:9:y:2020:i:4:p:38-:d:340182
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2076-0760/9/4/38/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2076-0760/9/4/38/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John Ainley & Ralph Carstens, 2018. "Teaching and Learning International Survey (TALIS) 2018 Conceptual Framework," OECD Education Working Papers 187, OECD Publishing.
    2. Albert Satorra & Peter Bentler, 2010. "Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 243-248, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    2. Anastasia Stathopoulou & Tommy Kweku Quansah & George Balabanis, 2022. "The Blinding Effects of Team Identification on Sports Corruption: Cross-Cultural Evidence from Sub-Saharan African Countries," Journal of Business Ethics, Springer, vol. 179(2), pages 511-529, August.
    3. Lars Petersen & Jacob Hörisch & Kathleen Jacobs, 2021. "Worse is worse and better doesn't matter?: The effects of favorable and unfavorable environmental information on consumers’ willingness to pay," Journal of Industrial Ecology, Yale University, vol. 25(5), pages 1338-1356, October.
    4. F Rodrigues & R Macedo & DS Teixeira & L Cid & D Monteiro, 2020. "Motivation in sport and exercise: a comparison between the BRSQ and BREQ," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(4), pages 1335-1350, August.
    5. Antonio J. Rodríguez-Hidalgo & Anabel Alcívar & Mauricio Herrera-López, 2019. "Traditional Bullying and Discriminatory Bullying Around Special Educational Needs: Psychometric Properties of Two Instruments to Measure It," IJERPH, MDPI, vol. 16(1), pages 1-15, January.
    6. Joo-Young Jung & Jeong-Gil Woo, 2022. "Structural Model Analysis of Factors Affecting Sustainable Teacher Job Satisfaction in Korea: Evidence from TALIS 2018," Sustainability, MDPI, vol. 14(13), pages 1-16, June.
    7. Ilaria Buonomo & Caterina Fiorilli & Luciano Romano & Paula Benevene, 2020. "The Roles of Work-Life Conflict and Gender in the Relationship between Workplace Bullying and Personal Burnout. A Study on Italian School Principals," IJERPH, MDPI, vol. 17(23), pages 1-17, November.
    8. Olenka Dworakowski & Zilla M. Huber & Tabea Meier & Ryan L. Boyd & Mike Martin & Andrea B. Horn, 2022. "You Do Not Have to Get through This Alone: Interpersonal Emotion Regulation and Psychosocial Resources during the COVID-19 Pandemic across Four Countries," IJERPH, MDPI, vol. 19(23), pages 1-20, November.
    9. Chen, Tingting & Li, Fuli & Chen, Xiao-Ping & Ou, Zhanying, 2018. "Innovate or die: How should knowledge-worker teams respond to technological turbulence?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 149(C), pages 1-16.
    10. Hui-Ling Wendy Pan & Chih-Hung Chung & Yi-Chun Lin, 2023. "Exploring the Predictors of Teacher Well-Being: An Analysis of Teacher Training Preparedness, Autonomy, and Workload," Sustainability, MDPI, vol. 15(7), pages 1-14, March.
    11. Díaz, Estrella & Martín-Consuegra, David & Esteban, Águeda, 2015. "Perceptions of service cannibalisation: The moderating effect of the type of travel agency," Tourism Management, Elsevier, vol. 48(C), pages 329-342.
    12. Joana R. Casanova & Leandro S. Almeida & Francisco Peixoto & Rui-Bártolo Ribeiro & João Marôco, 2019. "Academic Expectations Questionnaire: A Proposal for a Short Version," SAGE Open, , vol. 9(1), pages 21582440188, January.
    13. Álvaro-Francisco Morote & María Hernández, 2022. "What Do School Children Know about Climate Change? A Social Sciences Approach," Social Sciences, MDPI, vol. 11(4), pages 1-17, April.
    14. Majid Ghasemy, 2022. "Estimating models with independent observed variables based on the PLSe2 methodology: a Monte Carlo simulation study," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4129-4159, December.
    15. A. Felipe & N. Martín & P. Miranda & L. Pardo, 2018. "Statistical inference in constrained latent class models for multinomial data based on $$\phi $$ ϕ -divergence measures," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 12(3), pages 605-636, September.
    16. Gibson, Samantha & Hsu, Maxwell K. & Zhou, Xing, 2022. "Convenience stores in the digital age: A focus on the customer experience and revisit intentions," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    17. Svenja B. Frenzel & Antonia J. Kaluza & Nina M. Junker & Rolf van Dick, 2022. "Sweet as Sugar—How Shared Social Identities Help Patients in Coping with Diabetes Mellitus," IJERPH, MDPI, vol. 19(17), pages 1-18, August.
    18. Stadler, Matthias & Niepel, Christoph & Greiff, Samuel, 2019. "Differentiating between static and complex problems: A theoretical framework and its empirical validation," Intelligence, Elsevier, vol. 72(C), pages 1-12.
    19. Ndijuye, Laurent Gabriel & Benguye, Nemes Danstan, 2023. "Home environment, early reading, and math: A longitudinal study on the mediating role of family SES in transition from pre-primary to grade one," International Journal of Educational Development, Elsevier, vol. 98(C).
    20. Blut, Markus, 2016. "E-Service Quality: Development of a Hierarchical Model," Journal of Retailing, Elsevier, vol. 92(4), pages 500-517.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jscscx:v:9:y:2020:i:4:p:38-:d:340182. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.