IDEAS home Printed from https://ideas.repec.org/a/eee/intell/v86y2021ics0160289621000131.html
   My bibliography  Save this article

The relation between science achievement and general cognitive abilities in large-scale assessments

Author

Listed:
  • Kampa, Nele
  • Scherer, Ronny
  • Saß, Steffani
  • Schipolowski, Stefan

Abstract

Although large-scale assessments (LSA) of school achievement claim to measure domain-specific achievement, they have been criticized for primarily measuring domain-general abilities. Numerous studies provide evidence that LSA of mathematical achievement as well as verbal achievement cover both general cognitive abilities (GCA) and domain-specific achievement dimensions. We extend previous research by analyzing a standards-oriented and literacy-oriented LSA in the domain of science to determine the relation of these two assessment types with domain-general abilities. While literacy-oriented assessments focus on the knowledge and skills students need to meet the demands of modern societies, standards-oriented assessments focus on national educational standards and curricula. A sample of 1722 students worked on three assessments: (a) the PISA scientific literacy assessment; (b) a standards-oriented assessment based on the German National Educational Standards in biology, chemistry, and physics developed by the Institute for Educational Quality Improvement (IQB); and (c) a GCA test. Comparisons of competing structural models showed that models differentiating between domain-specific achievement and GCA best represented the structure of the assessments. Furthermore, standards-oriented and literacy-oriented LSAs in science shared common variance with GCA but also comprised specific variance. In addition to a factor representing students' GCA, we identified a science literacy-oriented and two standards-oriented factors. Relations with school grades in various STEM and non-STEM subjects were mixed and only partly provided evidence for the specificity of science LSAs. Our findings are important for understanding and interpreting results of LSAs in the contexts of GCA and science. We discuss our outcomes with respect to educational monitoring practices.

Suggested Citation

  • Kampa, Nele & Scherer, Ronny & Saß, Steffani & Schipolowski, Stefan, 2021. "The relation between science achievement and general cognitive abilities in large-scale assessments," Intelligence, Elsevier, vol. 86(C).
    • Handle: RePEc:eee:intell:v:86:y:2021:i:c:s0160289621000131
    DOI: 10.1016/j.intell.2021.101529
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160289621000131
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.intell.2021.101529?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Saß, Steffani & Kampa, Nele & Köller, Olaf, 2017. "The interplay of g and mathematical abilities in large-scale assessments across grades," Intelligence, Elsevier, vol. 63(C), pages 33-44.
    2. Gignac, Gilles E. & Kretzschmar, André, 2017. "Evaluating dimensional distinctness with correlated-factor models: Limitations and suggestions," Intelligence, Elsevier, vol. 62(C), pages 138-147.
    3. Margaret Wu, 2010. "Comparing the Similarities and Differences of PISA 2003 and TIMSS," OECD Education Working Papers 32, OECD Publishing.
    4. Albert Satorra & Peter Bentler, 2010. "Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic," Psychometrika, Springer;The Psychometric Society, vol. 75(2), pages 243-248, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. César Merino-Soto & Gina Chávez-Ventura & Verónica López-Fernández & Guillermo M. Chans & Filiberto Toledano-Toledano, 2022. "Learning Self-Regulation Questionnaire (SRQ-L): Psychometric and Measurement Invariance Evidence in Peruvian Undergraduate Students," Sustainability, MDPI, vol. 14(18), pages 1-17, September.
    2. Sai-fu Fung & Esther Oi-wah Chow & Chau-kiu Cheung, 2020. "Development and Evaluation of the Psychometric Properties of a Brief Wisdom Development Scale," IJERPH, MDPI, vol. 17(8), pages 1-14, April.
    3. Anastasia Stathopoulou & Tommy Kweku Quansah & George Balabanis, 2022. "The Blinding Effects of Team Identification on Sports Corruption: Cross-Cultural Evidence from Sub-Saharan African Countries," Journal of Business Ethics, Springer, vol. 179(2), pages 511-529, August.
    4. Lars Petersen & Jacob Hörisch & Kathleen Jacobs, 2021. "Worse is worse and better doesn't matter?: The effects of favorable and unfavorable environmental information on consumers’ willingness to pay," Journal of Industrial Ecology, Yale University, vol. 25(5), pages 1338-1356, October.
    5. F Rodrigues & R Macedo & DS Teixeira & L Cid & D Monteiro, 2020. "Motivation in sport and exercise: a comparison between the BRSQ and BREQ," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(4), pages 1335-1350, August.
    6. Antonio J. Rodríguez-Hidalgo & Anabel Alcívar & Mauricio Herrera-López, 2019. "Traditional Bullying and Discriminatory Bullying Around Special Educational Needs: Psychometric Properties of Two Instruments to Measure It," IJERPH, MDPI, vol. 16(1), pages 1-15, January.
    7. Olenka Dworakowski & Zilla M. Huber & Tabea Meier & Ryan L. Boyd & Mike Martin & Andrea B. Horn, 2022. "You Do Not Have to Get through This Alone: Interpersonal Emotion Regulation and Psychosocial Resources during the COVID-19 Pandemic across Four Countries," IJERPH, MDPI, vol. 19(23), pages 1-20, November.
    8. Chen, Tingting & Li, Fuli & Chen, Xiao-Ping & Ou, Zhanying, 2018. "Innovate or die: How should knowledge-worker teams respond to technological turbulence?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 149(C), pages 1-16.
    9. Díaz, Estrella & Martín-Consuegra, David & Esteban, Águeda, 2015. "Perceptions of service cannibalisation: The moderating effect of the type of travel agency," Tourism Management, Elsevier, vol. 48(C), pages 329-342.
    10. Joana R. Casanova & Leandro S. Almeida & Francisco Peixoto & Rui-Bártolo Ribeiro & João Marôco, 2019. "Academic Expectations Questionnaire: A Proposal for a Short Version," SAGE Open, , vol. 9(1), pages 21582440188, January.
    11. Álvaro-Francisco Morote & María Hernández, 2022. "What Do School Children Know about Climate Change? A Social Sciences Approach," Social Sciences, MDPI, vol. 11(4), pages 1-17, April.
    12. Majid Ghasemy, 2022. "Estimating models with independent observed variables based on the PLSe2 methodology: a Monte Carlo simulation study," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4129-4159, December.
    13. A. Felipe & N. Martín & P. Miranda & L. Pardo, 2018. "Statistical inference in constrained latent class models for multinomial data based on $$\phi $$ ϕ -divergence measures," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 12(3), pages 605-636, September.
    14. Gibson, Samantha & Hsu, Maxwell K. & Zhou, Xing, 2022. "Convenience stores in the digital age: A focus on the customer experience and revisit intentions," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    15. Svenja B. Frenzel & Antonia J. Kaluza & Nina M. Junker & Rolf van Dick, 2022. "Sweet as Sugar—How Shared Social Identities Help Patients in Coping with Diabetes Mellitus," IJERPH, MDPI, vol. 19(17), pages 1-18, August.
    16. Stadler, Matthias & Niepel, Christoph & Greiff, Samuel, 2019. "Differentiating between static and complex problems: A theoretical framework and its empirical validation," Intelligence, Elsevier, vol. 72(C), pages 1-12.
    17. Ndijuye, Laurent Gabriel & Benguye, Nemes Danstan, 2023. "Home environment, early reading, and math: A longitudinal study on the mediating role of family SES in transition from pre-primary to grade one," International Journal of Educational Development, Elsevier, vol. 98(C).
    18. Blut, Markus, 2016. "E-Service Quality: Development of a Hierarchical Model," Journal of Retailing, Elsevier, vol. 92(4), pages 500-517.
    19. Yulia Tyumeneva & Alena Valdman & Martin Carnoy, 2014. "How well do you need to know it to use it?," HSE Working papers WP BRP 14/EDU/2014, National Research University Higher School of Economics.
    20. Altinay, Levent & Kinali Madanoglu, Gulsevim & Kromidha, Endrit & Nurmagambetova, Armiyash & Madanoglu, Melih, 2021. "Mental aspects of cultural intelligence and self-creativity of nascent entrepreneurs: The mediating role of emotionality," Journal of Business Research, Elsevier, vol. 131(C), pages 793-802.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intell:v:86:y:2021:i:c:s0160289621000131. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/intelligence .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.