IDEAS home Printed from https://ideas.repec.org/a/aoj/jeelre/v11y2024i3p499-519id5861.html
   My bibliography  Save this article

Reliability and separation index analysis of mathematics questions integrated with the cultural architecture framework using the Rasch model

Author

Listed:
  • Muh Fitrah
  • Anastasia Sofroniou
  • Ofianto
  • Loso Judijanto
  • Widihastuti

Abstract

This research uses Rasch model analysis to identify the reliability and separation index of an integrated mathematics test instrument with a cultural architecture structure in measuring students' mathematical thinking abilities. The study involved 357 students from six eighth-grade public junior high schools in Bima. The selection of schools was based on average school exam scores and considered the effectiveness of the learning process that used cultural settings to explore mathematical content. Data analysis was conducted using Microsoft Excel to calculate the content validity of Aiken's index with four experts and the jMetrik software to measure reliability and the separation index. The research results indicate that the mathematics test instrument passed validation by mathematics experts and measurements with a valid content validity level. Rasch model calibration shows a very high level of instrument reliability. Separation analysis on the logit scale indicates the instrument's ability to differentiate students with different ability levels with good homogeneity in the distribution of test items and individual abilities. Scale quality statistics show good item response variability, low error rates and a high separation index. This study has limitations because it focuses solely on multiple-choice questions. Similar research must be conducted using other types of questions (such as those used in PISA, namely open- constructed and closed-constructed questions) and integrating other mathematical materials within relevant cultural architectural structures.

Suggested Citation

  • Muh Fitrah & Anastasia Sofroniou & Ofianto & Loso Judijanto & Widihastuti, 2024. "Reliability and separation index analysis of mathematics questions integrated with the cultural architecture framework using the Rasch model," Journal of Education and e-Learning Research, Asian Online Journal Publishing Group, vol. 11(3), pages 499-519.
  • Handle: RePEc:aoj:jeelre:v:11:y:2024:i:3:p:499-519:id:5861
    as

    Download full text from publisher

    File URL: http://www.asianonlinejournals.com/index.php/JEELR/article/view/5861/2852
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aoj:jeelre:v:11:y:2024:i:3:p:499-519:id:5861. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sara Lim (email available below). General contact details of provider: http://asianonlinejournals.com/index.php/JEELR/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.