IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v49y2024i5p702-708.html
   My bibliography  Save this article

Harnessing AI for Educational Measurement: Standards and Emerging Frontiers

Author

Listed:
  • Hua-Hua Chang

Abstract

The surge of AI in education raises concerns about measurement downsides. Calls for clear standards are warranted. Fortunately, the psychometrics field has a long history of developing relevant standards—like sample invariance and item bias avoidance—crucial for reliable, valid, and interpretable assessments. This established body of knowledge, not unlike traffic laws for self-driving cars, should guide AI assessment development. Measuring new constructs necessitates stronger construct validity research. Instead of rewriting the rulebook, our focus should be on educating AI developers about these standards. This commentary specifically addresses the concern of empowering instructors not with high-stakes testing but with effective item writing through AI. We explore the potential of AI to transform item development, a key area highlighted by researchers. While AI tools offer exciting possibilities for tackling educational challenges, equipping instructors to leverage them effectively remains paramount.

Suggested Citation

  • Hua-Hua Chang, 2024. "Harnessing AI for Educational Measurement: Standards and Emerging Frontiers," Journal of Educational and Behavioral Statistics, , vol. 49(5), pages 702-708, October.
    • Handle: RePEc:sae:jedbes:v:49:y:2024:i:5:p:702-708
    DOI: 10.3102/10769986241264033
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986241264033
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986241264033?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hua-Hua Chang, 2015. "Psychometrics Behind Computerized Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 1-20, March.
    2. Hong-Yun Liu & Xiao-Feng You & Wen-Yi Wang & Shu-Liang Ding & Hua-Hua Chang, 2013. "The Development of Computerized Adaptive Testing with Cognitive Diagnosis for an English Achievement Test in China," Journal of Classification, Springer;The Classification Society, vol. 30(2), pages 152-172, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Steven Andrew Culpepper, 2024. "Introduction to the JEBS Special Section on Artificial Intelligence in Educational Statistics," Journal of Educational and Behavioral Statistics, , vol. 49(5), pages 691-693, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yan Li & Chao Huang & Jia Liu, 2023. "Diagnosing Primary Students’ Reading Progression: Is Cognitive Diagnostic Computerized Adaptive Testing the Way Forward?," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 842-865, December.
    2. Edison M. Choe & Jinming Zhang & Hua-Hua Chang, 2018. "Sequential Detection of Compromised Items Using Response Times in Computerized Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 650-673, September.
    3. Qingrong Tan & Yan Cai & Fen Luo & Dongbo Tu, 2023. "Development of a High-Accuracy and Effective Online Calibration Method in CD-CAT Based on Gini Index," Journal of Educational and Behavioral Statistics, , vol. 48(1), pages 103-141, February.
    4. Hung-Yu Huang, 2018. "Effects of Item Calibration Errors on Computerized Adaptive Testing under Cognitive Diagnosis Models," Journal of Classification, Springer;The Classification Society, vol. 35(3), pages 437-465, October.
    5. Xuliang Gao & Daxun Wang & Yan Cai & Dongbo Tu, 2020. "Cognitive Diagnostic Computerized Adaptive Testing for Polytomously Scored Items," Journal of Classification, Springer;The Classification Society, vol. 37(3), pages 709-729, October.
    6. Xiao Li & Hanchen Xu & Jinming Zhang & Hua-hua Chang, 2023. "Deep Reinforcement Learning for Adaptive Learning Systems," Journal of Educational and Behavioral Statistics, , vol. 48(2), pages 220-243, April.
    7. Wenyi Wang & Lihong Song & Teng Wang & Peng Gao & Jian Xiong, 2020. "A Note on the Relationship of the Shannon Entropy Procedure and the Jensen–Shannon Divergence in Cognitive Diagnostic Computerized Adaptive Testing," SAGE Open, , vol. 10(1), pages 21582440198, January.
    8. Hua-Hua Chang, 2015. "Psychometrics Behind Computerized Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 1-20, March.
    9. Edison M. Choe & Hua-Hua Chang, 2019. "The Asymptotic Distribution of Average Test Overlap Rate in Computerized Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 84(4), pages 1129-1151, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:49:y:2024:i:5:p:702-708. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.