IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v6y2016i3p2158244016659905.html
   My bibliography  Save this article

Three Tales of Change

Author

Listed:
  • Nikolaus Bezruczko
  • Serah S. Fatani
  • Noriko Magari

Abstract

When could it be safe to report ordinal scores instead of linear measures? In this study, preschool gains measured with ordinal scores were compared with residualized gain scores, as well as Rasch model measures of linear change (logits) to clarify respective implications for objectivity, precision, validity, and meaningfulness. Results showed that ordinal scores and linear gains were highly correlated (~.90), and specific conditions were identified such as pre-test score distributions, pre-test variability, and overall test targeting that determine complementarity of ordinal scores and linear scale values for reporting achievement gains. Several properties of ordinal score gains were discussed, including negative correlation between gain and pre-test, unreliability of gains, and usefulness of residualized gains. This report concludes by supporting interchangeability of ordinal scores and objective, linear measures when appraisal of complementarity is supervised by principles of mathematical logic.

Suggested Citation

  • Nikolaus Bezruczko & Serah S. Fatani & Noriko Magari, 2016. "Three Tales of Change," SAGE Open, , vol. 6(3), pages 21582440166, July.
    • Handle: RePEc:sae:sagope:v:6:y:2016:i:3:p:2158244016659905
    DOI: 10.1177/2158244016659905
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/2158244016659905
    Download Restriction: no
    File URL: https://libkey.io/10.1177/2158244016659905?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Rogosa & John Willett, 1985. "Understanding correlates of change by modeling individual differences in growth," Psychometrika, Springer;The Psychometric Society, vol. 50(2), pages 203-228, June.
    2. Susan Embretson (Whitely), 1984. "A general latent trait model for response processes," Psychometrika, Springer;The Psychometric Society, vol. 49(2), pages 175-186, June.
    3. Binder, Arnold, 1984. "Restrictions on statistics imposed by method of measurement: Some reality, much mythology," Journal of Criminal Justice, Elsevier, vol. 12(5), pages 467-481.
    4. Donald Zimmerman & Richard Williams, 1982. "The relative error magnitude in three measures of change," Psychometrika, Springer;The Psychometric Society, vol. 47(2), pages 141-147, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jason Barabas, 1998. "Wage Erosion, Economic Assessments, and Social Welfare Opinions," JCPR Working Papers 56, Northwestern University/University of Chicago Joint Center for Poverty Research.
    2. Acedo, Francisco J. & Coviello, Nicole & Agustí, María, 2021. "Caution ahead! The long-term effects of initial export intensity and geographic dispersion on INV development," Journal of World Business, Elsevier, vol. 56(6).
    3. Peter Congdon & John Shepherd, 1988. "Components of Social Change in Urban Areas," Urban Studies, Urban Studies Journal Limited, vol. 25(3), pages 173-189, June.
    4. Sora Lee & Daniel M. Bolt, 2018. "Asymmetric Item Characteristic Curves and Item Complexity: Insights from Simulation and Real Data Analyses," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 453-475, June.
    5. Kaestner, Robert & Grossman, Michael, 2009. "Effects of weight on children's educational achievement," Economics of Education Review, Elsevier, vol. 28(6), pages 651-661, December.
    6. Tenko Raykov, 2001. "On the Use and Utility of the Reliability Coefficient in Social and Behavioral Research," Quality & Quantity: International Journal of Methodology, Springer, vol. 35(3), pages 253-263, August.
    7. Hess, Brian, 2000. "Assessing program impact using latent growth modeling: a primer for the evaluator," Evaluation and Program Planning, Elsevier, vol. 23(4), pages 419-428, November.
    8. Ping Chen, 2017. "A Comparative Study of Online Item Calibration Methods in Multidimensional Computerized Adaptive Testing," Journal of Educational and Behavioral Statistics, , vol. 42(5), pages 559-590, October.
    9. Elizabeth Ayers & Sophia Rabe-Hesketh & Rebecca Nugent, 2013. "Incorporating Student Covariates in Cognitive Diagnosis Models," Journal of Classification, Springer;The Classification Society, vol. 30(2), pages 195-224, July.
    10. Michael J. Shanahan & Adam Davey & Jennifer Brooks, 1998. "Dynamic Models of Poverty and Psychosocial Adjustment through Childhood," JCPR Working Papers 49, Northwestern University/University of Chicago Joint Center for Poverty Research.
    11. Robert Kaestner & Hope Corman, 1995. "The Impact of Child Health and Family Inputs on Child Cognitive Develop-ment," NBER Working Papers 5257, National Bureau of Economic Research, Inc.
    12. Ping Chen & Tao Xin & Chun Wang & Hua-Hua Chang, 2012. "Online Calibration Methods for the DINA Model with Independent Attributes in CD-CAT," Psychometrika, Springer;The Psychometric Society, vol. 77(2), pages 201-222, April.
    13. Jianan Sun & Yunxiao Chen & Jingchen Liu & Zhiliang Ying & Tao Xin, 2016. "Latent Variable Selection for Multidimensional Item Response Theory Models via $$L_{1}$$ L 1 Regularization," Psychometrika, Springer;The Psychometric Society, vol. 81(4), pages 921-939, December.
    14. Edward Nissan, 1992. "Convergence Of Regional And State Rates Of Growth Of Income, Employment, And Population: 1969-2000," The Review of Regional Studies, Southern Regional Science Association, vol. 22(3), pages 261-276, Winter.
    15. Hiroshi Tamano & Daichi Mochihashi, 2023. "Dynamical Non-compensatory Multidimensional IRT Model Using Variational Approximation," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 487-526, June.
    16. Chun Wang, 2021. "Using Penalized EM Algorithm to Infer Learning Trajectories in Latent Transition CDM," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 167-189, March.
    17. Green, Rex S., 1999. "The application of statistical process control to manage global client outcomes in behavioral healthcare," Evaluation and Program Planning, Elsevier, vol. 22(2), pages 199-210, May.
    18. Anwer Khurshid & Hardeo Sahai, 1993. "Scales of measurements: An introduction and a selected bibliography," Quality & Quantity: International Journal of Methodology, Springer, vol. 27(3), pages 303-324, August.
    19. William Stout, 2002. "Psychometrics: From practice to theory and back," Psychometrika, Springer;The Psychometric Society, vol. 67(4), pages 485-518, December.
    20. René Butter & Paul Boeck & Norman Verhelst, 1998. "An item response model with internal restrictions on item difficulty," Psychometrika, Springer;The Psychometric Society, vol. 63(1), pages 47-63, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:6:y:2016:i:3:p:2158244016659905. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.