IDEAS home Printed from https://ideas.repec.org/p/cor/louvco/2024009.html
   My bibliography  Save this paper

Temporally Dynamic, Cohort-Varying Value-Added Models

Author

Listed:
  • Page, Garritt L.
  • San Martin, Ernesto
  • Torres Irribarra, David
  • Van Bellegem, Sébastien

    (Université catholique de Louvain, LIDAM/CORE, Belgium)

Abstract

We aim to estimate school value-added dynamically in time. Our principal motivation for doing so is to establish school effectiveness persistence while taking into account the temporal dependence that typically exists in school performance from one year to the next. We propose two methods of incorporating temporal dependence in value-added models. In the first we model the random school effects that are commonly present in value-added models with an auto-regressive process. In the second approach, we incorporate dependence in value-added estimators by modeling the performance of one cohort based on the previous cohort’s perfor- mance. An identification analysis allows us to make explicit the meaning of the corresponding value-added indicators: based on these meanings, we show that each model is useful for monitoring specific aspects of school persistence. Furthermore, we carefully detail how value-added can be estimated over time. We show through simulations that ignoring temporal dependence when it exists results in diminished efficiency in value-added estimation while incorporating it results in improved estimation (even when temporal dependence is weak). Finally, we illustrate the methodology by considering two cohorts from Chile’s national standardized test in mathematics.

Suggested Citation

  • Page, Garritt L. & San Martin, Ernesto & Torres Irribarra, David & Van Bellegem, Sébastien, 2024. "Temporally Dynamic, Cohort-Varying Value-Added Models," LIDAM Discussion Papers CORE 2024009, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    • Handle: RePEc:cor:louvco:2024009
    as

    Download full text from publisher

    File URL: https://dial.uclouvain.be/pr/boreal/en/object/boreal%3A287809/datastream/PDF_01/view
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Florens, J.-P. & Mouchart, M. & Rolin, J.-M., 1985. "On two definitions of identification," LIDAM Reprints CORE 638, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    2. Abderrahim Oulhaj & Michel Mouchart, 2006. "The role of the exogenous randomness in the identification of conditional models," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(2), pages 253-271.
    3. Silvia Bianconcini & Silvia Cagnone, 2012. "A General Multivariate Latent Growth Model With Applications to Student Achievement," Journal of Educational and Behavioral Statistics, , vol. 37(2), pages 339-364, April.
    4. Ernesto Martín & Jorge González & Francis Tuerlinckx, 2015. "On the Unidentifiability of the Fixed-Effects 3PL Model," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 450-467, June.
    5. Derek C. Briggs & Jonathan P. Weeks, 2011. "The Persistence of School-Level Value-Added," Journal of Educational and Behavioral Statistics, , vol. 36(5), pages 616-637, October.
    6. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    7. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    8. MANZI, Jorge & SAN MARTIN, Ernesto & VAN BELLEGEM, Sébastien, 2014. "School system evaluation by value added analysis under endogeneity," LIDAM Reprints CORE 2630, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    9. Sass, Tim R. & Hannaway, Jane & Xu, Zeyu & Figlio, David N. & Feng, Li, 2012. "Value added of teachers in high-poverty schools and lower poverty schools," Journal of Urban Economics, Elsevier, vol. 72(2), pages 104-122.
    10. Garritt L. Page & Ernesto San Martín & Javiera Orellana & Jorge González, 2017. "Exploring complete school effectiveness via quantile value added," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 315-340, January.
    11. San Martin, Ernesto & Jara, Alejandro & Rolin, Jean-Marie & Mouchart, Michel, 2011. "On the Bayesian nonparametric generalization of IRT-type models," LIDAM Reprints ISBA 2011012, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    12. Jorge Manzi & Ernesto San Martín & Sébastien Van Bellegem, 2014. "School System Evaluation by Value Added Analysis Under Endogeneity," Psychometrika, Springer;The Psychometric Society, vol. 79(1), pages 130-153, January.
    13. Ernesto San Martín & Jean-Marie Rolin & Luis Castro, 2013. "Identification of the 1PL Model with Guessing Parameter: Parametric and Semi-parametric Results," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 341-379, April.
    14. Donald Zimmerman, 1975. "Probability spaces, hilbert spaces, and the axioms of test theory," Psychometrika, Springer;The Psychometric Society, vol. 40(3), pages 395-412, September.
    15. Paul Clarke & Claire Crawford & Fiona Steele & Anna Vignoles, 2015. "Revisiting fixed- and random-effects models: some considerations for policy-relevant education research," Education Economics, Taylor & Francis Journals, vol. 23(3), pages 259-277, June.
    16. Ernesto San Martín & Alejandro Jara & Jean-Marie Rolin & Michel Mouchart, 2011. "On the Bayesian Nonparametric Generalization of IRT-Type Models," Psychometrika, Springer;The Psychometric Society, vol. 76(3), pages 385-409, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Garritt L. Page & Ernesto San Martín & David Torres Irribarra & Sébastien Van Bellegem, 2024. "Temporally Dynamic, Cohort-Varying Value-Added Models," Psychometrika, Springer;The Psychometric Society, vol. 89(3), pages 1074-1103, September.
    2. Ernesto San Martín & Jean-Marie Rolin & Luis Castro, 2013. "Identification of the 1PL Model with Guessing Parameter: Parametric and Semi-parametric Results," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 341-379, April.
    3. Wim J. Linden & Michelle D. Barrett, 2016. "Linking Item Response Model Parameters," Psychometrika, Springer;The Psychometric Society, vol. 81(3), pages 650-673, September.
    4. Ernesto Martín & Jorge González & Francis Tuerlinckx, 2015. "On the Unidentifiability of the Fixed-Effects 3PL Model," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 450-467, June.
    5. Paul Anand & Jere R. Behrman & Hai-Anh H. Dang & Sam Jones, 2018. "Inequality of opportunity in education: Accounting for the contributions of Sibs, schools and sorting across East Africa," Working Papers 480, ECINEQ, Society for the Study of Economic Inequality.
    6. Jean-Pierre Florens & Anna Simoni, 2021. "Revisiting Identification Concepts in Bayesian Analysis," Annals of Economics and Statistics, GENES, issue 144, pages 1-38.
    7. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    8. Paul Anand & Jere R. Behrman & Hai-Anh H. Dang & Sam Jones, 2019. "Does sorting matter for learning inequality?Evidence from East Africa," PIER Working Paper Archive 20-006, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    9. Paula Fariña & Jorge González & Ernesto San Martín, 2019. "The Use of an Identifiability-Based Strategy for the Interpretation of Parameters in the 1PL-G and Rasch Models," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 511-528, June.
    10. Eric Parsons & Cory Koedel & Li Tan, 2019. "Accounting for Student Disadvantage in Value-Added Models," Journal of Educational and Behavioral Statistics, , vol. 44(2), pages 144-179, April.
    11. Sally Paganin & Christopher J. Paciorek & Claudia Wehrhahn & Abel Rodríguez & Sophia Rabe-Hesketh & Perry de Valpine, 2023. "Computational Strategies and Estimation Performance With Bayesian Semiparametric Item Response Theory Models," Journal of Educational and Behavioral Statistics, , vol. 48(2), pages 147-188, April.
    12. Justin L. Kern & Steven Andrew Culpepper, 2020. "A Restricted Four-Parameter IRT Model: The Dyad Four-Parameter Normal Ogive (Dyad-4PNO) Model," Psychometrika, Springer;The Psychometric Society, vol. 85(3), pages 575-599, September.
    13. Paul Anand & Jere R Behrman & Hai-Anh H Dang & Sam Jones, 2022. "Decomposing Learning Inequalities in East Africa: How Much Does Sorting Matter?," The World Bank Economic Review, World Bank, vol. 36(1), pages 219-243.
    14. Xin-Yuan Song & Zhao-Hua Lu & Jing-Heng Cai & Edward Ip, 2013. "A Bayesian Modeling Approach for Generalized Semiparametric Structural Equation Models," Psychometrika, Springer;The Psychometric Society, vol. 78(4), pages 624-647, October.
    15. Garritt L. Page & Ernesto San Martín & Javiera Orellana & Jorge González, 2017. "Exploring complete school effectiveness via quantile value added," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 315-340, January.
    16. Lea Cassar & Mira Fischer & Vanessa Valero, 2022. "Keep Calm and Carry On: Immediate-vs. Six-Month Effects of Mindfulness Training on Academic Performance," CESifo Working Paper Series 10099, CESifo.
    17. Miranda-Agrippino, Silvia & Ricco, Giovanni, 2018. "Bayesian Vector Autoregressions," The Warwick Economics Research Paper Series (TWERPS) 1159, University of Warwick, Department of Economics.
    18. Ayse Guveli & Lucinda Platt, 2023. "Religiosity of Migrants and Natives in Western Europe 2002–2018: Convergence and Divergence," European Journal of Population, Springer;European Association for Population Studies, vol. 39(1), pages 1-27, December.
    19. Matthew A. Kraft & John P. Papay & Olivia L. Chi, 2020. "Teacher Skill Development: Evidence from Performance Ratings by Principals," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 315-347, March.
    20. Kasper Brandt, 2018. "Private beats public: A flexible value-added model with Tanzanian school switchers," WIDER Working Paper Series 81, World Institute for Development Economic Research (UNU-WIDER).

    More about this item

    Keywords

    School value persistence ; value-added models ; temporal dependence;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cor:louvco:2024009. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alain GILLIS (email available below). General contact details of provider: https://edirc.repec.org/data/coreebe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.