IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v89y2024i3d10.1007_s11336-024-09979-0.html
   My bibliography  Save this article

Temporally Dynamic, Cohort-Varying Value-Added Models

Author

Listed:
  • Garritt L. Page

    (Brigham Young University)

  • Ernesto San Martín

    (MILLENNIUM NUCLEUS ON INTERGENERATIONAL MOBILITY MOVI
    LIDAM/CORE, Université catholique de Louvain
    Pontificia Universidad Católica de Chile)

  • David Torres Irribarra

    (School of Psychology, Pontificia Universidad Católica de Chile)

  • Sébastien Van Bellegem

    (LIDAM/CORE, Université catholique de Louvain)

Abstract

We aim to estimate school value-added dynamically in time. Our principal motivation for doing so is to establish school effectiveness persistence while taking into account the temporal dependence that typically exists in school performance from one year to the next. We propose two methods of incorporating temporal dependence in value-added models. In the first we model the random school effects that are commonly present in value-added models with an auto-regressive process. In the second approach, we incorporate dependence in value-added estimators by modeling the performance of one cohort based on the previous cohort’s performance. An identification analysis allows us to make explicit the meaning of the corresponding value-added indicators: based on these meanings, we show that each model is useful for monitoring specific aspects of school persistence. Furthermore, we carefully detail how value-added can be estimated over time. We show through simulations that ignoring temporal dependence when it exists results in diminished efficiency in value-added estimation while incorporating it results in improved estimation (even when temporal dependence is weak). Finally, we illustrate the methodology by considering two cohorts from Chile’s national standardized test in mathematics.

Suggested Citation

  • Garritt L. Page & Ernesto San Martín & David Torres Irribarra & Sébastien Van Bellegem, 2024. "Temporally Dynamic, Cohort-Varying Value-Added Models," Psychometrika, Springer;The Psychometric Society, vol. 89(3), pages 1074-1103, September.
    • Handle: RePEc:spr:psycho:v:89:y:2024:i:3:d:10.1007_s11336-024-09979-0
    DOI: 10.1007/s11336-024-09979-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-024-09979-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-024-09979-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. MANZI, Jorge & SAN MARTIN, Ernesto & VAN BELLEGEM, Sébastien, 2014. "School system evaluation by value added analysis under endogeneity," LIDAM Reprints CORE 2630, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    2. Florens,Jean-Pierre & Marimoutou,Velayoudom & Peguin-Feissolle,Anne, 2007. "Econometric Modeling and Inference," Cambridge Books, Cambridge University Press, number 9780521876407, April.
    3. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    4. Florens,Jean-Pierre & Marimoutou,Velayoudom & Peguin-Feissolle,Anne, 2007. "Econometric Modeling and Inference," Cambridge Books, Cambridge University Press, number 9780521700061, September.
    5. Sass, Tim R. & Hannaway, Jane & Xu, Zeyu & Figlio, David N. & Feng, Li, 2012. "Value added of teachers in high-poverty schools and lower poverty schools," Journal of Urban Economics, Elsevier, vol. 72(2), pages 104-122.
    6. Garritt L. Page & Ernesto San Martín & Javiera Orellana & Jorge González, 2017. "Exploring complete school effectiveness via quantile value added," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 315-340, January.
    7. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    8. San Martin, Ernesto & Jara, Alejandro & Rolin, Jean-Marie & Mouchart, Michel, 2011. "On the Bayesian nonparametric generalization of IRT-type models," LIDAM Reprints ISBA 2011012, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    9. Jorge Manzi & Ernesto San Martín & Sébastien Van Bellegem, 2014. "School System Evaluation by Value Added Analysis Under Endogeneity," Psychometrika, Springer;The Psychometric Society, vol. 79(1), pages 130-153, January.
    10. Abderrahim Oulhaj & Michel Mouchart, 2006. "The role of the exogenous randomness in the identification of conditional models," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(2), pages 253-271.
    11. Josh Kinsler, 2012. "Beyond Levels and Growth: Estimating Teacher Value-Added and its Persistence," Journal of Human Resources, University of Wisconsin Press, vol. 47(3), pages 722-753.
    12. Silvia Bianconcini & Silvia Cagnone, 2012. "A General Multivariate Latent Growth Model With Applications to Student Achievement," Journal of Educational and Behavioral Statistics, , vol. 37(2), pages 339-364, April.
    13. Ernesto San Martín & Jean-Marie Rolin & Luis Castro, 2013. "Identification of the 1PL Model with Guessing Parameter: Parametric and Semi-parametric Results," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 341-379, April.
    14. Ernesto Martín & Jorge González & Francis Tuerlinckx, 2015. "On the Unidentifiability of the Fixed-Effects 3PL Model," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 450-467, June.
    15. Donald Zimmerman, 1975. "Probability spaces, hilbert spaces, and the axioms of test theory," Psychometrika, Springer;The Psychometric Society, vol. 40(3), pages 395-412, September.
    16. Paul Clarke & Claire Crawford & Fiona Steele & Anna Vignoles, 2015. "Revisiting fixed- and random-effects models: some considerations for policy-relevant education research," Education Economics, Taylor & Francis Journals, vol. 23(3), pages 259-277, June.
    17. Derek C. Briggs & Jonathan P. Weeks, 2011. "The Persistence of School-Level Value-Added," Journal of Educational and Behavioral Statistics, , vol. 36(5), pages 616-637, October.
    18. Ernesto San Martín & Alejandro Jara & Jean-Marie Rolin & Michel Mouchart, 2011. "On the Bayesian Nonparametric Generalization of IRT-Type Models," Psychometrika, Springer;The Psychometric Society, vol. 76(3), pages 385-409, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Page, Garritt L. & San Martin, Ernesto & Torres Irribarra, David & Van Bellegem, Sébastien, 2024. "Temporally Dynamic, Cohort-Varying Value-Added Models," LIDAM Discussion Papers CORE 2024009, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    2. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    3. Wim J. Linden & Michelle D. Barrett, 2016. "Linking Item Response Model Parameters," Psychometrika, Springer;The Psychometric Society, vol. 81(3), pages 650-673, September.
    4. Eric Parsons & Cory Koedel & Li Tan, 2019. "Accounting for Student Disadvantage in Value-Added Models," Journal of Educational and Behavioral Statistics, , vol. 44(2), pages 144-179, April.
    5. Ernesto Martín & Jorge González & Francis Tuerlinckx, 2015. "On the Unidentifiability of the Fixed-Effects 3PL Model," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 450-467, June.
    6. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    7. Xiaohong Chen & Andres Santos, 2018. "Overidentification in Regular Models," Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.
    8. Sally Paganin & Christopher J. Paciorek & Claudia Wehrhahn & Abel Rodríguez & Sophia Rabe-Hesketh & Perry de Valpine, 2023. "Computational Strategies and Estimation Performance With Bayesian Semiparametric Item Response Theory Models," Journal of Educational and Behavioral Statistics, , vol. 48(2), pages 147-188, April.
    9. Paul Anand & Jere R. Behrman & Hai-Anh H. Dang & Sam Jones, 2018. "Inequality of opportunity in education: Accounting for the contributions of Sibs, schools and sorting across East Africa," Working Papers 480, ECINEQ, Society for the Study of Economic Inequality.
    10. Kevin C. Bastian & Gary T. Henry & Charles L. Thompson, 2013. "Incorporating Access to More Effective Teachers into Assessments of Educational Resource Equity," Education Finance and Policy, MIT Press, vol. 8(4), pages 560-580, October.
    11. Zheng, Lei & Qi, Xiang & Zhang, Chongjiu, 2023. "Can improvements in teacher quality reduce the cognitive gap between urban and rural students in China?," International Journal of Educational Development, Elsevier, vol. 100(C).
    12. Ingo E. Isphording & Ulf Zölitz, 2020. "The value of a peer," ECON - Working Papers 342, Department of Economics - University of Zurich.
    13. Ernesto San Martín & Jean-Marie Rolin & Luis Castro, 2013. "Identification of the 1PL Model with Guessing Parameter: Parametric and Semi-parametric Results," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 341-379, April.
    14. Lavy, Victor & Megalokonomou, Rigissa, 2024. "Alternative Measures of Teachers' Value Added and Impact on Short and Long-Term Outcomes: Evidence from Random Assignment," IZA Discussion Papers 17121, Institute of Labor Economics (IZA).
    15. Pauline Givord & Milena Suarez Castillo, 2021. "What Makes a Good High School? Measuring School Effects beyond the Average," Economie et Statistique / Economics and Statistics, Institut National de la Statistique et des Etudes Economiques (INSEE), issue 528-529, pages 29-45.
    16. Atangana Ondoa, Henri & Tomo, Christian Parfait, 2022. "Déterminants des ménages et accès au crédit dans les tontines au Cameroun [Determinants of households and access to credit in Cameroon]," MPRA Paper 113629, University Library of Munich, Germany, revised Jun 2022.
    17. Roberto V. Penaloza & Mark Berends, 2022. "The Mechanics of Treatment-effect Estimate Bias for Nonexperimental Data," Sociological Methods & Research, , vol. 51(1), pages 165-202, February.
    18. Richard K. Mansfield, 2015. "Teacher Quality and Student Inequality," Journal of Labor Economics, University of Chicago Press, vol. 33(3), pages 751-788.
    19. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    20. Dhushyanth Raju, 2017. "Public School Teacher Management in Sri Lanka," South Asia Economic Journal, Institute of Policy Studies of Sri Lanka, vol. 18(1), pages 39-63, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:89:y:2024:i:3:d:10.1007_s11336-024-09979-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.