IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v32y2008i6p511-525.html
   My bibliography  Save this article

Assessing School Effectiveness

Author

Listed:
  • Stephen Klein
  • David Freedman
  • Richard Shavelson
  • Roger Bolus

Abstract

The Collegiate Learning Assessment (CLA) program measures value added in colleges and universities, by testing the ability of freshmen and seniors to think logically and write clearly. The program is popular enough that it has attracted critics. In this paper, we outline the methods used by the CLA to determine value added. We summarize the criticisms, which revolve around the question of which students take the CLA tests. Typically, samples are not random, so that selection bias is a concern, as is confounding. We respond by showing that criticisms of CLA procedures are not supported by the data.

Suggested Citation

  • Stephen Klein & David Freedman & Richard Shavelson & Roger Bolus, 2008. "Assessing School Effectiveness," Evaluation Review, , vol. 32(6), pages 511-525, December.
    • Handle: RePEc:sae:evarev:v:32:y:2008:i:6:p:511-525
    DOI: 10.1177/0193841X08325948
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X08325948
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X08325948?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ernest T. Pascarella & Ty Cruce & Paul D. Umbach & Gregory C. Wolniak & George D. Kuh & Robert M. Carini & John C. Hayek & Robert M. Gonyea & Chun-Mei Zhao, 2006. "Institutional Selectivity and Good Practices in Undergraduate Education: How Strong is the Link?," The Journal of Higher Education, Taylor & Francis Journals, vol. 77(2), pages 251-285, March.
    2. Freedman, David & Lane, David, 1983. "A Nonstochastic Interpretation of Reported Significance Levels," Journal of Business & Economic Statistics, American Statistical Association, vol. 1(4), pages 292-298, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gregg Thomson and John Aubrey Douglass, 2009. "Decoding Learning Gains: Measuring Outcomes and the Pivotal Role of the Major and Student Backgrounds," University of California at Berkeley, Center for Studies in Higher Education qt2173006c, Center for Studies in Higher Education, UC Berkeley.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stefano Bonnini & Michela Borghesi, 2022. "Relationship between Mental Health and Socio-Economic, Demographic and Environmental Factors in the COVID-19 Lockdown Period—A Multivariate Regression Analysis," Mathematics, MDPI, vol. 10(18), pages 1-15, September.
    2. Purevdorj Tuvaandorj, 2021. "Robust Permutation Tests in Linear Instrumental Variables Regression," Papers 2111.13774, arXiv.org, revised Jul 2024.
    3. Hu, Yuan & Behrman, Jere R. & Zhang, Junsen, 2021. "The causal effects of parents’ schooling on children's schooling in urban China," Journal of Comparative Economics, Elsevier, vol. 49(1), pages 258-276.
    4. Kherad-Pajouh, Sara & Renaud, Olivier, 2010. "An exact permutation method for testing any effect in balanced and unbalanced fixed effect ANOVA," Computational Statistics & Data Analysis, Elsevier, vol. 54(7), pages 1881-1893, July.
    5. Michael Daly & Liam Delaney & Orla Doyle & Nick Fitzpatrick & Christine O'Farrelly, 2014. "Can Early Intervention Policies Improve Well-being? Evidence from a randomized controlled trial," Working Papers 201415, School of Economics, University College Dublin.
    6. Gill,Indermit S., 1990. "Does the structure of production affect demand for schooling in Peru?," Policy Research Working Paper Series 468, The World Bank.
    7. Josipa Roksa & Teniell L. Trolian & Ernest T. Pascarella & Cindy A. Kilgo & Charles Blaich & Kathleen S. Wise, 2017. "Racial Inequality in Critical Thinking Skills: The Role of Academic and Diversity Experiences," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(2), pages 119-140, March.
    8. Pinto, Rodrigo, 2010. "Evaluation of Small-sample Compromised Randomization: Long-term Effects of Early Childhood Intervention on Health and Addictive Behavior," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 30(2), December.
    9. Sara Kherad-Pajouh & Olivier Renaud, 2015. "A general permutation approach for analyzing repeated measures ANOVA and mixed-model designs," Statistical Papers, Springer, vol. 56(4), pages 947-967, November.
    10. Pini, Alessia & Stamm, Aymeric & Vantini, Simone, 2018. "Hotelling’s T2 in separable Hilbert spaces," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 284-305.
    11. Mittelhammer, Ron C. & Judge, George G., 2005. "Combining estimators to improve structural model estimation and inference under quadratic loss," Journal of Econometrics, Elsevier, vol. 128(1), pages 1-29, September.
    12. Orla Doyle, 2024. "Can Early Intervention Have a Sustained Effect on Human Capital?," Journal of Human Resources, University of Wisconsin Press, vol. 59(5), pages 1599-1636.
    13. Nathaniel E. Helwig, 2022. "Robust Permutation Tests for Penalized Splines," Stats, MDPI, vol. 5(3), pages 1-18, September.
    14. Karel Hron & Jitka Machalová & Alessandra Menafoglio, 2023. "Bivariate densities in Bayes spaces: orthogonal decomposition and spline representation," Statistical Papers, Springer, vol. 64(5), pages 1629-1667, October.
    15. Soo Hong Chew & Junjian Yi & Junsen Zhang & Songfa Zhong, 2016. "Education and anomalies in decision making: Experimental evidence from Chinese adult twins," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 163-200, December.
    16. David Dekker & David Krackhardt & Tom Snijders, 2007. "Sensitivity of MRQAP Tests to Collinearity and Autocorrelation Conditions," Psychometrika, Springer;The Psychometric Society, vol. 72(4), pages 563-581, December.
    17. Veronika Římalová & Alessandra Menafoglio & Alessia Pini & Vilém Pechanec & Eva Fišerová, 2020. "A permutation approach to the analysis of spatiotemporal geochemical data in the presence of heteroscedasticity," Environmetrics, John Wiley & Sons, Ltd., vol. 31(4), June.
    18. Jiří Dvořák & Tomáš Mrkvička & Jorge Mateu & Jonatan A. González, 2022. "Nonparametric Testing of the Dependence Structure Among Points–Marks–Covariates in Spatial Point Patterns," International Statistical Review, International Statistical Institute, vol. 90(3), pages 592-621, December.
    19. Cindy A. Kilgo & K. C. Culver & Ryan L. Young & Michael B. Paulsen, 2017. "The Relationship Between Students’ Perceptions of “Good Practices for Undergraduate Education” and the Paradigmatic Development of Disciplines in Course-Taking Behavior," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(4), pages 430-448, June.
    20. Orla Doyle, 2017. "The First 2,000 Days and Child Skills: Evidence from a Randomized Experiment of Home Visiting," Working Papers 201715, School of Economics, University College Dublin.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:32:y:2008:i:6:p:511-525. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.