IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v32y2008i6p511-525.html
   My bibliography  Save this article

Assessing School Effectiveness

Author

Listed:
  • Stephen Klein
  • David Freedman
  • Richard Shavelson
  • Roger Bolus

Abstract

The Collegiate Learning Assessment (CLA) program measures value added in colleges and universities, by testing the ability of freshmen and seniors to think logically and write clearly. The program is popular enough that it has attracted critics. In this paper, we outline the methods used by the CLA to determine value added. We summarize the criticisms, which revolve around the question of which students take the CLA tests. Typically, samples are not random, so that selection bias is a concern, as is confounding. We respond by showing that criticisms of CLA procedures are not supported by the data.

Suggested Citation

  • Stephen Klein & David Freedman & Richard Shavelson & Roger Bolus, 2008. "Assessing School Effectiveness," Evaluation Review, , vol. 32(6), pages 511-525, December.
    • Handle: RePEc:sae:evarev:v:32:y:2008:i:6:p:511-525
    DOI: 10.1177/0193841X08325948
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X08325948
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X08325948?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Freedman, David & Lane, David, 1983. "A Nonstochastic Interpretation of Reported Significance Levels," Journal of Business & Economic Statistics, American Statistical Association, vol. 1(4), pages 292-298, October.
    2. Ernest T. Pascarella & Ty Cruce & Paul D. Umbach & Gregory C. Wolniak & George D. Kuh & Robert M. Carini & John C. Hayek & Robert M. Gonyea & Chun-Mei Zhao, 2006. "Institutional Selectivity and Good Practices in Undergraduate Education: How Strong is the Link?," The Journal of Higher Education, Taylor & Francis Journals, vol. 77(2), pages 251-285, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gregg Thomson and John Aubrey Douglass, 2009. "Decoding Learning Gains: Measuring Outcomes and the Pivotal Role of the Major and Student Backgrounds," University of California at Berkeley, Center for Studies in Higher Education qt2173006c, Center for Studies in Higher Education, UC Berkeley.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Niels Lundtorp Olsen & Alessia Pini & Simone Vantini, 2021. "False discovery rate for functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(3), pages 784-809, September.
    2. Orla Doyle & Liam Delaney & Christine O'Farrelly & Nick Fitzpatrick & Michael Daly, 2015. "Can Early Intervention Improve Maternal Well-being? Evidence from a Randomized Controlled Trial," Working Papers 2015-015, Human Capital and Economic Opportunity Working Group.
    3. Stefano Bonnini & Michela Borghesi, 2022. "Relationship between Mental Health and Socio-Economic, Demographic and Environmental Factors in the COVID-19 Lockdown Period—A Multivariate Regression Analysis," Mathematics, MDPI, vol. 10(18), pages 1-15, September.
    4. repec:jss:jstsof:07:i10 is not listed on IDEAS
    5. Purevdorj Tuvaandorj, 2021. "Robust Permutation Tests in Linear Instrumental Variables Regression," Papers 2111.13774, arXiv.org, revised Jun 2023.
    6. Orla Doyle, 2017. "The First 2,000 Days and Child Skills: Evidence from a Randomized Experiment of Home Visiting," Working Papers 2017-054, Human Capital and Economic Opportunity Working Group.
    7. Charles A. Holt & Sean P. Sullivan, 2023. "Permutation tests for experimental data," Experimental Economics, Springer;Economic Science Association, vol. 26(4), pages 775-812, September.
    8. Juliana Menger & William E Magnusson & Marti J Anderson & Martin Schlegel & Guy Pe’er & Klaus Henle, 2017. "Environmental characteristics drive variation in Amazonian understorey bird assemblages," PLOS ONE, Public Library of Science, vol. 12(2), pages 1-20, February.
    9. Teniell L. Trolian & Elizabeth A. Jach & Christine A. Ogren & Jana M. Hanson, 2018. "Women Students’ Interactions with Faculty and Exposure to Good Teaching at Colleges and Universities with Varying Histories of Admitting Women," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(4), pages 461-488, June.
    10. Hu, Yuan & Behrman, Jere R. & Zhang, Junsen, 2021. "The causal effects of parents’ schooling on children's schooling in urban China," Journal of Comparative Economics, Elsevier, vol. 49(1), pages 258-276.
    11. Orla Doyle, 2020. "Can Early Intervention have a Sustained Effect on Human Capital?," Working Papers 202001, Geary Institute, University College Dublin.
    12. Aithal, Sreeramana, 2015. "Internal Quality Assurance Cell and its Contribution to Quality Improvement in Higher Education Institutions : A Case of SIMS," MPRA Paper 71434, University Library of Munich, Germany, revised May 2015.
    13. Kherad-Pajouh, Sara & Renaud, Olivier, 2010. "An exact permutation method for testing any effect in balanced and unbalanced fixed effect ANOVA," Computational Statistics & Data Analysis, Elsevier, vol. 54(7), pages 1881-1893, July.
    14. Michael Daly & Liam Delaney & Orla Doyle & Nick Fitzpatrick & Christine O'Farrelly, 2014. "Can Early Intervention Policies Improve Well-being? Evidence from a randomized controlled trial," Working Papers 201415, School of Economics, University College Dublin.
    15. Gill,Indermit S., 1990. "Does the structure of production affect demand for schooling in Peru?," Policy Research Working Paper Series 468, The World Bank.
    16. Josipa Roksa & Teniell L. Trolian & Ernest T. Pascarella & Cindy A. Kilgo & Charles Blaich & Kathleen S. Wise, 2017. "Racial Inequality in Critical Thinking Skills: The Role of Academic and Diversity Experiences," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(2), pages 119-140, March.
    17. Agostino Torti & Alessia Pini & Simone Vantini, 2021. "Modelling time‐varying mobility flows using function‐on‐function regression: Analysis of a bike sharing system in the city of Milan," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(1), pages 226-247, January.
    18. Bonnet, Eric & de Peer, Yves Van, 2002. "zt: A Sofware Tool for Simple and Partial Mantel Tests," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 7(i10).
    19. Pinto, Rodrigo, 2010. "Evaluation of Small-sample Compromised Randomization: Long-term Effects of Early Childhood Intervention on Health and Addictive Behavior," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 30(2), December.
    20. Sara Kherad-Pajouh & Olivier Renaud, 2015. "A general permutation approach for analyzing repeated measures ANOVA and mixed-model designs," Statistical Papers, Springer, vol. 56(4), pages 947-967, November.
    21. Pini, Alessia & Stamm, Aymeric & Vantini, Simone, 2018. "Hotelling’s T2 in separable Hilbert spaces," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 284-305.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:32:y:2008:i:6:p:511-525. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.