IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v40y2016i4p314-333.html
   My bibliography  Save this article

Estimates of Intraclass Correlation Coefficients and Other Design Parameters for Studies of School-Based Nutritional Interventions

Author

Listed:
  • Randall Juras

Abstract

Introduction: When cluster randomized trials are used to evaluate school-based nutritional interventions such as school lunch programs, design-stage estimates of the required sample size must take into account the correlation in outcomes among individuals within each cluster (e.g., classrooms, schools, or districts). Estimates of the necessary parameters have been carefully developed for educational interventions, but for nutritional interventions the literature is thin. Methods: Using data from two large multi-school, multi-district impact evaluations conducted in the United States, this article calculates estimates of the design parameters required for sizing school-based nutritional studies. The large size of the trials (252 and 1,327 schools) yields precise estimates of the parameters of interest. Variance components are estimated by fitting random-intercept multilevel models in Stata. Results: School-level intraclass correlations are similar to those typically found for educational outcomes. In particular, school-level estimates range from less than .01 to .26 across the two studies, and district-level estimates ranged from less than .01 to .19. This suggests that cluster randomized trials of nutritional interventions may require samples with numbers of schools similar to the education studies to detect similar effect sizes.

Suggested Citation

  • Randall Juras, 2016. "Estimates of Intraclass Correlation Coefficients and Other Design Parameters for Studies of School-Based Nutritional Interventions," Evaluation Review, , vol. 40(4), pages 314-333, August.
    • Handle: RePEc:sae:evarev:v:40:y:2016:i:4:p:314-333
    DOI: 10.1177/0193841X16675223
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X16675223
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X16675223?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Varnell, S.P. & Murray, D.M. & Janega, J.B. & Blitstein, J.L., 2004. "Design and Analysis of Group-Randomized Trials: A Review of Recent Practices," American Journal of Public Health, American Public Health Association, vol. 94(3), pages 393-399.
    2. repec:mpr:mprres:5673 is not listed on IDEAS
    3. repec:mpr:mprres:4632 is not listed on IDEAS
    4. Center for Nutrition Policy and Promotion, 1995. "The Healthy Eating index," CNPP Reports 311249, United States Department of Agriculture, Center for Nutrition Policy and Promotion.
    5. repec:mpr:mprres:5863 is not listed on IDEAS
    6. Ann M. Collins & Ronette Briefel & Jacob Alex Klerman & Gretchen Rowe & Anne Wolf & Christopher W. Logan & Anne Gordon & Carrie Wolfson & Ayesha Enver & Cheryl Owens & Charlotte Cabili & Stephen Bell, "undated". "Summary of Summer Electronic Benefits Transfer for Children: Evaluation Findings for the Full Implementation Year 2012," Mathematica Policy Research Reports f2d019d4c8da4b828914b8421, Mathematica Policy Research.
    7. repec:mpr:mprres:7930 is not listed on IDEAS
    8. repec:mpr:mprres:7932 is not listed on IDEAS
    9. Peter Z. Schochet & Hanley S. Chiang, "undated". "Error Rates in Measuring Teacher and School Performance Based on Student Test Score Gains," Mathematica Policy Research Reports d415285f980b4d64b7e75f40b, Mathematica Policy Research.
    10. repec:mpr:mprres:6721 is not listed on IDEAS
    11. Sophia Rabe-Hesketh & Anders Skrondal & Andrew Pickles, 2004. "Generalized multilevel structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 69(2), pages 167-190, June.
    12. Peter Z. Schochet, "undated". "Statistical Power for Random Assignment Evaluations of Education Programs," Mathematica Policy Research Reports 6749d31ad72d4acf988f7dce5, Mathematica Policy Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Z. Schochet & Hanley S. Chiang, 2013. "What Are Error Rates for Classifying Teacher and School Performance Using Value-Added Models?," Journal of Educational and Behavioral Statistics, , vol. 38(2), pages 142-171, April.
    2. Variyam, Jayachandran N. & Blaylock, James R. & Smallwood, David M. & Basiotis, P. Peter, 1998. "USDA's Healthy Eating Index and Nutrition Information," Technical Bulletins 33588, United States Department of Agriculture, Economic Research Service.
    3. Thiele, S., 2001. "Die Nachfrage nach Ernährungsqualität als Gesundheitsaspekt in der Lebensmittelnachfrage," Proceedings “Schriften der Gesellschaft für Wirtschafts- und Sozialwissenschaften des Landbaues e.V.”, German Association of Agricultural Economists (GEWISOLA), vol. 37.
    4. Dan Goldhaber & Roddy Theobald, 2013. "Managing the Teacher Workforce in Austere Times: The Determinants and Implications of Teacher Layoffs," Education Finance and Policy, MIT Press, vol. 8(4), pages 494-527, October.
    5. Ryan Mullins & Raj Agnihotri, 2022. "Digital selling: organizational and managerial influences for frontline readiness and effectiveness," Journal of the Academy of Marketing Science, Springer, vol. 50(4), pages 800-821, July.
    6. World Bank, 2017. "Pre-Primary Education in Mongolia," World Bank Publications - Reports 26402, The World Bank Group.
    7. Sun-Joo Cho & Allan S. Cohen, 2010. "A Multilevel Mixture IRT Model With an Application to DIF," Journal of Educational and Behavioral Statistics, , vol. 35(3), pages 336-370, June.
    8. Christine T Cigolle & Corey L Nagel & Caroline S Blaum & Jersey Liang & Ana R Quiñones, 2018. "Inconsistency in the Self-report of Chronic Diseases in Panel Surveys: Developing an Adjudication Method for the Health and Retirement Study," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 73(5), pages 901-912.
    9. Pesko, Michael F. & Baum, Christopher F., 2016. "The self-medication hypothesis: Evidence from terrorism and cigarette accessibility," Economics & Human Biology, Elsevier, vol. 22(C), pages 94-102.
    10. Sijia Huang & Li Cai, 2024. "Cross-Classified Item Response Theory Modeling With an Application to Student Evaluation of Teaching," Journal of Educational and Behavioral Statistics, , vol. 49(3), pages 311-341, June.
    11. Bambio, Yiriyibin & Bouayad Agha, Salima, 2018. "Land tenure security and investment: Does strength of land right really matter in rural Burkina Faso?," World Development, Elsevier, vol. 111(C), pages 130-147.
    12. Andrew K. Rose & Mark M. Spiegel, 2010. "Cross‐Country Causes And Consequences Of The 2008 Crisis: International Linkages And American Exposure," Pacific Economic Review, Wiley Blackwell, vol. 15(3), pages 340-363, August.
    13. Jonathan L. Blitstein & Peter J. Hannan & David M. Murray & William R. Shadish, 2005. "Increasing the Degrees of Freedom in Existing Group Randomized Trials," Evaluation Review, , vol. 29(3), pages 241-267, June.
    14. repec:mpr:mprres:6286 is not listed on IDEAS
    15. Michela Battauz & Ruggero Bellio, 2011. "Structural Modeling of Measurement Error in Generalized Linear Models with Rasch Measures as Covariates," Psychometrika, Springer;The Psychometric Society, vol. 76(1), pages 40-56, January.
    16. Axel Dreher & Merle Kreibaum, 2016. "Weapons of choice," Journal of Peace Research, Peace Research Institute Oslo, vol. 53(4), pages 539-553, July.
    17. Nocella, Giuseppe & Srinivasan, C.S., 2019. "Adherence to WHO’s nutrition recommendations in the UK: Dietary patterns and policy implications from a national survey," Food Policy, Elsevier, vol. 86(C), pages 1-1.
    18. Hakan Aslan & Burcak Vatansever, 2018. "Efficiency of Knowledge Inflow Structures: The Mediation Effect of Task Environment Analysis," International Journal of Research in Business and Social Science (2147-4478), Center for the Strategic Studies in Business and Finance, vol. 7(4), pages 30-43, October.
    19. Gary Henry & Roderick Rose & Doug Lauen, 2014. "Are value-added models good enough for teacher evaluations? Assessing commonly used models with simulated and actual data," Investigaciones de Economía de la Educación volume 9, in: Adela García Aracil & Isabel Neira Gómez (ed.), Investigaciones de Economía de la Educación 9, edition 1, volume 9, chapter 20, pages 383-405, Asociación de Economía de la Educación.
    20. Alston, Julian M. & Mullally, Conner C. & Sumner, Daniel A. & Townsend, Marilyn & Vosti, Stephen A., 2009. "Likely effects on obesity from proposed changes to the US food stamp program," Food Policy, Elsevier, vol. 34(2), pages 176-184, April.
    21. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:40:y:2016:i:4:p:314-333. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.