IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v20y2023i23p7131-d1292211.html
   My bibliography  Save this article

Comment on Marsigliante et al. Effects on Children’s Physical and Mental Well-Being of a Physical-Activity-Based School Intervention Program: A Randomized Study. Int. J. Environ. Res. Public Health 2023, 20 , 1927

Author

Listed:
  • Raphiel Murden

    (Department of Biostatistics and Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, GA 30322, USA)

  • Jon Agley

    (Department of Applied Health Science, School of Public Health-Bloomington, Indiana University, Indianapolis, IN 46805, USA)

  • Lilian Golzarri-Arroyo

    (Biostatistics Consulting Center, School of Public Health-Bloomington, Indiana University, Indianapolis, IN 46805, USA)

  • Armando Peña

    (Department of Health and Wellness Design, School of Public Health-Bloomington, Indiana University, Indianapolis, IN 46805, USA)

  • Danny Valdez

    (Department of Applied Health Science, School of Public Health-Bloomington, Indiana University, Indianapolis, IN 46805, USA)

  • Abu Bakkar Siddique

    (School of Public Administration, Florida Atlantic University, 777 Glades Road, Boca Raton, FL 33431, USA)

  • Moonseong Heo

    (Department of Public Health Sciences, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC 29634, USA)

  • David B. Allison

    (Department of Epidemiology and Biostatistics, School of Public Health-Bloomington, Indiana University Bloomington, Bloomington, IN 47405, USA)

Abstract

We conducted a critical review of the article “Effects on Children’s Physical and Mental Well-Being of a Physical-Activity-Based School Intervention Program: A Randomized Study”, published in the International Journal of Environmental Research and Public Health in 2023 as part of the Special Issue “Psychomotricity and Physical Education in School Health”. We identified multiple mistakes in the statistical analyses applied. First, the authors claim to have found a statistically significant association between the proposed intervention and change in body composition (body mass index (BMI) percentiles, relative fat mass, and BMI classes) by way of exhibiting differences in nominal significance between the pre- and post-intervention changes within the control and intervention groups, instead of exhibiting a significant difference between groups. Furthermore, the analysis described fails to account for clustering and nesting in the data. The reporting of the statistical methods and results include multiple elements that are variously incorrect, incoherent, or impossible. Revised statistical analyses are proposed which can render the study’s methods valid and its results substantiated, whereas the current methods and results are invalid and unsubstantiated, respectively.

Suggested Citation

  • Raphiel Murden & Jon Agley & Lilian Golzarri-Arroyo & Armando Peña & Danny Valdez & Abu Bakkar Siddique & Moonseong Heo & David B. Allison, 2023. "Comment on Marsigliante et al. Effects on Children’s Physical and Mental Well-Being of a Physical-Activity-Based School Intervention Program: A Randomized Study. Int. J. Environ. Res. Public Health 20," IJERPH, MDPI, vol. 20(23), pages 1-5, December.
    • Handle: RePEc:gam:jijerp:v:20:y:2023:i:23:p:7131-:d:1292211
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/20/23/7131/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/20/23/7131/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Murray, D.M. & Varnell, S.P. & Blitstein, J.L., 2004. "Design and Analysis of Group-Randomized Trials: A Review of Recent Methodological Developments," American Journal of Public Health, American Public Health Association, vol. 94(3), pages 423-432.
    2. Santo Marsigliante & Manuel Gómez-López & Antonella Muscella, 2023. "Effects on Children’s Physical and Mental Well-Being of a Physical-Activity-Based School Intervention Program: A Randomized Study," IJERPH, MDPI, vol. 20(3), pages 1-16, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonathan L. Blitstein & David M. Murray & Peter J. Hannan & William R. Shadish, 2005. "Increasing the Degrees of Freedom in Future Group Randomized Trials," Evaluation Review, , vol. 29(3), pages 268-286, June.
    2. Jonathan L. Blitstein & Peter J. Hannan & David M. Murray & William R. Shadish, 2005. "Increasing the Degrees of Freedom in Existing Group Randomized Trials," Evaluation Review, , vol. 29(3), pages 241-267, June.
    3. Ji-Hyun Lee & Michael J Schell & Richard Roetzheim, 2009. "Analysis of Group Randomized Trials with Multiple Binary Endpoints and Small Number of Groups," PLOS ONE, Public Library of Science, vol. 4(10), pages 1-9, October.
    4. Siying Guo & Jianxuan Liu & Qiu Wang, 2022. "Effective Learning During COVID-19: Multilevel Covariates Matching and Propensity Score Matching," Annals of Data Science, Springer, vol. 9(5), pages 967-982, October.
    5. repec:mpr:mprres:4632 is not listed on IDEAS
    6. Peter Z. Schochet, "undated". "Statistical Power for Random Assignment Evaluations of Education Programs," Mathematica Policy Research Reports 6749d31ad72d4acf988f7dce5, Mathematica Policy Research.
    7. Benjamin F. Arnold & Francois Rerolle & Christine Tedijanto & Sammy M. Njenga & Mahbubur Rahman & Ayse Ercumen & Andrew Mertens & Amy J. Pickering & Audrie Lin & Charles D. Arnold & Kishor Das & Chris, 2024. "Geographic pair matching in large-scale cluster randomized trials," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    8. Hélène Sancho-Garnier & Bruno Pereira & Pierre Césarini, 2012. "A Cluster Randomized Trial to Evaluate a Health Education Programme “Living with Sun at School”," IJERPH, MDPI, vol. 9(7), pages 1-17, July.
    9. Yasaman Jamshidi-Naeini & Armando Pena & Abu Bakkar Siddique & Andrew W. Brown & David B. Allison, 2023. "One Cluster per Condition Is Not a Valid Design in Cluster-Randomized Trials. Comment on Wang et al. The Effect of Different Physical Exercise Programs on Physical Fitness among Preschool Children: A ," IJERPH, MDPI, vol. 20(17), pages 1-2, August.
    10. Larry V. Hedges, 2009. "Adjusting a Significance Test for Clustering in Designs With Two Levels of Nesting," Journal of Educational and Behavioral Statistics, , vol. 34(4), pages 464-490, December.
    11. Jose Giovany Babativa-Márquez & José Luis Vicente-Villardón, 2021. "Logistic Biplot by Conjugate Gradient Algorithms and Iterated SVD," Mathematics, MDPI, vol. 9(16), pages 1-19, August.
    12. Spyros Konstantopoulos, 2009. "Incorporating Cost in Power Analysis for Three-Level Cluster-Randomized Designs," Evaluation Review, , vol. 33(4), pages 335-357, August.
    13. Ruoxuan Xiong & Susan Athey & Mohsen Bayati & Guido Imbens, 2024. "Optimal Experimental Design for Staggered Rollouts," Management Science, INFORMS, vol. 70(8), pages 5317-5336, August.
    14. Konstantopoulos, Spyros, 2006. "The Power of the Test in Three-Level Designs," IZA Discussion Papers 2412, Institute of Labor Economics (IZA).
    15. Fang Yu & Nicholas A Hein & Danstan S Bagenda, 2020. "Preventing HIV and HSV-2 through knowledge and attitudes: A replication study of a multi-component community-based intervention in Zimbabwe," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-25, January.
    16. Steven Teerenstra & Bing Lu & John S. Preisser & Theo van Achterberg & George F. Borm, 2010. "Sample Size Considerations for GEE Analyses of Three-Level Cluster Randomized Trials," Biometrics, The International Biometric Society, vol. 66(4), pages 1230-1237, December.
    17. Wang Pengyuan & Traskin Mikhail & Small Dylan S., 2013. "Robust Inferences from a Before-and-After Study with Multiple Unaffected Control Groups," Journal of Causal Inference, De Gruyter, vol. 1(2), pages 209-234, June.
    18. Winfried Zinn & Sebastian Sauer & Richard Göllner, 2016. "The German Inpatient Satisfaction Scale," SAGE Open, , vol. 6(2), pages 21582440166, April.
    19. Dateng Li & Jing Cao & Song Zhang, 2020. "Power analysis for cluster randomized trials with multiple binary co‐primary endpoints," Biometrics, The International Biometric Society, vol. 76(4), pages 1064-1074, December.
    20. Walt Stroup & Elizabeth Claassen, 2020. "Pseudo-Likelihood or Quadrature? What We Thought We Knew, What We Think We Know, and What We Are Still Trying to Figure Out," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 25(4), pages 639-656, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:20:y:2023:i:23:p:7131-:d:1292211. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.