IDEAS home Printed from https://ideas.repec.org/a/spr/reihed/v65y2024i5d10.1007_s11162-023-09767-2.html
   My bibliography  Save this article

Illuminating the Post-Graduation Impact of Undergraduate Participation in High-Impact Practices Using Propensity Score Analysis with Structural Equation Modeling

Author

Listed:
  • Joanna L. Dickert

    (Kent State University
    Carnegie Mellon University)

  • Jian Li

    (Kent State University)

Abstract

As colleges and universities grapple with uncertainty around current and future enrollment as well as increasingly vocal questions about the value of postsecondary education, it is critically important that institutions ascertain and invest in the elements of campus learning and engagement that add value to the undergraduate experience. This study examines the relationship between cumulative participation in high-impact practices (HIPs) and the perceived importance of postsecondary experience in preparation for adult life using the Educational Longitudinal Study of 2002 (ELS) dataset. Employing a methodology proposed and tested by Leite et al. (Struct Equ Model Multidiscip J 26(3):448–469, 2019. https://doi.org/10.1080/10705511.2018.1522591 ), this analysis incorporated the ability to account for self-selection into HIPs using propensity score (PS) analysis with a multiple-group structural equation model (SEM) design to examine differences between students who participated in two or more HIPs and those who did not (n = 3105). Results offered evidence of benefit to participation in two or more HIP experiences with positive and statistically significant differences in the perceived importance of postsecondary education in preparation for adult life across the analytic sample with doubly robust estimation techniques. Interaction effects for female students, students from low SES backgrounds, and students who are members of minoritized racial/ethnic populations were also identified. The findings offered evidence of post-graduation impact of cumulative participation in HIPs that can inform program development and student decision-making as well as the future use of analytic techniques such as PS analysis, doubly robust estimation, and sensitivity analysis to enhance measurement precision.

Suggested Citation

  • Joanna L. Dickert & Jian Li, 2024. "Illuminating the Post-Graduation Impact of Undergraduate Participation in High-Impact Practices Using Propensity Score Analysis with Structural Equation Modeling," Research in Higher Education, Springer;Association for Institutional Research, vol. 65(5), pages 943-964, August.
    • Handle: RePEc:spr:reihed:v:65:y:2024:i:5:d:10.1007_s11162-023-09767-2
    DOI: 10.1007/s11162-023-09767-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11162-023-09767-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11162-023-09767-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Heejung Bang & James M. Robins, 2005. "Doubly Robust Estimation in Missing Data and Causal Inference Models," Biometrics, The International Biometric Society, vol. 61(4), pages 962-973, December.
    2. Tricia A. Seifert & Benjamin Gillig & Jana M. Hanson & Ernest T. Pascarella & Charles F. Blaich, 2014. "The Conditional Nature of High Impact/Good Practices on Student Learning Outcomes," The Journal of Higher Education, Taylor & Francis Journals, vol. 85(4), pages 531-564, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    2. Ruoxuan Xiong & Allison Koenecke & Michael Powell & Zhu Shen & Joshua T. Vogelstein & Susan Athey, 2021. "Federated Causal Inference in Heterogeneous Observational Data," Papers 2107.11732, arXiv.org, revised Apr 2023.
    3. Jelena Bradic & Weijie Ji & Yuqian Zhang, 2021. "High-dimensional Inference for Dynamic Treatment Effects," Papers 2110.04924, arXiv.org, revised May 2023.
    4. Görg Holger & Marchal Léa, 2019. "Die Effekte deutscher Direktinvestitionen im Empfängerland vor dem Hintergrund des Leistungsbilanzüberschusses: Empirische Evidenz mit Mikrodaten für Frankreich," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 20(1), pages 53-69, June.
    5. Tran Linh & Petersen Maya & Schwab Joshua & van der Laan Mark J., 2023. "Robust variance estimation and inference for causal effect estimation," Journal of Causal Inference, De Gruyter, vol. 11(1), pages 1-27, January.
    6. Léa Marchal & Clément Nedoncelle, 2019. "Immigrants, occupations and firm export performance," Review of International Economics, Wiley Blackwell, vol. 27(5), pages 1480-1509, November.
    7. Hisaki Kono & Yasuyuki Sawada & Abu S. Shonchoy, 2016. "DVD-based Distance-learning Program for University Entrance Exams: Experimental Evidence from Rural Bangladesh," CIRJE F-Series CIRJE-F-1027, CIRJE, Faculty of Economics, University of Tokyo.
    8. Masahiro Kato & Masaaki Imaizumi & Takuya Ishihara & Toru Kitagawa, 2023. "Asymptotically Optimal Fixed-Budget Best Arm Identification with Variance-Dependent Bounds," Papers 2302.02988, arXiv.org, revised Jul 2023.
    9. Takahiro Hoshino & Yuya Shimizu, 2019. "Doubly Robust-type Estimation of Population Moments and Parameters in Biased Sampling," Keio-IES Discussion Paper Series 2019-006, Institute for Economics Studies, Keio University.
    10. Uysal, S. Derya, 2013. "Doubly Robust Estimation of Causal Effects with Multivalued Treatments," Economics Series 297, Institute for Advanced Studies.
    11. Paul Frédéric Blanche & Anders Holt & Thomas Scheike, 2023. "On logistic regression with right censored data, with or without competing risks, and its use for estimating treatment effects," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 29(2), pages 441-482, April.
    12. Ignaciuk, Ada & Malevolti, Giulia & Scognamillo, Antonio & Sitko, Nicholas J., 2022. "Can food aid relax farmers’ constraints to adopting climate-adaptive agricultural practices? Evidence from Ethiopia, Malawi and the United Republic of Tanzania," ESA Working Papers 324073, Food and Agriculture Organization of the United Nations, Agricultural Development Economics Division (ESA).
    13. Everding, Jakob & Marcus, Jan, 2020. "The effect of unemployment on the smoking behavior of couples," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 29(2), pages 154-170.
    14. Li Liang & Greene Tom, 2013. "A Weighting Analogue to Pair Matching in Propensity Score Analysis," The International Journal of Biostatistics, De Gruyter, vol. 9(2), pages 215-234, July.
    15. Frank Fossen & Martin Simmler, 2016. "Personal taxation of capital income and the financial leverage of firms," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 23(1), pages 48-81, February.
    16. repec:ags:unassr:234387 is not listed on IDEAS
    17. Yiyi Huo & Yingying Fan & Fang Han, 2023. "On the adaptation of causal forests to manifold data," Papers 2311.16486, arXiv.org, revised Dec 2023.
    18. Brian J. Reich & Shu Yang & Yawen Guan & Andrew B. Giffin & Matthew J. Miller & Ana Rappold, 2021. "A Review of Spatial Causal Inference Methods for Environmental and Epidemiological Applications," International Statistical Review, International Statistical Institute, vol. 89(3), pages 605-634, December.
    19. Satoshi Hattori & Masayuki Henmi, 2014. "Stratified doubly robust estimators for the average causal effect," Biometrics, The International Biometric Society, vol. 70(2), pages 270-277, June.
    20. Stephanie A Kovalchik, 2020. "‘In search of lost time’: Identifying the causative role of cumulative competition load and competition time-loss in professional tennis using a structural nested mean model," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-18, April.
    21. Konan Alain N'Ghauran & Corinne Autant-Bernard, 2020. "Assessing the collaboration and network additionality of innovation policies: a counterfactual approach to the French cluster policy," Post-Print halshs-03128972, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:reihed:v:65:y:2024:i:5:d:10.1007_s11162-023-09767-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.