IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022i4p2007-2034.html
   My bibliography  Save this article

Modelling time to maximum competency in medical student progress tests

Author

Listed:
  • Daniel McNeish
  • Denis Dumas
  • Dario Torre
  • Neil Rice

Abstract

The current paper is motivated by longitudinal progress tests given to medical students in the United Kingdom, which are used to assess students' applied medical knowledge during their learning programme. The main analytic interest is the maximum competency each student achieves on the assessment and the point in the programme at which each student attains this competency. Direct estimates of maximum competency and the time at which students realised this competency are useful for optimising allocation of classroom and hands‐on experiences, as well as to inform curriculum development. Models have been developed for estimating the timing of a threshold or cut‐off common across people or for estimating different rates of change that occur for different phases of time. However, less attention has been paid to models interested in the timing of a value that can change across people—such as maximum competency—and where growth is flat in some phases of time. In this paper, we build a model that borrows pieces from various existing methods such as reparameterisations of polynomial models, splines for ceiling effects, time‐to‐criterion models, dynamic measurement and non‐linear mixed‐effect models to allow the motivating questions to be addressed from these data.

Suggested Citation

  • Daniel McNeish & Denis Dumas & Dario Torre & Neil Rice, 2022. "Modelling time to maximum competency in medical student progress tests," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 2007-2034, October.
  • Handle: RePEc:bla:jorssa:v:185:y:2022:i:4:p:2007-2034
    DOI: 10.1111/rssa.12864
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12864
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssa.12864?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Casey Codd & Robert Cudeck, 2014. "Nonlinear Random-Effects Mixture Models for Repeated Measures," Psychometrika, Springer;The Psychometric Society, vol. 79(1), pages 60-83, January.
    2. Browne, William J. & Draper, David & Goldstein, Harvey & Rasbash, Jon, 2002. "Bayesian and likelihood methods for fitting multilevel models with complex level-1 variation," Computational Statistics & Data Analysis, Elsevier, vol. 39(2), pages 203-225, April.
    3. W. Sauerbrei & P. Royston, 1999. "Building multivariable prognostic and diagnostic models: transformation of the predictors by using fractional polynomials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 162(1), pages 71-94.
    4. Donald Hedeker & Robin J. Mermelstein & Hakan Demirtas, 2008. "An Application of a Mixed-Effects Location Scale Model for Analysis of Ecological Momentary Assessment (EMA) Data," Biometrics, The International Biometric Society, vol. 64(2), pages 627-634, June.
    5. Patrick Royston & Gareth Ambler, 1999. "Multivariable fractional polynomials," Stata Technical Bulletin, StataCorp LP, vol. 8(43).
    6. Stephen Toit & Robert Cudeck, 2009. "Estimation of the Nonlinear Random Coefficient Model when Some Random Effects Are Separable," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 65-82, March.
    7. Bradley P. Carlin & Alan E. Gelfand & Adrian F. M. Smith, 1992. "Hierarchical Bayesian Analysis of Changepoint Problems," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 41(2), pages 389-405, June.
    8. Patrick Royston & Douglas G. Altman, 1994. "Regression Using Fractional Polynomials of Continuous Covariates: Parsimonious Parametric Modelling," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 43(3), pages 429-453, September.
    9. Hélène Jacqmin-Gadda & Daniel Commenges & Jean-François Dartigues, 2006. "Random Changepoint Model for Joint Modeling of Cognitive Decline and Dementia," Biometrics, The International Biometric Society, vol. 62(1), pages 254-260, March.
    10. Emmanuel Lesaffre & Bart Spiessens, 2001. "On the effect of the number of quadrature points in a logistic random effects model: an example," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 50(3), pages 325-335.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marisa Rifada & Vita Ratnasari & Purhadi Purhadi, 2023. "Parameter Estimation and Hypothesis Testing of The Bivariate Polynomial Ordinal Logistic Regression Model," Mathematics, MDPI, vol. 11(3), pages 1-12, January.
    2. Sauerbrei, W. & Meier-Hirmer, C. & Benner, A. & Royston, P., 2006. "Multivariable regression model building by using fractional polynomials: Description of SAS, STATA and R programs," Computational Statistics & Data Analysis, Elsevier, vol. 50(12), pages 3464-3485, August.
    3. Sauerbrei, Willi & Royston, Patrick & Zapien, Karina, 2007. "Detecting an interaction between treatment and a continuous covariate: A comparison of two approaches," Computational Statistics & Data Analysis, Elsevier, vol. 51(8), pages 4054-4063, May.
    4. William D. Dupont, 2010. "Review of Multivariable Model-building: A Pragmatic Approach to Regression Analysis Based on Fractional Polynomials for Modeling Continuous Variables, by Royston and Sauerbrei," Stata Journal, StataCorp LP, vol. 10(2), pages 297-302, June.
    5. Royston, P. & Sauerbrei, W., 2007. "Improving the robustness of fractional polynomial models by preliminary covariate transformation: A pragmatic approach," Computational Statistics & Data Analysis, Elsevier, vol. 51(9), pages 4240-4253, May.
    6. Patrick Royston & Willi Sauerbrei, 2009. "Two techniques for investigating interactions between treatment and continuous covariates in clinical trials," Stata Journal, StataCorp LP, vol. 9(2), pages 230-251, June.
    7. Charles-Olivier Amédée-Manesme & Fabrice Barthélémy & Didier Maillard, 2019. "Computation of the corrected Cornish–Fisher expansion using the response surface methodology: application to VaR and CVaR," Annals of Operations Research, Springer, vol. 281(1), pages 423-453, October.
    8. Geweke, John & Petrella, Lea, 2014. "Likelihood-based inference for regular functions with fractional polynomial approximations," Journal of Econometrics, Elsevier, vol. 183(1), pages 22-30.
    9. Farber, Steven & Li, Xiao, 2013. "Urban sprawl and social interaction potential: an empirical analysis of large metropolitan regions in the United States," Journal of Transport Geography, Elsevier, vol. 31(C), pages 267-277.
    10. Armando Rungi & Davide Del Prete, 2017. "The 'Smile Curve': where Value is Added along Supply Chains," Working Papers 05/2017, IMT School for Advanced Studies Lucca, revised Mar 2017.
    11. Binder, Harald & Sauerbrei, Willi, 2008. "Increasing the usefulness of additive spline models by knot removal," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5305-5318, August.
    12. Ali Fakih & Walid Marrouch, 2019. "Environmental Kuznets Curve, a Mirage? A Non-parametric Analysis for MENA Countries," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 25(1), pages 113-119, February.
    13. Griffin, John M. & Kruger, Samuel & Maturana, Gonzalo, 2021. "What drove the 2003–2006 house price boom and subsequent collapse? Disentangling competing explanations," Journal of Financial Economics, Elsevier, vol. 141(3), pages 1007-1035.
    14. John K. Pattison‐Williams & Philippe Marcoul & Sandeep Mohapatra, 2023. "Intrahousehold moral hazard frictions and household poverty traps in rural India," Economics of Transition and Institutional Change, John Wiley & Sons, vol. 31(1), pages 67-96, January.
    15. Gwilym Pryce, 2011. "Bidding Conventions and the Degree of Overpricing in the Market for Houses," Urban Studies, Urban Studies Journal Limited, vol. 48(4), pages 765-791, March.
    16. Marco Caliendo & Stefan Tübbicke, 2020. "New evidence on long-term effects of start-up subsidies: matching estimates and their robustness," Empirical Economics, Springer, vol. 59(4), pages 1605-1631, October.
    17. Jackson, Christopher, 2016. "flexsurv: A Platform for Parametric Survival Modeling in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 70(i08).
    18. Annalisa Orenti & Patrizia Boracchi & Giuseppe Marano & Elia Biganzoli & Federico Ambrogi, 2022. "A pseudo-values regression model for non-fatal event free survival in the presence of semi-competing risks," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(3), pages 709-727, September.
    19. Strasak, Alexander M. & Umlauf, Nikolaus & Pfeiffer, Ruth M. & Lang, Stefan, 2011. "Comparing penalized splines and fractional polynomials for flexible modelling of the effects of continuous predictor variables," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1540-1551, April.
    20. Stefanie Hieke & Harald Binder & Alexandra Nieters & Martin Schumacher, 2014. "minPtest: a resampling based gene region-level testing procedure for genetic case-control studies," Computational Statistics, Springer, vol. 29(1), pages 51-63, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:4:p:2007-2034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.