IDEAS home Printed from https://ideas.repec.org/p/eti/dpaper/23081.html
   My bibliography  Save this paper

SMART-EXAM: Incorporating Participants' Welfare into Sequential Multiple Assignment Randomized Trials

Author

Listed:
  • Xinru WANG
  • Nina DELIU
  • NARITA Yusuke
  • Bibhas CHAKRABORTY

Abstract

Dynamic Treatment Regimes (DTRs) are sequences of decision rules that recommend treatments based on patients’ time-varying clinical conditions. The Sequential Multiple Assignment Randomized Trial (SMART) is an experimental design that can provide high-quality evidence for constructing optimal DTRs. In a conventional SMART, participants are randomized to available treatments at multiple stages with balanced randomization probabilities. Despite its relative simplicity of implementation and desirable performance in comparing embedded DTRs, the conventional SMART faces inevitable ethical issues including assigning many participants to the empirically inferior treatment or the treatment they dislike, which might slow down the recruitment procedure and lead to higher attrition rates, ultimately leading to poor internal and external validities of the trial results. In this context, we propose a SMART under the Experiment-as-Market framework (SMART-EXAM), a novel SMART design that holds the potential to improve participants’ welfare by incorporating their preferences and predicted treatment effects into the randomization procedure. We describe the steps of conducting a SMART-EXAM and evaluate its performance compared to the conventional SMART. The results indicate that the SMART-EXAM can improve the welfare of the participants enrolled in the trial, while also achieving a desirable ability to construct an optimal DTR when the experimental parameters are suitably specified. We finally illustrate the practical potential of the SMART-EXAM design using data from a SMART for children with attention-deficit/hyperactivity disorder (ADHD).

Suggested Citation

  • Xinru WANG & Nina DELIU & NARITA Yusuke & Bibhas CHAKRABORTY, 2023. "SMART-EXAM: Incorporating Participants' Welfare into Sequential Multiple Assignment Randomized Trials," Discussion papers 23081, Research Institute of Economy, Trade and Industry (RIETI).
    • Handle: RePEc:eti:dpaper:23081
    as

    Download full text from publisher

    File URL: https://www.rieti.go.jp/jp/publications/dp/23e081.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brian J. Gaines & James H. Kuklinski, 2011. "Experimental Estimation of Heterogeneous Treatment Effects Related to Self‐Selection," American Journal of Political Science, John Wiley & Sons, vol. 55(3), pages 724-736, July.
    2. Bibhas Chakraborty & Eric B. Laber & Yingqi Zhao, 2013. "Inference for Optimal Dynamic Treatment Regimes Using an Adaptive m-Out-of-n Bootstrap Scheme," Biometrics, The International Biometric Society, vol. 69(3), pages 714-723, September.
    3. Lu Wang & Andrea Rotnitzky & Xihong Lin & Randall E. Millikan & Peter F. Thall, 2012. "Evaluation of Viable Dynamic Treatment Regimes in a Sequentially Randomized Trial of Advanced Prostate Cancer," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 493-508, June.
    4. Michael C Knaus & Michael Lechner & Anthony Strittmatter, 2021. "Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 134-161.
    5. Liwen Wu & Junyao Wang & Abdus S. Wahed, 2023. "Interim monitoring in sequential multiple assignment randomized trials," Biometrics, The International Biometric Society, vol. 79(1), pages 368-380, March.
    6. Dean Knox & Teppei Yamamoto & Matthew A. Baum & Adam J. Berinsky, 2019. "Design, Identification, and Sensitivity Analysis for Patient Preference Trials," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1532-1546, October.
    7. Ying Kuen Cheung & Bibhas Chakraborty & Karina W. Davidson, 2015. "Sequential multiple assignment randomized trial (SMART) with adaptive randomization for quality improvement in depression treatment program," Biometrics, The International Biometric Society, vol. 71(2), pages 450-459, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael P. Wallace & Erica E. M. Moodie, 2015. "Doubly‐robust dynamic treatment regimen estimation via weighted least squares," Biometrics, The International Biometric Society, vol. 71(3), pages 636-644, September.
    2. Yebin Tao & Lu Wang, 2017. "Adaptive contrast weighted learning for multi-stage multi-treatment decision-making," Biometrics, The International Biometric Society, vol. 73(1), pages 145-155, March.
    3. Q. Clairon & R. Henderson & N. J. Young & E. D. Wilson & C. J. Taylor, 2021. "Adaptive treatment and robust control," Biometrics, The International Biometric Society, vol. 77(1), pages 223-236, March.
    4. Early Kirstin & Mankoff Jennifer & Fienberg Stephen E., 2017. "Dynamic Question Ordering in Online Surveys," Journal of Official Statistics, Sciendo, vol. 33(3), pages 625-657, September.
    5. Davide Viviano & Jelena Bradic, 2019. "Synthetic learner: model-free inference on treatments over time," Papers 1904.01490, arXiv.org, revised Aug 2022.
    6. Engberg, Erik & Görg, Holger & Lodefalk, Magnus & Javed, Farrukh & Längkvist, Martin & Monteiro, Natália & Kyvik Nordås, Hildegunn & Pulito, Giuseppe & Schroeder, Sarah & Tang, Aili, 2023. "AI Unboxed and Jobs: A Novel Measure and Firm-Level Evidence from Three Countries," Ratio Working Papers 370, The Ratio Institute.
    7. Pons Rotger, Gabriel & Rosholm, Michael, 2020. "The Role of Beliefs in Long Sickness Absence: Experimental Evidence from a Psychological Intervention," IZA Discussion Papers 13582, Institute of Labor Economics (IZA).
    8. Daniel Goller, 2023. "Analysing a built-in advantage in asymmetric darts contests using causal machine learning," Annals of Operations Research, Springer, vol. 325(1), pages 649-679, June.
    9. Yiyi Huo & Yingying Fan & Fang Han, 2023. "On the adaptation of causal forests to manifold data," Papers 2311.16486, arXiv.org, revised Dec 2023.
    10. Michael Lechner, 2023. "Causal Machine Learning and its use for public policy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-15, December.
    11. Zeyu Bian & Erica E. M. Moodie & Susan M. Shortreed & Sahir Bhatnagar, 2023. "Variable selection in regression‐based estimation of dynamic treatment regimes," Biometrics, The International Biometric Society, vol. 79(2), pages 988-999, June.
    12. Thomas A. Murray & Peter F. Thall & Ying Yuan & Sarah McAvoy & Daniel R. Gomez, 2017. "Robust Treatment Comparison Based on Utilities of Semi-Competing Risks in Non-Small-Cell Lung Cancer," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 11-23, January.
    13. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    14. Ogundari, Kolawole, 2021. "A systematic review of statistical methods for estimating an education production function," MPRA Paper 105283, University Library of Munich, Germany.
    15. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    16. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    17. Humphreys, Macartan & Scacco, Alexandra, 2020. "The aggregation challenge," World Development, Elsevier, vol. 127(C).
    18. Cockx, Bart & Lechner, Michael & Bollens, Joost, 2023. "Priority to unemployed immigrants? A causal machine learning evaluation of training in Belgium," Labour Economics, Elsevier, vol. 80(C).
    19. Daniel Boller & Michael Lechner & Gabriel Okasa, 2021. "The Effect of Sport in Online Dating: Evidence from Causal Machine Learning," Papers 2104.04601, arXiv.org.
    20. Daniel Jacob, 2021. "CATE meets ML -- The Conditional Average Treatment Effect and Machine Learning," Papers 2104.09935, arXiv.org, revised Apr 2021.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eti:dpaper:23081. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: TANIMOTO, Toko (email available below). General contact details of provider: https://edirc.repec.org/data/rietijp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.