IDEAS home Printed from https://ideas.repec.org/p/oxf/wpaper/1009.html
   My bibliography  Save this paper

Robust combination testing: methods and application to COVID-19 detection

Author

Listed:
  • Sanjay Jain
  • Jónas Oddur Jónasson
  • Jean Pauphilet
  • Kamalini Ramdas

Abstract

Simple and affordable testing tools are often not accurate enough to be operationally relevant. For COVID-19 detection, rapid point-of-care tests are cheap and provide results in minutes, but largely fail policymakers’ accuracy requirements. We propose an analytical methodology, based on robust optimization, that identifies optimal combinations of results from cheap tests for increased predictive accuracy. This methodological tool allows policymakers to credibly quantify the benefits from combination testing and thus break the trade-off between cost and accuracy. Our methodology is robust to noisy and partially missing input data and incorporates operational constraints—relevant considerations in practice. We apply our methodology to two datasets containing individual-level results of multiple COVID-19 rapid antibody and antigen tests, respectively, to generate Pareto-dominating receiver operating characteristic (ROC) curves. We find that combining only three rapid tests increases out-of-sample area under the curve (AUC) by 4% (6%) compared with the best performing individual test for antibody (antigen) detection. We also find that a policymaker who requires a specificity of at least 0.95 can improve sensitivity by 8% and 2% for antibody and antigen testing, respectively, relative to available combination testing heuristics. Our numerical analysis demonstrates that robust optimization is a powerful tool to avoid overfitting, accommodate missing data, and improve out-of-sample performance. Based on our analytical and empirical results, policymakers should consider approving and deploying a curated combination of cheap point-of-care tests in settings where ‘gold standard’ tests are too expensive or too slow.

Suggested Citation

  • Sanjay Jain & Jónas Oddur Jónasson & Jean Pauphilet & Kamalini Ramdas, 2023. "Robust combination testing: methods and application to COVID-19 detection," Economics Series Working Papers 1009, University of Oxford, Department of Economics.
  • Handle: RePEc:oxf:wpaper:1009
    as

    Download full text from publisher

    File URL: https://ora.ox.ac.uk/objects/uuid:49e5c5fe-93b5-4480-ba03-31247605a9f1
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Oktay Günlük & Jayant Kalagnanam & Minhan Li & Matt Menickelly & Katya Scheinberg, 2021. "Optimal decision trees for categorical data via integer programming," Journal of Global Optimization, Springer, vol. 81(1), pages 233-260, September.
    2. John J. McCall, 1965. "Maintenance Policies for Stochastically Failing Equipment: A Survey," Management Science, INFORMS, vol. 11(5), pages 493-524, March.
    3. Maximilian Kasy & Alexander Teytelboym, 2020. "Adaptive targeted infectious disease testing," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 36(Supplemen), pages 77-93.
    4. John C. Hershey & Randall D. Cebul & Sankey V. Williams, 1986. "Clinical Guidelines for Using Two Dichotomous Tests," Medical Decision Making, , vol. 6(2), pages 68-78, June.
    5. Wang, Hongzhou, 2002. "A survey of maintenance policies of deteriorating systems," European Journal of Operational Research, Elsevier, vol. 139(3), pages 469-489, June.
    6. Oguzhan Alagoz & Jagpreet Chhatwal & Elizabeth S. Burnside, 2013. "Optimal Policies for Reducing Unnecessary Follow-Up Mammography Exams in Breast Cancer Diagnosis," Decision Analysis, INFORMS, vol. 10(3), pages 200-224, September.
    7. Hrayer Aprahamian & Douglas R. Bish & Ebru K. Bish, 2019. "Optimal Risk-Based Group Testing," Management Science, INFORMS, vol. 65(9), pages 4365-4384, September.
    8. Mirko Kremer & Francis de Véricourt, 2022. "Mismanaging diagnostic accuracy under congestion," ESMT Research Working Papers ESMT-22-01, ESMT European School of Management and Technology.
    9. Retsef Levi & Thomas Magnanti & Yaron Shaposhnik, 2019. "Scheduling with Testing," Management Science, INFORMS, vol. 65(2), pages 776-793, February.
    10. George B. Dantzig, 1957. "Discrete-Variable Extremum Problems," Operations Research, INFORMS, vol. 5(2), pages 266-288, April.
    11. Hamsa Bastani & Kimon Drakopoulos & Vishal Gupta & Ioannis Vlachogiannis & Christos Hadjichristodoulou & Pagona Lagiou & Gkikas Magiorkinis & Dimitrios Paraskevis & Sotirios Tsiodras, 2021. "Efficient and targeted COVID-19 border testing via reinforcement learning," Nature, Nature, vol. 599(7883), pages 108-113, November.
    12. Martin W. McIntosh & Margaret Sullivan Pepe, 2002. "Combining Several Screening Tests: Optimality of the Risk Score," Biometrics, The International Biometric Society, vol. 58(3), pages 657-664, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiang, Yisha, 2013. "Joint optimization of X¯ control chart and preventive maintenance policies: A discrete-time Markov chain approach," European Journal of Operational Research, Elsevier, vol. 229(2), pages 382-390.
    2. David T. Abdul‐Malak & Jeffrey P. Kharoufeh & Lisa M. Maillart, 2019. "Maintaining systems with heterogeneous spare parts," Naval Research Logistics (NRL), John Wiley & Sons, vol. 66(6), pages 485-501, September.
    3. Belyi, Dmitriy & Popova, Elmira & Morton, David P. & Damien, Paul, 2017. "Bayesian failure-rate modeling and preventive maintenance optimization," European Journal of Operational Research, Elsevier, vol. 262(3), pages 1085-1093.
    4. Alaswad, Suzan & Xiang, Yisha, 2017. "A review on condition-based maintenance optimization models for stochastically deteriorating system," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 54-63.
    5. Pinciroli, Luca & Baraldi, Piero & Zio, Enrico, 2023. "Maintenance optimization in industry 4.0," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    6. Zio, Enrico & Compare, Michele, 2013. "Evaluating maintenance policies by quantitative modeling and analysis," Reliability Engineering and System Safety, Elsevier, vol. 109(C), pages 53-65.
    7. Wang, Wenbin, 2012. "An overview of the recent advances in delay-time-based maintenance modelling," Reliability Engineering and System Safety, Elsevier, vol. 106(C), pages 165-178.
    8. Oakley, Jordan L. & Wilson, Kevin J. & Philipson, Pete, 2022. "A condition-based maintenance policy for continuously monitored multi-component systems with economic and stochastic dependence," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    9. Pongpech, J. & Murthy, D.N.P., 2006. "Optimal periodic preventive maintenance policy for leased equipment," Reliability Engineering and System Safety, Elsevier, vol. 91(7), pages 772-777.
    10. Kai He & Lisa M. Maillart & Oleg A. Prokopyev, 2019. "Optimal sequencing of heterogeneous, non-instantaneous interventions," Annals of Operations Research, Springer, vol. 276(1), pages 109-135, May.
    11. Lipnowski, Elliot & Ravid, Doron, 2021. "Pooled testing for quarantine decisions," Journal of Economic Theory, Elsevier, vol. 198(C).
    12. Lisa M. Maillart & Xiang Fang, 2006. "Optimal maintenance policies for serial, multi‐machine systems with non‐instantaneous repairs," Naval Research Logistics (NRL), John Wiley & Sons, vol. 53(8), pages 804-813, December.
    13. Olde Keizer, Minou C.A. & Flapper, Simme Douwe P. & Teunter, Ruud H., 2017. "Condition-based maintenance policies for systems with multiple dependent components: A review," European Journal of Operational Research, Elsevier, vol. 261(2), pages 405-420.
    14. Olde Keizer, Minou C.A. & Teunter, Ruud H. & Veldman, Jasper, 2016. "Clustering condition-based maintenance for systems with redundancy and economic dependencies," European Journal of Operational Research, Elsevier, vol. 251(2), pages 531-540.
    15. Y-H Kim & L C Thomas, 2006. "Repair strategies in an uncertain environment: Markov decision process approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(8), pages 957-964, August.
    16. Alireza Sabouri & Woonghee Tim Huh & Steven M. Shechter, 2017. "Screening Strategies for Patients on the Kidney Transplant Waiting List," Operations Research, INFORMS, vol. 65(5), pages 1131-1146, October.
    17. Yeek-Hyun Kim & Lyn Thomas, 2013. "Training and repair policies for stand-by systems," Annals of Operations Research, Springer, vol. 208(1), pages 469-487, September.
    18. Retsef Levi & Thomas Magnanti & Yaron Shaposhnik, 2019. "Scheduling with Testing," Management Science, INFORMS, vol. 65(2), pages 776-793, February.
    19. Schneider, Kellie & Richard Cassady, C., 2015. "Evaluation and comparison of alternative fleet-level selective maintenance models," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 178-187.
    20. Steven M. Shechter & Matthew D. Bailey & Andrew J. Schaefer, 2008. "Replacing nonidentical vital components to extend system life," Naval Research Logistics (NRL), John Wiley & Sons, vol. 55(7), pages 700-703, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oxf:wpaper:1009. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anne Pouliquen (email available below). General contact details of provider: https://edirc.repec.org/data/sfeixuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.