IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v305y2023i2p838-852.html
   My bibliography  Save this article

To do or not to do? Cost-sensitive causal classification with individual treatment effect estimates

Author

Listed:
  • Verbeke, Wouter
  • Olaya, Diego
  • Guerry, Marie-Anne
  • Van Belle, Jente

Abstract

Individual treatment effect models allow optimizing decision-making by predicting the effect of a treatment on an outcome of interest for individual instances. These predictions allow selecting instances to treat in order to optimize the overall efficiency and net treatment effect. In this article, we extend upon the expected value framework and introduce a cost-sensitive causal classification boundary for selecting instances to treat based on predictions of individual treatment effects and for the case of a binary outcome. The boundary is a linear function of the estimated individual treatment effect, the positive outcome probability and the cost and benefit parameters of the problem setting. It allows causally classifying instances in the positive and negative treatment class in order to maximize the expected causal profit, which is introduced as the objective at hand in cost-sensitive causal classification. We present the expected causal profit ranker which ranks instances for maximizing the expected causal profit at each possible threshold that results from a constraint on the number of positive treatments and which differs from the conventional ranking approach based on the individual treatment effect. The proposed ranking approach is experimentally evaluated on synthetic and marketing campaign data sets. The results indicate that the presented ranking method outperforms the cost-insensitive ranking approach.

Suggested Citation

  • Verbeke, Wouter & Olaya, Diego & Guerry, Marie-Anne & Van Belle, Jente, 2023. "To do or not to do? Cost-sensitive causal classification with individual treatment effect estimates," European Journal of Operational Research, Elsevier, vol. 305(2), pages 838-852.
  • Handle: RePEc:eee:ejores:v:305:y:2023:i:2:p:838-852
    DOI: 10.1016/j.ejor.2022.03.049
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221722002739
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2022.03.049?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Haupt, Johannes & Lessmann, Stefan, 2022. "Targeting customers under response-dependent costs," European Journal of Operational Research, Elsevier, vol. 297(1), pages 369-379.
    2. Höppner, Sebastiaan & Baesens, Bart & Verbeke, Wouter & Verdonck, Tim, 2022. "Instance-dependent cost-sensitive learning for detecting transfer fraud," European Journal of Operational Research, Elsevier, vol. 297(1), pages 291-300.
    3. Michael C Knaus & Michael Lechner & Anthony Strittmatter, 2021. "Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 134-161.
    4. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    5. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    6. Evy Rombaut & Marie-Anne Guerry, 2020. "The effectiveness of employee retention through an uplift modeling approach," International Journal of Manpower, Emerald Group Publishing Limited, vol. 41(8), pages 1199-1220, April.
    7. Gubela, Robin M. & Lessmann, Stefan & Jaroszewicz, Szymon, 2020. "Response transformation and profit decomposition for revenue uplift modeling," European Journal of Operational Research, Elsevier, vol. 283(2), pages 647-661.
    8. Verbeke, Wouter & Dejaeger, Karel & Martens, David & Hur, Joon & Baesens, Bart, 2012. "New insights into churn prediction in the telecommunication sector: A profit driven data mining approach," European Journal of Operational Research, Elsevier, vol. 218(1), pages 211-229.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bokelmann, Björn & Lessmann, Stefan, 2024. "Improving uplift model evaluation on randomized controlled trial data," European Journal of Operational Research, Elsevier, vol. 313(2), pages 691-707.
    2. Vairetti, Carla & Gennaro, Franco & Maldonado, Sebastián, 2024. "Propensity score oversampling and matching for uplift modeling," European Journal of Operational Research, Elsevier, vol. 316(3), pages 1058-1069.
    3. Christopher Bockel-Rickermann & Sam Verboven & Tim Verdonck & Wouter Verbeke, 2023. "A Causal Perspective on Loan Pricing: Investigating the Impacts of Selection Bias on Identifying Bid-Response Functions," Papers 2309.03730, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bokelmann, Björn & Lessmann, Stefan, 2024. "Improving uplift model evaluation on randomized controlled trial data," European Journal of Operational Research, Elsevier, vol. 313(2), pages 691-707.
    2. Haupt, Johannes & Lessmann, Stefan, 2022. "Targeting customers under response-dependent costs," European Journal of Operational Research, Elsevier, vol. 297(1), pages 369-379.
    3. Gabriel Okasa, 2022. "Meta-Learners for Estimation of Causal Effects: Finite Sample Cross-Fit Performance," Papers 2201.12692, arXiv.org.
    4. Davide Viviano & Jelena Bradic, 2019. "Synthetic learner: model-free inference on treatments over time," Papers 1904.01490, arXiv.org, revised Aug 2022.
    5. Daniel Goller, 2023. "Analysing a built-in advantage in asymmetric darts contests using causal machine learning," Annals of Operations Research, Springer, vol. 325(1), pages 649-679, June.
    6. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    7. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    8. Cockx, Bart & Lechner, Michael & Bollens, Joost, 2023. "Priority to unemployed immigrants? A causal machine learning evaluation of training in Belgium," Labour Economics, Elsevier, vol. 80(C).
    9. Daniel Jacob, 2021. "CATE meets ML -- The Conditional Average Treatment Effect and Machine Learning," Papers 2104.09935, arXiv.org, revised Apr 2021.
    10. Boller, Daniel & Lechner, Michael & Okasa, Gabriel, 2021. "The Effect of Sport in Online Dating: Evidence from Causal Machine Learning," Economics Working Paper Series 2104, University of St. Gallen, School of Economics and Political Science.
    11. Phillip Heiler & Michael C. Knaus, 2021. "Effect or Treatment Heterogeneity? Policy Evaluation with Aggregated and Disaggregated Treatments," Papers 2110.01427, arXiv.org, revised Aug 2023.
    12. Goller, Daniel & Lechner, Michael & Moczall, Andreas & Wolff, Joachim, 2020. "Does the estimation of the propensity score by machine learning improve matching estimation? The case of Germany's programmes for long term unemployed," Labour Economics, Elsevier, vol. 65(C).
    13. Daniel Goller & Tamara Harrer & Michael Lechner & Joachim Wolff, 2021. "Active labour market policies for the long-term unemployed: New evidence from causal machine learning," Papers 2106.10141, arXiv.org, revised May 2023.
    14. Axenbeck, Janna & Berner, Anne & Kneib, Thomas, 2022. "What drives the relationship between digitalization and industrial energy demand? Exploring firm-level heterogeneity," ZEW Discussion Papers 22-059, ZEW - Leibniz Centre for European Economic Research.
    15. De Bock, Koen W. & Coussement, Kristof & Caigny, Arno De & Słowiński, Roman & Baesens, Bart & Boute, Robert N. & Choi, Tsan-Ming & Delen, Dursun & Kraus, Mathias & Lessmann, Stefan & Maldonado, Sebast, 2024. "Explainable AI for Operational Research: A defining framework, methods, applications, and a research agenda," European Journal of Operational Research, Elsevier, vol. 317(2), pages 249-272.
    16. Rafael Quintana, 2023. "Embracing complexity in social science research," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 15-38, February.
    17. Koen W. de Bock & Kristof Coussement & Arno De Caigny & Roman Slowiński & Bart Baesens & Robert N Boute & Tsan-Ming Choi & Dursun Delen & Mathias Kraus & Stefan Lessmann & Sebastián Maldonado & David , 2023. "Explainable AI for Operational Research: A Defining Framework, Methods, Applications, and a Research Agenda," Post-Print hal-04219546, HAL.
    18. Kleifgen, Eva & Lang, Julia, 2022. "Should I Train Or Should I Go? Estimating Treatment Effects of Retraining on Regional and Occupational Mobility," VfS Annual Conference 2022 (Basel): Big Data in Economics 264069, Verein für Socialpolitik / German Economic Association.
    19. Di Fang & Michael R. Thomsen & Rodolfo M. Nayga & Aaron M. Novotny, 2019. "WIC Participation and Relative Quality of Household Food Purchases: Evidence from FoodAPS," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 83-105, July.
    20. Santiago Carbo-Valverde & Pedro Cuadros-Solas & Francisco Rodríguez-Fernández, 2020. "A machine learning approach to the digitalization of bank customers: Evidence from random and causal forests," PLOS ONE, Public Library of Science, vol. 15(10), pages 1-39, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:305:y:2023:i:2:p:838-852. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.