IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v315y2024i3p1083-1095.html
   My bibliography  Save this article

Counterfactual analysis and target setting in benchmarking

Author

Listed:
  • Bogetoft, Peter
  • Ramírez-Ayerbe, Jasone
  • Romero Morales, Dolores

Abstract

Data Envelopment Analysis (DEA) allows us to capture the complex relationship between multiple inputs and outputs in firms and organizations. Unfortunately, managers may find it hard to understand a DEA model and this may lead to mistrust in the analyses and to difficulties in deriving actionable information from the model. In this paper, we propose to use the ideas of target setting in DEA and of counterfactual analysis in Machine Learning to overcome these problems. We define DEA counterfactuals or targets as alternative combinations of inputs and outputs that are close to the original inputs and outputs of the firm and lead to desired improvements in its performance. We formulate the problem of finding counterfactuals as a bilevel optimization model. For a rich class of cost functions, reflecting the effort an inefficient firm will need to spend to change to its counterfactual, finding counterfactual explanations boils down to solving Mixed Integer Convex Quadratic Problems with linear constraints. We illustrate our approach using both a small numerical example and a real-world dataset on banking branches.

Suggested Citation

  • Bogetoft, Peter & Ramírez-Ayerbe, Jasone & Romero Morales, Dolores, 2024. "Counterfactual analysis and target setting in benchmarking," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1083-1095.
  • Handle: RePEc:eee:ejores:v:315:y:2024:i:3:p:1083-1095
    DOI: 10.1016/j.ejor.2024.01.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221724000067
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2024.01.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter Bogetoft & Jens Hougaard, 1999. "Efficiency Evaluations Based on Potential (Non-Proportional) Improvements," Journal of Productivity Analysis, Springer, vol. 12(3), pages 233-247, November.
    2. Kao, Chiang, 2009. "Efficiency decomposition in network data envelopment analysis: A relational model," European Journal of Operational Research, Elsevier, vol. 192(3), pages 949-962, February.
    3. R. Färe & S. Grosskopf & G. Whittaker, 2013. "Directional output distance functions: endogenous directions based on exogenous normalization constraints," Journal of Productivity Analysis, Springer, vol. 40(3), pages 267-269, December.
    4. Laurens Cherchye & Bram De Rock & Bart Dierynck & Filip Roodhooft & Jeroen Sabbe, 2013. "Opening the “Black Box” of Efficiency Measurement: Input Allocation in Multioutput Settings," Operations Research, INFORMS, vol. 61(5), pages 1148-1165, October.
    5. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    6. Haney, Aoife Brophy & Pollitt, Michael G., 2009. "Efficiency analysis of energy networks: An international survey of regulators," Energy Policy, Elsevier, vol. 37(12), pages 5814-5830, December.
    7. Aparicio, Juan & Cordero, Jose M. & Pastor, Jesus T., 2017. "The determination of the least distance to the strongly efficient frontier in Data Envelopment Analysis oriented models: Modelling and computational aspects," Omega, Elsevier, vol. 71(C), pages 1-10.
    8. Maria Silva Portela & Pedro Borges & Emmanuel Thanassoulis, 2003. "Finding Closest Targets in Non-Oriented DEA Models: The Case of Convex and Non-Convex Technologies," Journal of Productivity Analysis, Springer, vol. 19(2), pages 251-269, April.
    9. Christopher F. Parmeter & Valentin Zelenyuk, 2019. "Combining the Virtues of Stochastic Frontier and Data Envelopment Analysis," Operations Research, INFORMS, vol. 67(6), pages 1628-1658, November.
    10. Färe, Rolf & Pasurka, Carl & Vardanyan, Michael, 2017. "On endogenizing direction vectors in parametric directional distance function-based models," European Journal of Operational Research, Elsevier, vol. 262(1), pages 361-369.
    11. Karen E. Dynan, 2000. "Habit Formation in Consumer Preferences: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 90(3), pages 391-406, June.
    12. Robert E. Hall, 2004. "Measuring Factor Adjustment Costs," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 899-927.
    13. Rick Antle & Peter Bogetoft, 2019. "Mix Stickiness Under Asymmetric Cost Information," Management Science, INFORMS, vol. 67(6), pages 2787-2812, June.
    14. Schaffnit, Claire & Rosen, Dan & Paradi, Joseph C., 1997. "Best practice analysis of bank branches: An application of DEA in a large Canadian bank," European Journal of Operational Research, Elsevier, vol. 98(2), pages 269-289, April.
    15. Jose Zofio & Jesus Pastor & Juan Aparicio, 2013. "The directional profit efficiency measure: on why profit inefficiency is either technical or allocative," Journal of Productivity Analysis, Springer, vol. 40(3), pages 257-266, December.
    16. Juan Aparicio & José Ruiz & Inmaculada Sirvent, 2007. "Closest targets and minimum distance to the Pareto-efficient frontier in DEA," Journal of Productivity Analysis, Springer, vol. 28(3), pages 209-218, December.
    17. Aparicio, Juan & Mahlberg, Bernhard & Pastor, Jesus T. & Sahoo, Biresh K., 2014. "Decomposing technical inefficiency using the principle of least action," European Journal of Operational Research, Elsevier, vol. 239(3), pages 776-785.
    18. Jeffrey C. Fuhrer, 2000. "Habit Formation in Consumption and Its Implications for Monetary-Policy Models," American Economic Review, American Economic Association, vol. 90(3), pages 367-390, June.
    19. Peter Bogetoft & Lars Otto, 2011. "Benchmarking with DEA, SFA, and R," International Series in Operations Research and Management Science, Springer, number 978-1-4419-7961-2, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aparicio, Juan & Cordero, Jose M. & Gonzalez, Martin & Lopez-Espin, Jose J., 2018. "Using non-radial DEA to assess school efficiency in a cross-country perspective: An empirical analysis of OECD countries," Omega, Elsevier, vol. 79(C), pages 9-20.
    2. Fangqing Wei & Junfei Chu & Jiayun Song & Feng Yang, 2019. "A cross-bargaining game approach for direction selection in the directional distance function," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 41(3), pages 787-807, September.
    3. Lozano, Sebastián & Calzada-Infante, Laura, 2018. "Computing gradient-based stepwise benchmarking paths," Omega, Elsevier, vol. 81(C), pages 195-207.
    4. Juan Aparicio & Magdalena Kapelko & Bernhard Mahlberg & Jose L. Sainz-Pardo, 2017. "Measuring input-specific productivity change based on the principle of least action," Journal of Productivity Analysis, Springer, vol. 47(1), pages 17-31, February.
    5. Aparicio, Juan & Pastor, Jesús T. & Vidal, Fernando & Zofío, José L., 2017. "Evaluating productive performance: A new approach based on the product-mix problem consistent with Data Envelopment Analysis," Omega, Elsevier, vol. 67(C), pages 134-144.
    6. Kao, Chiang, 2022. "Closest targets in the slacks-based measure of efficiency for production units with multi-period data," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1042-1054.
    7. Krüger, Jens J., 2018. "Direct targeting of efficient DMUs for benchmarking," International Journal of Production Economics, Elsevier, vol. 199(C), pages 1-6.
    8. Juan Aparicio & Magdalena Kapelko & Juan F. Monge, 2020. "A Well-Defined Composite Indicator: An Application to Corporate Social Responsibility," Journal of Optimization Theory and Applications, Springer, vol. 186(1), pages 299-323, July.
    9. Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada, 2020. "Cross-benchmarking for performance evaluation: Looking across best practices of different peer groups using DEA," Omega, Elsevier, vol. 92(C).
    10. Ke Wang & Yujiao Xian & Chia-Yen Lee & Yi-Ming Wei & Zhimin Huang, 2019. "On selecting directions for directional distance functions in a non-parametric framework: a review," Annals of Operations Research, Springer, vol. 278(1), pages 43-76, July.
    11. Fukuyama, Hirofumi & Matousek, Roman & Tzeremes, Nickolaos G., 2022. "Bank production with nonperforming loans: A minimum distance directional slack inefficiency approach," Omega, Elsevier, vol. 113(C).
    12. Lozano, Sebastián & Khezri, Somayeh, 2021. "Network DEA smallest improvement approach," Omega, Elsevier, vol. 98(C).
    13. Lee, Chia-Yen, 2014. "Meta-data envelopment analysis: Finding a direction towards marginal profit maximization," European Journal of Operational Research, Elsevier, vol. 237(1), pages 207-216.
    14. Aparicio, Juan & Garcia-Nove, Eva M. & Kapelko, Magdalena & Pastor, Jesus T., 2017. "Graph productivity change measure using the least distance to the pareto-efficient frontier in data envelopment analysis," Omega, Elsevier, vol. 72(C), pages 1-14.
    15. Alcaraz, Javier & Anton-Sanchez, Laura & Aparicio, Juan & Monge, Juan F. & Ramón, Nuria, 2021. "Russell Graph efficiency measures in Data Envelopment Analysis: The multiplicative approach," European Journal of Operational Research, Elsevier, vol. 292(2), pages 663-674.
    16. Ruiz, José L. & Sirvent, Inmaculada, 2019. "Performance evaluation through DEA benchmarking adjusted to goals," Omega, Elsevier, vol. 87(C), pages 150-157.
    17. Paradi, Joseph C. & Zhu, Haiyan & Edelstein, Barak, 2012. "Identifying managerial groups in a large Canadian bank branch network with a DEA approach," European Journal of Operational Research, Elsevier, vol. 219(1), pages 178-187.
    18. Mette Asmild & Tomas Baležentis & Jens Leth Hougaard, 2016. "Multi-directional productivity change: MEA-Malmquist," Journal of Productivity Analysis, Springer, vol. 46(2), pages 109-119, December.
    19. Kao, Chiang, 2024. "Maximum slacks-based measure of efficiency in network data envelopment analysis: A case of garment manufacturing," Omega, Elsevier, vol. 123(C).
    20. Somayeh Razipour-GhalehJough & Farhad Hosseinzadeh Lotfi & Gholamreza Jahanshahloo & Mohsen Rostamy-malkhalifeh & Hamid Sharafi, 2020. "Finding closest target for bank branches in the presence of weight restrictions using data envelopment analysis," Annals of Operations Research, Springer, vol. 288(2), pages 755-787, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:315:y:2024:i:3:p:1083-1095. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.