IDEAS home Printed from https://ideas.repec.org/a/spr/operea/v23y2023i1d10.1007_s12351-023-00755-z.html
   My bibliography  Save this article

Exact and stochastic methods for robustness analysis in the context of Imprecise Data Envelopment Analysis

Author

Listed:
  • Anna Labijak-Kowalska

    (Poznań University of Technology)

  • Miłosz Kadziński

    (Poznań University of Technology)

Abstract

We consider the problem of measuring the efficiency of decision-making units with a ratio-based model. In this perspective, we introduce a framework for robustness analysis that admits both interval and ordinal performances on inputs and outputs. The proposed methodology exploits the uncertainty related to the imprecise data and all feasible input/output weight vectors delimited through linear constraints. We offer methods for verifying the robustness of three types of outcomes: efficiency scores, efficiency preference relations, and efficiency ranks. On the one hand, we formulate mathematical programming models to compute the extreme, necessary, and possible results. On the other hand, we incorporate the stochastic analysis driven by the Monte Carlo simulations to derive the probability distribution of different outcomes. The framework is implemented in R and made available on open-source software. Its use is illustrated in two case studies concerning Chinese ports or industrial robots.

Suggested Citation

  • Anna Labijak-Kowalska & Miłosz Kadziński, 2023. "Exact and stochastic methods for robustness analysis in the context of Imprecise Data Envelopment Analysis," Operational Research, Springer, vol. 23(1), pages 1-34, March.
    • Handle: RePEc:spr:operea:v:23:y:2023:i:1:d:10.1007_s12351-023-00755-z
    DOI: 10.1007/s12351-023-00755-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12351-023-00755-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12351-023-00755-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Risto Lahdelma & Pekka Salminen, 2001. "SMAA-2: Stochastic Multicriteria Acceptability Analysis for Group Decision Making," Operations Research, INFORMS, vol. 49(3), pages 444-454, June.
    2. Azadi, Majid & Farzipoor Saen, Reza, 2013. "A combination of QFD and imprecise DEA with enhanced Russell graph measure: A case study in healthcare," Socio-Economic Planning Sciences, Elsevier, vol. 47(4), pages 281-291.
    3. A. Hadi‐Vencheh & R. Kazemi Matin, 2011. "An application of IDEA to wheat farming efficiency," Agricultural Economics, International Association of Agricultural Economists, vol. 42(4), pages 487-493, July.
    4. Bohlool Ebrahimi & Mehdi Toloo, 2020. "Efficiency bounds and efficiency classifications in imprecise DEA: An extension," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 71(3), pages 491-504, March.
    5. Kadziński, Miłosz & Tervonen, Tommi, 2013. "Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements," European Journal of Operational Research, Elsevier, vol. 228(1), pages 169-180.
    6. Yongjun Shen & Elke Hermans & Tom Brijs & Geert Wets, 2013. "Data Envelopment Analysis for Composite Indicators: A Multiple Layer Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(2), pages 739-756, November.
    7. William W. Cooper & Kyung Sam Park & Gang Yu, 1999. "IDEA and AR-IDEA: Models for Dealing with Imprecise Data in DEA," Management Science, INFORMS, vol. 45(4), pages 597-607, April.
    8. Lahdelma, Risto & Miettinen, Kaisa & Salminen, Pekka, 2003. "Ordinal criteria in stochastic multicriteria acceptability analysis (SMAA)," European Journal of Operational Research, Elsevier, vol. 147(1), pages 117-127, May.
    9. Kao, Chiang, 2006. "Interval efficiency measures in data envelopment analysis with imprecise data," European Journal of Operational Research, Elsevier, vol. 174(2), pages 1087-1099, October.
    10. Jie Wu & Yafei Yu & Qingyuan Zhu & Qingxian An & Liang Liang, 2018. "Closest target for the orientation-free context-dependent DEA under variable returns to scale," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 69(11), pages 1819-1833, November.
    11. Seiford, Lawrence M. & Zhu, Joe, 1998. "Stability regions for maintaining efficiency in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 108(1), pages 127-139, July.
    12. Zhu, Joe, 1996. "Robustness of the efficient DMUs in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 90(3), pages 451-460, May.
    13. Chen, Lei & Wang, Ying-Ming, 2020. "DEA target setting approach within the cross efficiency framework," Omega, Elsevier, vol. 96(C).
    14. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "A survey of DEA applications," Omega, Elsevier, vol. 41(5), pages 893-902.
    15. Despotis, Dimitris K. & Smirlis, Yiannis G., 2002. "Data envelopment analysis with imprecise data," European Journal of Operational Research, Elsevier, vol. 140(1), pages 24-36, July.
    16. K S Park, 2007. "Efficiency bounds and efficiency classifications in DEA with imprecise data," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(4), pages 533-540, April.
    17. Salvatore Corrente & Salvatore Greco & Roman Słowiński, 2017. "Handling imprecise evaluations in multiple criteria decision aiding and robust ordinal regression by n-point intervals," Fuzzy Optimization and Decision Making, Springer, vol. 16(2), pages 127-157, June.
    18. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    19. William W. Cooper & Kyung Sam Park & Gang Yu, 2001. "An Illustrative Application of Idea (Imprecise Data Envelopment Analysis) to a Korean Mobile Telecommunication Company," Operations Research, INFORMS, vol. 49(6), pages 807-820, December.
    20. M C Gouveia & L C Dias & C H Antunes, 2008. "Additive DEA based on MCDA with imprecise information," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(1), pages 54-63, January.
    21. Zhu, Joe, 2003. "Imprecise data envelopment analysis (IDEA): A review and improvement with an application," European Journal of Operational Research, Elsevier, vol. 144(3), pages 513-529, February.
    22. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    23. Shaher Z. Zahran & Jobair Bin Alam & Abdulrahem H. Al-Zahrani & Yiannis Smirlis & Stratos Papadimitriou & Vangelis Tsioumas, 2020. "Analysis of port efficiency using imprecise and incomplete data," Operational Research, Springer, vol. 20(1), pages 219-246, March.
    24. Juan Aparicio & José Ruiz & Inmaculada Sirvent, 2007. "Closest targets and minimum distance to the Pareto-efficient frontier in DEA," Journal of Productivity Analysis, Springer, vol. 28(3), pages 209-218, December.
    25. Tervonen, Tommi & Lahdelma, Risto, 2007. "Implementing stochastic multicriteria acceptability analysis," European Journal of Operational Research, Elsevier, vol. 178(2), pages 500-513, April.
    26. Kao, Chiang & Liu, Shiang-Tai, 2009. "Stochastic data envelopment analysis in measuring the efficiency of Taiwan commercial banks," European Journal of Operational Research, Elsevier, vol. 196(1), pages 312-322, July.
    27. Widiarto, Indra & Emrouznejad, Ali, 2015. "Social and financial efficiency of Islamic microfinance institutions: A Data Envelopment Analysis application," Socio-Economic Planning Sciences, Elsevier, vol. 50(C), pages 1-17.
    28. Adler, Nicole & Friedman, Lea & Sinuany-Stern, Zilla, 2002. "Review of ranking methods in the data envelopment analysis context," European Journal of Operational Research, Elsevier, vol. 140(2), pages 249-265, July.
    29. Bohlool Ebrahimi & Madjid Tavana & Andreas Kleine & Andreas Dellnitz, 2021. "An epsilon-based data envelopment analysis approach for solving performance measurement problems with interval and ordinal dual-role factors," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 43(4), pages 1103-1124, December.
    30. F. Hosseinzadeh Lotfi & G. R. Jahanshahloo & M. Khodabakhshi & M. Rostamy-Malkhlifeh & Z. Moghaddas & M. Vaez-Ghasemi, 2013. "A Review of Ranking Models in Data Envelopment Analysis," Journal of Applied Mathematics, Hindawi, vol. 2013, pages 1-20, July.
    31. Lahdelma, Risto & Salminen, Pekka, 2006. "Stochastic multicriteria acceptability analysis using the data envelopment model," European Journal of Operational Research, Elsevier, vol. 170(1), pages 241-252, April.
    32. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    33. Aparicio, Juan & Cordero, Jose M. & Ortiz, Lidia, 2019. "Measuring efficiency in education: The influence of imprecision and variability in data on DEA estimates," Socio-Economic Planning Sciences, Elsevier, vol. 68(C).
    34. Kadziński, MiŁosz & Greco, Salvatore & SŁowiński, Roman, 2012. "Extreme ranking analysis in robust ordinal regression," Omega, Elsevier, vol. 40(4), pages 488-501.
    35. Greco, Salvatore & Mousseau, Vincent & Slowinski, Roman, 2008. "Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions," European Journal of Operational Research, Elsevier, vol. 191(2), pages 416-436, December.
    36. Tervonen, Tommi & van Valkenhoef, Gert & Baştürk, Nalan & Postmus, Douwe, 2013. "Hit-And-Run enables efficient weight generation for simulation-based multiple criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 224(3), pages 552-559.
    37. Ciomek, Krzysztof & Ferretti, Valentina & Kadzinski, Milosz, 2018. "Predictive analytics and disused railways requalification: insights from a Post Factum Analysis perspective," LSE Research Online Documents on Economics 85922, London School of Economics and Political Science, LSE Library.
    38. Kadziński, Miłosz & Labijak, Anna & Napieraj, Małgorzata, 2017. "Integrated framework for robustness analysis using ratio-based efficiency model with application to evaluation of Polish airports," Omega, Elsevier, vol. 67(C), pages 1-18.
    39. M C Gouveia & L C Dias & C H Antunes, 2013. "Super-efficiency and stability intervals in additive DEA," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(1), pages 86-96, January.
    40. SHOKOUHI, Amir H. & HATAMI-MARBINI, Adel & TAVANA, Madjid & SAATI, Saber, 2010. "A robust optimization approach for imprecise data envelopment analysis," LIDAM Reprints CORE 2215, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    41. Joe Zhu, 2014. "Data Envelopment Analysis," International Series in Operations Research & Management Science, in: Quantitative Models for Performance Evaluation and Benchmarking, edition 3, chapter 1, pages 1-9, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Labijak-Kowalska, Anna & Kadziński, Miłosz & Dias, Luis C., 2024. "Robustness analysis for imprecise additive value efficiency analysis with an application to evaluation of special economic zones in Poland," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kadziński, Miłosz & Labijak, Anna & Napieraj, Małgorzata, 2017. "Integrated framework for robustness analysis using ratio-based efficiency model with application to evaluation of Polish airports," Omega, Elsevier, vol. 67(C), pages 1-18.
    2. Labijak-Kowalska, Anna & Kadziński, Miłosz & Dias, Luis C., 2024. "Robustness analysis for imprecise additive value efficiency analysis with an application to evaluation of special economic zones in Poland," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    3. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min, 2016. "Research fronts in data envelopment analysis," Omega, Elsevier, vol. 58(C), pages 33-45.
    4. R. Pelissari & M. C. Oliveira & S. Ben Amor & A. Kandakoglu & A. L. Helleno, 2020. "SMAA methods and their applications: a literature review and future research directions," Annals of Operations Research, Springer, vol. 293(2), pages 433-493, October.
    5. Lampe, Hannes W. & Hilgers, Dennis, 2015. "Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA," European Journal of Operational Research, Elsevier, vol. 240(1), pages 1-21.
    6. Cui, Qiang & Lin, Jing-ling & Jin, Zi-yin, 2020. "Evaluating airline efficiency under “Carbon Neutral Growth from 2020” strategy through a Network Interval Slack-Based Measure," Energy, Elsevier, vol. 193(C).
    7. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore, 2014. "The SMAA-PROMETHEE method," European Journal of Operational Research, Elsevier, vol. 239(2), pages 514-522.
    8. Toloo, Mehdi & Mensah, Emmanuel Kwasi & Salahi, Maziar, 2022. "Robust optimization and its duality in data envelopment analysis," Omega, Elsevier, vol. 108(C).
    9. Shabani, Amir & Visani, Franco & Barbieri, Paolo & Dullaert, Wout & Vigo, Daniele, 2019. "Reliable estimation of suppliers’ total cost of ownership: An imprecise data envelopment analysis model with common weights," Omega, Elsevier, vol. 87(C), pages 57-70.
    10. HATAMI-MARBINI, Adel & AGRELL, Per & AGHAYI, Nazila, 2013. "Imprecise data envelopment analysis for the two-stage process," LIDAM Discussion Papers CORE 2013004, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    11. Park, K. Sam, 2010. "Duality, efficiency computations and interpretations in imprecise DEA," European Journal of Operational Research, Elsevier, vol. 200(1), pages 289-296, January.
    12. Ciomek, Krzysztof & Ferretti, Valentina & Kadzinski, Milosz, 2018. "Predictive analytics and disused railways requalification: insights from a Post Factum Analysis perspective," LSE Research Online Documents on Economics 85922, London School of Economics and Political Science, LSE Library.
    13. Raffaele Lagravinese & Paolo Liberati & Giuliano Resce, 2020. "Measuring Health Inequality in US: A Composite Index Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 147(3), pages 921-946, February.
    14. Juan Carlos Martín & Cira Mendoza & Concepción Román, 2017. "A DEA Travel–Tourism Competitiveness Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 130(3), pages 937-957, February.
    15. Kadziński, Miłosz & Tervonen, Tommi, 2013. "Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements," European Journal of Operational Research, Elsevier, vol. 228(1), pages 169-180.
    16. Liu, Jiapeng & Liao, Xiuwu & Huang, Wei & Liao, Xianzhao, 2019. "Market segmentation: A multiple criteria approach combining preference analysis and segmentation decision," Omega, Elsevier, vol. 83(C), pages 1-13.
    17. Bohlool Ebrahimi & Madjid Tavana & Andreas Kleine & Andreas Dellnitz, 2021. "An epsilon-based data envelopment analysis approach for solving performance measurement problems with interval and ordinal dual-role factors," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 43(4), pages 1103-1124, December.
    18. Govindan, Kannan & Kadziński, Miłosz & Ehling, Ronja & Miebs, Grzegorz, 2019. "Selection of a sustainable third-party reverse logistics provider based on the robustness analysis of an outranking graph kernel conducted with ELECTRE I and SMAA," Omega, Elsevier, vol. 85(C), pages 1-15.
    19. Patrick Gasser & Marco Cinelli & Anna Labijak & Matteo Spada & Peter Burgherr & Miłosz Kadziński & Božidar Stojadinović, 2020. "Quantifying Electricity Supply Resilience of Countries with Robust Efficiency Analysis," Energies, MDPI, vol. 13(7), pages 1-35, March.
    20. Henriques, C.O. & Chavez, J.M. & Gouveia, M.C. & Marcenaro-Gutierrez, O.D., 2022. "Efficiency of secondary schools in Ecuador: A value based DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 82(PA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:operea:v:23:y:2023:i:1:d:10.1007_s12351-023-00755-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.