IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v63y2024i6d10.1007_s10614-023-10407-1.html
   My bibliography  Save this article

A Hybrid Parallel Processing Strategy for Large-Scale DEA Computation

Author

Listed:
  • Shengqing Chang

    (Hefei University of Technology)

  • Jingjing Ding

    (Hefei University of Technology
    Intelligent Interconnection System Anhui Provincial Laboratory
    (Hefei University of Technology), Ministry of Education)

  • Chenpeng Feng

    (Hefei University of Technology
    Intelligent Interconnection System Anhui Provincial Laboratory
    (Hefei University of Technology), Ministry of Education)

  • Ruifeng Wang

    (SPD Bank)

Abstract

Using data envelopment analysis (DEA) with large-scale data poses a big challenge to applications due to its computing-intensive nature. So far, various strategies have been proposed in academia to accelerate the DEA computation, including DEA algorithms such as hierarchical decomposition (HD), DEA enhancements such as restricted basis entry (RBE) and LP accelerators such as hot starts. However, few studies have integrated these strategies and combined them with a parallel processing framework to solve large-scale DEA problems. In this paper, a hybrid parallel DEA algorithm (named PRHH algorithm) is proposed, including the RBE algorithm, hot starts, and HD algorithm based on Message Passing Interface (MPI). Furthermore, the attribute of the PRHH algorithm is analyzed, and formalized as a computing time function, to shed light on its time complexity. Finally, the performance of the algorithm is investigated in various simulation scenarios with datasets of different characteristics and compared with existing methods. The results show that the proposed algorithm reduces computing time in general, and boosts performance dramatically in scenarios with low density in particular.

Suggested Citation

  • Shengqing Chang & Jingjing Ding & Chenpeng Feng & Ruifeng Wang, 2024. "A Hybrid Parallel Processing Strategy for Large-Scale DEA Computation," Computational Economics, Springer;Society for Computational Economics, vol. 63(6), pages 2325-2349, June.
    • Handle: RePEc:kap:compec:v:63:y:2024:i:6:d:10.1007_s10614-023-10407-1
    DOI: 10.1007/s10614-023-10407-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-023-10407-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-023-10407-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    2. Dula, J. H. & Helgason, R. V., 1996. "A new procedure for identifying the frame of the convex hull of a finite collection of points in multidimensional space," European Journal of Operational Research, Elsevier, vol. 92(2), pages 352-367, July.
    3. Tao Jie, 2020. "Parallel processing of the Build Hull algorithm to address the large-scale DEA problem," Annals of Operations Research, Springer, vol. 295(1), pages 453-481, December.
    4. Yande Gong & Joe Zhu & Ya Chen & Wade D. Cook, 2018. "DEA as a tool for auditing: application to Chinese manufacturing industry with parallel network structures," Annals of Operations Research, Springer, vol. 263(1), pages 247-269, April.
    5. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    6. Chen, Yao & Iqbal Ali, Agha, 2002. "Output-input ratio analysis and DEA frontier," European Journal of Operational Research, Elsevier, vol. 142(3), pages 476-479, November.
    7. Richard Barr & Matthew Durchholz, 1997. "Parallel and hierarchical decomposition approaches for solving large-scale Data Envelopment Analysis models," Annals of Operations Research, Springer, vol. 73(0), pages 339-372, October.
    8. Wen-Chih Chen & Sheng-Yung Lai, 2017. "Determining radial efficiency with a large data set by solving small-size linear programs," Annals of Operations Research, Springer, vol. 250(1), pages 147-166, March.
    9. J. H. Dulá & R. V. Helgason & N. Venugopal, 1998. "An Algorithm for Identifying the Frame of a Pointed Finite Conical Hull," INFORMS Journal on Computing, INFORMS, vol. 10(3), pages 323-330, August.
    10. Shaojian Qu & Lei Xu & Sachin Kumar Mangla & Felix T. S. Chan & Jianli Zhu & Sobhan Arisian, 2022. "Matchmaking in reward-based crowdfunding platforms: a hybrid machine learning approach," International Journal of Production Research, Taylor & Francis Journals, vol. 60(24), pages 7551-7571, December.
    11. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    12. Ali, Agha Iqbal, 1993. "Streamlined computation for data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 64(1), pages 61-67, January.
    13. Shaojian Qu & Can Feng & Shan Jiang & Jinpeng Wei & Yuting Xu, 2022. "Data-Driven Robust DEA Models for Measuring Operational Efficiency of Endowment Insurance System of Different Provinces in China," Sustainability, MDPI, vol. 14(16), pages 1-21, August.
    14. Shaojian Qu & Yuting Xu & Ying Ji & Can Feng & Jinpeng Wei & Shan Jiang, 2022. "Data-Driven Robust Data Envelopment Analysis for Evaluating the Carbon Emissions Efficiency of Provinces in China," Sustainability, MDPI, vol. 14(20), pages 1-26, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chu, Junfei & Rui, Yuting & Khezrimotlagh, Dariush & Zhu, Joe, 2024. "A general computational framework and a hybrid algorithm for large-scale data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 316(2), pages 639-650.
    2. Khezrimotlagh, Dariush & Zhu, Joe & Cook, Wade D. & Toloo, Mehdi, 2019. "Data envelopment analysis and big data," European Journal of Operational Research, Elsevier, vol. 274(3), pages 1047-1054.
    3. Zelenyuk, Valentin, 2020. "Aggregation of inputs and outputs prior to Data Envelopment Analysis under big data," European Journal of Operational Research, Elsevier, vol. 282(1), pages 172-187.
    4. Wen-Chih Chen & Sheng-Yung Lai, 2017. "Determining radial efficiency with a large data set by solving small-size linear programs," Annals of Operations Research, Springer, vol. 250(1), pages 147-166, March.
    5. J. H. Dulá, 2011. "An Algorithm for Data Envelopment Analysis," INFORMS Journal on Computing, INFORMS, vol. 23(2), pages 284-296, May.
    6. Tao Jie, 2020. "Parallel processing of the Build Hull algorithm to address the large-scale DEA problem," Annals of Operations Research, Springer, vol. 295(1), pages 453-481, December.
    7. Valentin Zelenyuk, 2019. "Data Envelopment Analysis and Business Analytics: The Big Data Challenges and Some Solutions," CEPA Working Papers Series WP072019, School of Economics, University of Queensland, Australia.
    8. López, Francisco J., 2011. "Generalizing cross redundancy in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 214(3), pages 716-721, November.
    9. Khezrimotlagh, Dariush & Cook, Wade D. & Zhu, Joe, 2020. "A nonparametric framework to detect outliers in estimating production frontiers," European Journal of Operational Research, Elsevier, vol. 286(1), pages 375-388.
    10. Martin Eling, 2006. "Performance measurement of hedge funds using data envelopment analysis," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 20(4), pages 442-471, December.
    11. Peyrache, Antonio & Rose, Christiern & Sicilia, Gabriela, 2020. "Variable selection in Data Envelopment Analysis," European Journal of Operational Research, Elsevier, vol. 282(2), pages 644-659.
    12. Yang, Guo-liang & Fukuyama, Hirofumi & Chen, Kun, 2019. "Investigating the regional sustainable performance of the Chinese real estate industry: A slack-based DEA approach," Omega, Elsevier, vol. 84(C), pages 141-159.
    13. Imanirad, Raha & Cook, Wade D. & Aviles-Sacoto, Sonia Valeria & Zhu, Joe, 2015. "Partial input to output impacts in DEA: The case of DMU-specific impacts," European Journal of Operational Research, Elsevier, vol. 244(3), pages 837-844.
    14. Cheng, Gang & Qian, Zhenhua, 2011. "Dea数据标准化方法及其在方向距离函数模型中的应用 [Data normalization for data envelopment analysis and its application to directional distance function]," MPRA Paper 31995, University Library of Munich, Germany.
    15. Anna Ćwiąkała-Małys & Violetta Nowak, 2009. "Classification of Data Envelopment Analysis models," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 19(3), pages 5-18.
    16. Hatami-Marbini, Adel & Emrouznejad, Ali & Tavana, Madjid, 2011. "A taxonomy and review of the fuzzy data envelopment analysis literature: Two decades in the making," European Journal of Operational Research, Elsevier, vol. 214(3), pages 457-472, November.
    17. Premachandra, I. M., 2001. "A note on DEA vs principal component analysis: An improvement to Joe Zhu's approach," European Journal of Operational Research, Elsevier, vol. 132(3), pages 553-560, August.
    18. Vicente J. Bolós & Rafael Benítez & Vicente Coll-Serrano, 2023. "Continuous models combining slacks-based measures of efficiency and super-efficiency," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 31(2), pages 363-391, June.
    19. Qing Yang & Lingmei Fu & Xingxing Liu & Mengying Cheng, 2018. "Evaluating the Efficiency of Municipal Solid Waste Management in China," IJERPH, MDPI, vol. 15(11), pages 1-23, November.
    20. M. Foddi & S. Usai, 2012. "Regional innovation performance in Europe," Working Paper CRENoS 201221, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:63:y:2024:i:6:d:10.1007_s10614-023-10407-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.