IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v63y2024i6d10.1007_s10614-023-10407-1.html
   My bibliography  Save this article

A Hybrid Parallel Processing Strategy for Large-Scale DEA Computation

Author

Listed:
  • Shengqing Chang

    (Hefei University of Technology)

  • Jingjing Ding

    (Hefei University of Technology
    Intelligent Interconnection System Anhui Provincial Laboratory
    (Hefei University of Technology), Ministry of Education)

  • Chenpeng Feng

    (Hefei University of Technology
    Intelligent Interconnection System Anhui Provincial Laboratory
    (Hefei University of Technology), Ministry of Education)

  • Ruifeng Wang

    (SPD Bank)

Abstract

Using data envelopment analysis (DEA) with large-scale data poses a big challenge to applications due to its computing-intensive nature. So far, various strategies have been proposed in academia to accelerate the DEA computation, including DEA algorithms such as hierarchical decomposition (HD), DEA enhancements such as restricted basis entry (RBE) and LP accelerators such as hot starts. However, few studies have integrated these strategies and combined them with a parallel processing framework to solve large-scale DEA problems. In this paper, a hybrid parallel DEA algorithm (named PRHH algorithm) is proposed, including the RBE algorithm, hot starts, and HD algorithm based on Message Passing Interface (MPI). Furthermore, the attribute of the PRHH algorithm is analyzed, and formalized as a computing time function, to shed light on its time complexity. Finally, the performance of the algorithm is investigated in various simulation scenarios with datasets of different characteristics and compared with existing methods. The results show that the proposed algorithm reduces computing time in general, and boosts performance dramatically in scenarios with low density in particular.

Suggested Citation

  • Shengqing Chang & Jingjing Ding & Chenpeng Feng & Ruifeng Wang, 2024. "A Hybrid Parallel Processing Strategy for Large-Scale DEA Computation," Computational Economics, Springer;Society for Computational Economics, vol. 63(6), pages 2325-2349, June.
    • Handle: RePEc:kap:compec:v:63:y:2024:i:6:d:10.1007_s10614-023-10407-1
    DOI: 10.1007/s10614-023-10407-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-023-10407-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-023-10407-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chen, Yao & Iqbal Ali, Agha, 2002. "Output-input ratio analysis and DEA frontier," European Journal of Operational Research, Elsevier, vol. 142(3), pages 476-479, November.
    2. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    3. Richard Barr & Matthew Durchholz, 1997. "Parallel and hierarchical decomposition approaches for solving large-scale Data Envelopment Analysis models," Annals of Operations Research, Springer, vol. 73(0), pages 339-372, October.
    4. Wen-Chih Chen & Sheng-Yung Lai, 2017. "Determining radial efficiency with a large data set by solving small-size linear programs," Annals of Operations Research, Springer, vol. 250(1), pages 147-166, March.
    5. Dula, J. H. & Helgason, R. V., 1996. "A new procedure for identifying the frame of the convex hull of a finite collection of points in multidimensional space," European Journal of Operational Research, Elsevier, vol. 92(2), pages 352-367, July.
    6. Tao Jie, 2020. "Parallel processing of the Build Hull algorithm to address the large-scale DEA problem," Annals of Operations Research, Springer, vol. 295(1), pages 453-481, December.
    7. Yande Gong & Joe Zhu & Ya Chen & Wade D. Cook, 2018. "DEA as a tool for auditing: application to Chinese manufacturing industry with parallel network structures," Annals of Operations Research, Springer, vol. 263(1), pages 247-269, April.
    8. J. H. Dulá & R. V. Helgason & N. Venugopal, 1998. "An Algorithm for Identifying the Frame of a Pointed Finite Conical Hull," INFORMS Journal on Computing, INFORMS, vol. 10(3), pages 323-330, August.
    9. Shaojian Qu & Lei Xu & Sachin Kumar Mangla & Felix T. S. Chan & Jianli Zhu & Sobhan Arisian, 2022. "Matchmaking in reward-based crowdfunding platforms: a hybrid machine learning approach," International Journal of Production Research, Taylor & Francis Journals, vol. 60(24), pages 7551-7571, December.
    10. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    11. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    12. Ali, Agha Iqbal, 1993. "Streamlined computation for data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 64(1), pages 61-67, January.
    13. Shaojian Qu & Can Feng & Shan Jiang & Jinpeng Wei & Yuting Xu, 2022. "Data-Driven Robust DEA Models for Measuring Operational Efficiency of Endowment Insurance System of Different Provinces in China," Sustainability, MDPI, vol. 14(16), pages 1-21, August.
    14. Shaojian Qu & Yuting Xu & Ying Ji & Can Feng & Jinpeng Wei & Shan Jiang, 2022. "Data-Driven Robust Data Envelopment Analysis for Evaluating the Carbon Emissions Efficiency of Provinces in China," Sustainability, MDPI, vol. 14(20), pages 1-26, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Khezrimotlagh, Dariush & Zhu, Joe & Cook, Wade D. & Toloo, Mehdi, 2019. "Data envelopment analysis and big data," European Journal of Operational Research, Elsevier, vol. 274(3), pages 1047-1054.
    2. Chu, Junfei & Rui, Yuting & Khezrimotlagh, Dariush & Zhu, Joe, 2024. "A general computational framework and a hybrid algorithm for large-scale data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 316(2), pages 639-650.
    3. Wen-Chih Chen & Sheng-Yung Lai, 2017. "Determining radial efficiency with a large data set by solving small-size linear programs," Annals of Operations Research, Springer, vol. 250(1), pages 147-166, March.
    4. J. H. Dulá, 2011. "An Algorithm for Data Envelopment Analysis," INFORMS Journal on Computing, INFORMS, vol. 23(2), pages 284-296, May.
    5. Tao Jie, 2020. "Parallel processing of the Build Hull algorithm to address the large-scale DEA problem," Annals of Operations Research, Springer, vol. 295(1), pages 453-481, December.
    6. Valentin Zelenyuk, 2019. "Data Envelopment Analysis and Business Analytics: The Big Data Challenges and Some Solutions," CEPA Working Papers Series WP072019, School of Economics, University of Queensland, Australia.
    7. López, Francisco J., 2011. "Generalizing cross redundancy in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 214(3), pages 716-721, November.
    8. Zelenyuk, Valentin, 2020. "Aggregation of inputs and outputs prior to Data Envelopment Analysis under big data," European Journal of Operational Research, Elsevier, vol. 282(1), pages 172-187.
    9. Khezrimotlagh, Dariush & Cook, Wade D. & Zhu, Joe, 2020. "A nonparametric framework to detect outliers in estimating production frontiers," European Journal of Operational Research, Elsevier, vol. 286(1), pages 375-388.
    10. Alperovych, Yan & Hübner, Georges & Lobet, Fabrice, 2015. "How does governmental versus private venture capital backing affect a firm's efficiency? Evidence from Belgium," Journal of Business Venturing, Elsevier, vol. 30(4), pages 508-525.
    11. Peter Fernandes Wanke & Rebecca de Mattos, 2014. "Capacity Issues and Efficiency Drivers in Brazilian Bulk Terminals," Brazilian Business Review, Fucape Business School, vol. 11(5), pages 72-98, October.
    12. Jin XU & Panagiotis ZERVOPOULOS & Zhenhua QIAN & Gang CHENG, 2012. "A Universal Solution For Units - Invariance In Data Envelopment Analysis," Theoretical and Practical Research in the Economic Fields, ASERS Publishing, vol. 3(2), pages 121-128.
    13. Martin Eling, 2006. "Performance measurement of hedge funds using data envelopment analysis," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 20(4), pages 442-471, December.
    14. Alexandr Gedranovich & Mykhaylo Salnykov, 2012. "Productivity analysis of Belarusian higher education system," BEROC Working Paper Series 16, Belarusian Economic Research and Outreach Center (BEROC).
    15. Peyrache, Antonio & Rose, Christiern & Sicilia, Gabriela, 2020. "Variable selection in Data Envelopment Analysis," European Journal of Operational Research, Elsevier, vol. 282(2), pages 644-659.
    16. Yang, Guo-liang & Fukuyama, Hirofumi & Chen, Kun, 2019. "Investigating the regional sustainable performance of the Chinese real estate industry: A slack-based DEA approach," Omega, Elsevier, vol. 84(C), pages 141-159.
    17. Tao Ding & Ya Chen & Huaqing Wu & Yuqi Wei, 2018. "Centralized fixed cost and resource allocation considering technology heterogeneity: a DEA approach," Annals of Operations Research, Springer, vol. 268(1), pages 497-511, September.
    18. Branda, Martin, 2013. "Diversification-consistent data envelopment analysis with general deviation measures," European Journal of Operational Research, Elsevier, vol. 226(3), pages 626-635.
    19. Yingying Shao & Gongbing Bi & Feng Yang & Qiong Xia, 2018. "Resource allocation for branch network system with considering heterogeneity based on DEA method," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 26(4), pages 1005-1025, December.
    20. Imanirad, Raha & Cook, Wade D. & Aviles-Sacoto, Sonia Valeria & Zhu, Joe, 2015. "Partial input to output impacts in DEA: The case of DMU-specific impacts," European Journal of Operational Research, Elsevier, vol. 244(3), pages 837-844.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:63:y:2024:i:6:d:10.1007_s10614-023-10407-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.