IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v242y2015i2p525-535.html
   My bibliography  Save this article

Evaluation of system efficiency using the Monte Carlo DEA: The case of small health areasAuthor-Name: Torres-Jiménez, Mercedes

Author

Listed:
  • García-Alonso, Carlos R.
  • Salvador-Carulla, Luis
  • Fernández-Rodríguez, Vicente

Abstract

This paper uses Monte Carlo Data Envelopment Analysis (Monte Carlo DEA) to evaluate the relative technical efficiency of small health care areas in probabilistic terms with respect to both mental health care as well as the efficiency of the whole system. Taking into account that the number of areas did not permit maximum discrimination to be achieved, all the scenarios of non-correlated inputs and outputs of a specific size were designed using Monte Carlo Pearson to maximize the discrimination of Monte Carlo DEA and the information included in the models. A knowledge base was included in the simulation engine in order to guide the dynamic interpretation of non-standard inputs and outputs. Results show the probability that all DMU and the whole system have of being efficient, as well as the specific inputs and outputs that make the areas or the system efficient or inefficient, along with a classification of the areas into four groups according to their efficiency (k-means cluster analysis). This final classification was compared with an expert-based classification to validate both the knowledge base and the Monte Carlo DEA model. Both classifications showed results that were very similar although not exactly the same, basically due to the difficulty experts experience in recognizing “intermediately-inefficient” DMU. We propose this methodology as an instrument that could help health care managers to assess relative technical efficiency in complex systems under uncertainty.

Suggested Citation

  • García-Alonso, Carlos R. & Salvador-Carulla, Luis & Fernández-Rodríguez, Vicente, 2015. "Evaluation of system efficiency using the Monte Carlo DEA: The case of small health areasAuthor-Name: Torres-Jiménez, Mercedes," European Journal of Operational Research, Elsevier, vol. 242(2), pages 525-535.
    • Handle: RePEc:eee:ejores:v:242:y:2015:i:2:p:525-535
    DOI: 10.1016/j.ejor.2014.10.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221714008406
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2014.10.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cheng, Gang & Zervopoulos, Panagiotis D., 2014. "Estimating the technical efficiency of health care systems: A cross-country comparison using the directional distance function," European Journal of Operational Research, Elsevier, vol. 238(3), pages 899-910.
    2. Kao, Chiang & Liu, Shiang-Tai, 2009. "Stochastic data envelopment analysis in measuring the efficiency of Taiwan commercial banks," European Journal of Operational Research, Elsevier, vol. 196(1), pages 312-322, July.
    3. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    4. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    5. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    6. Zhu, Joe, 2003. "Imprecise data envelopment analysis (IDEA): A review and improvement with an application," European Journal of Operational Research, Elsevier, vol. 144(3), pages 513-529, February.
    7. Perelman, Sergio & Santín, Daniel, 2009. "How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement," European Journal of Operational Research, Elsevier, vol. 199(1), pages 303-310, November.
    8. Krüger, Jens J., 2012. "A Monte Carlo study of old and new frontier methods for efficiency measurement," European Journal of Operational Research, Elsevier, vol. 222(1), pages 137-148.
    9. O. B. Olesen & N. C. Petersen, 1995. "Chance Constrained Efficiency Evaluation," Management Science, INFORMS, vol. 41(3), pages 442-457, March.
    10. Office of Health Economics, 2007. "The Economics of Health Care," For School 001490, Office of Health Economics.
    11. Fare, Rolf, 1989. "Multilateral Productivity Comparisons When Some Outputs Are Undesirable: A Nonparametric Approach," The Review of Economics and Statistics, MIT Press, vol. 71(1), pages 90-98, February.
    12. Dyson, R. G. & Allen, R. & Camanho, A. S. & Podinovski, V. V. & Sarrico, C. S. & Shale, E. A., 2001. "Pitfalls and protocols in DEA," European Journal of Operational Research, Elsevier, vol. 132(2), pages 245-259, July.
    13. Diego Prior, 2006. "Efficiency and total quality management in health care organizations: A dynamic frontier approach," Annals of Operations Research, Springer, vol. 145(1), pages 281-299, July.
    14. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    15. Cook, Wade D. & Zhu, Joe, 2007. "Classifying inputs and outputs in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 180(2), pages 692-699, July.
    16. Rajiv D. Banker, 1993. "Maximum Likelihood, Consistency and Data Envelopment Analysis: A Statistical Foundation," Management Science, INFORMS, vol. 39(10), pages 1265-1273, October.
    17. Wheelock, David C. & Wilson, Paul W., 2004. "Consolidation in US banking: Which banks engage in mergers?," Review of Financial Economics, Elsevier, vol. 13(1-2), pages 7-39.
    18. John Ruggiero, 2004. "Data envelopment analysis with stochastic data," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(9), pages 1008-1012, September.
    19. Fare, Rolf & Grosskopf, Shawna, 2004. "Modeling undesirable factors in efficiency evaluation: Comment," European Journal of Operational Research, Elsevier, vol. 157(1), pages 242-245, August.
    20. Cook, Wade D. & Zhu, Joe, 2006. "Rank order data in DEA: A general framework," European Journal of Operational Research, Elsevier, vol. 174(2), pages 1021-1038, October.
    21. Atakelty Hailu & Terrence S. Veeman, 2001. "Non-parametric Productivity Analysis with Undesirable Outputs: An Application to the Canadian Pulp and Paper Industry," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 83(3), pages 605-616.
    22. Yasar Ozcan & Marcos Lins & Maria Lobo & Angela da Silva & Roberto Fiszman & Basilio Pereira, 2010. "Evaluating the performance of Brazilian university hospitals," Annals of Operations Research, Springer, vol. 178(1), pages 247-261, July.
    23. Ruggiero, John, 1999. "Efficiency estimation and error decomposition in the stochastic frontier model: A Monte Carlo analysis," European Journal of Operational Research, Elsevier, vol. 115(3), pages 555-563, June.
    24. R G Dyson & E A Shale, 2010. "Data envelopment analysis, operational research and uncertainty," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(1), pages 25-34, January.
    25. David C. Wheelock & Paul W. Wilson, 2004. "Trends in the efficiency of Federal Reserve check processing operations," Review, Federal Reserve Bank of St. Louis, vol. 86(Sep), pages 7-20.
    26. Matthias Staat, 2001. "The Effect of Sample Size on the Mean Efficiency in DEA: Comment," Journal of Productivity Analysis, Springer, vol. 15(2), pages 129-137, March.
    27. Reinhard, Stijn & Knox Lovell, C. A. & Thijssen, Geert J., 2000. "Environmental efficiency with multiple environmentally detrimental variables; estimated with SFA and DEA," European Journal of Operational Research, Elsevier, vol. 121(2), pages 287-303, March.
    28. Jenkins, Larry & Anderson, Murray, 2003. "A multivariate statistical approach to reducing the number of variables in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 147(1), pages 51-61, May.
    29. Seiford, Lawrence M. & Zhu, Joe, 2002. "Modeling undesirable factors in efficiency evaluation," European Journal of Operational Research, Elsevier, vol. 142(1), pages 16-20, October.
    30. Scheel, Holger, 2001. "Undesirable outputs in efficiency valuations," European Journal of Operational Research, Elsevier, vol. 132(2), pages 400-410, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sebastian Kohl & Jan Schoenfelder & Andreas Fügener & Jens O. Brunner, 2019. "The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals," Health Care Management Science, Springer, vol. 22(2), pages 245-286, June.
    2. Nathaniel D. Bastian & Tahir Ekin & Hyojung Kang & Paul M. Griffin & Lawrence V. Fulton & Benjamin C. Grannan, 2017. "Stochastic multi-objective auto-optimization for resource allocation decision-making in fixed-input health systems," Health Care Management Science, Springer, vol. 20(2), pages 246-264, June.
    3. Surakiat PARICHATNON & Kamonthip MAICHUM & Ke-Chung PENG, 2018. "Measuring technical efficiency of Thai rubber production using the three-stage data envelopment analysis," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 64(5), pages 227-240.
    4. Nakamoto, Yuya & Eguchi, Shogo & Takayabu, Hirotaka, 2024. "Efficiency and benchmarks for photovoltaic power generation amid uncertain conditions," Socio-Economic Planning Sciences, Elsevier, vol. 94(C).
    5. Nerea Almeda & Carlos R. García-Alonso & José A. Salinas-Pérez & Mencía R. Gutiérrez-Colosía & Luis Salvador-Carulla, 2019. "Causal Modelling for Supporting Planning and Management of Mental Health Services and Systems: A Systematic Review," IJERPH, MDPI, vol. 16(3), pages 1-20, January.
    6. Zaiwu Gong & Xiaoqing Chen, 2017. "Analysis of Interval Data Envelopment Efficiency Model Considering Different Distribution Characteristics—Based on Environmental Performance Evaluation of the Manufacturing Industry," Sustainability, MDPI, vol. 9(12), pages 1-25, November.
    7. R. K. Jha & B. S. Sahay & P. Charan, 2016. "Healthcare operations management: a structured literature review," DECISION: Official Journal of the Indian Institute of Management Calcutta, Springer;Indian Institute of Management Calcutta, vol. 43(3), pages 259-279, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min, 2016. "Research fronts in data envelopment analysis," Omega, Elsevier, vol. 58(C), pages 33-45.
    2. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    3. Toloo, Mehdi & Hančlová, Jana, 2020. "Multi-valued measures in DEA in the presence of undesirable outputs," Omega, Elsevier, vol. 94(C).
    4. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    5. Zhou, P. & Ang, B.W. & Poh, K.L., 2008. "A survey of data envelopment analysis in energy and environmental studies," European Journal of Operational Research, Elsevier, vol. 189(1), pages 1-18, August.
    6. Benjamin Hampf, 2018. "Measuring inefficiency in the presence of bad outputs: Does the disposability assumption matter?," Empirical Economics, Springer, vol. 54(1), pages 101-127, February.
    7. Wang, Derek D. & Ren, Yaoyao, 2024. "Accuracy of Deterministic Nonparametric Frontier Models with Undesirable Outputs," European Journal of Operational Research, Elsevier, vol. 315(2), pages 596-612.
    8. Halkos, George & Petrou, Kleoniki Natalia, 2019. "Treating undesirable outputs in DEA: A critical review," Economic Analysis and Policy, Elsevier, vol. 62(C), pages 97-104.
    9. Afzalinejad, Mohammad, 2020. "Reverse efficiency measures for environmental assessment in data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    10. Cordero, José Manuel & Alonso-Morán, Edurne & Nuño-Solinis, Roberto & Orueta, Juan F. & Arce, Regina Sauto, 2015. "Efficiency assessment of primary care providers: A conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 240(1), pages 235-244.
    11. Zhou, Haibo & Yang, Yi & Chen, Yao & Zhu, Joe, 2018. "Data envelopment analysis application in sustainability: The origins, development and future directions," European Journal of Operational Research, Elsevier, vol. 264(1), pages 1-16.
    12. George Halkos & George Papageorgiou, 2016. "Spatial environmental efficiency indicators in regional waste generation: a nonparametric approach," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 59(1), pages 62-78, January.
    13. Fusco, Elisa & Vidoli, Francesco & Rogge, Nicky, 2020. "Spatial directional robust Benefit of the Doubt approach in presence of undesirable output: An application to Italian waste sector," Omega, Elsevier, vol. 94(C).
    14. Zhang, Chunhong & Liu, Haiying & Bressers, Hans Th.A. & Buchanan, Karen S., 2011. "Productivity growth and environmental regulations - accounting for undesirable outputs: Analysis of China's thirty provincial regions using the Malmquist–Luenberger index," Ecological Economics, Elsevier, vol. 70(12), pages 2369-2379.
    15. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    16. Chiu, Yung-Ho & Lee, Jen-Hui & Lu, Ching-Cheng & Shyu, Ming-Kuang & Luo, Zhengying, 2012. "The technology gap and efficiency measure in WEC countries: Application of the hybrid meta frontier model," Energy Policy, Elsevier, vol. 51(C), pages 349-357.
    17. Halkos, George & Petrou, Kleoniki Natalia, 2018. "A critical review of the main methods to treat undesirable outputs in DEA," MPRA Paper 90374, University Library of Munich, Germany.
    18. George Halkos & Nickolaos Tzeremes, 2014. "Measuring the effect of Kyoto protocol agreement on countries’ environmental efficiency in CO 2 emissions: an application of conditional full frontiers," Journal of Productivity Analysis, Springer, vol. 41(3), pages 367-382, June.
    19. Zhou, Yan & Xing, Xinpeng & Fang, Kuangnan & Liang, Dapeng & Xu, Chunlin, 2013. "Environmental efficiency analysis of power industry in China based on an entropy SBM model," Energy Policy, Elsevier, vol. 57(C), pages 68-75.
    20. Richard Simper & Maximilian J.B. Hall & Wenbin B. Liu & Valentin Zelenyuk & Zhongbao Zhou, 2014. "How Relevant is the Choice of Risk Management Control Variable to Non-parametric Bank Profit Efficiency Analysis?," CEPA Working Papers Series WP122014, School of Economics, University of Queensland, Australia.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:242:y:2015:i:2:p:525-535. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.