IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v205y2010i3p719-728.html
   My bibliography  Save this article

Comparing efficiency across markets: An extension and critique of the methodology

Author

Listed:
  • Chumpitaz, Ruben
  • Kerstens, Kristiaan
  • Paparoidamis, Nicholas
  • Staat, Matthias

Abstract

The use of non-parametric frontier methods for the evaluation of product market efficiency in heterogeneous markets seems to have gained some popularity recently. However, the statistical properties of these frontier estimators have been largely ignored. The main point is that non-parametric frontier estimators are biased and that the degree of bias depends on specific sample properties, most importantly sample size and number of dimensions of the model. To investigate the effect of this bias on comparing market efficiency, this contribution estimates the efficiency for several datasets for two main product categories. Following (Zhang, Y., Bartels, R., 1998. The effect of sample size on the mean efficiency in DEA with an application to electricity distribution in Australia, Sweden and New Zealand. Journal of Productivity Analysis, 9(3), 187-204.), these results comprise re-estimates for the larger samples limiting their size to that of the smaller samples when the model dimensions for different samples are identical. Furthermore, sample sizes are adjusted to mitigate the eventual differences in dimensions in specification. This allows comparing market efficiency for different markets on a more equal footing, since it reduces the bias effect to a minimum making the comparison of market efficiency possible. However, the article also points out the critical limitations of this [Zhang, Y., Bartels, R., (1998). The effect of sample size on the mean efficiency in DEA with an application to electricity distribution in Australia, Sweden and New Zealand. Journal of Productivity Analysis 9 (3), 187-204] approach in certain respects. Apart from reporting these negative results, we also offer some suggestions for future work.

Suggested Citation

  • Chumpitaz, Ruben & Kerstens, Kristiaan & Paparoidamis, Nicholas & Staat, Matthias, 2010. "Comparing efficiency across markets: An extension and critique of the methodology," European Journal of Operational Research, Elsevier, vol. 205(3), pages 719-728, September.
    • Handle: RePEc:eee:ejores:v:205:y:2010:i:3:p:719-728
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(10)00007-X
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Léopold Simar & Paul Wilson, 2000. "Statistical Inference in Nonparametric Frontier Models: The State of the Art," Journal of Productivity Analysis, Springer, vol. 13(1), pages 49-78, January.
    2. Kelvin Balcombe & Iain Fraser & Jae Kim, 2006. "Estimating technical efficiency of Australian dairy farms using alternative frontier methodologies," Applied Economics, Taylor & Francis Journals, vol. 38(19), pages 2221-2236.
    3. Franklin Dexter & Liam O’Neill & Lei Xin & Johannes Ledolter, 2008. "Sensitivity of super-efficient data envelopment analysis results to individual decision-making units: an example of surgical workload by specialty," Health Care Management Science, Springer, vol. 11(4), pages 307-318, December.
    4. Kevin Fox & Robert Hill & W. Diewert, 2004. "Identifying Outliers in Multi-Output Models," Journal of Productivity Analysis, Springer, vol. 22(1), pages 73-94, July.
    5. Kneip, Alois & Simar, Léopold & Wilson, Paul W., 2008. "Asymptotics And Consistent Bootstraps For Dea Estimators In Nonparametric Frontier Models," Econometric Theory, Cambridge University Press, vol. 24(6), pages 1663-1697, December.
    6. Aomar Ibourk & Bénédicte Maillard & Sergio Perelman & Henri Sneessens, 2004. "Aggregate Matching Efficiency: A Stochastic Production Frontier Approach, France 1990–1994," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 31(1), pages 1-25, March.
    7. Bruce Hollingsworth & P.J. Dawson & N. Maniadakis, 1999. "Efficiency measurement of health care: a review of non‐parametric methods and applications," Health Care Management Science, Springer, vol. 2(3), pages 161-172, July.
    8. Kneip, Alois & Park, Byeong U. & Simar, Léopold, 1998. "A Note On The Convergence Of Nonparametric Dea Estimators For Production Efficiency Scores," Econometric Theory, Cambridge University Press, vol. 14(6), pages 783-793, December.
    9. Berger, Allen N. & Humphrey, David B., 1997. "Efficiency of financial institutions: International survey and directions for future research," European Journal of Operational Research, Elsevier, vol. 98(2), pages 175-212, April.
    10. Varian, Hal R., 1988. "Revealed preference with a subset of goods," Journal of Economic Theory, Elsevier, vol. 46(1), pages 179-185, October.
    11. Elizabeth J. Warner & Robert B. Barsky, 1995. "The Timing and Magnitude of Retail Store Markdowns: Evidence from Weekends and Holidays," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(2), pages 321-352.
    12. Polachek, Solomon W. & Robst, John, 1998. "Employee labor market information: comparing direct world of work measures of workers' knowledge to stochastic frontier estimates," Labour Economics, Elsevier, vol. 5(2), pages 231-242, June.
    13. Yun Zhang & Robert Bartels, 1998. "The Effect of Sample Size on the Mean Efficiency in DEA with an Application to Electricity Distribution in Australia, Sweden and New Zealand," Journal of Productivity Analysis, Springer, vol. 9(3), pages 187-204, March.
    14. Berger, Allen N. & Demsetz, Rebecca S. & Strahan, Philip E., 1999. "The consolidation of the financial services industry: Causes, consequences, and implications for the future," Journal of Banking & Finance, Elsevier, vol. 23(2-4), pages 135-194, February.
    15. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    16. Angel S. Fernandez-Castro & Peter C. Smith, 2002. "Lancaster's characteristics approach revisited: product selection using non-parametric methods," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 23(2), pages 83-91.
    17. F Pedraja-Chaparro & J Salinas-Jiménez & P Smith, 1999. "On the quality of the data envelopment analysis model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(6), pages 636-644, June.
    18. Fare, Rolf & Grosskopf, Shawna & Kokkelenberg, Edward C, 1989. "Measuring Plant Capacity, Utilization and Technical Change: A Nonparametric Approach," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 30(3), pages 655-666, August.
    19. J-D Lee & A Repkine & S-W Hwang & T-Y Kim, 2004. "Estimating consumers' willingness to pay for individual quality attributes with DEA," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(10), pages 1064-1070, October.
    20. Matthias Staat & Maik Hammerschmidt, 2005. "Product performance evaluation: a super-efficiency model," International Journal of Business Performance Management, Inderscience Enterprises Ltd, vol. 7(3), pages 304-319.
    21. Gstach, Dieter, 1995. "Comparing Structural Efficiency of Unbalanced Subsamples: A Resampling Adaptation of Data Envelopment Analysis," Empirical Economics, Springer, vol. 20(3), pages 531-542.
    22. Victoria Shestalova, 2003. "Sequential Malmquist Indices of Productivity Growth: An Application to OECD Industrial Activities," Journal of Productivity Analysis, Springer, vol. 19(2), pages 211-226, April.
    23. Carlton, Dennis W., 1989. "The theory and the facts of how markets clear: Is industrial organization valuable for understanding macroeconomics?," Handbook of Industrial Organization, in: R. Schmalensee & R. Willig (ed.), Handbook of Industrial Organization, edition 1, volume 1, chapter 15, pages 909-946, Elsevier.
    24. Wilson, Paul W, 1993. "Detecting Outliers in Deterministic Nonparametric Frontier Models with Multiple Outputs," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(3), pages 319-323, July.
    25. Simar, Leopold & Wilson, Paul W., 2002. "Non-parametric tests of returns to scale," European Journal of Operational Research, Elsevier, vol. 139(1), pages 115-132, May.
    26. Rosen, Sherwin, 1974. "Hedonic Prices and Implicit Markets: Product Differentiation in Pure Competition," Journal of Political Economy, University of Chicago Press, vol. 82(1), pages 34-55, Jan.-Feb..
    27. Kelvin J. Lancaster, 1966. "A New Approach to Consumer Theory," Journal of Political Economy, University of Chicago Press, vol. 74(2), pages 132-132.
    28. Léopold Simar, 2003. "Detecting Outliers in Frontier Models: A Simple Approach," Journal of Productivity Analysis, Springer, vol. 20(3), pages 391-424, November.
    29. Martins-Filho, Carlos & Yao, Feng, 2008. "A smooth nonparametric conditional quantile frontier estimator," Journal of Econometrics, Elsevier, vol. 143(2), pages 317-333, April.
    30. Kamakura, Wagner A & Ratchford, Brian T & Agrawal, Jagdish, 1988. "Measuring Market Efficiency and Welfare Loss," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 15(3), pages 289-302, December.
    31. Dyson, R. G. & Allen, R. & Camanho, A. S. & Podinovski, V. V. & Sarrico, C. S. & Shale, E. A., 2001. "Pitfalls and protocols in DEA," European Journal of Operational Research, Elsevier, vol. 132(2), pages 245-259, July.
    32. Gad Allon & Michael Beenstock & Steven Hackman & Ury Passy & Alexander Shapiro, 2007. "Nonparametric estimation of concave production technologies by entropic methods," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(4), pages 795-816.
    33. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    34. Hjorth-Andersen, Chr, 1984. "The Concept of Quality and the Efficiency of Markets for Consumer Products," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 11(2), pages 708-718, September.
    35. Bill L. Seaver & Konstantinos P. Triantis, 1995. "The Impact of Outliers and Leverage Points for Technical Efficiency Measurement Using High Breakdown Procedures," Management Science, INFORMS, vol. 41(6), pages 937-956, June.
    36. Matthias Staat & Hans H. Bauer & Maik Hammerschmidt, 2004. "Structuring Product-Markets: An Approach Based On Customer Value," Microeconomics 0401002, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bogetoft, Peter & Kromann, Lene, 2018. "Evaluating treatment effects using data envelopment analysis on matched samples: An analysis of electronic information sharing and firm performance," European Journal of Operational Research, Elsevier, vol. 270(1), pages 302-313.
    2. Karagiannis, Roxani & Karagiannis, Giannis, 2023. "Nonparametric estimates of price efficiency for the Greek infant milk market: Curing the curse of dimensionality with shannon entropy," Economic Modelling, Elsevier, vol. 121(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruben Chumpitaz & Kristiaan Kerstens & Nicholas Paparoidamis & Matthias Staat, 2010. "Hedonic price function estimation in economics and marketing: revisiting Lancaster’s issue of “noncombinable” goods," Annals of Operations Research, Springer, vol. 173(1), pages 145-161, January.
    2. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    3. Amir Moradi-Motlagh & Ali Emrouznejad, 2022. "The origins and development of statistical approaches in non-parametric frontier models: a survey of the first two decades of scholarly literature (1998–2020)," Annals of Operations Research, Springer, vol. 318(1), pages 713-741, November.
    4. Sebastian Kohl & Jan Schoenfelder & Andreas Fügener & Jens O. Brunner, 2019. "The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals," Health Care Management Science, Springer, vol. 22(2), pages 245-286, June.
    5. Emrouznejad, Ali & De Witte, Kristof, 2010. "COOPER-framework: A unified process for non-parametric projects," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1573-1586, December.
    6. Wilson, Paul W., 2018. "Dimension reduction in nonparametric models of production," European Journal of Operational Research, Elsevier, vol. 267(1), pages 349-367.
    7. Kristof De Witte & Rui Marques, 2010. "Designing performance incentives, an international benchmark study in the water sector," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 18(2), pages 189-220, June.
    8. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    9. Ljubica Nedelkoska, 2010. "Occupations at risk: The task content and job stability," Jena Economics Research Papers 2010-024, Friedrich-Schiller-University Jena.
    10. Khezrimotlagh, Dariush & Cook, Wade D. & Zhu, Joe, 2020. "A nonparametric framework to detect outliers in estimating production frontiers," European Journal of Operational Research, Elsevier, vol. 286(1), pages 375-388.
    11. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    12. Wheelock, David C. & Wilson, Paul W., 2008. "Non-parametric, unconditional quantile estimation for efficiency analysis with an application to Federal Reserve check processing operations," Journal of Econometrics, Elsevier, vol. 145(1-2), pages 209-225, July.
    13. Bracalente, Bruno & Polinori, Paolo, 2010. "L’efficienza tecnico-economica dei servizi pubblici locali: i casi delle farmacie comunali e dei servizi di igiene urbana [Technical And Economic Efficiency Of Local Public Services: The Cases Of T," MPRA Paper 34455, University Library of Munich, Germany.
    14. Oleg Badunenko, 2010. "Downsizing in the German chemical manufacturing industry during the 1990s. Why is small beautiful?," Small Business Economics, Springer, vol. 34(4), pages 413-431, May.
    15. Guccio, Calogero & Mignosa, Anna & Rizzo, Ilde, 2018. "Are public state libraries efficient? An empirical assessment using network Data Envelopment Analysis," Socio-Economic Planning Sciences, Elsevier, vol. 64(C), pages 78-91.
    16. Aggelopoulos, Eleftherios & Georgopoulos, Antonios, 2017. "Bank branch efficiency under environmental change: A bootstrap DEA on monthly profit and loss accounting statements of Greek retail branches," European Journal of Operational Research, Elsevier, vol. 261(3), pages 1170-1188.
    17. Alexander Schiersch, 2013. "Firm size and efficiency in the German mechanical engineering industry," Small Business Economics, Springer, vol. 40(2), pages 335-350, February.
    18. Valentin Zelenyuk, 2019. "Data Envelopment Analysis and Business Analytics: The Big Data Challenges and Some Solutions," CEPA Working Papers Series WP072019, School of Economics, University of Queensland, Australia.
    19. de Borger, Bruno & Kerstens, Kristiaan & Staat, Matthias, 2008. "Transit costs and cost efficiency: Bootstrapping non-parametric frontiers," Research in Transportation Economics, Elsevier, vol. 23(1), pages 53-64, January.
    20. Dana PANCUROVA & Stefan LYOCSA, 2013. "Determinants of Commercial Banks’ Efficiency: Evidence from 11 CEE Countries," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 63(2), pages 152-179, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:205:y:2010:i:3:p:719-728. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.