IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v28y2000i2p125-141.html
   My bibliography  Save this article

A framework for measuring the efficiency of organizational investments in information technology using data envelopment analysis

Author

Listed:
  • Shafer, Scott M.
  • Byrd, Terry A.

Abstract

Over the last few decades, organizations have been increasingly investing in information technology (IT). However, despite these substantial investments in IT, empirical studies have not persuasively established corresponding improvements in organazational performance. In fact, to the contrary, many studies investigating investments in IT have found no significant relationship between firm performance and investments in IT. Brynjolfsson and Kaufman and Weill identify shortcomings in past studies. These shortcomings include measurement errors, lags between investments and benefits, redistribution of profits, and mismanagement of IT resources. This paper proposes a framework for measuring the efficiency of investments in IT that addresses these shortcomings. In particular, we demonstrate how a mathematical programming technique called Data Envelopment Analysis (DEA) can be used to evaluate the efficiency of IT investments. Our framework is illustrated using data compiled for over 200 large organizations. The paper illustrates how the shortcomings listed above can be addressed.

Suggested Citation

  • Shafer, Scott M. & Byrd, Terry A., 2000. "A framework for measuring the efficiency of organizational investments in information technology using data envelopment analysis," Omega, Elsevier, vol. 28(2), pages 125-141, April.
  • Handle: RePEc:eee:jomega:v:28:y:2000:i:2:p:125-141
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(99)00039-0
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J.C. Paradi & D.N. Reese & D. Rosen, 1997. "Applications of DEA to measure the efficiency of software production at two large Canadian banks," Annals of Operations Research, Springer, vol. 73(0), pages 91-115, October.
    2. Peter Weill, 1992. "The Relationship Between Investment in Information Technology and Firm Performance: A Study of the Valve Manufacturing Sector," Information Systems Research, INFORMS, vol. 3(4), pages 307-333, December.
    3. Scherer, F. M., 1982. "Inter-industry technology flows in the United States," Research Policy, Elsevier, vol. 11(4), pages 227-245, August.
    4. Hammer, Michael & Champy, James, 1993. "Reengineering the corporation: A manifesto for business revolution," Business Horizons, Elsevier, vol. 36(5), pages 90-91.
    5. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    6. Sirkka L. Jarvenpaa & Blake Ives, 1990. "Information Technology and Corporate Strategy: A View from the Top," Information Systems Research, INFORMS, vol. 1(4), pages 351-376, December.
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Indranil Bardhan & William Cooper & Subal Kumbhakar, 1998. "A Simulation Study of Joint Uses of Data Envelopment Analysis and Statistical Regressions for Production Function Estimation and Efficiency Evaluation," Journal of Productivity Analysis, Springer, vol. 9(3), pages 249-278, March.
    9. Sidney E. Harris & Joseph L. Katz, 1991. "Organizational Performance and Information Technology Investment Intensity in the Insurance Industry," Organization Science, INFORMS, vol. 2(3), pages 263-295, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Barua, Anitesh & Brockett, P. L. & Cooper, W. W. & Deng, Honghui & Parker, Barnett R. & Ruefli, T. W. & Whinston, A., 2004. "DEA evaluations of long- and short-run efficiencies of digital vs. physical product "dot com" companies," Socio-Economic Planning Sciences, Elsevier, vol. 38(4), pages 233-253, December.
    2. Zeng, Shihong & Jiang, Chunxia & Ma, Chen & Su, Bin, 2018. "Investment efficiency of the new energy industry in China," Energy Economics, Elsevier, vol. 70(C), pages 536-544.
    3. A Mukherjee & P Nath & M Pal, 2003. "Resource, service quality and performance triad: a framework for measuring efficiency of banking services," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(7), pages 723-735, July.
    4. Chun-Hsien Wang & Jun-Yen Lee & Yi-Hua Chang, 2012. "Measuring productivity in the biotechnology industry using the global Malmquist index," Applied Economics Letters, Taylor & Francis Journals, vol. 19(9), pages 807-812, June.
    5. Chun Sun & Sheng Ang & Fangqing Wei & Dawei Wang & Feng Yang, 2024. "Supply–demand effectiveness: capturing the effects of supply and demand mismatches in operational performance measurement," Operational Research, Springer, vol. 24(2), pages 1-22, June.
    6. van Wessel, R.M., 2008. "Realizing business benefits from company IT standardization : Case study research into the organizational value of IT standards, towards a company IT standardization management framework," Other publications TiSEM 4bdde091-4f3f-4be1-84aa-9, Tilburg University, School of Economics and Management.
    7. Kao, Ta-Wei (Daniel) & Simpson, N.C. & Shao, Benjamin B.M. & Lin, Winston T., 2017. "Relating supply network structure to productive efficiency: A multi-stage empirical investigation," European Journal of Operational Research, Elsevier, vol. 259(2), pages 469-485.
    8. Khallaf, Ashraf, 2012. "Information technology investments and nonfinancial measures: A research framework," Accounting forum, Elsevier, vol. 36(2), pages 109-121.
    9. Fazlollahi, Ariyan & Franke, Ulrik, 2018. "Measuring the impact of enterprise integration on firm performance using data envelopment analysis," International Journal of Production Economics, Elsevier, vol. 200(C), pages 119-129.
    10. Hokey Min & Hyesung Min & Seong Jong Joo, 2007. "A data envelopment analysis on assessing the competitiveness of Korean hotels," The Service Industries Journal, Taylor & Francis Journals, vol. 29(3), pages 367-385, November.
    11. H Seol & H Lee & S Kim & Y Park, 2008. "The impact of information technology on organizational efficiency in public services: a DEA-based DT approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 231-238, February.
    12. Carnero Moya, M. Carmen, 2004. "The control of the setting up of a predictive maintenance programme using a system of indicators," Omega, Elsevier, vol. 32(1), pages 57-75, February.
    13. Madjid Tavana & Salman Nazari-Shirkouhi & Hamidreza Farzaneh Kholghabad, 2021. "An integrated quality and resilience engineering framework in healthcare with Z-number data envelopment analysis," Health Care Management Science, Springer, vol. 24(4), pages 768-785, December.
    14. Mehdi Toloo & Soroosh Nalchigar & Babak Sohrabi, 2018. "Selecting most efficient information system projects in presence of user subjective opinions: a DEA approach," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 26(4), pages 1027-1051, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Byrd, T. A. & Marshall, T. E., 1997. "Relating information technology investment to organizational performance: a causal model analysis," Omega, Elsevier, vol. 25(1), pages 43-56, February.
    2. Amar Oukil & Slim Zekri, 2021. "Investigating farming efficiency through a two stage analytical approach: Application to the agricultural sector in Northern Oman," Papers 2104.10943, arXiv.org.
    3. Glover, Fred & Sueyoshi, Toshiyuki, 2009. "Contributions of Professor William W. Cooper in Operations Research and Management Science," European Journal of Operational Research, Elsevier, vol. 197(1), pages 1-16, August.
    4. Matthews, N. & Grové, B. & Kundhlande, G., 2007. "PR - Estimating Input-specific Recommendations For Technically Inefficient Crop Farmers," 16th Congress, Cork, Ireland, July 15-20, 2007 345436, International Farm Management Association.
    5. Shih, Jhih-Shyang & Harrington, Winston & Pizer, William A. & Gillingham, Kenneth, 2004. "Economies of Scale and Technical Efficiency in Community Water Systems," Discussion Papers 10788, Resources for the Future.
    6. Groot, Tom & Garcia-Valderrama, Teresa, 2006. "Research quality and efficiency: An analysis of assessments and management issues in Dutch economics and business research programs," Research Policy, Elsevier, vol. 35(9), pages 1362-1376, November.
    7. Matthews, N. & Grové, B. & Kundhlande, G., 2007. "PR. Estimating Input-specific Recommendations For Technically Inefficient Crop Farmers," 16th Congress, Cork, Ireland, July 15-20, 2007 345485, International Farm Management Association.
    8. Krüger, Jens J., 2012. "A Monte Carlo study of old and new frontier methods for efficiency measurement," European Journal of Operational Research, Elsevier, vol. 222(1), pages 137-148.
    9. Adler, Nicole & Raveh, Adi, 2008. "Presenting DEA graphically," Omega, Elsevier, vol. 36(5), pages 715-729, October.
    10. Chien-Ming Chen & Magali A. Delmas, 2012. "Measuring Eco-Inefficiency: A New Frontier Approach," Operations Research, INFORMS, vol. 60(5), pages 1064-1079, October.
    11. Asmild, Mette & Paradi, Joseph C. & Reese, David N. & Tam, Fai, 2007. "Measuring overall efficiency and effectiveness using DEA," European Journal of Operational Research, Elsevier, vol. 178(1), pages 305-321, April.
    12. Phillip Fanchon, 2003. "Variable selection for dynamic measures of efficiency in the computer industry," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 9(3), pages 175-188, August.
    13. Saggi Nevo & Michael Wade & Wade D. Cook, 2010. "An empirical study of IT as a factor of production: The case of Net-enabled IT assets," Information Systems Frontiers, Springer, vol. 12(3), pages 323-335, July.
    14. Perelman, Sergio & Santín, Daniel, 2009. "How to generate regularly behaved production data? A Monte Carlo experimentation on DEA scale efficiency measurement," European Journal of Operational Research, Elsevier, vol. 199(1), pages 303-310, November.
    15. Guan, Jian Cheng & Yam, Richard C.M. & Mok, Chiu Kam & Ma, Ning, 2006. "A study of the relationship between competitiveness and technological innovation capability based on DEA models," European Journal of Operational Research, Elsevier, vol. 170(3), pages 971-986, May.
    16. Franz R. Hahn, 2007. "Determinants of Bank Efficiency in Europe. Assessing Bank Performance Across Markets," WIFO Studies, WIFO, number 31499, April.
    17. Alperovych, Yan & Hübner, Georges & Lobet, Fabrice, 2015. "How does governmental versus private venture capital backing affect a firm's efficiency? Evidence from Belgium," Journal of Business Venturing, Elsevier, vol. 30(4), pages 508-525.
    18. Wang, Zhao-Hua & Zeng, Hua-Lin & Wei, Yi-Ming & Zhang, Yi-Xiang, 2012. "Regional total factor energy efficiency: An empirical analysis of industrial sector in China," Applied Energy, Elsevier, vol. 97(C), pages 115-123.
    19. Azarnoosh Kafi & Behrouz Daneshian & Mohsen Rostamy-Malkhalifeh, 2021. "Forecasting the confidence interval of efficiency in fuzzy DEA," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 31(1), pages 41-59.
    20. Ruiqing Yuan & Xiangyang Xu & Yanli Wang & Jiayi Lu & Ying Long, 2024. "Evaluating Carbon-Emission Efficiency in China’s Construction Industry: An SBM-Model Analysis of Interprovincial Building Heating," Sustainability, MDPI, vol. 16(6), pages 1-16, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:28:y:2000:i:2:p:125-141. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.