IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v62y2016i5p1487-1510.html
   My bibliography  Save this article

Technical Debt and the Reliability of Enterprise Software Systems: A Competing Risks Analysis

Author

Listed:
  • Narayan Ramasubbu

    (Joseph M. Katz Graduate School of Business, University of Pittsburgh, Pittsburgh, Pennsylvania 15260)

  • Chris F. Kemerer

    (Joseph M. Katz Graduate School of Business, University of Pittsburgh, Pittsburgh, Pennsylvania 15260)

Abstract

Enterprise software systems are required to be highly reliable because they are central to the business operations of most firms. However, configuring and maintaining these systems can be highly complex, making it challenging to achieve high reliability. Resource-constrained software teams facing business pressures can be tempted to take design shortcuts in order to deliver business functionality more quickly. These design shortcuts and other maintenance activities contribute to the accumulation of technical debt , that is, a buildup of software maintenance obligations that need to be addressed in the future. We model and empirically analyze the impact of technical debt on system reliability by utilizing a longitudinal data set spanning the 10-year life cycle of a commercial enterprise system deployed at 48 different client firms. We use a competing risks analysis approach to discern the interdependency between client and vendor maintenance activities. This allows us to assess the effect of both problematic client modifications (client errors) and software errors present in the vendor-supplied platform (vendor errors) on system failures. We also examine the relative effects of modular and architectural maintenance activities undertaken by clients in order to analyze the dynamics of technical debt reduction. The results of our analysis first establish that technical debt decreases the reliability of enterprise systems. Second, modular maintenance targeted to reduce technical debt was approximately 53% more effective than architectural maintenance in reducing the probability of a system failure due to client errors, but it had the side effect of increasing the chance of a system failure due to vendor errors by approximately 83% more than did architectural maintenance activities. Using our empirical results we illustrate how firms could evaluate their business risk exposure due to technical debt accumulation in their enterprise systems, and we assess the estimated net effects, both positive and negative, of a range of software maintenance practices. Finally, we discuss implications for research in measuring and managing technical debt in enterprise systems. This paper was accepted by Chris Forman, information systems .

Suggested Citation

  • Narayan Ramasubbu & Chris F. Kemerer, 2016. "Technical Debt and the Reliability of Enterprise Software Systems: A Competing Risks Analysis," Management Science, INFORMS, vol. 62(5), pages 1487-1510, May.
    • Handle: RePEc:inm:ormnsc:v:62:y:2016:i:5:p:1487-1510
    DOI: 10.1287/mnsc.2015.2196
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2015.2196
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.2015.2196?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Box-Steffensmeier, Janet M. & De Boef, Suzanna & Joyce, Kyle A., 2007. "Event Dependence and Heterogeneity in Duration Models: The Conditional Frailty Model," Political Analysis, Cambridge University Press, vol. 15(3), pages 237-256, July.
    2. Franke, Nikolaus & Hippel, Eric von, 2003. "Satisfying heterogeneous user needs via innovation toolkits: the case of Apache security software," Research Policy, Elsevier, vol. 32(7), pages 1199-1215, July.
    3. Peng Huang & Marco Ceccagnoli & Chris Forman & D. J. Wu, 2013. "Appropriability Mechanisms and the Platform Partnership Decision: Evidence from Enterprise Software," Management Science, INFORMS, vol. 59(1), pages 102-121, July.
    4. Alan MacCormack & John Rusnak & Carliss Y. Baldwin, 2006. "Exploring the Structure of Complex Software Designs: An Empirical Study of Open Source and Proprietary Code," Management Science, INFORMS, vol. 52(7), pages 1015-1030, July.
    5. Donald E. Harter & Mayuram S. Krishnan & Sandra A. Slaughter, 2000. "Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development," Management Science, INFORMS, vol. 46(4), pages 451-466, April.
    6. Kalle Lyytinen & Lars Mathiassen & Janne Ropponen, 1998. "Attention Shaping and Software Risk—A Categorical Analysis of Four Classical Risk Management Approaches," Information Systems Research, INFORMS, vol. 9(3), pages 233-255, September.
    7. Wai Fong Boh & Sandra A. Slaughter & J. Alberto Espinosa, 2007. "Learning from Experience in Software Development: A Multilevel Analysis," Management Science, INFORMS, vol. 53(8), pages 1315-1331, August.
    8. Sarv Devaraj & Rajiv Kohli, 2003. "Performance Impacts of Information Technology: Is Actual Usage the Missing Link?," Management Science, INFORMS, vol. 49(3), pages 273-289, March.
    9. Jose A. Guajardo & Morris A. Cohen & Sang-Hyun Kim & Serguei Netessine, 2012. "Impact of Performance-Based Contracting on Product Reliability: An Empirical Analysis," Management Science, INFORMS, vol. 58(5), pages 961-979, May.
    10. Evelyn J. Barry & Chris F. Kemerer & Sandra A. Slaughter, 2006. "Environmental Volatility, Development Decisions, and Software Volatility: A Longitudinal Analysis," Management Science, INFORMS, vol. 52(3), pages 448-464, March.
    11. Jean‐Yves Dauxois & Sophie Sencey, 2009. "Non‐parametric Tests for Recurrent Events under Competing Risks," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(4), pages 649-670, December.
    12. Shane M. Greenstein & James B. Wade, 1998. "The Product Life Cycle in the Commercial Mainframe Computer Market, 1968-1982," RAND Journal of Economics, The RAND Corporation, vol. 29(4), pages 772-789, Winter.
    13. Rajiv D. Banker & Sandra A. Slaughter, 2000. "The Moderating Effects of Structure on Volatility and Complexity in Software Enhancement," Information Systems Research, INFORMS, vol. 11(3), pages 219-240, September.
    14. Sandra A. Slaughter & Laurie J. Kirsch, 2006. "The Effectiveness of Knowledge Transfer Portfolios in Software Process Improvement: A Field Study," Information Systems Research, INFORMS, vol. 17(3), pages 301-320, September.
    15. Sendil K. Ethiraj & Daniel Levinthal, 2004. "Modularity and Innovation in Complex Systems," Management Science, INFORMS, vol. 50(2), pages 159-173, February.
    16. Marco Iansiti, 2000. "How the Incumbent Can Win: Managing Technological Transitions in the Semiconductor Industry," Management Science, INFORMS, vol. 46(2), pages 169-185, February.
    17. Robert S. Huckman & Bradley R. Staats & David M. Upton, 2009. "Team Familiarity, Role Experience, and Performance: Evidence from Indian Software Services," Management Science, INFORMS, vol. 55(1), pages 85-100, January.
    18. Guy G. Gable, 1996. "A Multidimensional Model of Client Success When Engaging External Consultants," Management Science, INFORMS, vol. 42(8), pages 1175-1198, August.
    19. Rajiv D. Banker & Srikant M. Datar & Chris F. Kemerer, 1991. "A Model to Evaluate Variables Impacting the Productivity of Software Maintenance Projects," Management Science, INFORMS, vol. 37(1), pages 1-18, January.
    20. Eric von Hippel & Ralph Katz, 2002. "Shifting Innovation to Users via Toolkits," Management Science, INFORMS, vol. 48(7), pages 821-833, July.
    21. D. J. Wu & Min Ding & Lorin M. Hitt, 2013. "IT Implementation Contract Design: Analytical and Experimental Investigation of IT Value, Learning, and Contract Structure," Information Systems Research, INFORMS, vol. 24(3), pages 787-801, September.
    22. P. K. Kapur & H. Pham & A. Gupta & P. C. Jha, 2011. "Software Reliability Growth Models," Springer Series in Reliability Engineering, in: Software Reliability Assessment with OR Applications, chapter 0, pages 49-95, Springer.
    23. Ron Adner & Daniel Levinthal, 2001. "Demand Heterogeneity and Technology Evolution: Implications for Product and Process Innovation," Management Science, INFORMS, vol. 47(5), pages 611-628, May.
    24. Kathy A. Paulson Gjerde & Susan A. Slotnick & Matthew J. Sobel, 2002. "New Product Innovation with Multiple Features and Technology Constraints," Management Science, INFORMS, vol. 48(10), pages 1268-1284, October.
    25. Robert D. Austin, 2001. "The Effects of Time Pressure on Quality in Software Development: An Agency Model," Information Systems Research, INFORMS, vol. 12(2), pages 195-207, June.
    26. Baldwin, Carliss & Hienerth, Christoph & von Hippel, Eric, 2006. "How user innovations become commercial products: A theoretical investigation and case study," Research Policy, Elsevier, vol. 35(9), pages 1291-1313, November.
    27. Andrea Masini & Luk N. Van Wassenhove, 2009. "ERP Competence-Building Mechanisms: An Exploratory Investigation of Configurations of ERP Adopters in the European and U.S. Manufacturing Sectors," Manufacturing & Service Operations Management, INFORMS, vol. 11(2), pages 274-298, May.
    28. Shanling Li & Jennifer Shang & Sandra A. Slaughter, 2010. "Why Do Software Firms Fail? Capabilities, Competitive Actions, and Firm Survival in the Software Industry from 1995 to 2007," Information Systems Research, INFORMS, vol. 21(3), pages 631-654, September.
    29. Robin Williams & Neil Pollock, 2012. "Research Commentary ---Moving Beyond the Single Site Implementation Study: How (and Why) We Should Study the Biography of Packaged Enterprise Solutions," Information Systems Research, INFORMS, vol. 23(1), pages 1-22, March.
    30. Marc H. Meyer & Peter Tertzakian & James M. Utterback, 1997. "Metrics for Managing Research and Development in the Context of the Product Family," Management Science, INFORMS, vol. 43(1), pages 88-111, January.
    31. Kamalini Ramdas & Taylor Randall, 2008. "Does Component Sharing Help or Hurt Reliability? An Empirical Study in the Automotive Industry," Management Science, INFORMS, vol. 54(5), pages 922-938, May.
    32. Eric von Hippel, 1998. "Economics of Product Development by Users: The Impact of "Sticky" Local Information," Management Science, INFORMS, vol. 44(5), pages 629-644, May.
    33. Ramnath K. Chellappa & V. Sambamurthy & Nilesh Saraf, 2010. "Competing in Crowded Markets: Multimarket Contact and the Nature of Competition in the Enterprise Systems Software Industry," Information Systems Research, INFORMS, vol. 21(3), pages 614-630, September.
    34. Von Hippel, Eric A. & Katz, Ralph, 2002. "Shifting Innovation to Users Via Toolkits," Working papers 4232-02, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    35. Umble, Elisabeth J. & Haft, Ronald R. & Umble, M. Michael, 2003. "Enterprise resource planning: Implementation procedures and critical success factors," European Journal of Operational Research, Elsevier, vol. 146(2), pages 241-257, April.
    36. Alan MacCormack & Roberto Verganti & Marco Iansiti, 2001. "Developing Products on "Internet Time": The Anatomy of a Flexible Development Process," Management Science, INFORMS, vol. 47(1), pages 133-150, January.
    37. Rajiv D. Banker & Gordon B. Davis & Sandra A. Slaughter, 1998. "Software Development Practices, Software Complexity, and Software Maintenance Performance: A Field Study," Management Science, INFORMS, vol. 44(4), pages 433-450, April.
    38. Rajiv D. Banker & Sandra A. Slaughter, 1997. "A Field Study of Scale Economies in Software Maintenance," Management Science, INFORMS, vol. 43(12), pages 1709-1725, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Panos Constantinides & Ola Henfridsson & Geoffrey G. Parker, 2018. "Introduction—Platforms and Infrastructures in the Digital Age," Information Systems Research, INFORMS, vol. 29(2), pages 381-400, June.
    2. Knut H. Rolland & Lars Mathiassen & Arun Rai, 2018. "Managing Digital Platforms in User Organizations: The Interactions Between Digital Options and Digital Debt," Information Systems Research, INFORMS, vol. 29(2), pages 419-443, June.
    3. Rajiv Banker & Yi Liang & Narayan Ramasubbu, 2021. "Technical Debt and Firm Performance," Management Science, INFORMS, vol. 67(5), pages 3174-3194, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sriram Narayanan & Sridhar Balasubramanian & Jayashankar M. Swaminathan, 2009. "A Matter of Balance: Specialization, Task Variety, and Individual Learning in a Software Maintenance Environment," Management Science, INFORMS, vol. 55(11), pages 1861-1876, November.
    2. Sánchez-González, Gloria & González-Álvarez, Nuria & Nieto, Mariano, 2009. "Sticky information and heterogeneous needs as determining factors of R&D cooperation with customers," Research Policy, Elsevier, vol. 38(10), pages 1590-1603, December.
    3. Rajiv D. Banker & Robert J. Kauffman, 2004. "50th Anniversary Article: The Evolution of Research on Information Systems: A Fiftieth-Year Survey of the Literature in Management Science," Management Science, INFORMS, vol. 50(3), pages 281-298, March.
    4. Maria Roszkowska-Menkes, 2017. "User Innovation: State of the Art and Perspectives for Future Research," Journal of Entrepreneurship, Management and Innovation, Fundacja Upowszechniająca Wiedzę i Naukę "Cognitione", vol. 13(2), pages 127-154.
    5. Tian Heong Chan & Shi-Ying Lim, 2023. "The Emergence of Novel Product Uses: An Investigation of Exaptations in IKEA Hacks," Management Science, INFORMS, vol. 69(5), pages 2870-2892, May.
    6. Habicht, Hagen & Oliveira, Pedro & Shcherbatiuk, Viktoriia, 2012. "User Innovators: When Patients Set Out to Help Themselves and End Up Helping Many," Die Unternehmung - Swiss Journal of Business Research and Practice, Nomos Verlagsgesellschaft mbH & Co. KG, vol. 66(3), pages 277-295.
    7. Di Stefano, Giada & Gambardella, Alfonso & Verona, Gianmario, 2012. "Technology push and demand pull perspectives in innovation studies: Current findings and future research directions," Research Policy, Elsevier, vol. 41(8), pages 1283-1295.
    8. Fuller, Johann & Jawecki, Gregor & Muhlbacher, Hans, 2007. "Innovation creation by online basketball communities," Journal of Business Research, Elsevier, vol. 60(1), pages 60-71, January.
    9. Scott A. Shane & Karl T. Ulrich, 2004. "50th Anniversary Article: Technological Innovation, Product Development, and Entrepreneurship in Management Science," Management Science, INFORMS, vol. 50(2), pages 133-144, February.
    10. Lars Bo Jeppesen & Lars Frederiksen, 2006. "Why Do Users Contribute to Firm-Hosted User Communities? The Case of Computer-Controlled Music Instruments," Organization Science, INFORMS, vol. 17(1), pages 45-63, February.
    11. Francesco Paolo Appio & Antonella Martini & Silvia Massa & Stefania Testa, 2016. "Unveiling the intellectual origins of Social Media-based innovation: insights from a bibliometric approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 355-388, July.
    12. Viswanath Venkatesh & Arun Rai & Likoebe M. Maruping, 2018. "Information Systems Projects and Individual Developer Outcomes: Role of Project Managers and Process Control," Information Systems Research, INFORMS, vol. 29(1), pages 127-148, March.
    13. Lalicic, Lidija & Dickinger, Astrid, 2019. "An assessment of user-driven innovativeness in a mobile computing travel platform," Technological Forecasting and Social Change, Elsevier, vol. 144(C), pages 233-241.
    14. Evelyn J. Barry & Chris F. Kemerer & Sandra A. Slaughter, 2006. "Environmental Volatility, Development Decisions, and Software Volatility: A Longitudinal Analysis," Management Science, INFORMS, vol. 52(3), pages 448-464, March.
    15. Linda Argote & Sunkee Lee & Jisoo Park, 2021. "Organizational Learning Processes and Outcomes: Major Findings and Future Research Directions," Management Science, INFORMS, vol. 67(9), pages 5399-5429, September.
    16. Bengtsson, Lars & Ryzhkova, Natalia, 2013. "Managing a strategic source of innovation: Online users," International Journal of Information Management, Elsevier, vol. 33(4), pages 655-662.
    17. Sheen S. Levine & Michael J. Prietula, 2014. "Open Collaboration for Innovation: Principles and Performance," Organization Science, INFORMS, vol. 25(5), pages 1414-1433, October.
    18. Alfonso Gambardella & Christina Raasch & Eric von Hippel, 2017. "The User Innovation Paradigm: Impacts on Markets and Welfare," Management Science, INFORMS, vol. 63(5), pages 1450-1468, May.
    19. Rajiv D. Banker & Sandra A. Slaughter, 2000. "The Moderating Effects of Structure on Volatility and Complexity in Software Enhancement," Information Systems Research, INFORMS, vol. 11(3), pages 219-240, September.
    20. Piller, Frank & Vossen, Alexander & Ihl, Christoph, 2012. "From Social Media to Social Product Development: The Impact of Social Media on Co-Creation of Innovation," Die Unternehmung - Swiss Journal of Business Research and Practice, Nomos Verlagsgesellschaft mbH & Co. KG, vol. 66(1), pages 7-27.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:62:y:2016:i:5:p:1487-1510. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.