IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v340y2024i1d10.1007_s10479-023-05240-6.html
   My bibliography  Save this article

Stochastic debugging based reliability growth models for Open Source Software project

Author

Listed:
  • Shakshi Singhal

    (Fortune Institute of International Business (FIIB))

  • P. K. Kapur

    (Amity University, Uttar Pradesh)

  • Vivek Kumar

    (University of Delhi)

  • Saurabh Panwar

    (University of Delhi)

Abstract

Open Source Software (OSS) is one of the most trusted technologies for implementing industry 4.0 solutions. The study aims to assist a community of OSS developers in quantifying the product’s reliability. This research proposes reliability growth models for OSS by incorporating dynamicity in the debugging process. For this, stochastic differential equation-based analytical models are developed to represent the instantaneous rate of error generation. The fault introduction rate is modeled using exponential and Erlang distribution functions. The empirical applications of the proposed methodology are verified using the real-life failure data of the Open Source Software projects, GNU Network Object Model Environment, and Eclipse. A soft computing technique, Genetic Algorithm, is applied to estimate model parameters. Cross-validation is also performed to examine the forecasting efficacy of the model. The predictive power of the developed models is compared with various benchmark studies. The data analysis is conducted using the R statistical computing software. The results demonstrate the proposed models’ efficacy in parameter estimation and predictive performance. In addition, the optimal release time policy based on the proposed mathematical models is presented by formulating the optimization model that intends to minimize the total cost of software development under reliability constraints. The numerical illustration and sensitivity analysis exhibit the proposed problem's practical significance. The findings of the numerical analysis exemplify the proposed study's capability of decision-making under uncertainty.

Suggested Citation

  • Shakshi Singhal & P. K. Kapur & Vivek Kumar & Saurabh Panwar, 2024. "Stochastic debugging based reliability growth models for Open Source Software project," Annals of Operations Research, Springer, vol. 340(1), pages 531-569, September.
    • Handle: RePEc:spr:annopr:v:340:y:2024:i:1:d:10.1007_s10479-023-05240-6
    DOI: 10.1007/s10479-023-05240-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-023-05240-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-023-05240-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. T Bhaskar & U D Kumar, 2006. "A cost model for N-version programming with imperfect debugging," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(8), pages 986-994, August.
    2. Tamura, Yoshinobu & Yamada, Shigeru, 2006. "A flexible stochastic differential equation model in distributed development environment," European Journal of Operational Research, Elsevier, vol. 168(1), pages 143-152, January.
    3. Rajkumar Venkatesan & Trichy V. Krishnan & V. Kumar, 2004. "Evolutionary Estimation of Macro-Level Diffusion Models Using Genetic Algorithms: An Alternative to Nonlinear Least Squares," Marketing Science, INFORMS, vol. 23(3), pages 451-464, August.
    4. Yaghoobi, Tahere, 2020. "Parameter optimization of software reliability models using improved differential evolution algorithm," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 177(C), pages 46-62.
    5. Zhengrui Jiang & Sumit Sarkar & Varghese S. Jacob, 2012. "Postrelease Testing and Software Release Policy for Enterprise-Level Systems," Information Systems Research, INFORMS, vol. 23(3-part-1), pages 635-657, September.
    6. Yamada, Shigeru & Osaki, Shunji, 1987. "Optimal software release policies with simultaneous cost and reliability requirements," European Journal of Operational Research, Elsevier, vol. 31(1), pages 46-51, July.
    7. Pham, Hoang & Zhang, Xuemei, 2003. "NHPP software reliability and cost models with testing coverage," European Journal of Operational Research, Elsevier, vol. 145(2), pages 443-454, March.
    8. Shigeru Yamada & Yoshinobu Tamura, 2016. "OSS Reliability Measurement and Assessment," Springer Series in Reliability Engineering, Springer, edition 1, number 978-3-319-31818-9, April.
    9. Kwang Yoon Song & In Hong Chang & Hoang Pham, 2019. "A Testing Coverage Model Based on NHPP Software Reliability Considering the Software Operating Environment and the Sensitivity Analysis," Mathematics, MDPI, vol. 7(5), pages 1-21, May.
    10. P.K. Kapur & Hoang Pham & A. Gupta & P.C. Jha, 2011. "Software Reliability Assessment with OR Applications," Springer Series in Reliability Engineering, Springer, number 978-0-85729-204-9, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Avinash K. Shrivastava & Vivek Kumar & P. K. Kapur & Ompal Singh, 0. "Software release and testing stop time decision with change point," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 0, pages 1-12.
    2. Aktekin, Tevfik & Caglar, Toros, 2013. "Imperfect debugging in software reliability: A Bayesian approach," European Journal of Operational Research, Elsevier, vol. 227(1), pages 112-121.
    3. P. K. Kapur & Saurabh Panwar & Ompal Singh & Vivek Kumar, 2022. "Joint optimization of software time-to-market and testing duration using multi-attribute utility theory," Annals of Operations Research, Springer, vol. 312(1), pages 305-332, May.
    4. Avinash K. Shrivastava & Vivek Kumar & P. K. Kapur & Ompal Singh, 2020. "Software release and testing stop time decision with change point," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 11(2), pages 196-207, July.
    5. Ritu Bibyan & Sameer Anand & Anu G. Aggarwal & Abhishek Tandon, 2023. "Multi-release testing coverage-based SRGM considering error generation and change-point incorporating the random effect," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 14(5), pages 1877-1887, October.
    6. Yoshinobu Tamura & Shigeru Yamada, 2022. "Prototype of 3D Reliability Assessment Tool Based on Deep Learning for Edge OSS Computing," Mathematics, MDPI, vol. 10(9), pages 1-20, May.
    7. Yoshinobu Tamura & Shigeru Yamada, 2022. "Maintenance effort management based on double jump diffusion model for OSS project," Annals of Operations Research, Springer, vol. 312(1), pages 411-426, May.
    8. Ranjan Kumar & Subhash Kumar & Sanjay K. Tiwari, 2019. "A study of software reliability on big data open source software," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 10(2), pages 242-250, April.
    9. Yoshinobu Tamura & Ryota Ueki & Adarsh Anand & Shigeru Yamada, 2024. "Estimation and comparison of mean time between failures based on deep learning for OSS fault big data," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 15(8), pages 3596-3611, August.
    10. Terrence August & Marius Florin Niculescu, 2013. "The Influence of Software Process Maturity and Customer Error Reporting on Software Release and Pricing," Management Science, INFORMS, vol. 59(12), pages 2702-2726, December.
    11. Subhashis Chatterjee & Ankur Shukla & Hoang Pham, 2019. "Modeling and analysis of software fault detectability and removability with time variant fault exposure ratio, fault removal efficiency, and change point," Journal of Risk and Reliability, , vol. 233(2), pages 246-256, April.
    12. Min Xie & Chengjie Xiong & Szu-Hui Ng, 2014. "A study of N-version programming and its impact on software availability," International Journal of Systems Science, Taylor & Francis Journals, vol. 45(10), pages 2145-2157, October.
    13. Qing Tian & Chun-Wu Yeh & Chih-Chiang Fang, 2022. "Bayesian Decision Making of an Imperfect Debugging Software Reliability Growth Model with Consideration of Debuggers’ Learning and Negligence Factors," Mathematics, MDPI, vol. 10(10), pages 1-21, May.
    14. Yoshinobu Tamura & Shoichiro Miyamoto & Lei Zhou & Adarsh Anand & P. K. Kapur & Shigeru Yamada, 2024. "OSS reliability assessment method based on deep learning and independent Wiener data preprocessing," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 15(6), pages 2668-2676, June.
    15. Chih-Chiang Fang & Chun-Wu Yeh, 2016. "Effective confidence interval estimation of fault-detection process of software reliability growth models," International Journal of Systems Science, Taylor & Francis Journals, vol. 47(12), pages 2878-2892, September.
    16. Chetna Choudhary & P. K. Kapur & Sunil K. Khatri & R. Muthukumar & Avinash K. Shrivastava, 2020. "Effort based release time of software for detection and correction processes using MAUT," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 11(2), pages 367-378, July.
    17. Singhal, Shakshi & Anand, Adarsh & Singh, Ompal, 2020. "Studying dynamic market size-based adoption modeling & product diffusion under stochastic environment," Technological Forecasting and Social Change, Elsevier, vol. 161(C).
    18. Qian, Yanjun & Xie, Min & Goh, Thong Ngee & Lin, Jun, 2010. "Optimal testing strategies in overlapped design process," European Journal of Operational Research, Elsevier, vol. 206(1), pages 131-143, October.
    19. Yogita Kansal & Gurinder Singh & Uday Kumar & P. K. Kapur, 2016. "Optimal release and patching time of software with warranty," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 7(4), pages 462-468, December.
    20. Subhashis Chatterjee & Deepjyoti Saha & Akhilesh Sharma & Yogesh Verma, 2022. "Reliability and optimal release time analysis for multi up-gradation software with imperfect debugging and varied testing coverage under the effect of random field environments," Annals of Operations Research, Springer, vol. 312(1), pages 65-85, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:340:y:2024:i:1:d:10.1007_s10479-023-05240-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.