IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v7y2019i12p1215-d296053.html
   My bibliography  Save this article

A New Criterion for Model Selection

Author

Listed:
  • Hoang Pham

    (Department of Industrial and Systems Engineering, Rutgers University, Piscataway, NJ 08854, USA)

Abstract

Selecting the best model from a set of candidates for a given set of data is obviously not an easy task. In this paper, we propose a new criterion that takes into account a larger penalty when adding too many coefficients (or estimated parameters) in the model from too small a sample in the presence of too much noise, in addition to minimizing the sum of squares error. We discuss several real applications that illustrate the proposed criterion and compare its results to some existing criteria based on a simulated data set and some real datasets including advertising budget data, newly collected heart blood pressure health data sets and software failure data.

Suggested Citation

  • Hoang Pham, 2019. "A New Criterion for Model Selection," Mathematics, MDPI, vol. 7(12), pages 1-12, December.
    • Handle: RePEc:gam:jmathe:v:7:y:2019:i:12:p:1215-:d:296053
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/7/12/1215/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/7/12/1215/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hoang Pham, 2006. "System Software Reliability," Springer Series in Reliability Engineering, Springer, number 978-1-84628-295-9, July.
    2. Qiuying Li & Hoang Pham, 2017. "A testing-coverage software reliability model considering fault removal efficiency and error generation," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-25, July.
    3. Kwang Yoon Song & In Hong Chang & Hoang Pham, 2019. "A Testing Coverage Model Based on NHPP Software Reliability Considering the Software Operating Environment and the Sensitivity Analysis," Mathematics, MDPI, vol. 7(5), pages 1-21, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chun-Chieh Tseng & Kuo-Ching Chiou & Kuen-Suan Chen, 2022. "Estimation of the Six Sigma Quality Index," Mathematics, MDPI, vol. 10(19), pages 1-13, September.
    2. Kanthilanka, H. & Ramilan, T. & Farquharson, R.J. & Weerahewa, J., 2023. "Optimal nitrogen fertilizer decisions for rice farming in a cascaded tank system in Sri Lanka: An analysis using an integrated crop, hydro-nutrient and economic model," Agricultural Systems, Elsevier, vol. 207(C).
    3. Monika Trojanová & Alexander Hošovský & Tomáš Čakurda, 2022. "Evaluation of Machine Learning-Based Parsimonious Models for Static Modeling of Fluidic Muscles in Compliant Mechanisms," Mathematics, MDPI, vol. 11(1), pages 1-33, December.
    4. Mohammad Rasoul Nazari Sendi & Iraj Hassanzad Navroodi & Aman Mohammad Kalteh, . "Estimation of Fagus orientalis Lipsky height using nonlinear models in Hyrcanian forests, Iran," Journal of Forest Science, Czech Academy of Agricultural Sciences, vol. 0.
    5. Piotr Michalak, 2023. "Simulation and Experimental Study on the Use of Ventilation Air for Space Heating of a Room in a Low-Energy Building," Energies, MDPI, vol. 16(8), pages 1-17, April.
    6. Ahmad Al Humssi & Maria Petrovskaya & Milana Abueva, 2022. "Modelling the Impact of World Oil Prices and the Mining and Quarrying Sector on the United Arab Emirates’ GDP," Mathematics, MDPI, vol. 11(1), pages 1-22, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tahere Yaghoobi & Man-Fai Leung, 2023. "Modeling Software Reliability with Learning and Fatigue," Mathematics, MDPI, vol. 11(16), pages 1-20, August.
    2. Kwang Yoon Song & In Hong Chang & Hoang Pham, 2019. "A Testing Coverage Model Based on NHPP Software Reliability Considering the Software Operating Environment and the Sensitivity Analysis," Mathematics, MDPI, vol. 7(5), pages 1-21, May.
    3. Qing Tian & Chun-Wu Yeh & Chih-Chiang Fang, 2022. "Bayesian Decision Making of an Imperfect Debugging Software Reliability Growth Model with Consideration of Debuggers’ Learning and Negligence Factors," Mathematics, MDPI, vol. 10(10), pages 1-21, May.
    4. Liviu Adrian COTFAS & Andreea DIOSTEANU, 2010. "Software Reliability in Semantic Web Service Composition Applications," Informatica Economica, Academy of Economic Studies - Bucharest, Romania, vol. 14(4), pages 48-56.
    5. Vibha Verma & Sameer Anand & P. K. Kapur & Anu G. Aggarwal, 2022. "Unified framework to assess software reliability and determine optimal release time in presence of fault reduction factor, error generation and fault removal efficiency," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 13(5), pages 2429-2441, October.
    6. Congcong Zhou & Zhenzhong Shen & Liqun Xu & Yiqing Sun & Wenbing Zhang & Hongwei Zhang & Jiayi Peng, 2023. "Global Sensitivity Analysis Method for Embankment Dam Slope Stability Considering Seepage–Stress Coupling under Changing Reservoir Water Levels," Mathematics, MDPI, vol. 11(13), pages 1-24, June.
    7. Shakshi Singhal & P. K. Kapur & Vivek Kumar & Saurabh Panwar, 2024. "Stochastic debugging based reliability growth models for Open Source Software project," Annals of Operations Research, Springer, vol. 340(1), pages 531-569, September.
    8. Subhashis Chatterjee & Shobhit Nigam & Jeetendra Bahadur Singh & Lakshmi Narayan Upadhyaya, 2012. "Effect of change point and imperfect debugging in software reliability and its optimal release policy," Mathematical and Computer Modelling of Dynamical Systems, Taylor & Francis Journals, vol. 18(5), pages 539-551, March.
    9. Wang, Jinyong & Wu, Zhibo, 2016. "Study of the nonlinear imperfect software debugging model," Reliability Engineering and System Safety, Elsevier, vol. 153(C), pages 180-192.
    10. Subhashis Chatterjee & Jeetendra B. Singh & Arunava Roy, 2015. "A structure-based software reliability allocation using fuzzy analytic hierarchy process," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(3), pages 513-525, February.
    11. Gaurav Mishra & P. K. Kapur & Anu G. Aggarwal, 2023. "A generalized multi-upgradation SRGM considering uncertainty of random field operating environments," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 14(1), pages 328-336, March.
    12. Bistouni, Fathollah & Jahanshahi, Mohsen, 2017. "Remove and contraction: A novel method for calculating the reliability of Ethernet ring mesh networks," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 362-375.
    13. Vikas Dhaka & Nidhi Nijhawan, 2024. "Effect of change in environment on reliability growth modeling integrating fault reduction factor and change point: a general approach," Annals of Operations Research, Springer, vol. 340(1), pages 181-215, September.
    14. Ranjan Kumar & Subhash Kumar & Sanjay K. Tiwari, 2019. "A study of software reliability on big data open source software," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 10(2), pages 242-250, April.
    15. Utkin, Lev V. & Coolen, Frank P.A., 2018. "A robust weighted SVR-based software reliability growth model," Reliability Engineering and System Safety, Elsevier, vol. 176(C), pages 93-101.
    16. Da Hye Lee & In Hong Chang & Hoang Pham, 2020. "Software Reliability Model with Dependent Failures and SPRT," Mathematics, MDPI, vol. 8(8), pages 1-14, August.
    17. Anshul Tickoo & P. K. Kapur & A. K. Shrivastava & Sunil K. Khatri, 2016. "Testing effort based modeling to determine optimal release and patching time of software," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 7(4), pages 427-434, December.
    18. Hoang Pham, 2020. "Estimating the COVID-19 Death Toll by Considering the Time-Dependent Effects of Various Pandemic Restrictions," Mathematics, MDPI, vol. 8(9), pages 1-12, September.
    19. Yi-Ting Chen & Edward W. Sun & Yi-Bing Lin, 2019. "Coherent quality management for big data systems: a dynamic approach for stochastic time consistency," Annals of Operations Research, Springer, vol. 277(1), pages 3-32, June.
    20. Vishal Pradhan & Ajay Kumar & Joydip Dhar, 2022. "Modelling software reliability growth through generalized inflection S-shaped fault reduction factor and optimal release time," Journal of Risk and Reliability, , vol. 236(1), pages 18-36, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:7:y:2019:i:12:p:1215-:d:296053. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.