IDEAS home Printed from https://ideas.repec.org/a/spr/ijsaem/v12y2021i3d10.1007_s13198-021-01090-2.html
   My bibliography  Save this article

Applying statistical approach to check the consistency of pairwise comparison matrices during software requirements prioritization process

Author

Listed:
  • Mohd. Sadiq

    (Indian Institute of Science)

  • Mohd. Sadim

    (Al-Falah University)

  • Azra Parveen

    (Jamia Millia Islamia (A Central University))

Abstract

In the field of software engineering, multi-criteria decision making (MCDM) methods have been applied during software requirements prioritization (SRP) process. Among various MCDM methods, analytic hierarchy process is a desired technique to compute the ranking values of the software requirements (SRs). These ranking values are employed to choose the SRs that would be executed during different releases of the software. During SRP, stakeholders specify their preferences on SRs in a matrix, which is known as pairwise comparison matrix (PCM). This matrix is used to compute the ranking values of the SRs. The ranking values of the SRs would be reliable only when the PCMs are consistent. Based on our literature review, we identify that during SRP process less attention is given to statistical based approaches to examine the consistency of PCM. Therefore, to address this issue we proposed a method for SRP which is pliable and genuine because it sets a relevant significance level according to the size of the PCMs. Finally, the proposed method is discussed by considering the SRs of an institute examination system.

Suggested Citation

  • Mohd. Sadiq & Mohd. Sadim & Azra Parveen, 2021. "Applying statistical approach to check the consistency of pairwise comparison matrices during software requirements prioritization process," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 12(3), pages 451-460, June.
    • Handle: RePEc:spr:ijsaem:v:12:y:2021:i:3:d:10.1007_s13198-021-01090-2
    DOI: 10.1007/s13198-021-01090-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13198-021-01090-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s13198-021-01090-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bana e Costa, Carlos A. & Vansnick, Jean-Claude, 2008. "A critical analysis of the eigenvalue method used to derive priorities in AHP," European Journal of Operational Research, Elsevier, vol. 187(3), pages 1422-1428, June.
    2. Vargas, Luis G., 2008. "The consistency index in reciprocal matrices: Comparison of deterministic and statistical approaches," European Journal of Operational Research, Elsevier, vol. 191(2), pages 454-463, December.
    3. Stein, William E. & Mizzi, Philip J., 2007. "The harmonic consistency index for the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 177(1), pages 488-497, February.
    4. Ergu, Daji & Kou, Gang & Peng, Yi & Shi, Yong, 2011. "A simple method to improve the consistency ratio of the pair-wise comparison matrix in ANP," European Journal of Operational Research, Elsevier, vol. 213(1), pages 246-259, August.
    5. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    6. Karapetrovic, Stanislav & Rosenbloom, E. S., 1999. "A quality control approach to consistency paradoxes in AHP," European Journal of Operational Research, Elsevier, vol. 119(3), pages 704-718, December.
    7. Changsheng Lin & Gang Kou & Daji Ergu, 2013. "An improved statistical approach for consistency test in AHP," Annals of Operations Research, Springer, vol. 211(1), pages 289-299, December.
    8. Dalia Susnienė & Ojaras Purvinis, 2015. "Empirical Insights on Understanding Stakeholder Influence," Journal of Business Economics and Management, Taylor & Francis Journals, vol. 16(4), pages 845-860, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Changsheng Lin & Gang Kou & Daji Ergu, 2013. "An improved statistical approach for consistency test in AHP," Annals of Operations Research, Springer, vol. 211(1), pages 289-299, December.
    2. Kou, Gang & Lin, Changsheng, 2014. "A cosine maximization method for the priority vector derivation in AHP," European Journal of Operational Research, Elsevier, vol. 235(1), pages 225-232.
    3. József Temesi, 2019. "An interactive approach to determine the elements of a pairwise comparison matrix," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 27(2), pages 533-549, June.
    4. Kun Chen & Gang Kou & J. Michael Tarn & Yan Song, 2015. "Bridging the gap between missing and inconsistent values in eliciting preference from pairwise comparison matrices," Annals of Operations Research, Springer, vol. 235(1), pages 155-175, December.
    5. Li, Kevin W. & Wang, Zhou-Jing & Tong, Xiayu, 2016. "Acceptability analysis and priority weight elicitation for interval multiplicative comparison matrices," European Journal of Operational Research, Elsevier, vol. 250(2), pages 628-638.
    6. Tomashevskii, I.L., 2015. "Eigenvector ranking method as a measuring tool: Formulas for errors," European Journal of Operational Research, Elsevier, vol. 240(3), pages 774-780.
    7. Paul Thaddeus Kazibudzki, 2016. "An examination of performance relations among selected consistency measures for simulated pairwise judgments," Annals of Operations Research, Springer, vol. 244(2), pages 525-544, September.
    8. Alessio Ishizaka, 2014. "Comparison of fuzzy logic, AHP, FAHP and hybrid fuzzy AHP for new supplier selection and its performance analysis," International Journal of Integrated Supply Management, Inderscience Enterprises Ltd, vol. 9(1/2), pages 1-22.
    9. A Ishizaka & D Balkenborg & T Kaplan, 2011. "Does AHP help us make a choice? An experimental evaluation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(10), pages 1801-1812, October.
    10. József Temesi, 2011. "Pairwise comparison matrices and the error-free property of the decision maker," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(2), pages 239-249, June.
    11. Wu-E Yang & Chao-Qun Ma & Zhi-Qiu Han & Wen-Jun Chen, 2016. "Checking and adjusting order-consistency of linguistic pairwise comparison matrices for getting transitive preference relations," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 38(3), pages 769-787, July.
    12. Ho, William & Ma, Xin, 2018. "The state-of-the-art integrations and applications of the analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 267(2), pages 399-414.
    13. Jiří Mazurek, 2018. "Some notes on the properties of inconsistency indices in pairwise comparisons," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 28(1), pages 27-42.
    14. Alessio Ishizaka & Sajid Siraj, 2020. "Interactive consistency correction in the analytic hierarchy process to preserve ranks," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 443-464, December.
    15. Liu, Fang & Zou, Shu-Cai & Li, Qing, 2020. "Deriving priorities from pairwise comparison matrices with a novel consistency index," Applied Mathematics and Computation, Elsevier, vol. 374(C).
    16. Matteo Brunelli, 2017. "Studying a set of properties of inconsistency indices for pairwise comparisons," Annals of Operations Research, Springer, vol. 248(1), pages 143-161, January.
    17. Brunelli, Matteo & Fedrizzi, Michele, 2015. "Boundary properties of the inconsistency of pairwise comparisons in group decisions," European Journal of Operational Research, Elsevier, vol. 240(3), pages 765-773.
    18. Dong, Yucheng & Hong, Wei-Chiang & Xu, Yinfeng & Yu, Shui, 2013. "Numerical scales generated individually for analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 229(3), pages 654-662.
    19. Ágoston, Kolos Csaba & Csató, László, 2022. "Inconsistency thresholds for incomplete pairwise comparison matrices," Omega, Elsevier, vol. 108(C).
    20. Fujun Hou, 2016. "Market Competitiveness Evaluation of Mechanical Equipment with a Pairwise Comparisons Hierarchical Model," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-18, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:ijsaem:v:12:y:2021:i:3:d:10.1007_s13198-021-01090-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.