IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v99y2014i3d10.1007_s11192-014-1258-y.html
   My bibliography  Save this article

On the quality evaluation of scientific entities in Poland supported by consistency-driven pairwise comparisons method

Author

Listed:
  • Waldemar W. Koczkodaj

    (Laurentian University)

  • Konrad Kułakowski

    (AGH University of Science and Technology)

  • Antoni Ligęza

    (AGH University of Science and Technology)

Abstract

Comparison, rating, and ranking of alternative solutions, in case of multicriteria evaluations, have been an eternal focus of operations research and optimization theory. There exist numerous approaches at practical solving the multicriteria ranking problem. The recent focus of interest in this domain was the event of parametric evaluation of research entities in Poland. The principal methodology was based on pairwise comparisons. For each single comparison, four criteria have been used. One of the controversial points of the assumed approach was that the weights of these criteria were arbitrary. The main focus of this study is to put forward a theoretically justified way of extracting weights from the opinions of domain experts. Theoretical bases for the whole procedure are based on a survey and its experimental results. Discussion and comparison of the two resulting sets of weights and the computed inconsistency indicator are discussed.

Suggested Citation

  • Waldemar W. Koczkodaj & Konrad Kułakowski & Antoni Ligęza, 2014. "On the quality evaluation of scientific entities in Poland supported by consistency-driven pairwise comparisons method," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 911-926, June.
    • Handle: RePEc:spr:scient:v:99:y:2014:i:3:d:10.1007_s11192-014-1258-y
    DOI: 10.1007/s11192-014-1258-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-014-1258-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-014-1258-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. P Ji & R Jiang, 2003. "Scale transitivity in the AHP," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(8), pages 896-905, August.
    2. Dong, Yucheng & Xu, Yinfeng & Li, Hongyi & Dai, Min, 2008. "A comparative study of the numerical scales and the prioritization methods in AHP," European Journal of Operational Research, Elsevier, vol. 186(1), pages 229-242, April.
    3. Thomas L. Saaty, 2005. "The Analytic Hierarchy and Analytic Network Processes for the Measurement of Intangible Criteria and for Decision-Making," International Series in Operations Research & Management Science, in: Multiple Criteria Decision Analysis: State of the Art Surveys, chapter 0, pages 345-405, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matteo Brunelli & Michele Fedrizzi, 2019. "A general formulation for some inconsistency indices of pairwise comparisons," Annals of Operations Research, Springer, vol. 274(1), pages 155-169, March.
    2. Matteo Brunelli, 2017. "Studying a set of properties of inconsistency indices for pairwise comparisons," Annals of Operations Research, Springer, vol. 248(1), pages 143-161, January.
    3. Jacek Szybowski & Konrad Kułakowski & Sebastian Ernst, 2024. "Almost optimal manipulation of pairwise comparisons of alternatives," Journal of Global Optimization, Springer, vol. 90(1), pages 243-259, September.
    4. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dong, Yucheng & Hong, Wei-Chiang & Xu, Yinfeng & Yu, Shui, 2013. "Numerical scales generated individually for analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 229(3), pages 654-662.
    2. Carayannis, Elias G. & Goletsis, Yorgos & Grigoroudis, Evangelos, 2018. "Composite innovation metrics: MCDA and the Quadruple Innovation Helix framework," Technological Forecasting and Social Change, Elsevier, vol. 131(C), pages 4-17.
    3. Shin-Liang Chan & Wann-Ming Wey & Pin-Huai Chang, 2014. "Establishing Disaster Resilience Indicators for Tan-sui River Basin in Taiwan," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 115(1), pages 387-418, January.
    4. Styliani Karamountzou & Dimitra G. Vagiona, 2023. "Suitability and Sustainability Assessment of Existing Onshore Wind Farms in Greece," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    5. Paul Thaddeus Kazibudzki, 2016. "An examination of performance relations among selected consistency measures for simulated pairwise judgments," Annals of Operations Research, Springer, vol. 244(2), pages 525-544, September.
    6. Angilella, Silvia & Giarlotta, Alfio, 2009. "Implementations of PACMAN," European Journal of Operational Research, Elsevier, vol. 194(2), pages 474-495, April.
    7. Jih-Jeng Huang, 2021. "Analytic Hierarchy Process with the Correlation Effect via WordNet," Mathematics, MDPI, vol. 9(8), pages 1-13, April.
    8. De Brucker, Klaas & Macharis, Cathy & Verbeke, Alain, 2013. "Multi-criteria analysis and the resolution of sustainable development dilemmas: A stakeholder management approach," European Journal of Operational Research, Elsevier, vol. 224(1), pages 122-131.
    9. Mukherjee, Krishnendu, 2014. "Analytic hierarchy process and technique for order preference by similarity to ideal solution: a bibliometric analysis from past, present and future of AHP and TOPSIS," MPRA Paper 59887, University Library of Munich, Germany.
    10. Angilella, Silvia & Greco, Salvatore & Matarazzo, Benedetto, 2010. "Non-additive robust ordinal regression: A multiple criteria decision model based on the Choquet integral," European Journal of Operational Research, Elsevier, vol. 201(1), pages 277-288, February.
    11. Dong, Yucheng & Xu, Yinfeng & Li, Hongyi & Dai, Min, 2008. "A comparative study of the numerical scales and the prioritization methods in AHP," European Journal of Operational Research, Elsevier, vol. 186(1), pages 229-242, April.
    12. Klaus D. Goepel, 2019. "Comparison of Judgment Scales of the Analytical Hierarchy Process — A New Approach," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(02), pages 445-463, March.
    13. Hassan, Mohammad Nurul & Hawas, Yaser E. & Ahmed, Kamran, 2013. "A multi-dimensional framework for evaluating the transit service performance," Transportation Research Part A: Policy and Practice, Elsevier, vol. 50(C), pages 47-61.
    14. Yael Grushka-Cockayne & Bert De Reyck, 2009. "Towards a Single European Sky," Interfaces, INFORMS, vol. 39(5), pages 400-414, October.
    15. Zuo, Ting & Wei, Heng, 2019. "Bikeway prioritization to increase bicycle network connectivity and bicycle-transit connection: A multi-criteria decision analysis approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 129(C), pages 52-71.
    16. Greco, Salvatore & Mousseau, Vincent & Slowinski, Roman, 2008. "Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions," European Journal of Operational Research, Elsevier, vol. 191(2), pages 416-436, December.
    17. Feifei Dong & Yong Liu & Han Su & Zhongyao Liang & Rui Zou & Huaicheng Guo, 2016. "Uncertainty-Based Multi-Objective Decision Making with Hierarchical Reliability Analysis Under Water Resources and Environmental Constraints," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 30(2), pages 805-822, January.
    18. Pawel Tadeusz Kazibudzki & Tomasz Witold Trojanowski, 2020. "Examination of marketing mix performance in relation to sustainable development of the Poland’s confectionery industry," PLOS ONE, Public Library of Science, vol. 15(10), pages 1-25, October.
    19. Spyridoula Kakia & Georgia Pozoukidou & Dimitra G. Vagiona, 2023. "Providing an Integrated Vulnerability Assessment Indicator System (VAIS) to Measure the Spatial Vulnerability of Areas near Seveso Establishments in Thessaloniki (Greece)," Sustainability, MDPI, vol. 15(3), pages 1-18, January.
    20. József Temesi, 2011. "Pairwise comparison matrices and the error-free property of the decision maker," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(2), pages 239-249, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:99:y:2014:i:3:d:10.1007_s11192-014-1258-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.