IDEAS home Printed from https://ideas.repec.org/a/ids/ijmdma/v8y2007i5-6p586-600.html
   My bibliography  Save this article

Determining the level of agreement of expert estimates

Author

Listed:
  • Valentinas Podvezko

Abstract

This paper considers the techniques of determining the concordance of expert estimates. Expert methods of evaluating particular criteria may be practically used, for instance, in multi-criteria decision support systems, if judgements are in good agreement. This is expressed by the concordance coefficient calculated by using expert-provided data. The concordance coefficient can be calculated only if the considered criteria are ranked. If other evaluation methods are used by experts, the data should be transformed to rankings before the calculation of the concordance coefficient is made. There is the dependence of the agreement of expert estimates on a particular method used. The highest degree of agreement has been obtained by using a direct ranking method. The effect of equally assessed criteria, that is, the tied ranks, on the concordance coefficient and thereby on the level of expert judgements agreement is usually insignificant and cannot change the results of rating.

Suggested Citation

  • Valentinas Podvezko, 2007. "Determining the level of agreement of expert estimates," International Journal of Management and Decision Making, Inderscience Enterprises Ltd, vol. 8(5/6), pages 586-600.
    • Handle: RePEc:ids:ijmdma:v:8:y:2007:i:5/6:p:586-600
    as

    Download full text from publisher

    File URL: http://www.inderscience.com/link.php?id=13420
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Edvardas Liachovičius & Viktor Skrickij & Askoldas Podviezko, 2020. "MCDM Evaluation of Asset-Based Road Freight Transport Companies Using Key Drivers That Influence the Enterprise Value," Sustainability, MDPI, vol. 12(18), pages 1-16, September.
    2. Marius Jakimavičius & Marija Burinskienė & Modesta Gusarovienė & Askoldas Podviezko, 2016. "Assessing multiple criteria for rapid bus routes in the public transport system in Vilnius," Public Transport, Springer, vol. 8(3), pages 365-385, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ids:ijmdma:v:8:y:2007:i:5/6:p:586-600. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sarah Parker (email available below). General contact details of provider: http://www.inderscience.com/browse/index.php?journalID=19 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.