IDEAS home Printed from https://ideas.repec.org/a/sae/eeupol/v6y2005i3p315-337.html
   My bibliography  Save this article

Assessing the Reliability and Validity of Expert Interviews

Author

Listed:
  • Han Dorussen

    (University of Essex, UK, hdorus@essex.ac.uk)

  • Hartmut Lenz

    (University of Essex, UK, hlenz@essex.ac.uk)

  • Spyros Blavoukos

    (University of Essex, UK, sblavo@aueb.gr)

Abstract

Testing the reliability of experts should be a key element of expert interviews. Using the Condorcet Jury Theorem, it is shown that expert reliability can provide an indication of the validity of expert-opinion data. The theoretical framework is applied to expert-interview data collected in the Domestic Structures and European Integration (DOSEI) project. Special attention is paid to the role of ‘leading’ experts and salient issues. Evaluating the DOSEI data, the main findings are that (i) with some exceptions, there are acceptable levels of inter-expert agreement, (ii) whether the leading expert is included or not does not make a large difference to expert agreement, and (iii) experts are more in agreement on salient issues.

Suggested Citation

  • Han Dorussen & Hartmut Lenz & Spyros Blavoukos, 2005. "Assessing the Reliability and Validity of Expert Interviews," European Union Politics, , vol. 6(3), pages 315-337, September.
    • Handle: RePEc:sae:eeupol:v:6:y:2005:i:3:p:315-337
    DOI: 10.1177/1465116505054835
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1465116505054835
    Download Restriction: no
    File URL: https://libkey.io/10.1177/1465116505054835?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kolbe, Richard H & Burnett, Melissa S, 1991. "Content-Analysis Research: An Examination of Applications with Directives for Improving Research Reliability and Objectivity," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 18(2), pages 243-250, September.
    2. Nitzan, Shmuel & Paroush, Jacob, 1982. "Optimal Decision Rules in Uncertain Dichotomous Choice Situations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 23(2), pages 289-297, June.
    3. Dyson, Kenneth & Featherstone, Kevin, 1999. "The Road To Maastricht: Negotiating Economic and Monetary Union," OUP Catalogue, Oxford University Press, number 9780198296386.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kalaba, Felix Kanungwe, 2016. "Barriers to policy implementation and implications for Zambia's forest ecosystems," Forest Policy and Economics, Elsevier, vol. 69(C), pages 40-44.
    2. Rehner, Robert & McCauley, Darren, 2016. "Security, justice and the energy crossroads: Assessing the implications of the nuclear phase-out in Germany," Energy Policy, Elsevier, vol. 88(C), pages 289-298.
    3. Mengelkamp, Esther & Schlund, David & Weinhardt, Christof, 2019. "Development and real-world application of a taxonomy for business models in local energy markets," Applied Energy, Elsevier, vol. 256(C).
    4. Thomas König & Daniel Finke, 2007. "Reforming the equilibrium? Veto players and policy change in the European constitution-building process," The Review of International Organizations, Springer, vol. 2(2), pages 153-176, June.
    5. Faxi Yuan & Rui Liu, 2018. "Crowdsourcing for forensic disaster investigations: Hurricane Harvey case study," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 93(3), pages 1529-1546, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Namrata Sandhu, 2019. "Fueling Gender Stereotypes: A Content Analysis of Automobile Advertisements," Business Perspectives and Research, , vol. 7(2), pages 163-178, July.
    2. Chiara Mauri & Angelo Di Gregorio & Alice Mazzucchelli & Isabella Maggioni, 2017. "The employability of marketing graduates in the era of digitalisation and globalisation," MERCATI & COMPETITIVIT?, FrancoAngeli Editore, vol. 2017(4), pages 103-124.
    3. Jörg Bibow, 2018. "How Germany’s anti-Keynesianism has brought Europe to its knees," International Review of Applied Economics, Taylor & Francis Journals, vol. 32(5), pages 569-588, September.
    4. Smith, Andrew N. & Fischer, Eileen & Yongjian, Chen, 2012. "How Does Brand-related User-generated Content Differ across YouTube, Facebook, and Twitter?," Journal of Interactive Marketing, Elsevier, vol. 26(2), pages 102-113.
    5. Sophie Jacquot & Cornelia Woll, 2003. "Usage of European Integration - Europeanisation from a Sociological Perspective," SciencePo Working papers Main hal-01019642, HAL.
    6. Ruth Ben-Yashar & Shmuel Nitzan, 2017. "Is diversity in capabilities desirable when adding decision makers?," Theory and Decision, Springer, vol. 82(3), pages 395-402, March.
    7. Dhillon, Amrita & Kotsialou, Grammateia & Xefteris, Dimitris, 2021. "Information Aggregation with Delegation of Votes," SocArXiv ubk7p, Center for Open Science.
    8. Scott Feld & Bernard Grofman, 1984. "The accuracy of group majority decisions in groups with added members," Public Choice, Springer, vol. 42(3), pages 273-285, January.
    9. Xiaohong Yu & Zhaoyang Sun, 2022. "The company they keep: When and why Chinese judges engage in collegiality," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 19(4), pages 936-1002, December.
    10. Maschke, Andreas, 2024. "Talking exports: The representation of Germany's current account in newspaper media," MPIfG Discussion Paper 24/1, Max Planck Institute for the Study of Societies.
    11. Parijat Chakrabarti & Margaret Frye, 2017. "A mixed-methods framework for analyzing text data: Integrating computational techniques with qualitative methods in demography," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 37(42), pages 1351-1382.
    12. Jorg Bibow, 2015. "The Euro's Savior? Assessing the ECB's Crisis Management Performance and Potential for Crisis Resolution," Economics Working Paper Archive wp_845, Levy Economics Institute.
    13. Eyal Baharad & Jacob Goldberger & Moshe Koppel & Shmuel Nitzan, 2012. "Beyond Condorcet: optimal aggregation rules using voting records," Theory and Decision, Springer, vol. 72(1), pages 113-130, January.
    14. Luca Fornaro, 2022. "A Theory of Monetary Union and Financial Integration," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(4), pages 1911-1947.
    15. Tony Cooper & Constantino Stavros & Angela R. Dobele, 2019. "The levers of engagement: an exploration of governance in an online brand community," Journal of Brand Management, Palgrave Macmillan, vol. 26(3), pages 240-254, May.
    16. Jacob Paroush, 1997. "Order relations among efficient decision rules," Theory and Decision, Springer, vol. 43(3), pages 209-218, November.
    17. Scharpf, Fritz W., 2011. "Monetary union, fiscal crisis and the preemption of democracy," MPIfG Discussion Paper 11/11, Max Planck Institute for the Study of Societies.
    18. Lei Du & Yingbin Feng & Li Yaning Tang & Wei Kang & Wei Lu, 2020. "Networks in disaster emergency management: a systematic review," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 103(1), pages 1-27, August.
    19. Pullig, Chris & Maxham, James III & Hair, Joseph Jr., 2002. "Salesforce automation systems: an exploratory examination of organizational factors associated with effective implementation and salesforce productivity," Journal of Business Research, Elsevier, vol. 55(5), pages 401-415, May.
    20. Smith, Ronn J. & Knuff, David C. & Sprott, David E. & Spangenberg, Eric R., 2013. "The influence of negative marketplace information on consumer attitudes toward a service establishment," Journal of Retailing and Consumer Services, Elsevier, vol. 20(3), pages 358-364.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:eeupol:v:6:y:2005:i:3:p:315-337. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.