IDEAS home Printed from https://ideas.repec.org/a/sae/eeupol/v6y2005i3p315-337.html
   My bibliography  Save this article

Assessing the Reliability and Validity of Expert Interviews

Author

Listed:
  • Han Dorussen

    (University of Essex, UK, hdorus@essex.ac.uk)

  • Hartmut Lenz

    (University of Essex, UK, hlenz@essex.ac.uk)

  • Spyros Blavoukos

    (University of Essex, UK, sblavo@aueb.gr)

Abstract

Testing the reliability of experts should be a key element of expert interviews. Using the Condorcet Jury Theorem, it is shown that expert reliability can provide an indication of the validity of expert-opinion data. The theoretical framework is applied to expert-interview data collected in the Domestic Structures and European Integration (DOSEI) project. Special attention is paid to the role of ‘leading’ experts and salient issues. Evaluating the DOSEI data, the main findings are that (i) with some exceptions, there are acceptable levels of inter-expert agreement, (ii) whether the leading expert is included or not does not make a large difference to expert agreement, and (iii) experts are more in agreement on salient issues.

Suggested Citation

  • Han Dorussen & Hartmut Lenz & Spyros Blavoukos, 2005. "Assessing the Reliability and Validity of Expert Interviews," European Union Politics, , vol. 6(3), pages 315-337, September.
    • Handle: RePEc:sae:eeupol:v:6:y:2005:i:3:p:315-337
    DOI: 10.1177/1465116505054835
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1465116505054835
    Download Restriction: no
    File URL: https://libkey.io/10.1177/1465116505054835?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kolbe, Richard H & Burnett, Melissa S, 1991. "Content-Analysis Research: An Examination of Applications with Directives for Improving Research Reliability and Objectivity," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 18(2), pages 243-250, September.
    2. Nitzan, Shmuel & Paroush, Jacob, 1982. "Optimal Decision Rules in Uncertain Dichotomous Choice Situations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 23(2), pages 289-297, June.
    3. Dyson, Kenneth & Featherstone, Kevin, 1999. "The Road To Maastricht: Negotiating Economic and Monetary Union," OUP Catalogue, Oxford University Press, number 9780198296386.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rehner, Robert & McCauley, Darren, 2016. "Security, justice and the energy crossroads: Assessing the implications of the nuclear phase-out in Germany," Energy Policy, Elsevier, vol. 88(C), pages 289-298.
    2. Mengelkamp, Esther & Schlund, David & Weinhardt, Christof, 2019. "Development and real-world application of a taxonomy for business models in local energy markets," Applied Energy, Elsevier, vol. 256(C).
    3. Thomas König & Daniel Finke, 2007. "Reforming the equilibrium? Veto players and policy change in the European constitution-building process," The Review of International Organizations, Springer, vol. 2(2), pages 153-176, June.
    4. Faxi Yuan & Rui Liu, 2018. "Crowdsourcing for forensic disaster investigations: Hurricane Harvey case study," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 93(3), pages 1529-1546, September.
    5. Kalaba, Felix Kanungwe, 2016. "Barriers to policy implementation and implications for Zambia's forest ecosystems," Forest Policy and Economics, Elsevier, vol. 69(C), pages 40-44.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Namrata Sandhu, 2019. "Fueling Gender Stereotypes: A Content Analysis of Automobile Advertisements," Business Perspectives and Research, , vol. 7(2), pages 163-178, July.
    2. Chiara Mauri & Angelo Di Gregorio & Alice Mazzucchelli & Isabella Maggioni, 2017. "The employability of marketing graduates in the era of digitalisation and globalisation," MERCATI & COMPETITIVIT?, FrancoAngeli Editore, vol. 2017(4), pages 103-124.
    3. Jörg Bibow, 2018. "How Germany’s anti-Keynesianism has brought Europe to its knees," International Review of Applied Economics, Taylor & Francis Journals, vol. 32(5), pages 569-588, September.
    4. Sophie Jacquot & Cornelia Woll, 2003. "Usage of European Integration - Europeanisation from a Sociological Perspective," SciencePo Working papers Main hal-01019642, HAL.
    5. Xiaohong Yu & Zhaoyang Sun, 2022. "The company they keep: When and why Chinese judges engage in collegiality," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 19(4), pages 936-1002, December.
    6. Eyal Baharad & Jacob Goldberger & Moshe Koppel & Shmuel Nitzan, 2012. "Beyond Condorcet: optimal aggregation rules using voting records," Theory and Decision, Springer, vol. 72(1), pages 113-130, January.
    7. Jacob Paroush, 1997. "Order relations among efficient decision rules," Theory and Decision, Springer, vol. 43(3), pages 209-218, November.
    8. Lei Du & Yingbin Feng & Li Yaning Tang & Wei Kang & Wei Lu, 2020. "Networks in disaster emergency management: a systematic review," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 103(1), pages 1-27, August.
    9. Pullig, Chris & Maxham, James III & Hair, Joseph Jr., 2002. "Salesforce automation systems: an exploratory examination of organizational factors associated with effective implementation and salesforce productivity," Journal of Business Research, Elsevier, vol. 55(5), pages 401-415, May.
    10. Kowalski, Tadeusz & Pietrzykowski, Maciej, 2010. "The economic and monetary union vs. shifts in competitiveness of member states," MPRA Paper 33995, University Library of Munich, Germany.
    11. Conitzer, Vincent, 2012. "Should social network structure be taken into account in elections?," Mathematical Social Sciences, Elsevier, vol. 64(1), pages 100-102.
    12. Eichengreen, Barry & Naef, Alain, 2022. "Imported or home grown? The 1992–3 EMS crisis," Journal of International Economics, Elsevier, vol. 138(C).
    13. Chilombo, Andrew & Van Der Horst, Dan, 2021. "Livelihoods and coping strategies of local communities on previous customary land in limbo of commercial agricultural development: Lessons from the farm block program in Zambia," Land Use Policy, Elsevier, vol. 104(C).
    14. Scott L. Greer, 2015. "States, Debt & Power: ‘Saints’ & ‘Sinners’ in European History & Integration, by Kenneth Dyson," Publius: The Journal of Federalism, CSF Associates Inc., vol. 45(3), pages 1-10.
    15. Ivo Maes & Lucia Quaglia, 2003. "The process of european monetary integration: a comparison of the belgian and italian approaches," BNL Quarterly Review, Banca Nazionale del Lavoro, vol. 56(227), pages 299-335.
    16. Gabriel, Ricardo Duque & Pessoa, Ana Sofia, 2024. "Adopting the euro: A synthetic control approach," European Journal of Political Economy, Elsevier, vol. 83(C).
    17. Baharad, Eyal & Ben-Yashar, Ruth & Patal, Tal, 2020. "On the merit of non-specialization in the context of majority voting," Journal of Mathematical Economics, Elsevier, vol. 87(C), pages 128-133.
    18. Otto H. Swank & Phongthorn Wrasai, 2002. "Deliberation, Information Aggregation and Collective Decision Making," Tinbergen Institute Discussion Papers 02-006/1, Tinbergen Institute, revised 03 Dec 2002.
    19. Bezalel Peleg & Shmuel Zamir, 2012. "Extending the Condorcet Jury Theorem to a general dependent jury," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(1), pages 91-125, June.
    20. Höpner, Martin & Schäfer, Armin (ed.), 2008. "Die Politische Ökonomie der europäischen Integration," Schriften aus dem Max-Planck-Institut für Gesellschaftsforschung Köln, Max Planck Institute for the Study of Societies, volume 61, number 61.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:eeupol:v:6:y:2005:i:3:p:315-337. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.