IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v49y2015i6p2291-2306.html
   My bibliography  Save this article

An iterative expert survey approach for estimating parties’ policy positions

Author

Listed:
  • Kostas Gemenis

Abstract

This article introduces the iterative expert survey approach in estimating parties’ policy positions. Methodologically, the proposed approach is based on the tradition of ‘judgemental’ coding in the content analysis of political text, and incorporates the idea of anonymous iteration among a panel of expert coders taken from the method known as ‘Delphi’. Anonymous iteration presents an effective way of reducing the random error, and potential bias arising from inter-expert/coder disagreement evident in other popular methods. I provide an empirical demonstration of the approach by estimating parties’ policy positions in the context of a voting advice application in Germany, and argue that the method has considerable potential to generate valid and reliable data on party positions cross-nationally and retrospectively. Copyright Springer Science+Business Media Dordrecht 2015

Suggested Citation

  • Kostas Gemenis, 2015. "An iterative expert survey approach for estimating parties’ policy positions," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(6), pages 2291-2306, November.
    • Handle: RePEc:spr:qualqt:v:49:y:2015:i:6:p:2291-2306
    DOI: 10.1007/s11135-014-0109-5
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11135-014-0109-5
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11135-014-0109-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lewis, Jeffrey B. & King, Gary, 1999. "No Evidence on Directional vs. Proximity Voting," Political Analysis, Cambridge University Press, vol. 8(1), pages 21-33, January.
    2. Mikhaylov, Slava & Laver, Michael & Benoit, Kenneth R., 2012. "Coder Reliability and Misclassification in the Human Coding of Party Manifestos," Political Analysis, Cambridge University Press, vol. 20(1), pages 78-91, January.
    3. Lawrence Lau & Bruno Frey, 1971. "Ideology, public approval, and government behavior," Public Choice, Springer, vol. 10(1), pages 21-40, March.
    4. Stokes, Donald E., 1963. "Spatial Models of Party Competition," American Political Science Review, Cambridge University Press, vol. 57(2), pages 368-377, June.
    5. Mattia Zulianello, 2014. "Analyzing party competition through the comparative manifesto data: some theoretical and methodological considerations," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(3), pages 1723-1737, May.
    6. Dalton, Russell J. & Beck, Paul A. & Huckfeldt, Robert, 1998. "Partisan Cues and the Media: Information Flows in the 1992 Presidential Election," American Political Science Review, Cambridge University Press, vol. 92(1), pages 111-126, March.
    7. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    8. James Tilley & Christopher Wlezien, 2008. "Does Political Information Matter? An Experimental Test Relating to Party Positions on Europe," Political Studies, Political Studies Association, vol. 56, pages 192-214, March.
    9. Norman Dalkey & Olaf Helmer, 1963. "An Experimental Application of the DELPHI Method to the Use of Experts," Management Science, INFORMS, vol. 9(3), pages 458-467, April.
    10. Grimmer, Justin & Stewart, Brandon M., 2013. "Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts," Political Analysis, Cambridge University Press, vol. 21(3), pages 267-297, July.
    11. Jones Jr., Randall J., 2008. "The state of presidential election forecasting: The 2004 experience," International Journal of Forecasting, Elsevier, vol. 24(2), pages 310-321.
    12. Matt Golder & Jacek Stramski, 2010. "Ideological Congruence and Electoral Institutions," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 90-106, January.
    13. André Krouwel & Annemarie Elfrinkhof, 2014. "Combining strengths of methods of party positioning to counter their weaknesses: the development of a new methodology to calibrate parties on issues and ideological dimensions," Quality & Quantity: International Journal of Methodology, Springer, vol. 48(3), pages 1455-1472, May.
    14. James Tilley & Christopher Wlezien, 2008. "Does Political Information Matter? An Experimental Test Relating to Party Positions on Europe," Political Studies, Political Studies Association, vol. 56(1), pages 192-214, March.
    15. Brambor, Thomas & Clark, William Roberts & Golder, Matt, 2006. "Understanding Interaction Models: Improving Empirical Analyses," Political Analysis, Cambridge University Press, vol. 14(1), pages 63-82, January.
    16. Kenneth Benoit & Michael Laver & Slava Mikhaylov, 2009. "Treating Words as Data with Error: Uncertainty in Text Statements of Policy Positions," American Journal of Political Science, John Wiley & Sons, vol. 53(2), pages 495-513, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andres Reiljan & Lorenzo Cicchi & Diego Garzia, 2023. "Party placement in the void: the European political space in 10 years of cross-national Voting Advice Applications," RSCAS Working Papers 2023/20, European University Institute.
    2. Tiziano Gerosa & Gianluca Argentin & Alice Spada, 2024. "What are teacher relational skills? A defining study using a bottom-up modified Delphi method," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(1), pages 581-602, February.
    3. Nyhuis Dominic & König Pascal, 2018. "Estimating the Conflict Dimensionality in the German Länder from Vote Advice Applications, 2014–2017," Statistics, Politics and Policy, De Gruyter, vol. 9(1), pages 57-86, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rauh, Christian, 2018. "Validating a sentiment dictionary for German political language—a workbench note," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 15(4), pages 319-343.
    2. Merz, Nicolas & Regel, Sven & Lewandowski, Jirka, 2016. "The Manifesto Corpus: A new resource for research on political parties and quantitative text analysis," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 3(2 (April-), pages 1-8.
    3. Prommer, Lisa & Tiberius, Victor & Kraus, Sascha, 2020. "Exploring the future of startup leadership development," Journal of Business Venturing Insights, Elsevier, vol. 14(C).
    4. Prianto Budi Saptono & Gustofan Mahmud & Intan Pratiwi & Dwi Purwanto & Ismail Khozen & Muhamad Akbar Aditama & Siti Khodijah & Maria Eurelia Wayan & Rina Yuliastuty Asmara & Ferry Jie, 2023. "Development of Climate-Related Disclosure Indicators for Application in Indonesia: A Delphi Method Study," Sustainability, MDPI, vol. 15(14), pages 1-25, July.
    5. Di Zio, Simone & Bolzan, Mario & Marozzi, Marco, 2021. "Classification of Delphi outputs through robust ranking and fuzzy clustering for Delphi-based scenarios," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    6. Alyami, Saleh. H. & Rezgui, Yacine & Kwan, Alan, 2013. "Developing sustainable building assessment scheme for Saudi Arabia: Delphi consultation approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 43-54.
    7. Enriqueta Aragonès & Dimitrios Xefteris, 2017. "Imperfectly Informed Voters And Strategic Extremism," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 58(2), pages 439-471, May.
    8. James Rockey, 2009. "Who is left-wing, and who just thinks they are?," Discussion Papers in Economics 09/23, Division of Economics, School of Business, University of Leicester, revised Feb 2014.
    9. Georg Aichholzer, 2002. "Das ExpertInnen-Delphi: methodische Grundlagen und Anwendungsfeld ‘Technology Foresight‘ (The Expert Delphi: Methodology and Application in 'Technology Foresight')," ITA manu:scripts 02_01, Institute of Technology Assessment (ITA).
    10. Hayes, Tom, 2007. "Delphi study of the future of marketing of higher education," Journal of Business Research, Elsevier, vol. 60(9), pages 927-931, September.
    11. Haarhaus, Tim & Liening, Andreas, 2020. "Building dynamic capabilities to cope with environmental uncertainty: The role of strategic foresight," Technological Forecasting and Social Change, Elsevier, vol. 155(C).
    12. Ribeiro, Barbara E. & Quintanilla, Miguel A., 2015. "Transitions in biofuel technologies: An appraisal of the social impacts of cellulosic ethanol using the Delphi method," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 53-68.
    13. Pierre-Marc Daigneault & Dominic Duval & Louis M. Imbeau, 2018. "Supervised scaling of semi-structured interview transcripts to characterize the ideology of a social policy reform," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(5), pages 2151-2162, September.
    14. Yeh, Duen-Yian & Cheng, Ching-Hsue, 2015. "Recommendation system for popular tourist attractions in Taiwan using Delphi panel and repertory grid techniques," Tourism Management, Elsevier, vol. 46(C), pages 164-176.
    15. Hsin-Ke Lu & Sung-Chun Tsai & Peng-Chun Lin & Kuo-Chung Chu & Alexander N. Chen, 2020. "Toward a New Real-Time Approach for Group Consensus: A Usability Analysis of Synchronous Delphi System," Group Decision and Negotiation, Springer, vol. 29(2), pages 345-370, April.
    16. Torres-Sibille, Ana del Carmen & Cloquell-Ballester, Vicente-Agustín & Cloquell-Ballester, Víctor-Andrés & Artacho Ramírez, Miguel Ángel, 2009. "Aesthetic impact assessment of solar power plants: An objective and a subjective approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(5), pages 986-999, June.
    17. Laura Studen & Victor Tiberius, 2020. "Social Media, Quo Vadis? Prospective Development and Implications," Future Internet, MDPI, vol. 12(9), pages 1-22, August.
    18. Volkmar, Gioia & Fischer, Peter M. & Reinecke, Sven, 2022. "Artificial Intelligence and Machine Learning: Exploring drivers, barriers, and future developments in marketing management," Journal of Business Research, Elsevier, vol. 149(C), pages 599-614.
    19. Osterloh, Steffen, 2012. "Words speak louder than actions: The impact of politics on economic performance," Journal of Comparative Economics, Elsevier, vol. 40(3), pages 318-336.
    20. Kawamoto, Carlos Tadao & Wright, James Terence Coulter & Spers, Renata Giovinazzo & de Carvalho, Daniel Estima, 2019. "Can we make use of perception of questions' easiness in Delphi-like studies? Some results from an experiment with an alternative feedback," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 296-305.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:49:y:2015:i:6:p:2291-2306. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.