IDEAS home Printed from https://ideas.repec.org/a/spr/revint/v18y2023i3d10.1007_s11558-022-09476-y.html
   My bibliography  Save this article

Measuring precision precisely: A dictionary-based measure of imprecision

Author

Listed:
  • Markus Gastinger

    (University of Salzburg)

  • Henning Schmidtke

    (Minda de Gunzburg Center for European Studies at Harvard & GIGA German Institute for Global and Area Studies)

Abstract

How can we measure and explain the precision of international organizations’ (IOs) founding treaties? We define precision by its negative – imprecision – as indeterminate language that intentionally leaves a wide margin of interpretation for actors after agreements enter into force. Compiling a “dictionary of imprecision” from almost 500 scholarly contributions and leveraging insight from linguists that a single vague word renders the whole sentence vague, we introduce a dictionary-based measure of imprecision (DIMI) that is replicable, applicable to all written documents, and yields a continuous measure bound between zero and one. To demonstrate that DIMI usefully complements existing approaches and advances the study of (im-)precision, we apply it to a sample of 76 IOs. Our descriptive results show high face validity and closely track previous characterizations of these IOs. Finally, we explore patterns in the data, expecting that imprecision in IO treaties increases with the number of states, power asymmetries, and the delegation of authority, while it decreases with the pooling of authority. In a sample of major IOs, we find robust empirical support for the power asymmetries and delegation propositions. Overall, DIMI provides exciting new avenues to study precision in International Relations and beyond.

Suggested Citation

  • Markus Gastinger & Henning Schmidtke, 2023. "Measuring precision precisely: A dictionary-based measure of imprecision," The Review of International Organizations, Springer, vol. 18(3), pages 553-571, July.
    • Handle: RePEc:spr:revint:v:18:y:2023:i:3:d:10.1007_s11558-022-09476-y
    DOI: 10.1007/s11558-022-09476-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11558-022-09476-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11558-022-09476-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mark S. Manger & Clint Peinhardt, 2017. "Learning and the Precision of International Investment Agreements," International Interactions, Taylor & Francis Journals, vol. 43(6), pages 920-940, November.
    2. Lisa Lechner, 2016. "The domestic battle over the design of non-trade issues in preferential trade agreements," Review of International Political Economy, Taylor & Francis Journals, vol. 23(5), pages 840-871, September.
    3. de Vries, Erik & Schoonvelde, Martijn & Schumacher, Gijs, 2018. "No Longer Lost in Translation: Evidence that Google Translate Works for Comparative Bag-of-Words Text Applications," Political Analysis, Cambridge University Press, vol. 26(4), pages 417-430, October.
    4. Goldstein, Judith & Martin, Lisa L., 2000. "Legalization, Trade Liberalization, and Domestic Politics: A Cautionary Note," International Organization, Cambridge University Press, vol. 54(3), pages 603-632, July.
    5. Charles B. Roger & Sam S. Rowan, 2022. "Analyzing international organizations: How the concepts we use affect the answers we get," The Review of International Organizations, Springer, vol. 17(3), pages 597-625, July.
    6. Melissa Carlson & Barbara Koremenos, 2021. "Cooperation Failure or Secret Collusion? Absolute Monarchs and Informal Cooperation," The Review of International Organizations, Springer, vol. 16(1), pages 95-135, January.
    7. Liesbet Hooghe & Gary Marks, 2015. "Delegation and pooling in international organizations," The Review of International Organizations, Springer, vol. 10(3), pages 305-328, September.
    8. Oliver E. Williamson, 2000. "The New Institutional Economics: Taking Stock, Looking Ahead," Journal of Economic Literature, American Economic Association, vol. 38(3), pages 595-613, September.
    9. Snidal, Duncan, 1985. "Coordination versus Prisoners' Dilemma: Implications for International Cooperation and Regimes," American Political Science Review, Cambridge University Press, vol. 79(4), pages 923-942, December.
    10. Hyde, Susan D. & Saunders, Elizabeth N., 2020. "Recapturing Regime Type in International Relations: Leaders, Institutions, and Agency Space," International Organization, Cambridge University Press, vol. 74(2), pages 363-395, April.
    11. Randall Stone, 2013. "Informal governance in international organizations: Introduction to the special issue," The Review of International Organizations, Springer, vol. 8(2), pages 121-136, June.
    12. Jean Tirole, 1999. "Incomplete Contracts: Where Do We Stand?," Econometrica, Econometric Society, vol. 67(4), pages 741-782, July.
    13. Tobias Böhmelt & Gabriele Spilker, 2016. "The interaction of international institutions from a social network perspective," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 16(1), pages 67-89, February.
    14. Däubler, Thomas & Benoit, Kenneth & Mikhaylov, Slava & Laver, Michael, 2012. "Natural Sentences as Valid Units for Coded Political Texts," British Journal of Political Science, Cambridge University Press, vol. 42(4), pages 937-951, October.
    15. Abbott, Kenneth W. & Snidal, Duncan, 2000. "Hard and Soft Law in International Governance," International Organization, Cambridge University Press, vol. 54(3), pages 421-456, July.
    16. Walter Mattli & Alec Stone Sweet, 2012. "Regional Integration and the Evolution of the European Polity: On the Fiftieth Anniversary of the Journal of Common Market Studies," Journal of Common Market Studies, Wiley Blackwell, vol. 50(S1), pages 1-17, March.
    17. Abbott, Kenneth W. & Keohane, Robert O. & Moravcsik, Andrew & Slaughter, Anne-Marie & Snidal, Duncan, 2000. "The Concept of Legalization," International Organization, Cambridge University Press, vol. 54(3), pages 401-419, July.
    18. David Lake, 2007. "Delegating divisible sovereignty: Sweeping a conceptual minefield," The Review of International Organizations, Springer, vol. 2(3), pages 219-237, September.
    19. Baccini, Leonardo & Dür, Andreas & Elsig, Manfred, 2015. "The politics of trade agreement design: revisiting the depth-flexibility nexus," LSE Research Online Documents on Economics 62303, London School of Economics and Political Science, LSE Library.
    20. Koremenos, Barbara & Lipson, Charles & Snidal, Duncan, 2001. "The Rational Design of International Institutions," International Organization, Cambridge University Press, vol. 55(4), pages 761-799, October.
    21. Thompson, Alexander & Broude, Tomer & Haftel, Yoram Z., 2019. "Once Bitten, Twice Shy? Investment Disputes, State Sovereignty, and Change in Treaty Design," International Organization, Cambridge University Press, vol. 73(4), pages 859-880, October.
    22. Gabriele Spilker & Tobias Böhmelt, 2013. "The impact of preferential trade agreements on governmental repression revisited," The Review of International Organizations, Springer, vol. 8(3), pages 343-361, September.
    23. Thomas Bernauer & Anna Kalbhenn & Vally Koubi & Gabriele Spilker, 2013. "Is there a “Depth versus Participation” dilemma in international cooperation?," The Review of International Organizations, Springer, vol. 8(4), pages 477-497, December.
    24. RonaldB. Mitchell & LilianaB. Andonova & Mark Axelrod & Jörg Balsiger & Thomas Bernauer & JessicaF. Green & James Hollway & RakhyunE. Kim & Jean-Frédéric Morin, 2020. "What We Know (and Could Know) About International EnvironmentalAgreements," Global Environmental Politics, MIT Press, vol. 20(1), pages 103-121, February.
    25. Linos, Katerina & Pegram, Tom, 2016. "The Language of Compromise in International Agreements," International Organization, Cambridge University Press, vol. 70(3), pages 587-621, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tobias Lenz & Besir Ceka & Liesbet Hooghe & Gary Marks & Alexandr Burilkov, 2023. "Discovering cooperation: Endogenous change in international organizations," The Review of International Organizations, Springer, vol. 18(4), pages 631-666, October.
    2. Tobias Böhmelt & Edita Butkutė, 2018. "The self-selection of democracies into treaty design: insights from international environmental agreements," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 18(3), pages 351-367, June.
    3. Christoph Mödlhamer, 2020. "Innovativeness and the design of intellectual property rights in preferential trade agreements: A refinement of the North–South explanation," Journal of International Business Policy, Palgrave Macmillan, vol. 3(4), pages 329-348, December.
    4. Oliver Westerwinter & Kenneth W. Abbott & Thomas Biersteker, 2021. "Informal governance in world politics," The Review of International Organizations, Springer, vol. 16(1), pages 1-27, January.
    5. Tobias Böhmelt & Gabriele Spilker, 2016. "The interaction of international institutions from a social network perspective," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 16(1), pages 67-89, February.
    6. Tobias Böhmelt, 2022. "Environmental-agreement design and political ideology in democracies," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 22(3), pages 507-525, September.
    7. Francisco Santos-Carrillo & Luis A. Fernández-Portillo & Antonio Sianes, 2020. "Rethinking the Governance of the 2030 Agenda for Sustainable Development in the COVID-19 Era," Sustainability, MDPI, vol. 12(18), pages 1-24, September.
    8. Adela Toscano-Valle & Antonio Sianes & Francisco Santos-Carrillo & Luis A. Fernández-Portillo, 2022. "Can the Rational Design of International Institutions Solve Cooperation Problems? Insights from a Systematic Literature Review," Sustainability, MDPI, vol. 14(13), pages 1-22, June.
    9. Thomas Bernauer & Anna Kalbhenn & Vally Koubi & Gabriele Spilker, 2013. "Is there a “Depth versus Participation” dilemma in international cooperation?," The Review of International Organizations, Springer, vol. 8(4), pages 477-497, December.
    10. Oliver Westerwinter, 2017. "Barbara Koremenos. 2016. The continent of international law. Explaining agreement design. (Cambridge: Cambridge University Press)," The Review of International Organizations, Springer, vol. 12(4), pages 647-651, December.
    11. Maximilian S. T. Wanner, 0. "The effectiveness of soft law in international environmental regimes: participation and compliance in the Hyogo Framework for Action," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 0, pages 1-20.
    12. Maximilian S. T. Wanner, 2021. "The effectiveness of soft law in international environmental regimes: participation and compliance in the Hyogo Framework for Action," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 21(1), pages 113-132, March.
    13. Bernhard Reinsberg & Oliver Westerwinter, 2021. "The global governance of international development: Documenting the rise of multi-stakeholder partnerships and identifying underlying theoretical explanations," The Review of International Organizations, Springer, vol. 16(1), pages 59-94, January.
    14. Felicity Vabulas & Duncan Snidal, 2013. "Organization without delegation: Informal intergovernmental organizations (IIGOs) and the spectrum of intergovernmental arrangements," The Review of International Organizations, Springer, vol. 8(2), pages 193-220, June.
    15. Thomas Sommerer & Theresa Squatrito & Jonas Tallberg & Magnus Lundgren, 2022. "Decision-making in international organizations: institutional design and performance," The Review of International Organizations, Springer, vol. 17(4), pages 815-845, October.
    16. Michael Zürn & Alexandros Tokhi & Martin Binder, 2021. "The International Authority Database," Global Policy, London School of Economics and Political Science, vol. 12(4), pages 430-442, September.
    17. repec:got:cegedp:94 is not listed on IDEAS
    18. Liesbet Hooghe & Gary Marks, 2015. "Delegation and pooling in international organizations," The Review of International Organizations, Springer, vol. 10(3), pages 305-328, September.
    19. Fabio Franchino & Camilla Mariotto, 2021. "Noncompliance risk, asymmetric power and the design of enforcement of the European economic governance," European Union Politics, , vol. 22(4), pages 591-610, December.
    20. Oliver Westerwinter, 2015. "Joost Pauwelyn, Ramses A. Wessel and Jan Wouters (Eds.). 2012. Informal international lawmaking. (Oxford: Oxford University Press)," The Review of International Organizations, Springer, vol. 10(1), pages 97-101, March.
    21. Charles B. Roger & Sam S. Rowan, 2022. "Analyzing international organizations: How the concepts we use affect the answers we get," The Review of International Organizations, Springer, vol. 17(3), pages 597-625, July.

    More about this item

    Keywords

    International organizations; Design of international institutions; Legalization; Precision; Text as data; Dictionary-based approach;
    All these keywords.

    JEL classification:

    • F51 - International Economics - - International Relations, National Security, and International Political Economy - - - International Conflicts; Negotiations; Sanctions
    • F53 - International Economics - - International Relations, National Security, and International Political Economy - - - International Agreements and Observance; International Organizations
    • F55 - International Economics - - International Relations, National Security, and International Political Economy - - - International Institutional Arrangements
    • D86 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Economics of Contract Law

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:revint:v:18:y:2023:i:3:d:10.1007_s11558-022-09476-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.