IDEAS home Printed from https://ideas.repec.org/a/cup/jwecon/v16y2021i3p321-342_5.html
   My bibliography  Save this article

Wine Ratings: Seeking a Consensus among Tasters via Normalization, Approval, and Aggregation

Author

Listed:
  • Gergaud, Olivier
  • Ginsburgh, Victor
  • Moreno-Ternero, Juan D.

Abstract

The modern era of wine journalism has provided abundant information about wines and widespread use of numerical rating systems. A tiny difference, especially at the top of the distribution of ratings, may have striking consequences on wine sales and investment returns. This article provides a general framework to obtain a consensus among tasters’ opinions (reflected as numerical wine ratings) via three subsequent stages: normalization, approval, and aggregation. It is inspired by contributions in political science, social choice, game theory, and operations research. We apply it to the Judgment of Paris as well as to rank 2018 en-primeur Bordeaux wines, rated by five international experts. (JEL Classifications: C18, L15, L66)

Suggested Citation

  • Gergaud, Olivier & Ginsburgh, Victor & Moreno-Ternero, Juan D., 2021. "Wine Ratings: Seeking a Consensus among Tasters via Normalization, Approval, and Aggregation," Journal of Wine Economics, Cambridge University Press, vol. 16(3), pages 321-342, August.
    • Handle: RePEc:cup:jwecon:v:16:y:2021:i:3:p:321-342_5
    as

    Download full text from publisher

    File URL: https://www.cambridge.org/core/product/identifier/S1931436121000158/type/journal_article
    File Function: link to article abstract page
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ginsburgh, Victor & Zang, Israël, 2012. "Shapley Ranking of Wines," Journal of Wine Economics, Cambridge University Press, vol. 7(2), pages 169-180, November.
    2. Gerald J. Glasser, 1959. "Game Theory and Cumulative Voting for Corporate Directors," Management Science, INFORMS, vol. 5(2), pages 151-156, January.
    3. Marks, Denton, 2020. "Erring Experts? A Critique of Wine Ratings as Hedonic Scaling," Journal of Wine Economics, Cambridge University Press, vol. 15(4), pages 386-393, November.
    4. Ashton, Robert H., 2012. "Reliability and Consensus of Experienced Wine Judges: Expertise Within and Between?," Journal of Wine Economics, Cambridge University Press, vol. 7(1), pages 70-87, May.
    5. Conrad, Jon M. & Gomez, Miguel I. & Lamadrid, Alberto J., 2010. "Wine in Your Knapsack?," Working Papers 126966, Cornell University, Department of Applied Economics and Management.
    6. Cicchetti, Domenic V., 2006. "The Paris 1976 Wine Tastings Revisited Once More: Comparing Ratings of Consistent and Inconsistent Tasters," Journal of Wine Economics, Cambridge University Press, vol. 1(2), pages 125-140, October.
    7. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "The skewness of science in 219 sub-fields and a number of aggregates," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 385-397, August.
    8. Bodington, Jeffrey C., 2017. "The Distribution of Ratings Assigned to Blind Replicates," Journal of Wine Economics, Cambridge University Press, vol. 12(4), pages 363-369, November.
    9. Gustavo Bergantiños & Juan D. Moreno-Ternero, 2022. "On the axiomatic approach to sharing the revenues from broadcasting sports leagues," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 58(2), pages 321-347, February.
    10. Robert J. Weber, 1995. "Approval Voting," Journal of Economic Perspectives, American Economic Association, vol. 9(1), pages 39-49, Winter.
    11. Ali, Héla Hadj & Lecocq, Sébastien & Visser, Michael, 2010. "The Impact of Gurus: Parker Grades and en primeur Wine Prices," Journal of Wine Economics, Cambridge University Press, vol. 5(1), pages 22-39, April.
    12. Conrad, Jon M. & Gómez, Miguel I. & Lamadrid, Alberto J., 2011. "Wine in Your Knapsack?," Journal of Wine Economics, Cambridge University Press, vol. 6(1), pages 83-110, January.
    13. Ginsburgh, Victor & Zang, Israel, 2003. "The museum pass game and its value," Games and Economic Behavior, Elsevier, vol. 43(2), pages 322-325, May.
    14. Carmen Herrero & Juan D. Moreno‐Ternero, 2009. "Estimating production costs in the economic evaluation of health‐care programs," Health Economics, John Wiley & Sons, Ltd., vol. 18(1), pages 21-35, January.
    15. Ginsburgh, Victor & Moreno-Ternero, Juan D. & Weber, Shlomo, 2017. "Ranking languages in the European Union: Before and after Brexit," European Economic Review, Elsevier, vol. 93(C), pages 139-151.
    16. Juan D. Moreno-Ternero, 2007. "On the design of equal-opportunity policies," Investigaciones Economicas, Fundación SEPI, vol. 31(3), pages 351-374, September.
    17. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2010. "A comparison of the scientific performance of the U.S. and the European union at the turn of the 21st century," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 329-344, October.
    18. Alcalde-Unzu, Jorge & Moreno-Ternero, Juan D. & Weber, Shlomo, 2022. "The measurement of the value of a language," Journal of Economic Theory, Elsevier, vol. 203(C).
    19. Masset, Philippe & Weisskopf, Jean-Philippe & Cossutta, Mathieu, 2015. "Wine Tasters, Ratings, and En Primeur Prices," Journal of Wine Economics, Cambridge University Press, vol. 10(1), pages 75-107, May.
    20. Bergantiños, Gustavo & Moreno-Ternero, Juan D., 2015. "The axiomatic approach to the problem of sharing the revenue from museum passes," Games and Economic Behavior, Elsevier, vol. 89(C), pages 78-92.
    21. Bleichrodt, Han & Herrero, Carmen & Pinto, Jose Luis, 2002. "A proposal to solve the comparability problem in cost-utility analysis," Journal of Health Economics, Elsevier, vol. 21(3), pages 397-403, May.
    22. Alcalde-Unzu, Jorge & Vorsatz, Marc, 2009. "Size approval voting," Journal of Economic Theory, Elsevier, vol. 144(3), pages 1187-1210, May.
    23. Gustavo Bergantiños & Juan D. Moreno-Ternero, 2020. "Sharing the Revenues from Broadcasting Sport Events," Management Science, INFORMS, vol. 66(6), pages 2417-2431, June.
    24. Ashton, Robert H., 2016. "The Value of Expert Opinion in the Pricing of Bordeaux Wine Futures," Journal of Wine Economics, Cambridge University Press, vol. 11(2), pages 261-288, August.
    25. Cao, Jing, 2014. "Quantifying Randomness Versus Consensus in Wine Quality Ratings," Journal of Wine Economics, Cambridge University Press, vol. 9(2), pages 202-213, August.
    26. Stuen, Eric T. & Miller, Jon R. & Stone, Robert W., 2015. "An Analysis of Wine Critic Consensus: A Study of Washington and California Wines," Journal of Wine Economics, Cambridge University Press, vol. 10(1), pages 47-61, May.
    27. Ginsburgh, Victor & Moreno-Ternero, Juan D. & Weber, Shlomo, 2017. "Ranking languages in the European Union: Before and after Brexit," European Economic Review, Elsevier, vol. 93(C), pages 139-151.
    28. Cardebat, Jean-Marie & Paroissien, Emmanuel, 2015. "Standardizing Expert Wine Scores: An Application for Bordeaux en primeur ," Journal of Wine Economics, Cambridge University Press, vol. 10(3), pages 329-348, December.
    29. Cyr, Don & Kwong, Lester & Sun, Ling, 2019. "Who Will Replace Parker? A Copula Function Analysis of Bordeaux En Primeur Wine Raters," Journal of Wine Economics, Cambridge University Press, vol. 14(2), pages 133-144, May.
    30. Albarrán, Pedro & Crespo, Juan A. & Ortuño, Ignacio, 2009. "A comparison of the scientific performance of the U. S. and the European Union at the turn of the XXI century," UC3M Working papers. Economics we095534, Universidad Carlos III de Madrid. Departamento de Economía.
    31. Satterthwaite, Mark Allen, 1975. "Strategy-proofness and Arrow's conditions: Existence and correspondence theorems for voting procedures and social welfare functions," Journal of Economic Theory, Elsevier, vol. 10(2), pages 187-217, April.
    32. Richard Friberg & Erik Grönqvist, 2012. "Do Expert Reviews Affect the Demand for Wine?," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 193-211, January.
    33. Luxen, Marc F., 2018. "Consensus between Ratings of Red Bordeaux Wines by Prominent Critics and Correlations with Prices 2004–2010 and 2011–2016: Ashton Revisited and Expanded," Journal of Wine Economics, Cambridge University Press, vol. 13(1), pages 83-91, February.
    34. Ashenfelter, Orley & Jones, Gregory V., 2013. "The Demand for Expert Opinion: Bordeaux Wine," Journal of Wine Economics, Cambridge University Press, vol. 8(3), pages 285-293, December.
    35. Fogarty, James J. & Sadler, Rohan, 2014. "To Save or Savor: A Review of Approaches for Measuring Wine as an Investment," Journal of Wine Economics, Cambridge University Press, vol. 9(3), pages 225-248, December.
    36. Bodington, Jeffrey, 2020. "Rate the Raters: A Note on Wine Judge Consistency," Journal of Wine Economics, Cambridge University Press, vol. 15(4), pages 363-369, November.
    37. Gibbard, Allan, 1973. "Manipulation of Voting Schemes: A General Result," Econometrica, Econometric Society, vol. 41(4), pages 587-601, July.
    38. Cyr, Don & Kwong, Lester & Sun, Ling, 2017. "An Examination of Tail Dependence in Bordeaux Futures Prices and Parker Ratings," Journal of Wine Economics, Cambridge University Press, vol. 12(3), pages 252-266, August.
    39. Hodgson, Robert T., 2008. "An Examination of Judge Reliability at a major U.S. Wine Competition," Journal of Wine Economics, Cambridge University Press, vol. 3(2), pages 105-113, January.
    40. Jaeger, Elizabeth, 1981. "To Save or Savor: The Rate of Return to Storing Wine: Comment," Journal of Political Economy, University of Chicago Press, vol. 89(3), pages 584-592, June.
    41. Ashton, Robert H., 2013. "Is There Consensus Among Wine Quality Ratings of Prominent Critics? An Empirical Analysis of Red Bordeaux, 2004–2010," Journal of Wine Economics, Cambridge University Press, vol. 8(2), pages 225-234, November.
    42. Sawyer, Jack & MacRae, Duncan, 1962. "Game Theory and Cumulative Voting in Illinois: 1902–1954," American Political Science Review, Cambridge University Press, vol. 56(4), pages 936-946, December.
    43. Lindley, Dennis V., 2006. "Analysis of a Wine Tasting," Journal of Wine Economics, Cambridge University Press, vol. 1(1), pages 33-41, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Clarissa Laura Maria Spiess Bru, 2023. "Does the Tasting Note Matter? Language Categories and Their Impact on Professional Ratings and Prices," Working Papers Dissertations 105, Paderborn University, Faculty of Business Administration and Economics.
    2. Olivier Gergaud & Victor Ginsburgh & Juan D. Moreno-Ternero, 2022. "Tracking Quality Assessments Over Time. The Rise and Fall of S.L.V. Cabernet Sauvignon," Working Papers ECARES 2022-13, ULB -- Universite Libre de Bruxelles.
    3. Bergantiños, Gustavo & Moreno-Ternero, Juan D., 2020. "Broadcasting La Liga," MPRA Paper 104750, University Library of Munich, Germany.
    4. Victor Ginsburgh & Juan D. Moreno-Ternero, 2023. "The Eurovision Song Contest: voting rules, biases and rationality," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 47(2), pages 247-277, June.
    5. Barberà, Salvador & Bossert, Walter & Moreno-Ternero, Juan D., 2023. "Wine rankings and the Borda method," Journal of Wine Economics, Cambridge University Press, vol. 18(2), pages 122-138, May.
    6. Manuel Serra & Nuno Antonio & Claudia Henriques & Carlos M. Afonso, 2021. "Promoting Sustainability through Regional Food and Wine Pairing," Sustainability, MDPI, vol. 13(24), pages 1-22, December.
    7. Bodington, Jeff, 2021. "A Maximum Entropy Estimate of Uncertainty about a Wine Rating," Working Papers 321847, American Association of Wine Economists.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Olivier Gergaud & Victor Ginsburgh & Juan D. Moreno-Ternero, 2020. "Wine Ratings," Working Papers ECARES 2020-38, ULB -- Universite Libre de Bruxelles.
    2. Barberà, Salvador & Bossert, Walter & Moreno-Ternero, Juan D., 2023. "Wine rankings and the Borda method," Journal of Wine Economics, Cambridge University Press, vol. 18(2), pages 122-138, May.
    3. Clarissa Laura Maria Spiess Bru, 2023. "Does the Tasting Note Matter? Language Categories and Their Impact on Professional Ratings and Prices," Working Papers Dissertations 105, Paderborn University, Faculty of Business Administration and Economics.
    4. Alcalde-Unzu, Jorge & Moreno-Ternero, Juan D. & Weber, Shlomo, 2022. "The measurement of the value of a language," Journal of Economic Theory, Elsevier, vol. 203(C).
    5. Algaba, Encarnación & Béal, Sylvain & Fragnelli, Vito & Llorca, Natividad & Sánchez-Soriano, Joaquin, 2019. "Relationship between labeled network games and other cooperative games arising from attributes situations," Economics Letters, Elsevier, vol. 185(C).
    6. Gustavo Bergantiños & Juan D. Moreno-Ternero, 2023. "Decentralized revenue sharing from broadcasting sports," Public Choice, Springer, vol. 194(1), pages 27-44, January.
    7. Victor Ginsburgh, 2016. "On Judging Art and Wine," Working Papers ECARES ECARES 2016-21, ULB -- Universite Libre de Bruxelles.
    8. Pecchioli, Bruno & Moroz, David, 2023. "Do geographical appellations provide useful quality signals? The case of Scotch single malt whiskies," Economic Modelling, Elsevier, vol. 124(C).
    9. Victor Ginsburgh & Juan D. Moreno-Ternero, 2023. "The Eurovision Song Contest: voting rules, biases and rationality," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 47(2), pages 247-277, June.
    10. Ginsburgh, Victor & Moreno-Ternero, Juan D. & Weber, Shlomo, 2017. "Ranking languages in the European Union: Before and after Brexit," European Economic Review, Elsevier, vol. 93(C), pages 139-151.
    11. Ginsburgh, Victor & Moreno-Ternero, Juan D. & Weber, Shlomo, 2017. "Ranking languages in the European Union: Before and after Brexit," European Economic Review, Elsevier, vol. 93(C), pages 139-151.
    12. Bergantiños, Gustavo & Moreno-Ternero, Juan D., 2022. "Monotonicity in sharing the revenues from broadcasting sports leagues," European Journal of Operational Research, Elsevier, vol. 297(1), pages 338-346.
    13. Bergantiños, Gustavo & Moreno-Ternero, Juan D., 2020. "Allocating extra revenues from broadcasting sports leagues," Journal of Mathematical Economics, Elsevier, vol. 90(C), pages 65-73.
    14. Gustavo Bergantiños & Juan D. Moreno-Ternero, 2022. "On the axiomatic approach to sharing the revenues from broadcasting sports leagues," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 58(2), pages 321-347, February.
    15. Masset, Philippe & Weisskopf, Jean-Philippe, 2018. "Wine indices in practice: Nicely labeled but slightly corked," Economic Modelling, Elsevier, vol. 68(C), pages 555-569.
    16. Gustavo Berganti~nos & Juan D. Moreno-Ternero, 2023. "Revenue sharing at music streaming platforms," Papers 2310.11861, arXiv.org.
    17. Bernd Frick & Clarissa Laura Maria Spiess Bru & Daniel Kaimann, 2023. "Are Women (Really) More Lenient? Gender Differences in Expert Evaluations," Working Papers Dissertations 106, Paderborn University, Faculty of Business Administration and Economics.
    18. Gustavo Bergantiños & Juan Vidal-Puga, 2021. "A review of cooperative rules and their associated algorithms for minimum-cost spanning tree problems," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 12(1), pages 73-100, March.
    19. Saeed Alaei & Ali Makhdoumi & Azarakhsh Malekian & Saša Pekeč, 2022. "Revenue-Sharing Allocation Strategies for Two-Sided Media Platforms: Pro-Rata vs. User-Centric," Management Science, INFORMS, vol. 68(12), pages 8699-8721, December.
    20. Gustavo Bergantiños & Juan D. Moreno-Ternero, 2023. "Broadcasting revenue sharing after cancelling sports competitions," Annals of Operations Research, Springer, vol. 328(2), pages 1213-1238, September.

    More about this item

    JEL classification:

    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • L66 - Industrial Organization - - Industry Studies: Manufacturing - - - Food; Beverages; Cosmetics; Tobacco

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cup:jwecon:v:16:y:2021:i:3:p:321-342_5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kirk Stebbing (email available below). General contact details of provider: https://www.cambridge.org/jwe .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.