IDEAS home Printed from https://ideas.repec.org/a/inm/orinte/v34y2004i4p314-320.html
   My bibliography  Save this article

Aggregating Expert Ratings Using Preference-Neutral Weights: The Case of the College Football Polls

Author

Listed:
  • Ira Horowitz

    (Decision and Information Sciences, Warrington College of Business Administration, University of Florida, Gainesville, Florida 32611-7169)

Abstract

I use two principal college football polls to illustrate a preference-neutral linear programming procedure for determining optimal weights for aggregating expert ratings. I compute the weights for 84 weekly polls released during the 1999 through 2003 college football seasons. The weights vary from week to week (sometimes considerably over a year), the range of weights over which the aggregate ranking holds also tends to vary and to be quite small (with a range of zero almost half the time), and nothing is systematic about the week-to-week changes in either the weights or their ranges. The results suggest that predisposition to a particular set of weights is a bad idea, not just for the purpose of aggregating the football polls, but in any situation in which one wants to aggregate ratings provided by multiple sources of complementary expertise.

Suggested Citation

  • Ira Horowitz, 2004. "Aggregating Expert Ratings Using Preference-Neutral Weights: The Case of the College Football Polls," Interfaces, INFORMS, vol. 34(4), pages 314-320, August.
    • Handle: RePEc:inm:orinte:v:34:y:2004:i:4:p:314-320
    DOI: 10.1287/inte.1040.0086
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/inte.1040.0086
    Download Restriction: no
    File URL: https://libkey.io/10.1287/inte.1040.0086?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John DiNardo & Justin L. Tobias, 2001. "Nonparametric Density and Regression Estimation," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 11-28, Fall.
    2. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    3. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    4. I Horowitz, 2003. "Preference-neutral attribute weights in the journal-ranking problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(5), pages 452-457, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Winter, Peter, 2007. "Managerial Risk Accounting and Control – A German perspective," MPRA Paper 8185, University Library of Munich, Germany.
    2. J. Silvestre, & T. Araújo & M. St. Aubyn, 2016. "Economic growth and individual satisfaction in an agent-based economy," Working Papers Department of Economics 2016/19, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    3. Luigi Guiso, 2015. "A Test of Narrow Framing and its Origin," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 1(1), pages 61-100, March.
    4. Corak, Miles & Lauzon, Darren, 2009. "Differences in the distribution of high school achievement: The role of class-size and time-in-term," Economics of Education Review, Elsevier, vol. 28(2), pages 189-198, April.
    5. Kenneth Gillingham & William D. Nordhaus & David Anthoff & Geoffrey Blanford & Valentina Bosetti & Peter Christensen & Haewon McJeon & John Reilly & Paul Sztorc, 2015. "Modeling Uncertainty in Climate Change: A Multi-Model Comparison," NBER Working Papers 21637, National Bureau of Economic Research, Inc.
    6. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    7. B Kelsey Jack, "undated". "Market Inefficiencies and the Adoption of Agricultural Technologies in Developing Countries," CID Working Papers 50, Center for International Development at Harvard University.
    8. Wolfers, Justin & Stevenson, Betsey & Sacks, Dan, 2010. "Subjective Well-Being, Income, Economic Development and Growth," CEPR Discussion Papers 8048, C.E.P.R. Discussion Papers.
    9. Justin L. Tobias & Mingliang Li, 2003. "A finite-sample hierarchical analysis of wage variation across public high schools: evidence from the NLSY and high school and beyond," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(3), pages 315-336.
    10. Kelly, Scott & Shipworth, Michelle & Shipworth, David & Gentry, Michael & Wright, Andrew & Pollitt, Michael & Crawford-Brown, Doug & Lomas, Kevin, 2013. "Predicting the diversity of internal temperatures from the English residential sector using panel methods," Applied Energy, Elsevier, vol. 102(C), pages 601-621.
    11. Richard Disney & Eleonora Fischera & Trudy Owens, 2010. "Has the Introduction of Microfinance Crowded-out Informal Loans in Malawi?," Discussion Papers 10/08, University of Nottingham, CREDIT.
    12. Massimiliano BRATTI & Chiara BROCCOLINI & Stefano STAFFOLANI, 2006. "Is '3+2' Equal to 4? University Reform and Student Academic Performance in Italy," Working Papers 251, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    13. Becker, Gary S. & Rubinstein, Yona, 2011. "Fear and the response to terrorism: an economic analysis," LSE Research Online Documents on Economics 121740, London School of Economics and Political Science, LSE Library.
    14. Coleman, S., 2010. "Russian Election Reform and the Effect of Social Conformity on Voting and the Party System: 2007 and 2008," Journal of the New Economic Association, New Economic Association, issue 5, pages 73-90.
    15. Das, Willy & Das, Satyasiba, 2018. "Role of Heuristic Principles On Crowd-Funder's Investment Decision Making," 6th International OFEL Conference on Governance, Management and Entrepreneurship. New Business Models and Institutional Entrepreneurs: Leading Disruptive Change (Dubrovnik, 2018), in: 6th International OFEL Conference on Governance, Management and Entrepreneurship. New Business Models and Institutional Entrepreneurs: Leading Disrupt, pages 443-452, Governance Research and Development Centre (CIRU), Zagreb.
    16. Hernan Mondani & Petter Holme & Fredrik Liljeros, 2014. "Fat-Tailed Fluctuations in the Size of Organizations: The Role of Social Influence," PLOS ONE, Public Library of Science, vol. 9(7), pages 1-9, July.
    17. Avner Engel & Shalom Shachar, 2006. "Measuring and optimizing systems' quality costs and project duration," Systems Engineering, John Wiley & Sons, vol. 9(3), pages 259-280, September.
    18. Mao, Luke Lunhua & Huang, Haiyan, 2016. "Social impact of Formula One Chinese Grand Prix: A comparison of local residents’ perceptions based on the intrinsic dimension," Sport Management Review, Elsevier, vol. 19(3), pages 306-318.
    19. Randall Holcombe, 2005. "Government growth in the twenty-first century," Public Choice, Springer, vol. 124(1), pages 95-114, July.
    20. Shastitko, Andrey & Golovanova, Svetlana, 2016. "Meeting blindly… Is Austrian economics useful for dynamic capabilities theory?," Russian Journal of Economics, Elsevier, vol. 2(1), pages 86-110.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orinte:v:34:y:2004:i:4:p:314-320. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.