IDEAS home Printed from https://ideas.repec.org/a/inm/oropre/v54y2006i5p813-828.html
   My bibliography  Save this article

Evaluating Academic Programs: With Applications to U.S. Graduate Decision Science Programs

Author

Listed:
  • Ralph L. Keeney

    (Fuqua School of Business, Duke University, Box 90120, Durham, North Carolina 27708-0120)

  • Kelly E. See

    (Stern School of Business, New York University, 44 West 4th Street, New York, New York 10012-1106)

  • Detlof von Winterfeldt

    (School of Policy, Planning, and Development, University of Southern California, Ronald Tutor Hall, Room 310, Los Angeles, California 90089-2902)

Abstract

This paper describes a decision analysis methodology to evaluate academic programs. It avoids the shortcomings of the well-known evaluations of universities and academic programs produced by the public media. In addition to evaluating traditional departments and schools, the methodology is designed to evaluate interdisciplinary programs or fields that typically span many areas of a university, such as operations research, risk analysis, and decision science. We first discuss general principles of using this methodology for the evaluation of disciplinary or interdisciplinary academic programs. Next, we apply this methodology to interdisciplinary graduate decision science programs in United States universities, focusing on both prescriptive decision analysis and descriptive decision research. Finally, we suggest how the methodology might be implemented to evaluate operations research programs.

Suggested Citation

  • Ralph L. Keeney & Kelly E. See & Detlof von Winterfeldt, 2006. "Evaluating Academic Programs: With Applications to U.S. Graduate Decision Science Programs," Operations Research, INFORMS, vol. 54(5), pages 813-828, October.
    • Handle: RePEc:inm:oropre:v:54:y:2006:i:5:p:813-828
    DOI: 10.1287/opre.1060.0328
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/opre.1060.0328
    Download Restriction: no
    File URL: https://libkey.io/10.1287/opre.1060.0328?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    2. Ralph L. Keeney, 2002. "Common Mistakes in Making Value Trade-Offs," Operations Research, INFORMS, vol. 50(6), pages 935-945, December.
    3. Ralph L. Keeney & Robin S. Gregory, 2005. "Selecting Attributes to Measure the Achievement of Objectives," Operations Research, INFORMS, vol. 53(1), pages 1-11, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Köksalan, Murat & Büyükbasaran, Tayyar & Özpeynirci, Özgür & Wallenius, Jyrki, 2010. "A flexible approach to ranking with an application to MBA Programs," European Journal of Operational Research, Elsevier, vol. 201(2), pages 470-476, March.
    2. Barbaros Yet & Ceren Tuncer Şakar, 2020. "Estimating criteria weight distributions in multiple criteria decision making: a Bayesian approach," Annals of Operations Research, Springer, vol. 293(2), pages 495-519, October.
    3. Roger Chapman Burk & Richard M. Nehring, 2023. "An Empirical Comparison of Rank-Based Surrogate Weights in Additive Multiattribute Decision Analysis," Decision Analysis, INFORMS, vol. 20(1), pages 55-72, March.
    4. Tavana, Madjid & Di Caprio, Debora, 2016. "Modeling synergies in multi-criteria supplier selection and order allocation: An application to commodity tradingAuthor-Name: Sodenkamp, Mariya A," European Journal of Operational Research, Elsevier, vol. 254(3), pages 859-874.
    5. Sung-Shun Weng & Yang Liu & Yen-Ching Chuang, 2019. "Reform of Chinese Universities in the Context of Sustainable Development: Teacher Evaluation and Improvement Based on Hybrid Multiple Criteria Decision-Making Model," Sustainability, MDPI, vol. 11(19), pages 1-23, October.
    6. Laure Cabantous & Jean-Pascal Gond, 2011. "Rational Decision Making as Performative Praxis: Explaining Rationality's Éternel Retour," Organization Science, INFORMS, vol. 22(3), pages 573-586, June.
    7. Marcel Clermont & Julia Schaefer, 2019. "Identification of Outliers in Data Envelopment Analysis," Schmalenbach Business Review, Springer;Schmalenbach-Gesellschaft, vol. 71(4), pages 475-496, October.
    8. Márcia Elizabeth Marinho da Silva & Eduardo R. Santos & Denis Borenstein, 2010. "Implementing Regulation Policy in Brazilian Health Care Regulation Centers," Medical Decision Making, , vol. 30(3), pages 366-379, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    2. Carland, Corinne & Goentzel, Jarrod & Montibeller, Gilberto, 2018. "Modeling the values of private sector agents in multi-echelon humanitarian supply chains," European Journal of Operational Research, Elsevier, vol. 269(2), pages 532-543.
    3. Richard M. Anderson & Robert Clemen, 2013. "Toward an Improved Methodology to Construct and Reconcile Decision Analytic Preference Judgments," Decision Analysis, INFORMS, vol. 10(2), pages 121-134, June.
    4. Ralph L. Keeney, 2007. "Modeling Values for Anti‐Terrorism Analysis," Risk Analysis, John Wiley & Sons, vol. 27(3), pages 585-596, June.
    5. Eric D. Smith & Young Jun Son & Massimo Piattelli‐Palmarini & A. Terry Bahill, 2007. "Ameliorating mental mistakes in tradeoff studies," Systems Engineering, John Wiley & Sons, vol. 10(3), pages 222-240, September.
    6. Angelis, Aris & Kanavos, Panos, 2017. "Multiple Criteria Decision Analysis (MCDA) for evaluating new medicines in Health Technology Assessment and beyond: The Advance Value Framework," Social Science & Medicine, Elsevier, vol. 188(C), pages 137-156.
    7. Rodrigues, Teresa C. & Montibeller, Gilberto & Oliveira, Mónica D. & Bana e Costa, Carlos A., 2017. "Modelling multicriteria value interactions with Reasoning Maps," European Journal of Operational Research, Elsevier, vol. 258(3), pages 1054-1071.
    8. Melissa Garber & Shahram Sarkani & Thomas Mazzuchi, 2017. "A Framework for Multiobjective Decision Management with Diverse Stakeholders," Systems Engineering, John Wiley & Sons, vol. 20(4), pages 335-356, July.
    9. Vicki M. Bier & Simon French, 2020. "From the Editors: Decision Analysis Focus and Trends," Decision Analysis, INFORMS, vol. 17(1), pages 1-8, March.
    10. Angelis, A. & Linch, M. & Montibeller, G. & Molina-Lopez, T. & Zawada, A. & Orzel, K. & Arickx, F. & Espin, J. & Kanavos, P., 2020. "Multiple Criteria Decision Analysis for HTA across four EU Member States: Piloting the Advance Value Framework," Social Science & Medicine, Elsevier, vol. 246(C).
    11. Marttunen, Mika & Belton, Valerie & Lienert, Judit, 2018. "Are objectives hierarchy related biases observed in practice? A meta-analysis of environmental and energy applications of Multi-Criteria Decision Analysis," European Journal of Operational Research, Elsevier, vol. 265(1), pages 178-194.
    12. Seow Eng Ong & Davin Wang & Calvin Chua, 2023. "Disruptive Innovation and Real Estate Agency: The Disruptee Strikes Back," The Journal of Real Estate Finance and Economics, Springer, vol. 67(2), pages 287-317, August.
    13. Herrmann, Tabea & Hübler, Olaf & Menkhoff, Lukas & Schmidt, Ulrich, 2016. "Allais for the poor," Kiel Working Papers 2036, Kiel Institute for the World Economy (IfW Kiel).
    14. Christiane Goodfellow & Dirk Schiereck & Steffen Wippler, 2013. "Are behavioural finance equity funds a superior investment? A note on fund performance and market efficiency," Journal of Asset Management, Palgrave Macmillan, vol. 14(2), pages 111-119, April.
    15. Berg, Joyce E. & Rietz, Thomas A., 2019. "Longshots, overconfidence and efficiency on the Iowa Electronic Market," International Journal of Forecasting, Elsevier, vol. 35(1), pages 271-287.
    16. Reckers, Philip M.J. & Sanders, Debra L. & Roark, Stephen J., 1994. "The Influence of Ethical Attitudes on Taxpayer Compliance," National Tax Journal, National Tax Association;National Tax Journal, vol. 47(4), pages 825-836, December.
    17. Bier, Vicki & Gutfraind, Alexander, 2019. "Risk analysis beyond vulnerability and resilience – characterizing the defensibility of critical systems," European Journal of Operational Research, Elsevier, vol. 276(2), pages 626-636.
    18. Sitinjak Elizabeth Lucky Maretha & Haryanti Kristiana & Kurniasari Widuri & Sasmito Yohanes Wisnu Djati, 2019. "Investor behavior based on personality and company life cycle," HOLISTICA – Journal of Business and Public Administration, Sciendo, vol. 10(2), pages 23-38, August.
    19. Theo Arentze & Tao Feng & Harry Timmermans & Jops Robroeks, 2012. "Context-dependent influence of road attributes and pricing policies on route choice behavior of truck drivers: results of a conjoint choice experiment," Transportation, Springer, vol. 39(6), pages 1173-1188, November.
    20. van den Bergh, J.C.J.M. & Botzen, W.J.W., 2015. "Monetary valuation of the social cost of CO2 emissions: A critical survey," Ecological Economics, Elsevier, vol. 114(C), pages 33-46.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:oropre:v:54:y:2006:i:5:p:813-828. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.