IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v28y2009i5p991-998.html
   My bibliography  Save this article

—Relevancy Is Robust Prediction, Not Alleged Realism

Author

Listed:
  • Steven M. Shugan

    (Warrington College of Business Administration, University of Florida, Gainesville, Florida 32611)

Abstract

Remember James Boswell, ninth Laird of Auchinleck, author of the famous maxim that the road to hell is paved with good intentions? Trying to build realistic theories differs dramatically from having correct explanatory theories tested on objective criteria, e.g., verifiable prediction. Evaluating theories on whether assumptions are realistic is potentially subjective, biased, and arbitrary. A theory's domain determines whether its assumptions are sufficiently realistic and when assumptions must hold and to what degree, so testing assumptions in isolation puts an unnecessary burden on the assumptions (i.e., they must hold everywhere). For theories explaining cooperation and information exchange, predictions reveal that the prisoner's dilemma assumptions (only two prisoners, four possible outcomes, two possible actions, etc.) are sufficiently realistic. For theories explaining prisoner sentencing guidelines and probation policy, predictions might suggest otherwise. Scientific methods allow the evaluation of theories on criteria such predictive accuracy, reliability, validity, and robustness—not based on realism. When multiple explanatory theories survive initial testing, one derives conflicting predictions. For example, a theory that people are broccoli produces correct predictions (people are mortal) and incorrect predictions (people are biennial). Tragic consequences can occur when theory adoption depends on whether assumptions are disliked, unpopular, or exclude a favorite variable. Denounce journals that reject models with insightful new implications because the assumptions are too simple or merely disliked. The term “unrealistic” sometimes means personally disliked.

Suggested Citation

  • Steven M. Shugan, 2009. "—Relevancy Is Robust Prediction, Not Alleged Realism," Marketing Science, INFORMS, vol. 28(5), pages 991-998, 09-10.
  • Handle: RePEc:inm:ormksc:v:28:y:2009:i:5:p:991-998
    DOI: 10.1287/mksc.1080.0467
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.1080.0467
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mksc.1080.0467?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Steven M. Shugan, 2007. "—It's the Findings, Stupid, Not the Assumptions," Marketing Science, INFORMS, vol. 26(4), pages 449-459, 07-08.
    2. Steven M. Shugan, 2007. "—Causality, Unintended Consequences and Deducing Shared Causes," Marketing Science, INFORMS, vol. 26(6), pages 731-741, 11-12.
    3. Marco Bertini & Luc Wathieu, 2008. "Research Note—Attention Arousal Through Price Partitioning," Marketing Science, INFORMS, vol. 27(2), pages 236-246, 03-04.
    4. Eric T. Bradlow, 2008. "Editorial—Enticing and Publishing the Home Run Paper," Marketing Science, INFORMS, vol. 27(1), pages 4-6, 01-02.
    5. Timothy J. Gilbride & Greg M. Allenby, 2006. "Estimating Heterogeneous EBA and Economic Screening Rule Choice Models," Marketing Science, INFORMS, vol. 25(5), pages 494-509, September.
    6. Steven M. Shugan, 2005. "Comments on Competitive Responsiveness," Marketing Science, INFORMS, vol. 24(1), pages 3-7.
    7. Steven M. Shugan, 2007. ": Does Good Marketing Cause Bad Unemployment?," Marketing Science, INFORMS, vol. 26(1), pages 1-17, 01-02.
    8. Amartya Sen, 1981. "Ingredients of Famine Analysis: Availability and Entitlements," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 96(3), pages 433-464.
    9. Olivier Toubia & John Hauser & Rosanna Garcia, 2007. "Probabilistic Polyhedral Methods for Adaptive Choice-Based Conjoint Analysis: Theory and Application," Marketing Science, INFORMS, vol. 26(5), pages 596-610, 09-10.
    10. Steven M. Shugan, 2002. "The Mission of Marketing Science," Marketing Science, INFORMS, vol. 21(1), pages 1-13.
    11. Eric T. Bradlow & Young-Hoon Park, 2007. "Bayesian Estimation of Bid Sequences in Internet Auctions Using a Generalized Record-Breaking Model," Marketing Science, INFORMS, vol. 26(2), pages 218-229, 03-04.
    12. George A. Akerlof, 1970. "The Market for "Lemons": Quality Uncertainty and the Market Mechanism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 84(3), pages 488-500.
    13. Niladri Syam & Partha Krishnamurthy & James D. Hess, 2008. "What I Thought I Wanted? Miswanting and Regret for a Standard Good in a Mass-Customized World," Marketing Science, INFORMS, vol. 27(3), pages 379-397, 05-06.
    14. Dapeng Cui & David Curry, 2005. "Prediction in Marketing Using the Support Vector Machine," Marketing Science, INFORMS, vol. 24(4), pages 595-615, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Steven M. Shugan, 2009. "—Think Theory Testing, Not Realism," Marketing Science, INFORMS, vol. 28(5), pages 1001-1001, 09-10.
    2. Eric W. K. Tsang, 2009. "—Robust Prediction and Unrealistic Assumptions," Marketing Science, INFORMS, vol. 28(5), pages 999-1000, 09-10.
    3. Peter Ebbes & Dominik Papies & Harald J. van Heerde, 2011. "The Sense and Non-Sense of Holdout Sample Validation in the Presence of Endogeneity," Marketing Science, INFORMS, vol. 30(6), pages 1115-1122, November.
    4. Decker, Reinhold & Trusov, Michael, 2010. "Estimating aggregate consumer preferences from online product reviews," International Journal of Research in Marketing, Elsevier, vol. 27(4), pages 293-307.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maldonado, Sebastián & Montoya, Ricardo & Weber, Richard, 2015. "Advanced conjoint analysis using feature selection via support vector machines," European Journal of Operational Research, Elsevier, vol. 241(2), pages 564-574.
    2. James Agarwal & Wayne DeSarbo & Naresh K. Malhotra & Vithala Rao, 2015. "An Interdisciplinary Review of Research in Conjoint Analysis: Recent Developments and Directions for Future Research," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 2(1), pages 19-40, March.
    3. Dongling Huang & Lan Luo, 2016. "Consumer Preference Elicitation of Complex Products Using Fuzzy Support Vector Machine Active Learning," Marketing Science, INFORMS, vol. 35(3), pages 445-464, May.
    4. Hauser, John R., 2014. "Consideration-set heuristics," Journal of Business Research, Elsevier, vol. 67(8), pages 1688-1699.
    5. Theodoros Evgeniou & Massimiliano Pontil & Olivier Toubia, 2007. "A Convex Optimization Approach to Modeling Consumer Heterogeneity in Conjoint Estimation," Marketing Science, INFORMS, vol. 26(6), pages 805-818, 11-12.
    6. Qing Liu & Yihui (Elina) Tang, 2015. "Construction of Heterogeneous Conjoint Choice Designs: A New Approach," Marketing Science, INFORMS, vol. 34(3), pages 346-366, May.
    7. Olivier Toubia, 2022. "Editorial: A New Chapter or a New Page for Marketing Science ?," Marketing Science, INFORMS, vol. 41(1), pages 1-6, January.
    8. Daria Dzyabura & John R. Hauser, 2011. "Active Machine Learning for Consideration Heuristics," Marketing Science, INFORMS, vol. 30(5), pages 801-819, September.
    9. Julio López & Sebastián Maldonado & Ricardo Montoya, 2017. "Simultaneous preference estimation and heterogeneity control for choice-based conjoint via support vector machines," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(11), pages 1323-1334, November.
    10. Hema Yoganarasimhan, 2013. "The Value of Reputation in an Online Freelance Marketplace," Marketing Science, INFORMS, vol. 32(6), pages 860-891, November.
    11. Bruno Boidin & Marie-Dominique Savina, 1996. "Privatisation des services sociaux et redéfinition du rôle de l'État : les prestations éducatives et sanitaires au Bénin," Revue Tiers Monde, Programme National Persée, vol. 37(148), pages 853-874.
    12. Oded Netzer & Olivier Toubia & Eric Bradlow & Ely Dahan & Theodoros Evgeniou & Fred Feinberg & Eleanor Feit & Sam Hui & Joseph Johnson & John Liechty & James Orlin & Vithala Rao, 2008. "Beyond conjoint analysis: Advances in preference measurement," Marketing Letters, Springer, vol. 19(3), pages 337-354, December.
    13. Denis Sauré & Juan Pablo Vielma, 2019. "Ellipsoidal Methods for Adaptive Choice-Based Conjoint Analysis," Operations Research, INFORMS, vol. 67(2), pages 315-338, March.
    14. Assaf Razin & Efraim Sadka & Chi-Wa Yuen, 1999. "An Information-Based Model of Foreign Direct Investment: The Gains from Trade Revisited," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 6(4), pages 579-596, November.
    15. Tisdell, Clem, 2014. "Information Technology's Impacts on Productivity, Welfare and Social Change: Second Version," Economic Theory, Applications and Issues Working Papers 195701, University of Queensland, School of Economics.
    16. Konduru, Srinivasa & Kalaitzandonakes, Nicholas G. & Magnier, Alexandre, 2009. "GMO Testing Strategies and Implications for Trade: A Game Theoretic Approach," 2009 Annual Meeting, July 26-28, 2009, Milwaukee, Wisconsin 49594, Agricultural and Applied Economics Association.
    17. König, Philipp J. & Pothier, David, 2018. "Safe but fragile: Information acquisition, sponsor support and shadow bank runs," Discussion Papers 15/2018, Deutsche Bundesbank.
    18. Andrea Attar & Thomas Mariotti & François Salanié, 2021. "Entry-Proofness and Discriminatory Pricing under Adverse Selection," American Economic Review, American Economic Association, vol. 111(8), pages 2623-2659, August.
    19. Reynolds, Travis & Kolodinsky, Jane & Murray, Byron, 2012. "Consumer preferences and willingness to pay for compact fluorescent lighting: Policy implications for energy efficiency promotion in Saint Lucia," Energy Policy, Elsevier, vol. 41(C), pages 712-722.
    20. Ginger Zhe Jin & Andrew Kato & John A. List, 2010. "That’S News To Me! Information Revelation In Professional Certification Markets," Economic Inquiry, Western Economic Association International, vol. 48(1), pages 104-122, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:28:y:2009:i:5:p:991-998. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.