IDEAS home Printed from https://ideas.repec.org/p/ems/eureri/77022.html
   My bibliography  Save this paper

Unraveling Scientific Impact

Author

Listed:
  • Stremersch, S.
  • Camacho, N.M.A.
  • Vanneste, S.
  • Verniers, I.W.J.

Abstract

The number of citations a paper receives is the most commonly used measure of scientific impact. In this paper, we study not only the number but also the type of citations that 659 marketing articles generated. We discern five citation types: application, affirmation, negation, review and perfunctory mention (i.e., citing an article only indirectly without really using it). Prior literature in scientometrics recognizes that the former three types, on average, signal a higher level of scientific indebtedness than the latter two types. In our sample, these three types of citation represent only 15% of all citations. We also find different determinants of citation behavior across citation types. Across the 49 determinants we included, only 13 have the same effect across all citation types, of which only 5 are statistically significant across all citation types. For instance, we find a significant inverted U-effect of challenging commonly held beliefs on citations counts, but only for three of the citation types: affirmation, review and perfunctory mention. Our results encourage scientific stakeholders to move beyond mere citation counts to assess a paper’s or a scholar’s scientific contribution, as well as to devote greater attention to the citation process itself.

Suggested Citation

  • Stremersch, S. & Camacho, N.M.A. & Vanneste, S. & Verniers, I.W.J., 2014. "Unraveling Scientific Impact," ERIM Report Series Research in Management ERS-2014-014-MKT, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    • Handle: RePEc:ems:eureri:77022
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/77022/ERS-2014-014-MKT.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jacob Goldenberg & Donald R. Lehmann & David Mazursky, 2001. "The Idea Itself and the Circumstances of Its Emergence as Predictors of New Product Success," Management Science, INFORMS, vol. 47(1), pages 69-84, January.
    2. Mingers, John & Xu, Fang, 2010. "The drivers of citations in management science journals," European Journal of Operational Research, Elsevier, vol. 205(2), pages 422-430, September.
    3. Hao Wang, 2004. "Do Returns Policies Intensify Retail Competition?," Marketing Science, INFORMS, vol. 23(4), pages 611-613, March.
    4. Terrence A. Brooks, 1985. "Private acts and public objects: An investigation of citer motivations," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 36(4), pages 223-229, July.
    5. Steve Hanney & Iain Frame & Jonathan Grant & Martin Buxton & Tracey Young & Grant Lewison, 2005. "Using categorisations of citations when assessing the outcomes from health research," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(3), pages 357-379, December.
    6. Magid M. Abraham & Leonard M. Lodish, 1993. "An Implemented System for Improving Promotion Productivity Using Store Scanner Data," Marketing Science, INFORMS, vol. 12(3), pages 248-269.
    7. Laband, David N, 1986. "Article Popularity," Economic Inquiry, Western Economic Association International, vol. 24(1), pages 173-180, January.
    8. V. Cano, 1989. "Citation behavior: Classification, utility, and location," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 40(4), pages 284-290, July.
    9. V. Padmanabhan & I. P. L. Png, 1997. "Manufacturer's Return Policies and Retail Competition," Marketing Science, INFORMS, vol. 16(1), pages 81-94.
    10. Borokhovich, Kenneth A & Bricker, Robert J & Simkins, Betty J, 1994. "Journal Communication and Influence in Financial Research," Journal of Finance, American Finance Association, vol. 49(2), pages 713-725, June.
    11. Günter Krampen & Ralf Becker & Ute Wahner & Leo Montada, 2007. "On the validity of citation counting in science evaluation: Content analyses of references and citations in psychological publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(2), pages 191-202, May.
    12. Baumgartner, H. & Pieters, R., 2000. "The Influence of Marketing Journals : A Citation Analysis of the Discipline and its Sub-areas," Discussion Paper 2000-123, Tilburg University, Center for Economic Research.
    13. S. Stremersch & I. Verniers & C. Verhoef, 2006. "The Quest for Citations: Drivers of Article Impact," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 06/422, Ghent University, Faculty of Economics and Business Administration.
    14. Donald O. Case & Georgeann M. Higgins, 2000. "How can we investigate citation behavior? A study of reasons for citing literature in communication," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 51(7), pages 635-645.
    15. Cameron, A. Colin & Trivedi, Pravin K., 1990. "Regression-based tests for overdispersion in the Poisson model," Journal of Econometrics, Elsevier, vol. 46(3), pages 347-364, December.
    16. Jacob Goldenberg & Barak Libai & Eitan Muller & Stefan Stremersch, 2010. "Database Submission—The Evolving Social Network of Marketing Scholars," Marketing Science, INFORMS, vol. 29(3), pages 561-567, 05-06.
    17. Leonidou, Leonidas C. & Katsikeas, Constantine S. & Samiee, Saeed, 2002. "Marketing strategy determinants of export performance: a meta-analysis," Journal of Business Research, Elsevier, vol. 55(1), pages 51-67, January.
    18. Stefan Stremersch & Peter C. Verhoef, 2005. "Globalization of Authorship in the Marketing Discipline: Does It Help or Hinder the Field?," Marketing Science, INFORMS, vol. 24(4), pages 585-594, February.
    19. Henry Small, 2004. "On the shoulders of Robert Merton: Towards a normative theory of citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(1), pages 71-79, May.
    20. Roberts, John H. & Kayande, Ujwal & Stremersch, Stefan, 2014. "From academic research to marketing practice: Exploring the marketing science value chain," International Journal of Research in Marketing, Elsevier, vol. 31(2), pages 127-140.
    21. Steven M. Shugan, 2003. "Editorial: Defining Interesting Research Problems," Marketing Science, INFORMS, vol. 22(1), pages 1-15.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    2. Zahedi, Zohreh & Haustein, Stefanie, 2018. "On the relationships between bibliographic characteristics of scientific documents and citation and Mendeley readership counts: A large-scale analysis of Web of Science publications," Journal of Informetrics, Elsevier, vol. 12(1), pages 191-202.
    3. Rosenzweig, Stav & Grinstein, Amir & Ofek, Elie, 2016. "Social network utilization and the impact of academic research in marketing," International Journal of Research in Marketing, Elsevier, vol. 33(4), pages 818-839.
    4. Tahamtan, Iman & Bornmann, Lutz, 2018. "Core elements in the process of citing publications: Conceptual overview of the literature," Journal of Informetrics, Elsevier, vol. 12(1), pages 203-216.
    5. Halder, Deepa & Pradhan, Debasis & Roy Chaudhuri, Himadri, 2021. "Forty-five years of celebrity credibility and endorsement literature: Review and learnings," Journal of Business Research, Elsevier, vol. 125(C), pages 397-415.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stremersch, Stefan & Camacho, Nuno & Vanneste, Sofie & Verniers, Isabel, 2015. "Unraveling scientific impact: Citation types in marketing journals," International Journal of Research in Marketing, Elsevier, vol. 32(1), pages 64-77.
    2. Dongqing Lyu & Xuanmin Ruan & Juan Xie & Ying Cheng, 2021. "The classification of citing motivations: a meta-synthesis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3243-3264, April.
    3. Tahamtan, Iman & Bornmann, Lutz, 2018. "Core elements in the process of citing publications: Conceptual overview of the literature," Journal of Informetrics, Elsevier, vol. 12(1), pages 203-216.
    4. Lakshmi Balachandran Nair & Michael Gibbert, 2016. "What makes a ‘good’ title and (how) does it matter for citations? A review and general model of article title attributes in management science," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1331-1359, June.
    5. Ponomariov, Branco & Toivanen, Hannes, 2014. "Knowledge flows and bases in emerging economy innovation systems: Brazilian research 2005–2009," Research Policy, Elsevier, vol. 43(3), pages 588-596.
    6. Dangzhi Zhao & Andreas Strotmann, 2020. "Telescopic and panoramic views of library and information science research 2011–2018: a comparison of four weighting schemes for author co-citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 255-270, July.
    7. Rosenzweig, Stav & Grinstein, Amir & Ofek, Elie, 2016. "Social network utilization and the impact of academic research in marketing," International Journal of Research in Marketing, Elsevier, vol. 33(4), pages 818-839.
    8. Teresa H. Jones & Claire Donovan & Steve Hanney, 2012. "Tracing the wider impacts of biomedical research: a literature search to develop a novel citation categorisation technique," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(1), pages 125-134, October.
    9. Meyer, Matthias & Waldkirch, Rüdiger W. & Duscher, Irina & Just, Alexander, 2018. "Drivers of citations: An analysis of publications in “top” accounting journals," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 51(C), pages 24-46.
    10. Stremersch, S. & Verniers, I.W.J. & Verhoef, P.C., 2006. "The Quest for Citations: Drivers of Article Impact," ERIM Report Series Research in Management ERS-2006-061-MKT, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    11. Chi-Shiou Lin, 2018. "An analysis of citation functions in the humanities and social sciences research from the perspective of problematic citation analysis assumptions," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 797-813, August.
    12. Lina Zhou & Uchechukwuka Amadi & Dongsong Zhang, 2020. "Is Self-Citation Biased? An Investigation via the Lens of Citation Polarity, Density, and Location," Information Systems Frontiers, Springer, vol. 22(1), pages 77-90, February.
    13. Frederique Bordignon, 2022. "Critical citations in knowledge construction and citation analysis: from paradox to definition," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 959-972, February.
    14. Dangzhi Zhao & Andreas Strotmann, 2020. "Deep and narrow impact: introducing location filtered citation counting," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 503-517, January.
    15. Stefan Stremersch & Peter C. Verhoef, 2005. "Globalization of Authorship in the Marketing Discipline: Does It Help or Hinder the Field?," Marketing Science, INFORMS, vol. 24(4), pages 585-594, February.
    16. Lauren Skinner Beitelspacher & Thomas L. Baker & Adam Rapp & Dhruv Grewal, 2018. "Understanding the long-term implications of retailer returns in business-to-business relationships," Journal of the Academy of Marketing Science, Springer, vol. 46(2), pages 252-272, March.
    17. Faiza Qayyum & Harun Jamil & Naeem Iqbal & DoHyeun Kim & Muhammad Tanvir Afzal, 2022. "Toward potential hybrid features evaluation using MLP-ANN binary classification model to tackle meaningful citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6471-6499, November.
    18. Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
    19. Ren, Minglun & Liu, Jiqiong & Feng, Shuai & Yang, Aifeng, 2021. "Pricing and return strategy of online retailers based on return insurance," Journal of Retailing and Consumer Services, Elsevier, vol. 59(C).
    20. Nigel Harwood, 2008. "Publication outlets and their effect on academic writers’ citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 253-265, November.

    More about this item

    Keywords

    science; citation; scientometrics; philosophy of science; marketing; innovation;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureri:77022. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/erimanl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.