IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v63y2005i1d10.1007_s11192-005-0206-2.html
   My bibliography  Save this article

Implementing relevant disciplinary evaluations in the social sciences

Author

Listed:
  • Philippe Jeannin

    (Université Toulouse III, LEREPS-GRESS & IUT de Tarbes)

  • Joëlle Devillard

    (Université Toulouse III, LERASS-MICS)

Abstract

Summary This paper addresses the issue of relevancy when tackling the problem of the evaluation of research published in Social Science journals. This evaluation initialy relies on a critical selection of the databases scientists use. To implement relevant disciplinary evaluations, the method also needs to be scientific, ethical, replicable, comprehensive, flexible, transparent, accessible, incentive, productive, updatable and “internationalizable”. This qualitative approach takes into account the current global environment of research. Our method - introducing these criteria - consists in selecting the bases (either bases from the Institute for Scientific Information or not) scientists favour, in crossing them to elaborate new lists of journals, in testing them, in launching a life-size survey among scientists. This method stands as a prerequisite for further applications. Beyond this rather constructivist approach, such evaluations of research can benefit to all the actors participating in the process of the dissemination of knowledge. The need for an international cooperation in coming up with relevant evaluation criteria and indexes is put forward when implementing these sets of evaluation. The appendix presents a case study on French sociology.

Suggested Citation

  • Philippe Jeannin & Joëlle Devillard, 2005. "Implementing relevant disciplinary evaluations in the social sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(1), pages 121-144, March.
    • Handle: RePEc:spr:scient:v:63:y:2005:i:1:d:10.1007_s11192-005-0206-2
    DOI: 10.1007/s11192-005-0206-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-005-0206-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-005-0206-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paul Resnick & Christopher Avery & Richard Zeckhauser, 1999. "The Market for Evaluations," American Economic Review, American Economic Association, vol. 89(3), pages 564-584, June.
    2. Papon, Pierre, 1998. "Research institutions in France: between the Republic of science and the nation-state in crisis," Research Policy, Elsevier, vol. 27(8), pages 771-780, December.
    3. Bruno Frey, 2002. "Why economists disregard economic methodology," Journal of Economic Methodology, Taylor & Francis Journals, vol. 8(1), pages 41-47.
    4. Wilts, Arnold, 2000. "Forms of research organisation and their responsiveness to external goal setting," Research Policy, Elsevier, vol. 29(6), pages 767-781, June.
    5. Mustar, Philippe & Laredo, Philippe, 2002. "Innovation and research policy in France (1980-2000) or the disappearance of the Colbertist state," Research Policy, Elsevier, vol. 31(1), pages 55-72, January.
    6. Diana Hicks, 1999. "The difficulty of achieving full coverage of international social science literature and the bibliometric consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 44(2), pages 193-215, February.
    7. T N van Leeuwen & L J van der Wurff & A F J van Raan, 2001. "The use of combined bibliometric methods in research funding policy," Research Evaluation, Oxford University Press, vol. 10(3), pages 195-201, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philippe Jeannin, 2004. "Les économistes et leurs revues," Revue d'économie politique, Dalloz, vol. 114(3), pages 275-288.
    2. Edgardo Arturo Ayala Gaytán, 2009. "Social network externalities and price dispersion in online markets," Ensayos Revista de Economia, Universidad Autonoma de Nuevo Leon, Facultad de Economia, vol. 0(2), pages 1-28, November.
    3. Funk, Matt, 2008. "On the Problem of Sustainable Economic Development: A Theoretical Solution to this Prisoner's Dilemma," MPRA Paper 19025, University Library of Munich, Germany, revised 08 Jun 2008.
    4. Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
    5. Rockenbach, Bettina & Sadrieh, Abdolkarim, 2012. "Sharing information," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 689-698.
    6. Engström, Per & Forsell, Eskil, 2018. "Demand effects of consumers’ stated and revealed preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 43-61.
    7. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    8. Sándor Soós & Zsófia Vida & András Schubert, 2018. "Long-term trends in the multidisciplinarity of some typical natural and social sciences, and its implications on the SSH versus STM distinction," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 795-822, March.
    9. Jonathan Levin, 2011. "The Economics of Internet Markets," Discussion Papers 10-018, Stanford Institute for Economic Policy Research.
    10. Paul Resnick & Richard Zeckhauser & John Swanson & Kate Lockwood, 2006. "The value of reputation on eBay: A controlled experiment," Experimental Economics, Springer;Economic Science Association, vol. 9(2), pages 79-101, June.
    11. Gesche, Tobias, 2018. "Reference Price Shifts and Customer Antagonism: Evidence from Reviews for Online Auctions," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181650, Verein für Socialpolitik / German Economic Association.
    12. Fagerberg, Jan & Fosaas, Morten & Sapprasert, Koson, 2012. "Innovation: Exploring the knowledge base," Research Policy, Elsevier, vol. 41(7), pages 1132-1153.
    13. van Dolen, Willemijn & de Ruyter, Ko & Carman, James, 2006. "The role of self- and group-efficacy in moderated group chat," Journal of Economic Psychology, Elsevier, vol. 27(3), pages 324-343, June.
    14. Klaus Mohn, 2010. "Autism in Economics? A Second Opinion," Forum for Social Economics, Springer;The Association for Social Economics, vol. 39(2), pages 191-208, July.
    15. Dellarocas, Chrysanthos, 2004. "The Digitization of Word-of-Mouth: Promise and Challenges of Online Feedback," Working papers 4296-03, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    16. Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2015. "Bibliometric evaluation vs. informed peer review: Evidence from Italy," Research Policy, Elsevier, vol. 44(2), pages 451-466.
    17. Reto Foellmi & Urs Meister, 2005. "Product-Market Competition in the Water Industry: Voluntary Non-discriminatory Pricing," Journal of Industry, Competition and Trade, Springer, vol. 5(2), pages 115-135, June.
    18. Cécile Crespy & Jean-Alain Héraud & Beth Perry, 2007. "Regierungsführung auf mehreren Ebenen, Regionen und Wissenschaft in Frankreich: zwischen Wettbewerb und Gleichheit [Multi-level governance, regions and science in France: between competition and eq," Post-Print hal-00514676, HAL.
    19. Hagiu, Andrei, 2009. "Why Do Intermediaries Divert Search?," Department of Economics, Working Paper Series qt3f34c5dk, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    20. Andreas Rehs, 2020. "A structural topic model approach to scientific reorientation of economics and chemistry after German reunification," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1229-1251, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:63:y:2005:i:1:d:10.1007_s11192-005-0206-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.