IDEAS home Printed from https://ideas.repec.org/a/taf/apeclt/v11y2004i15p945-948.html
   My bibliography  Save this article

Statistical variability of top ranking economics journals impact

Author

Listed:
  • Pedro Cosme Costa Vieira

Abstract

Four issues concerning the quality of scientific economics papers are addressed. First, the ex-ante procedure of computing the average impact of economic papers are validated by comparing its results with the ex post values. Second, an estimator of papers normalized impact is calibrated. Third, the ranking variability of journals is computed using a bootstrap procedure. Fourth, the statistical hypothesis that journals' ranking did not change over the time interval between 1980 and 2000 is tested. It is concluded that this hypothesis is rejected only for the Quarterly Journal of Economics and Econometrica, which saw their citation impact improved.

Suggested Citation

  • Pedro Cosme Costa Vieira, 2004. "Statistical variability of top ranking economics journals impact," Applied Economics Letters, Taylor & Francis Journals, vol. 11(15), pages 945-948.
    • Handle: RePEc:taf:apeclt:v:11:y:2004:i:15:p:945-948
    DOI: 10.1080/1350485042000282231
    as

    Download full text from publisher

    File URL: http://www.informaworld.com/openurl?genre=article&doi=10.1080/1350485042000282231&magic=repec&7C&7C8674ECAB8BB840C6AD35DC6213A474B5
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/1350485042000282231?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David Laband & John Sophocleus, 1985. "Revealed preference for economics journals: Citations as dollar votes," Public Choice, Springer, vol. 46(3), pages 317-324, January.
    2. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    3. Barrett, Christopher B. & Olia, Aliakbar & Bailey, DeeVon, 1996. "Subdiscipline-Specific Journal Rankings In Economics," Economics Research Institute, ERI Study Papers 28346, Utah State University, Economics Department.
    4. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    5. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    6. Christopher Barrett & Aliakbar Olia & Dee Von Bailey, 2000. "Subdiscipline-specific journal rankings: whither Applied Economics?," Applied Economics, Taylor & Francis Journals, vol. 32(2), pages 239-252.
    Full references (including those not matched with items on IDEAS)

    Citations

    RePEc Biblio mentions

    As found on the RePEc Biblio, the curated bibliography for Economics:
    1. > Economics Profession > Ranking in Economics
    2. > Economics Profession > Ranking in Economics > Ranking Methodology

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pedro Cosme da Costa Vieira, 2005. "A new economic journals’ ranking that takes into account the number of pages and co-authors," FEP Working Papers 189, Universidade do Porto, Faculdade de Economia do Porto.
    2. Pedro Cosme Vieira & Aurora A. C. Teixeira, 2010. "Are finance, management, and marketing autonomous fields of scientific research? An analysis based on journal citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 627-646, December.
    3. Pedro Cosme Costa Vieira, 2008. "An economics journals' ranking that takes into account the number of pages and co-authors," Applied Economics, Taylor & Francis Journals, vol. 40(7), pages 853-861.
    4. Justus Meyer & Klaus Wohlrabe, 2018. "Standing on the shoulder of giants: the aspect of free-riding in RePEc rankings," Applied Economics Letters, Taylor & Francis Journals, vol. 25(4), pages 223-228, February.
    5. Martin Gregor, 2006. "Hodnocení ekonomických pracovišť a ekonomů: Koho, proč, čím a jak [A survey of rankings of economic departments: Global, american, european and national]," Politická ekonomie, Prague University of Economics and Business, vol. 2006(3), pages 394-414.
    6. Lúcia Paiva Martins de Sousa & Pedro Cosme da Costa Vieira, 2005. "Um ranking das revistas científicas especializadas em economia regional e urbana," FEP Working Papers 193, Universidade do Porto, Faculdade de Economia do Porto.
    7. Pedro Cosme Costa Vieira, 2005. "The importance in the papers' impact of the number of pages and of co-authors - an empirical estimation with data from top ranking economic journals," FEP Working Papers 169, Universidade do Porto, Faculdade de Economia do Porto.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    2. Molero, Juan Carlos & Pujol, Francesc, 2004. "Ranking Italian Universities and Other Research Institutions Taking Into Account Public Economics Publications," MPRA Paper 8055, University Library of Munich, Germany.
    3. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    4. Chagas , André Luis Squarize, 2017. "Publish or Perish: um ranking de revistas da subárea de Economia Regional e Urbana para os pesquisadores brasileiros," Revista Brasileira de Estudos Regionais e Urbanos, Associação Brasileira de Estudos Regionais e Urbanos (ABER), vol. 11(4), pages 515-536.
    5. Azar, Ofer H., 2007. "Behavioral economics and socio-economics journals: A citation-based ranking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 36(3), pages 451-462, June.
    6. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    7. Melody Lo & M. C. Sunny Wong & Franklin G. Mixon, 2008. "Ranking Economics Journals, Economics Departments, and Economists Using Teaching‐Focused Research Productivity," Southern Economic Journal, John Wiley & Sons, vol. 74(3), pages 894-906, January.
    8. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    9. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & J. Martinez-Baena, 2012. "On first quartile journals which are not of highest impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 925-943, March.
    10. Yong Bao & Melody Lo & Franklin G. Mixon, 2010. "General-interest versus specialty journals: Using intellectual influence of econometrics research to rank economics journals and articles," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 345-353.
    11. John Gibson & David L. Anderson & John Tressler, 2014. "Which Journal Rankings Best Explain Academic Salaries? Evidence From The University Of California," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1322-1340, October.
    12. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    13. Baltagi, Badi H., 2007. "Worldwide Econometrics Rankings: 1989–2005," Econometric Theory, Cambridge University Press, vol. 23(5), pages 952-1012, October.
    14. Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    15. Waltman, Ludo & van Eck, Nees Jan, 2008. "Some comments on the journal weighted impact factor proposed by Habibzadeh and Yadollahie," Journal of Informetrics, Elsevier, vol. 2(4), pages 369-372.
    16. Berg, E. & Dabbert, S. & Herrmann, R. & Pöchtäger, S. & Salhofer, K., 2009. "Zur Qualität agrarökonomisch relevanter Zeitschriften: Das GEWISOLA/ÖGA Journal-Ranking," Proceedings “Schriften der Gesellschaft für Wirtschafts- und Sozialwissenschaften des Landbaues e.V.”, German Association of Agricultural Economists (GEWISOLA), vol. 44, March.
    17. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Trends in Economic Research: An International Perspective," Kyklos, Wiley Blackwell, vol. 63(4), pages 479-494, November.
    18. Michael Bräuninger & Justus Haucap & Johannes Muck, 2011. "Was lesen und schätzen deutschsprachige Ökonomen heute?," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(4), pages 339-371, November.
    19. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2011. "Overall prestige of journals with ranking score above a given threshold," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 229-243, October.
    20. László Á. Kóczy & Alexandru Nichifor & Martin Strobel, 2010. "Intellectual Infl uence: Quality versus Quantity," Working Paper Series 1009, Óbuda University, Keleti Faculty of Business and Management.

    More about this item

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Rankings of Economists, Economics Departments and Economics Journals

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:apeclt:v:11:y:2004:i:15:p:945-948. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RAEL20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.