Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Measuring research quality using the journal impact factor, citations and 'Ranked Journals

Blunt Instruments or Inspired Metrics

Bibliographic Data

ID4545864
AuthorsSom D Jarwal, D Jarwal (0000-0003-1843-9057, Monash University), Andrew M Brion, A Brion (0009-0009-7945-8375, Monash University), Maxwell L King (Monash University)
Year2009
Volume31
Issue4
Pages289-300
Publication date2009-10-06
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueJournal of Higher Education Policy and Management (JOURNAL)
Journal identifiersISSN: 1360-080X • E-ISSN: 1469-9508
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/13600800903191930
OpenAlexW1966095975
LanguageEN
Citations received13
References cited11

This paper examines whether three bibliometric indicators—the journal impact factor, citations per paper and the Excellence in Research for Australia (ERA) initiative's list of 'ranked journals'—can predict the quality of individual research articles as assessed by international experts, both overall and within broad disciplinary groupings. The analysis is based on data obtained from a Mock Research Quality Framework (RQF) exercise conducted by Monash University during 2006–07 in which external assessors rated research articles for their quality using a five-point scale. Although a significant relationship exists between all three bibliometric variables and the overall Mock RQF assessor quality scores, only a relatively small amount of the variance (generally <20 per cent) could be explained. There is some evidence that the relationship is stronger within some disciplinary groupings than others. The findings suggest caution should be exercised when using these indicators as proxies for research quality

Bibliometrics · Business · Citation · Excellence · Geography · Higher education · Impact factor · Information retrieval · Journal ranking · Library science · Political science · Quality (philosophy · Ranking (information retrieval · Research Assessment Exercise · Scale (ratio · Statistics · Variance (accounting · Computer Science · Mathematics · Psychology · scientometrics and bibliometrics research · Accounting

  • Development of a tool to accurately predict UK REF funding allocation

    Open Access•Shahd Al-Janabi, Shahd Al‐Janabi et al.•Scientometrics•2021

  • What is meaningful research and how should we measure it

    Open Access•Sven Helmer, David B Blumenthal et al.•Scientometrics•2020

  • Toward a classification of Spanish scholarly journals in social sciences and humanities considering their impact and visibility

    Open Access•Daniela De Filippo, Rafael Aleixandre Benavent et al.•Scientometrics•2020

  • Correlating article citedness and journal impact

    Open Access•Giovanni Abramo, Ciriaco Andrea D’Angelo et al.•Scientometrics•2023

  • A path for ranking success

    Open Access•Baris Uslu•Higher Education•2020

  • Pragmatism (or Realism) in Research

    Open Access•Craig Stephens, Craig Stephen et al.•EcoHealth•2016

  • Let the best story win – evaluation of the most cited business history articles

    Jari Ojala, Jari Eloranta et al.•Management & Organizational History•2017

  • The reliability of evidence review methodology in environmental science and conservation

    Open Access•Bethan C O’Leary, Kristian Kvist et al.•Environmental Science & Policy•2016

  • Impact Faktoren

    Bruno S Frey, Margit Osterloh•Soziale Welt•2015

  • Expanding the boundaries of interdisciplinary field

    Open Access•Valentina Kuskova, Dmitry Zaytsev et al.•Network Science•2023

  • Institutional strategies for capturing socio-economic impact of academic research

    Rosa Scoble, Keith Dickson et al.•Journal of Higher Education…•2010

  • Measuring research 'impact' for academic promotion

    Kylie Smith, Kylie M Smith et al.•Journal of Higher Education…•2013

  • A Revolution Reconsidered? Examining the Practice of Qualitative Research in Feminist Scholarship

    Sara O’shaughnessy, Naomi Krogman et al.•Signs: Journal of Women in…•2012

  • Why the impact factor of journals should not be used for evaluating research

    Open Access•Per O Seglen•BMJ•1997

  • Citation Analysis as a Tool in Journal Evaluation

    Open Access•Eugene Garfield•Science•1972

Unique citing works13
Citations per year0,81
Citation span2010 - 2023 (14)
Citation velocityhistorical
Highly citedNo
Citation typesNeutral: 13

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae