Expert-Driven and Citational Approaches to Assessing Journal Publications of Brazilian Political Scientists

Datos Bibliográficos

ID6235586
AutoresLorena G Barberia (0000-0001-6319-543X, Universidade de São Paulo), Danilo Praxedes Barboza (Universidade de São Paulo), Samuel Ralize De Godoy (0000-0003-1727-9928, Universidade de São Paulo)
Año2018
Volumen12
Número1
Fecha de publicación2018-03-19
Peer ReviewedSí
Open AccessSí
TipoARTICLE
RevistaBrazilian Political Science Review (JOURNAL)
Identificadores de la revistaISSN: 1981-3821 • E-ISSN: 1981-3821
EditorialFapUNIFESP (SciELO) (PUBLISHER)
DOI10.1590/1981-3821201800010004
OpenAlexW2789612075
SCIELO_PIDS1981-38212018000100200
IdiomaEN
Citas recibidas2
Referencias citadas29

In this study, we seek to contribute to discussions on how the quality of academic production in the field of political science should be evaluated using Brazil as a case study. We contrast the 'expert-driven approach' that is followed by CAPES, an agency of the Brazilian federal government with the 'citational' approach, which is based on the ranking of journals by mainstream indices of scientific research impact. With data provided by CAPES from 2010 to 2014, we examine to what extent journals that are ranked as having high quality by CAPES also have high impact indexes in the SCImago Journal rank index (SJR), the Hirsch index (h-index) calculated by SCImago, the h5-index and h5-median (based on the h-index period 05 years, calculated by Google Scholar Metrics), and the SNIP indicator (calculated by the CWTS Journal Indicators, included in the Scopus database). Our findings show that there is a positive, but weak correlation between citational criteria and the Qualis evaluation of the same journals. In ordered logistic regressions, we show that a journal's past Qualis scores are the most important factor for explaining its grades in the next evaluation. We show that once a journal's past Qualis score is considered, a journal's citational ranking does not influence its Qualis score with the exception of the SJR in the 2013-4 evaluation. Moreover, a journal's Qualis score is not influenced by the country of publication, language, or social science focus, all else equal

Bibliometrics · Citation · Impact factor · Index (typography · Journal ranking · Library science · MEDLINE · Political science · Ranking (information retrieval · Scopus · Social science · Sociology · Computer Science · Education and Public Policy · Law · Psychology · Science and Science Education · scientometrics and bibliometrics research · Artificial Intelligence