Ludo Waltman
Biographic Data
| ID | 4972739 |
|---|---|
| NAME | Ludo Waltman |
| GIVEN NAMES | Ludo |
| FAMILY NAME | Waltman |
| SIGNATURE | WALTMAN L |
| AFFILIATIONS | Leiden University |
| ORCID | 0000-0001-8249-1752 |
| VERIFIED | Yes |
| TOTAL WORKS | 30 |
| TOTAL CITATIONS | 458 |
| AUTHOR COUNT | 30 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 2009 |
| LATEST PUBLICATION YEAR | 2025 |
| H-INDEX | 1 |
Which topics are best represented by science maps? An analysis of clustering effectiveness for citation and text similarity networks
A science map of topics is a visualization that shows topics identified algorithmically based on the bibliographic metadata of scientific publications. In practice not all topics are well represented in a science map. We analyzed how effectively different topics are represented in science maps created by clustering biomedical publications. To achieve this, we investigated which topic categories, obtained from MeSH terms, are better represented in…
A comparison of citation-based clustering and topic modeling for science mapping
Understanding the different ways in which different science mapping approaches capture the structure of scientific fields is critical. This paper presents a comparative analysis of two commonly used approaches, topic modeling (TM) and citation-based clustering (CC), to assess their respective strengths, weaknesses, and the characteristics of their results. We compare the two approaches using cluster-to-topic and topic-to-cluster mappings based on…
Guidance for the reporting of bibliometric analyses
Despite the growth in the number of bibliometric analyses published in the peer-reviewed literature, few articles provide guidance on methods and reporting to ensure reliability, robustness, and reproducibility. Consequently, the quality of reporting in existing bibliometric studies varies greatly. In response, we are developing a preliminary Guidance List for the repOrting of Bibliometric AnaLyses (GLOBAL), a reporting guideline for bibliometric…
Incentivising, excluding, and enduring
Performance-based funding systems (PBFSs) are widely used to steer national research, but their effects vary significantly, particularly in countries with emerging research ecosystems. Relatively little attention has been paid to PBFSs and their concomitant policy dynamics in these countries, where the pressure to internationalise creates unique challenges. This paper presents a detailed study of the development of the Lithuanian PBFS from 2005 t…
Multi-actor Policy Dynamics in Research Evaluation
Making problems
Effective Protection of Fundamental Rights in a pluralist world
Academic information retrieval using citation clusters
The field of science mapping has shown the power of citation-based clusters for literature analysis, yet this technique has barely been used for information retrieval tasks. This work evaluates the performance of citation-based clusters for information retrieval tasks. We simulated a search process with a tree hierarchy of clusters and a cluster selection algorithm. We evaluated the task of finding the relevant documents for 25 systematic reviews…
Funding Covid-19 research
To analyze the outcomes of the funding they provide, it is essential for funding agencies to be able to trace the publications resulting from their funding. We study the open availability of funding data in Crossref, focusing on funding data for publications that report research related to COVID-19. We also present a comparison with the funding data available in two proprietary bibliometric databases: Scopus and Web of Science. Our analysis revea…
The challenges of scientometric studies of predatory publishing
This issue of Quantitative Science Studies features the article “Predatory publishing in Scopus: Evidence on cross-country differences,” coauthored by Vít Macháček and Martin Srholec. Based on the Scopus database, this article studies how likely different countries are to publish in so-called predatory journals. Journals suspected to be predatory are identified using the well-known (and controversial) list of potentially predatory publishers and …
Understanding gender differences in science requires a diversity of perspectives, including controversial ones
Large-scale comparison of bibliographic data sources
We present a large-scale comparison of five multidisciplinary bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic. The comparison considers scientific documents from the period 2008–2017 covered by these data sources. Scopus is compared in a pairwise manner with each of the other data sources. We first analyze differences between the data sources in the coverage of documents, focusing for instance on d…
A multidimensional framework for characterizing the citation impact of scientific publications
The citation impact of a scientific publication is usually seen as a one-dimensional concept. We introduce a multidimensional framework for characterizing the citation impact of a publication. In addition to the level of citation impact, quantified by the number of citations received by a publication, we also conceptualize and operationalize the depth and breadth and the dependence and independence of the citation impact of a publication. The pro…
Special issue on bibliographic data sources
Research in quantitative science studies relies on an increasingly broad range of data sources, providing data on scholarly publications, social media activity, peer review, research funding, the scholarly workforce, scientific prizes, and so on. However, there is one type of data source that remains at the heart of research in quantitative science studies: bibliographic databases. These data sources have increasingly diversified over the last de…
Opening science
Journal of Informetrics (JOI) was created in 2006 to serve the dynamic, interdisciplinary, and rapidly growing field of informetrics (Egghe, 2005, 2006a, 2006b, 2015). Leo Egghe, the founding Editor-in-Chief of JOI, attributed this growth to the increasing attraction of “scientists from fields such as mathematics, physics and computer sciences, thereby considerably increasing the number of researchers engaged in informetrics” (Egghe, 2006b, p. 4)…
A principled methodology for comparing relatedness measures for clustering publications
There are many different relatedness measures, based for instance on citation relations or textual similarity, that can be used to cluster scientific publications. We propose a principled methodology for evaluating the accuracy of clustering solutions obtained using these relatedness measures. We formally show that the proposed methodology has an important consistency property. The empirical analyses that we present are based on publications in t…
From Louvain to Leiden
Community detection is often used to understand the structure of large and complex networks. One of the most popular algorithms for uncovering community structure is the so-called Louvain algorithm. We show that this algorithm has a major defect that largely went unnoticed until now: the Louvain algorithm may yield arbitrarily badly connected communities. In the worst case, communities may even be disconnected, especially when running the algorit…
Science of science
The whys and wherefores of SciSci The science of science (SciSci) is based on a transdisciplinary approach that uses large data sets to study the mechanisms underlying the doing of science—from the choice of a research problem to career trajectories and progress within a field. In a Review, Fortunato et al. explain that the underlying rationale is that with a deeper understanding of the precursors of impactful science, it will be possible to deve…
A review of the literature on citation impact indicators
Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus
Constructing bibliometric networks
Field-normalized citation impact indicators and the choice of an appropriate counting method
Bibliometrics
Visualizing Bibliometric Networks
CitNetExplorer
A smart local moving algorithm for large-scale modularity-based community detection
Software survey
We present VOSviewer, a freely available computer program that we have developed for constructing and viewing bibliometric maps. Unlike most computer programs that are used for bibliometric mapping, VOSviewer pays special attention to the graphical representation of bibliometric maps. The functionality of VOSviewer is especially useful for displaying large bibliometric maps in an easy-to-interpret way. The paper consists of three parts. In the fi…
How to normalize cooccurrence data? An analysis of some well‐known similarity measures
In scientometric research, the use of cooccurrence data is very common. In many cases, a similarity measure is employed to normalize the data. However, there is no consensus among researchers on which similarity measure is most appropriate for normalization purposes. In this article, we theoretically analyze the properties of similarity measures for cooccurrence data, focusing in particular on four well‐known measures: the association strength, t…
Software survey
We present VOSviewer, a freely available computer program that we have developed for constructing and viewing bibliometric maps. Unlike most computer programs that are used for bibliometric mapping, VOSviewer pays special attention to the graphical representation of bibliometric maps. The functionality of VOSviewer is especially useful for displaying large bibliometric maps in an easy-to-interpret way. The paper consists of three parts. In the fi…
A comparison of two techniques for bibliometric mapping
VOS is a new mapping technique that can serve as an alternative to the well‐known technique of multidimensional scaling (MDS). We present an extensive comparison between the use of MDS and the use of VOS for constructing bibliometric maps. In our theoretical analysis, we show the mathematical relation between the two techniques. In our empirical analysis, we use the techniques for constructing maps of authors, journals, and keywords. Two commonly…
A unified approach to mapping and clustering of bibliometric networks
A new methodology for constructing a publication‐level classification system of science
Classifying journals or publications into research areas is an essential element of many bibliometric analyses. Classification usually takes place at the level of journals, where the W eb of S cience subject categories are the most popular classification system. However, journal‐level classification systems have two important limitations: They offer only a limited amount of detail, and they have difficulties with multidisciplinary journals. To av…
A smart local moving algorithm for large-scale modularity-based community detection
Visualizing Bibliometric Networks
CitNetExplorer
Field-normalized citation impact indicators and the choice of an appropriate counting method
Bibliometrics
A review of the literature on citation impact indicators
Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus
Constructing bibliometric networks
Science of science
The whys and wherefores of SciSci The science of science (SciSci) is based on a transdisciplinary approach that uses large data sets to study the mechanisms underlying the doing of science—from the choice of a research problem to career trajectories and progress within a field. In a Review, Fortunato et al. explain that the underlying rationale is that with a deeper understanding of the precursors of impactful science, it will be possible to deve…
From Louvain to Leiden
Community detection is often used to understand the structure of large and complex networks. One of the most popular algorithms for uncovering community structure is the so-called Louvain algorithm. We show that this algorithm has a major defect that largely went unnoticed until now: the Louvain algorithm may yield arbitrarily badly connected communities. In the worst case, communities may even be disconnected, especially when running the algorit…
Special issue on bibliographic data sources
Research in quantitative science studies relies on an increasingly broad range of data sources, providing data on scholarly publications, social media activity, peer review, research funding, the scholarly workforce, scientific prizes, and so on. However, there is one type of data source that remains at the heart of research in quantitative science studies: bibliographic databases. These data sources have increasingly diversified over the last de…
Opening science
Journal of Informetrics (JOI) was created in 2006 to serve the dynamic, interdisciplinary, and rapidly growing field of informetrics (Egghe, 2005, 2006a, 2006b, 2015). Leo Egghe, the founding Editor-in-Chief of JOI, attributed this growth to the increasing attraction of “scientists from fields such as mathematics, physics and computer sciences, thereby considerably increasing the number of researchers engaged in informetrics” (Egghe, 2006b, p. 4)…
A principled methodology for comparing relatedness measures for clustering publications
There are many different relatedness measures, based for instance on citation relations or textual similarity, that can be used to cluster scientific publications. We propose a principled methodology for evaluating the accuracy of clustering solutions obtained using these relatedness measures. We formally show that the proposed methodology has an important consistency property. The empirical analyses that we present are based on publications in t…
Understanding gender differences in science requires a diversity of perspectives, including controversial ones
Large-scale comparison of bibliographic data sources
We present a large-scale comparison of five multidisciplinary bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic. The comparison considers scientific documents from the period 2008–2017 covered by these data sources. Scopus is compared in a pairwise manner with each of the other data sources. We first analyze differences between the data sources in the coverage of documents, focusing for instance on d…
A multidimensional framework for characterizing the citation impact of scientific publications
The citation impact of a scientific publication is usually seen as a one-dimensional concept. We introduce a multidimensional framework for characterizing the citation impact of a publication. In addition to the level of citation impact, quantified by the number of citations received by a publication, we also conceptualize and operationalize the depth and breadth and the dependence and independence of the citation impact of a publication. The pro…
Funding Covid-19 research
To analyze the outcomes of the funding they provide, it is essential for funding agencies to be able to trace the publications resulting from their funding. We study the open availability of funding data in Crossref, focusing on funding data for publications that report research related to COVID-19. We also present a comparison with the funding data available in two proprietary bibliometric databases: Scopus and Web of Science. Our analysis revea…
The challenges of scientometric studies of predatory publishing
This issue of Quantitative Science Studies features the article “Predatory publishing in Scopus: Evidence on cross-country differences,” coauthored by Vít Macháček and Martin Srholec. Based on the Scopus database, this article studies how likely different countries are to publish in so-called predatory journals. Journals suspected to be predatory are identified using the well-known (and controversial) list of potentially predatory publishers and …
Academic information retrieval using citation clusters
The field of science mapping has shown the power of citation-based clusters for literature analysis, yet this technique has barely been used for information retrieval tasks. This work evaluates the performance of citation-based clusters for information retrieval tasks. We simulated a search process with a tree hierarchy of clusters and a cluster selection algorithm. We evaluated the task of finding the relevant documents for 25 systematic reviews…
Which topics are best represented by science maps? An analysis of clustering effectiveness for citation and text similarity networks
A science map of topics is a visualization that shows topics identified algorithmically based on the bibliographic metadata of scientific publications. In practice not all topics are well represented in a science map. We analyzed how effectively different topics are represented in science maps created by clustering biomedical publications. To achieve this, we investigated which topic categories, obtained from MeSH terms, are better represented in…
Computer Science (24 works) · Data science (16 works) · scientometrics and bibliometrics research (16 works) · Citation (15 works) · Information retrieval (14 works) · Complex Network Analysis Techniques (11 works) · Data mining (10 works) · World Wide Web (10 works) · Library science (9 works) · Mathematics (9 works)