鶹Ժ

May 10, 2018

Topic-adjusted visibility metric for scientific articles

An actual scientific article (from the KDD Cup dataset) with known citations was used to demonstrate how the algorithm could generate recommendations for researchers searching for information in a related field. Figure shows the top 15 citations recommended by the metric. Out of these 15 predicted citations, five of them (marked with asterisks) were actual citations by the article. In comparison, other methods did not manage to predict any of the actual citations. The coloured segments in the “topic proportions” indicate the probability that an article belongs to a specific topic. Credit: Annals of Applied Statistics
× close
An actual scientific article (from the KDD Cup dataset) with known citations was used to demonstrate how the algorithm could generate recommendations for researchers searching for information in a related field. Figure shows the top 15 citations recommended by the metric. Out of these 15 predicted citations, five of them (marked with asterisks) were actual citations by the article. In comparison, other methods did not manage to predict any of the actual citations. The coloured segments in the “topic proportions” indicate the probability that an article belongs to a specific topic. Credit: Annals of Applied Statistics

An NUS statistician has developed a metric that automatically accounts for citation variations in different disciplines for measuring the research merit of scientific articles.

The research merit (impact) of is frequently used as one of the parameters to judge the quality of research outcomes. This is usually obtained from the citations of research work already published in the journal. However, different academic disciplines have different research behaviours and practices. For example, articles in certain disciplines (e.g. mathematics) generally have low citations while other fields (e.g. molecular biology) in comparison averaged more citations. Hence, a comparison of research quality across different disciplines based on raw citation counts would not reflect accurately the research merit.

Prof Linda TAN from the Department of Statistics and Applied Probability, NUS has developed an article-level metric, called "topic-adjusted visibility metric", which is able to automatically account for the variation in citation activities among different research fields. It computes this without using existing classifications tagged to the individual article but by using a complex network containing attributes belonging to the selected article. Each article need not belong to a single field but can belong to multiple fields with varying degrees. This can provide a better gauge for comparing individual scientific publications across different fields. The research team has also developed an efficient computational algorithm using this metric to help academic researchers with article recommendations.

Prof Tan said, "When our method is applied to the KDD Cup 2003 (knowledge discovery and data mining competition) benchmarking dataset which has approximately 30,000 papers, it demonstrated better performance for recommendations by being more accurate in predicting the actual citations from test articles, as compared to other available models."

More information: Linda S. L. Tan et al. Topic-adjusted visibility metric for scientific articles, The Annals of Applied Statistics (2016).

Journal information: Annals of Applied Statistics

Load comments (0)

This article has been reviewed according to Science X's and . have highlighted the following attributes while ensuring the content's credibility:

Get Instant Summarized Text (GIST)

This summary was automatically generated using LLM.