Traditionally, the success of a researcher is assessed by the number of publications he or she publishes in peer-reviewed, indexed, high impact journals. This essential yardstick, often referred to as the impact of a ...Traditionally, the success of a researcher is assessed by the number of publications he or she publishes in peer-reviewed, indexed, high impact journals. This essential yardstick, often referred to as the impact of a specific researcher, is assessed through the use of various metrics. While researchers may be acquainted with such matrices, many do not know how to use them to enhance their careers. In addition to these metrics, a number of other factors should be taken into consideration to objectively evaluate a scientist＇s profile as a researcher and academician. Moreover, each metric has its own limitations that need to be considered when selecting an appropriate metric for evaluation. This paper provides a broad overview of the wide array of metrics currently in use in academia and research. Popular metrics are discussed and defined, including traditional metrics and article-level metrics, some of which are applied to researchers for a greater understanding of a particular concept, including varicocete that is the thematic area of this Special Issue of Asian Journal of Andrology. We recommend the combined use of quantitative and qualitative evaluation using judiciously selected metrics for a more objective assessment of scholarly output and research impact.展开更多
Purpose:To describe the characteristics of research outputs using persistent identifiers generated by ResearchGate to gain insight into what publications are shared and disseminated through this functionality,revealin...Purpose:To describe the characteristics of research outputs using persistent identifiers generated by ResearchGate to gain insight into what publications are shared and disseminated through this functionality,revealing their academic and non-academic impact.Design/methodology/approach:A total of 1,092,934 RG-DOIs were collected,using the DataCite API,along with bibliographic metadata for the associated registered output(RG-DOI publications).The subsequent analysis evaluated the publication date,document type,and language.These values were crossreferenced against the full text of a random sample of 666 records to verify accuracy.Findings:RG-DOIs have served primarily to identify and make accessible scholarly gray literature,including posters,presentations,conference papers,and theses,with notable emphasis on publications in Spanish and Portuguese.Around 41,000 citations from Web of Science indexed publications to RG publications are evidence of their infrequent but perceptible use in scholarly discourse.The declining number of registrations of RG-DOIs observed may indicate a shift in researcher preferences to alternative platforms for DOI generation.Research limitations:The study uncovered substantial inconsistencies in DataCite metadata,which can be attributed to the automated DOI registration process and internal changes in the available document types on ResearchGate.Practical implications:The study encountered challenges in conducting a quantitative analysis due to inconsistencies in the metadata.These have potential implications for researchers,practitioners,and librarians relying on RG-DOIs to conduct bibliometric or bibliographic analysis.Originality/value:This study is the first comprehensive analysis of RG-DOIs and,as such,provides a unique perspective into academic gray literature.It also sheds light on the quality of ResearchGate data transmitted to DataCite when registering DOIs.展开更多
The measurement indexes of literature include citation frequency,H index,etc.The evaluation of core joumals mainly relies on the indexes such as impact factor or comprehensive evaluation method.With the in-depth devel...The measurement indexes of literature include citation frequency,H index,etc.The evaluation of core joumals mainly relies on the indexes such as impact factor or comprehensive evaluation method.With the in-depth development of research,these indicators are not comprehensive and accurate for literature and jourmals.Therefore,according to various literature needs for different researchers,"core literature"in this study was divided into three types:classical,popular and frontier;and measurement system of document value was constructed with comprehensive use of entropy weight method and principal component analysis from the perspective of Article-Level Metrics.In the case study of artificial intelligence(AD),three types of document sets were acquired with the threshold value of specific indicators,and then measured by a combination of multi-index,achieving identification and recommendation of core documents for different research needs.At the same time,this paper further calculates the total score of the joumals according to the literature score,and finds that the journal distribution of different types of core literature is quite different.The difference between the ranking of joumal scores and the ranking of impact factor after literature classification is relatively large,but the ranking of jourmal normalized Eigenfactor and the ranking of impact factor are similar.These research directions,loading joumals,selected indicators,and temporal effects in three types of core documents were revealed in the study,which can provide a certain reference for promoting scientific research in AI and launching scientific research management services.展开更多
文摘Traditionally, the success of a researcher is assessed by the number of publications he or she publishes in peer-reviewed, indexed, high impact journals. This essential yardstick, often referred to as the impact of a specific researcher, is assessed through the use of various metrics. While researchers may be acquainted with such matrices, many do not know how to use them to enhance their careers. In addition to these metrics, a number of other factors should be taken into consideration to objectively evaluate a scientist＇s profile as a researcher and academician. Moreover, each metric has its own limitations that need to be considered when selecting an appropriate metric for evaluation. This paper provides a broad overview of the wide array of metrics currently in use in academia and research. Popular metrics are discussed and defined, including traditional metrics and article-level metrics, some of which are applied to researchers for a greater understanding of a particular concept, including varicocete that is the thematic area of this Special Issue of Asian Journal of Andrology. We recommend the combined use of quantitative and qualitative evaluation using judiciously selected metrics for a more objective assessment of scholarly output and research impact.
基金supported by Grant PID2022-142569NA-I00,funded by MCIN/AEI/10.13039/501100011033 and by the European Union through“ERDF A way of making Europe.”。
文摘Purpose:To describe the characteristics of research outputs using persistent identifiers generated by ResearchGate to gain insight into what publications are shared and disseminated through this functionality,revealing their academic and non-academic impact.Design/methodology/approach:A total of 1,092,934 RG-DOIs were collected,using the DataCite API,along with bibliographic metadata for the associated registered output(RG-DOI publications).The subsequent analysis evaluated the publication date,document type,and language.These values were crossreferenced against the full text of a random sample of 666 records to verify accuracy.Findings:RG-DOIs have served primarily to identify and make accessible scholarly gray literature,including posters,presentations,conference papers,and theses,with notable emphasis on publications in Spanish and Portuguese.Around 41,000 citations from Web of Science indexed publications to RG publications are evidence of their infrequent but perceptible use in scholarly discourse.The declining number of registrations of RG-DOIs observed may indicate a shift in researcher preferences to alternative platforms for DOI generation.Research limitations:The study uncovered substantial inconsistencies in DataCite metadata,which can be attributed to the automated DOI registration process and internal changes in the available document types on ResearchGate.Practical implications:The study encountered challenges in conducting a quantitative analysis due to inconsistencies in the metadata.These have potential implications for researchers,practitioners,and librarians relying on RG-DOIs to conduct bibliometric or bibliographic analysis.Originality/value:This study is the first comprehensive analysis of RG-DOIs and,as such,provides a unique perspective into academic gray literature.It also sheds light on the quality of ResearchGate data transmitted to DataCite when registering DOIs.
基金This research is funded by Bejing Social Science Fund(grant number 19GLC057)Project of High-level Teachers in Beijing Municipal Universities-Youth Top-notch Talent Support Program(grant number PXM2020_014204_000019).
文摘The measurement indexes of literature include citation frequency,H index,etc.The evaluation of core joumals mainly relies on the indexes such as impact factor or comprehensive evaluation method.With the in-depth development of research,these indicators are not comprehensive and accurate for literature and jourmals.Therefore,according to various literature needs for different researchers,"core literature"in this study was divided into three types:classical,popular and frontier;and measurement system of document value was constructed with comprehensive use of entropy weight method and principal component analysis from the perspective of Article-Level Metrics.In the case study of artificial intelligence(AD),three types of document sets were acquired with the threshold value of specific indicators,and then measured by a combination of multi-index,achieving identification and recommendation of core documents for different research needs.At the same time,this paper further calculates the total score of the joumals according to the literature score,and finds that the journal distribution of different types of core literature is quite different.The difference between the ranking of joumal scores and the ranking of impact factor after literature classification is relatively large,but the ranking of jourmal normalized Eigenfactor and the ranking of impact factor are similar.These research directions,loading joumals,selected indicators,and temporal effects in three types of core documents were revealed in the study,which can provide a certain reference for promoting scientific research in AI and launching scientific research management services.
