Is it reliable to screen the reviewer with algorithms?
May 22, 2024 09:18 Source: "China Social Sciences" May 22, 2024 Issue 2896 Author: Practic

 bet365 live casino games "Nature" magazine official website recently posted a post,The algorithm for sorting the reviewers of peer reviews according to the reputation can be used to find and screen the reviewer,But some people question whether the tool will have prejudice,Delivery of the reviewer who lacks experience or the reviewer in some regions。This algorithm judges the reputation of the reviewer based on the number of references evaluated by the reviewer,and rank。The designer of the tool said,It can help determine which papers may be a high -influential paper during peer review,The author can also judge the advice and feedback of the reviewers through this tool.。

Researchers extracted the reference data from bet365 live casino games the 308243 papers published by the American Institute of Physics from 1990 to 2010。Information from the reviewer of these papers cannot be obtained,Researchers used algorithms to create imaginary reviewers,These imaginary reviewers conduct imagination scores on papers based on the algorithm,Researchers compared the correlation between the false score and the actual score of the thesis。In order to rank fantastic reviewers,Researchers tracked the number of quotes of these papers,and checked their imagination scores。If the imaginary reviewer scores a high score,And these papers later got a lot of references,Then these imaginary reviewers will get a higher ranking。Subsequent,The author tested the results of the papers evaluated by the same imaginary reviewer in the second decade.,The results show,The evaluation of the imaginary reviewer is consistent with the actual number of these Bet365 app download papers in the second decade.,This indicates that the algorithm can predict high influence papers。

This tool is widely criticized because it is too dependent on reference indicators,Critics think,Reference indicators have exacerbated prejudice that exists in the academic world。Researchers acknowledge that there is limitations of the reference indicators,But they said that the work of the reviewer is also very important。Solid research is sometimes rejected because of the negative comments of the reviewer,But people rarely pay attention to the professionalism and reliability of the reviewer。If this algorithm can identify a reliable reviewer,Then it will reduce the weight of the unprofessional reviewer。Journal editing usually needs to manually determine the candidate for review,If the reputation of the reviewer is quantified and ranked,​​Journal editing can make it easier to choose。

bet365 live casino games Anita Bandrowski, an information scientist of the University of California, San Diego, said,Ranking according to the reputation of the reviewer is likely to exacerbate the unfairness and prejudice existing in peer reviews。Most of the responsibilities of the peer review process in the science field fall on a small part of the reviewer,They are usually senior positions in high -income countries,Geographically closer to most journal editors。Bandorovsky thinks,This algorithm may still be biased towards those reviewers with rich experienced manuscripts,Because they have been engaged in this work for a long time,There are more time to accumulate the number of quotation of the papers。She said,According to this standard,The oldest reviewer will be the best reviewer。

but but,Researchers do not agree that this method will make the reviewer's choice more unreasonable than now,After implementing the reputation ranking,bet365 live casino games Edit may find that some unconventional reviewers have a high reputation score,In some cases, even higher than those reviewers who have been drowned by a large number of reviewers。

Laura Feetham-Walker, the manager of the British Institute of Physicals Press, is worried that this algorithm may not take into account incremental research、negative research results and repetitive studies,Although the reference rate of such research is not high,But it is important for science。She said,In this ranking system,If the reviewer gives positive recommendations for incremental research,Then the reputation ranking of the reviewer will fall,The reason is very simple,It is unlikely to get a lot of references after the manuscript was published。Researchers who have never considered the manuscript for this ranking,or researchers who have never reviewed the manuscript for specific publishers。Fisham Walker Bet365 app download said,The reviewer can provide effective review opinions not only depends on professional knowledge,It depends on whether they have time、Are you interested in the theme,The algorithm needs to be more fine,Consider all the factors as much as possible,Help the issue to add new review candidates、rich reviewer database。

  (Practicing Zhi Leisure/Compilation)

Editor in charge: Zhang Jing
QR code icons 2.jpg
Key recommendation
The latest article
Graphics
bet365 live casino games
Video

Friendship link:

Website filing number: Jinggong.com Anmi 11010502030146 Bet365 app download Ministry of Industry and Information Technology:

All rights reserved by China Social Sciences Magazine shall not be reprinted and used without permission

General Editor Email: zzszbj@126.com This website contact information: 010-85886809 Address: 11-12, Building 1, Building 1, No. 15, Guanghua Road, Chaoyang District, Beijing: 100026