The dilemma of quotation analysis and the steering of scientific evaluation
08:14, August 04, 2023 Source: "China Social Sciences", August 4, 2023, Issue 2706, Issue 2706: Zhou Wenjie

Scientific evaluation is an important tool for promoting scientific development and promoting knowledge spread。First,Scientific evaluation can provide a reference for scientists to understand the advantages and lack of research on their research,Therefore, researchers continue to improve research methods,Improve research quality。At the same time,Limited resources in the field of scientific research,Scientific evaluation helps to achieve the best allocation of research funds and human resources。Another,Scientific evaluation passed review、Verification and reaping research results,Make sure the credibility and reliability of scientific research,to prevent errors or false information dissemination,Credit of Maintaining Science。Next,Through scientific evaluation,Understanding of high -quality research often shows,Then spread to the global scientific community,Promoting the exchange and cooperation of knowledge。Between different discipline areas,Whether to communicate with scientific evaluation,Effectively promote cross -disciplinary research,Stimulate communication between different fields、Cooperation and integration,Promoting scientific innovation。Another,Scientific evaluation also plays an important role in guiding the direction of scientific research。Through scientific evaluation,Scientists and scientific research institutions can not only understand the development of the current research field,Evaluate the value and prospects of different research directions,and can better identify the cutting -edge theme,Discover emerging fields,As a result。
In view of the significance of scientific evaluation to scientific development,Since the mid -20th century,From Library Intelligence、Science、Literature Measurement、Researchers in the fields of science and technology philosophy have given high attention to scientific evaluations,and developed a series of scientific evaluation tools and indicators。where,Scientific evaluation methods developed based on citations、Tools and System,Can be called the mainstream of scientific evaluation in the past few decades。
  The contribution and limitations of quotation analysis
Citation analysis is an analysis of the reference relationship between academic literature,Then the scientific evaluation method of judging the value of the research results,Its basic principle is to analyze the number of times and reference relationships quoted by bet365 live casino games the literature,Reveal the connection and influence between academic literature。1961,American information scientist Eugene Garfield (Eugene Garfield) created the Science Citation Index,SCI),Become the first systematic citation database in the world。The creation of SCI,allows scientists,At the same time, it also provides data source for citation analysis。1963,Calfield further founded the Social Sciences Citation INDEX,SSCI),The application scope of the analysis of citation to the field of social sciences。Since the 1970s,Researchers began to use SCI and SSCI and other quotes databases,Evaluation of academic influence and academic cooperation network,Expand the evaluation and analysis of scientific research。In the past 20 or 30 years,With the development of the Internet and digital technology,Citation analysis becomes more convenient and comprehensive。Current,With Google Scholar、Web of Science and Scopus and other academic search engines and literature databases,Citation analysis has a larger data foundation and more diverse evaluation tool selection。
Science No Borders。In the development process of scientific evaluation,Citation analysis has played an extremely important role in countries around the world。First,Citation analysis The number of times cited by a dissertation or a scholar is statistical,Measure its academic influence and academic contribution,So it provides a simplicity for scientific evaluation、An intuitive solution。Next,Citation analysis The quotation of the literature in a certain field,You can understand the research focus of this field、academic inheritance and innovation direction,Effectively reveal the development trends and research hotspots in different academic fields,Provided reference and guidance for scientific researchers。again,Citation analysis is also the most effective way to identify the academic cooperation network and discover the frontier fields。Last,Citation analysis results also have a certain guiding role in the formulation of academic policy and distribution of scientific research funds,Government and scientific institutions can analyze the results of the quotation,Adjust the distribution direction of scientific research funds,Research projects with high influence and potential。
Generally speaking,Citation analysis method provides important quantitative tools for scientific research and academic evaluation,Not only can help scientists understand the dynamics and academic influence of the academic world,Promote academic development and cooperation,Promoting the continuous progress of science,It can also help decision makers to Bet365 lotto review reasonably allocate resources for scientific research,Promoting the optimization configuration of scientific and technological resources。But what needs to be noticed is,Citation analysis also shows more and more shortcomings and shortcomings。Specific performance in:
1 is to ignore negative references。Citation analysis usually takes only the number of references,But there is no in -depth disclosure of the motivation of the citation。That is to say,Citation analysis naturally assumes that the reference is positive,The reference to other scholars on a paper is affirmation of its academic perspective。but,Many academic papers may be criticized or questioned by other scholars,Lead negative reference,These negative references are equally important for evaluating the academic quality of the paper,But was ignored in the analysis of traditional citation。
The second is potential reference bias。The specific performance is,Scholars are more inclined to quote the works of well -known or mainstream scholars,while ignoring or less reference to the results of non -well -known or non -mainstream scholars。This may cause some high -quality but unknown research to be ignored,thus affecting the fairness and comprehensiveness of scientific evaluation。
Third is the potential citation manipulation。The importance of referenced in scientific evaluation,Some scholars may try to manipulate reference data。For example,The number of references to the increase of your papers through artificially,To improve your academic reputation。This citation manipulation will lead to distortion of the evaluation results,Reduce the credibility of scientific evaluation。
Fourth, there are large differences in reference behavior between different disciplines。Some disciplines may be more inclined to make a lot of reference,and other disciplines may be less referenced。So,In the interdisciplinary evaluation,Simple comparison of reference data may cover up the difference between disciplines,As a result, the evaluation results are inaccurate。
Five is time lag。It takes time to accumulate due to citation analysis,Excellent research in emerging fields may not fully show its value due to short time。So,Evaluation based on citations may have time delay,Can't reflect the influence of emerging research in time and accurately。
Six is ​​language and regional bias。Due to historical reasons,The language used in the global scientific community is not balanced,English has natural communication advantages。Traditional quotation analysis methods usually pay more attention to English -based international journals and references of European and American Bet365 lotto review scholars,Research on non -English and non -Western scholars is limited to language barriers。For example,Posted on Chinese journals,There is a lower probability that it is cited by European and American scholars。This bias may lead to globally,The academic contribution of some regions and languages ​​is underestimated or even ignored。
To sum up,Citation analysis, although it has played an important role in scientific evaluation,But its limitations are also obvious。Although scholars try to improve the traditional citation analysis through the H index,,But there are also some obvious defects。The current scientific evaluation is urgent to steering,Limits to overcome the analysis of traditional citation。
  Research paradigm recognitionEvaluation of the Innovation Contribution with Researchers
Information Technology's rapid development,Provides opportunities for the development stage of scientific evaluation to a new stage of development,It also provides possibilities for verifying some forward -looking scientific philosophy concepts。For scientific evaluation,The concept of "paradigm" proposed and developed by the scientific philosopher Thomas Kon,It is an important theoretical tool that cannot be ignored。Kun thinks,Scientific development is not linear、Mobilized,Instead, it is achieved through the scientific revolution and the mutation of the paradigm。The so -called "paradigm",refers to the understanding of the sharing of the scientific community,Including theory、Method、Value, etc.,They guide the research direction and problem solving of scientists。Expressing over time,Internal problems and difficulties in a paradigm gradually increase,In the end, it may cause the disintegration of the paradigm and the emergence of the new paradigm。
Based on the theory of "Pavilion",Focusing on the completion of large -scale literature databases and the rise of scientific data opening campaign,With the help of big data and artificial intelligence technology,Development transparency、credible、Customized scientific evaluation tool,Can be called the basic mission of current scientific evaluation。Specifically,Scientific evaluation under big data -driven based on paradigm recognition,It will have the following characteristics: First, the number of published the paper、Traditional academic evaluation indicators such as reference times,The actual contributions of specific researchers and their academic achievements in the formation and development of the paradigm are included in the scope of evaluation,Ensure the objectivity and fairness of the evaluation。Second, the fine -grained analysis and evaluation of the content level of bet365 best casino games the content of the academic achievement,Make forward -looking evaluation of the future scientific trend and its possible paradigm,to better guide the scientific development direction。Third, start with many characteristics of the scientific community,Considering the quality and value of scientific research results more multi -dimensional,instead of relying only on a single quantitative indicator,Ensure that the openness of scientific evaluation、transparency and recoveability。
Generally speaking,Based on the paradigm theory,Focusing on the characteristics of the era of wisdom,Scientific evaluation is undergoing an unprecedented transformation and upgrade。Under the context of Chinese -style modernization,The latest trend to adapt to scientific evaluation,Construct a scientific evaluation theory with Chinese characteristics、Methods and indicator systems have obvious era significance。
Current,Comprehensive digitalization of academic literature、The rise of scientific data open movements and the rapid development of big data and artificial intelligence technology,It has become the most important driving force for contemporary scientific evaluation.。Application big data、Natural language processing、New technical tools such as machine learning and social network analysis,The recognition of the scientific research paradigm and the grasp of its evolution characteristics have become reality,Therefore, it provides a new way for scientific evaluation。The meaning of the new technology in the paradigm,It is mainly reflected in the following aspects:
First,Big data technology can help collect、Storage and processing massive academic data,panoramic depicting the status quo of the academic world、Dynamic、Trends、Hot spots and cooperation networks between scholars or institutions,Provide more multi -dimensional information for scientific evaluation。
Second,Natural Language Treatment (NLP) technology can conduct a large amount of text data for semantic analysis and information extraction,Help understand the content and quality of academic papers,To realize the steering from formal characteristics describing to content elements。Specifically,NLP technology can automatically identify keywords、Extract the topic、Judging the readability and accuracy of the thesis,Therefore, it provides more quantitative and objective indicators for scientific evaluation。
third,In scientific evaluation,You can use machine learning algorithms to predict the influence of academic achievements、Evaluate the academic quality of the paper,Even assisted the original and scientific significance of judging thesis。
fourth,Complex network analysis (especially social bet365 live casino games network analysis) can build academic cooperation networks between scholars or institutions,Identifying the cooperative relationship and academic influence between scholars,Scholars who found important status and influence,Evaluate Scholars' academic contribution and level of academic cooperation。You can also build concepts、Words or research topics common networks,The position and importance of identifying research issues in the overall scientific picture。
Fifth,Emerging AIGC (artificial intelligence generating content) technology also provides a new choice for the steering of scientific and technological evaluations。AIGC involved language model、neural network、Automatic encoder and other technologies。Use these technologies through comprehensive use,AIGC -based scientific evaluation is expected to consider the quality and influence of academic research more comprehensively,and improve the efficiency and accuracy of scientific evaluation,Help scientists and scientific research institutions to better understand the development dynamics of the academic world,Promoting the continuous progress of science。
To sum up,Paradigm theory provides theoretical basis for the scientific evaluation of academic circles,The development of new information technology provides conditions for researchers to carry out higher -quality scientific evaluation based on paradigm recognition。It can be said,Big data,Evaluate the actual contribution of researchers from multi,It has become the basic trend of scientific evaluation。
  Xinli Road, Analysis and Scientific Evaluation
Since the paradigm recognition has provided new opportunities for the innovation of scientific evaluation,So the urgent administration is to break through traditional evaluation methods such as the analysis of existing citation,Seeking a way to build a new way that can portray the essential attributes of the paradigm。In recent years,CO-Words Analysis (CO-Words Analysis) is directly deepened to bet365 best casino games the content of the academic literature,Able to show contact between academic concepts from the semantic level,The key tool for researchers to draw and reveal the internal structure of the knowledge world。
By characterization of the internal structure of the knowledge world through the synchronous word network,It is a feasible and credible way to realize hidden research paradigms。That is to say,For any scientific field,can be through the common word network,A visualization of its internal knowledge structure,Make the paradigm present in a panoramic way in a "concept map" way。Then,By associating the word nodes with researchers or research institutions,Methods using network bet365 live casino games analysis、Tools and indicators,It can substantially reveal the contribution of individual researchers or research institutions in knowledge innovation。
In short,The rapid development of big data technology and the increasing maturity of the relevant algorithm of natural language processing,The foundation laid the foundation for the visual presentation of the research paradigm,and the analysis of the connection between the common word network and its researcher,It provides conditions for evaluating the actual contribution of knowledge innovation。In this sense,,Research paradigm -based identification based on common word network has become a new way for scientific evaluation。For this,Academic circles、Scientific and technological manager and policy maker not only need to break the 桎梏 of traditional citation analysis,More high courage,Welcome to the change and baptism of scientific evaluation in the era of big data。
(The author is a professor at the School of Information Resources Management of Renmin University of China)

Editor in charge: Changchang
QR code icons 2.jpg
Key recommendation
The latest article
Graphics
bet365 live casino games

Friendship link:

Website filing number: Jinggong.com An Bei 11010502030146 Ministry of Industry and Information Technology:

All rights reserved by China Social Sciences Magazine shall not be reprinted and used without permission

General Editor Email: zzszbj@126.com This website contact information: 010-85886809 Address: 11-12, Building 1, Building 1, No. 15, Guanghua Road, Chaoyang District, Beijing: 100026