Evaluate the new trend and new method of evaluating the influence of social science research
July 05, 2023 10:48 Source: "China Social Sciences" July 5, 2023 Total 2684 Author: Our reporter practiced Zhizhi

Having influence is one of the pursuit of modern academic circles。In academic papers or research reports,Scholars often introduce the impact of its research work in various ways,Including changes to bring theoretical viewpoint,New research mode,Even influence or change the objective world and social life。Therefore,How to evaluate these impacts is also a hot topic in the academic world,Especially in the field of social sciences that are difficult to conduct research results and its influence,Many scholars have discussed on how to evaluate the influence of social science research。The new trend and new method of evaluation around social science influence,This reporter sorted out the point of view of experts and scholars,I interviewed Ziyad Marar, the chairman of the independent academic and professional publishing group Shizhe Publishing House (Sage Public Publishing),。

  bet365 Play online games

When talking about why scholars pay attention to the influence of research,Ron Kassimir, a senior adviser to the University of Columbia World Project, proposed that there may be multiple reasons for this。First,If the study has a strong influence,Naturally, it can improve the status and prestige of scholars,and make scholars hire、Salary、Promotion and acquisition funds are in a relatively favorable position。With social science research, more widespread attention,A reputation economy may also appear in some areas of the social science community。Next,Funders of Social Science Research on the expectations of the influence of research are increasing,In particular, I hope that the research results can have a large impact outside the academic field,This trend will make scholars pay more attention to the influence of research。Last,Many scholars in the social science community regard "influence" as a moral pursuit,Especially many young social science scholars are working to achieve a balance between occupational development and a wider impact on the world,It is expected to have influence in the academic and public domains。

Scholars are more and more concerned about the research influence,Many people have noticed the lack of influence evaluation methods,and demonstrate from various angles。Traditional scientific research influence evaluation standards are generally based on the reference situation of the research results,Shizhe Press published in 2019 entitled "The Latest Thinking About Metrics For Research IMPACT in the Social Sciences" (The Latest Thinking About Metrics For,Traditional evaluation methods can no longer meet modern academic needs,The reference situation in other academic works cannot fully display the value of the achievements of social science research outside the academic world,Therefore, you need to find a new influence evaluation method。

Anne-Wil Harzing, a professor of international management at Midasus University in the United Kingdom, explained from the diversity of influence,Think when discussing the influence Bet365 app download of research,Scholars often have different understanding of the concept of influence,can be divided into different situations to carry out targeted discussions。Different from the academic role of scholars,She divides the influence into three different levels。When as a researcher,Scholars' work target audience is other scholars,Realize or break through based on the research results of others。Scholars are working together to add bricks to the academic knowledge system,Promoting the development of science。In this case,The quotation of the results of academic research can be used to measure its academic influence。When as a teacher,Scholars' work target audience is a student,Its research results will enter the classroom as reading materials,Assist students to learn and cultivate critical thinking。At this level,The influence of research can be in textbooks、The appearance of the teaching outline to measure。The first two angles involve the influence of research results in the academic world,The results of academic research also play an important role outside the academic world,Being able to get the economy、Society、Culture、Public policy and other fields have an impact。Outside the academic world,The ultimate goal of the scholar is to solve social problems。Take a comprehensive,Harchie thinks,Only a separate quantitative indicator cannot comprehensively accurately measure the academic and non -academic influence of research results,Therefore, you need to comprehensively use quantitative indicators、Qualitative evidence and personal statement to measure and proof the influence of research。

Mara also puts forward a similar point of view in the article "On Measuring Social Science IMPACT" (。He thinks,When measuring the influence of social scientific research,If you only pay attention to the reference situation,The influence factor of the journal and the H index, etc.,Not only will it affect the accuracy of the evaluation,and it will bring unexpected consequences。With these indicators increasing weight in scholars' selection and promotion,It may also bring new risks。As the Gedhart Ding Law Said,When a policy becomes a target,It will no longer be a good policy。People will focus on the transfer from doing research to increasing influence values,Start using self -reference and "mutual quotation club" and other methods to increase value。Value belonging can shape the research and practice itself,and promotion、Get a lifelong position、Getting relevant incentive policies such as research funding will affect the behavior of scholars,Therefore, you need to evaluate the influence of research in a more comprehensive and diverse way。

The argument around the assessment method based on citation not only exists in the social science community,Other fields are also discussing how to measure the influence of research results。As early as 2012,Some scholars、Academic Organization、Funding agency、Periodicals, etc., jointly signed the "San Francisco Research Evaluation Declaration",Call for no longer use the impact factor to evaluate the academic achievements of individual scientists,University and research institutions no longer hire it as a professor、Promotion or scientific Bet365 app download research funding for decision elements,and call for improving funding agencies、How to evaluate the scientific research results of academic institutions and other related parties。After that,This voice is becoming increasingly strong。Science at the University of London, UK、Technology、Professor James Wilsdon, a professor at the Department of Engineering and Public Policy, led a survey on the role of evaluation indicators,If there is no peer review and other qualitative judgments as supplements and support,simply relying on indicators is not responsible for reliable evaluation method。

  Evaluation methods should meet the characteristics of social science

Senior Lecturer of the School of Library and Information Sciences at the University of Broas, Sweden, Bj? 觟 RN Hammarfelt, who interviewed scholars in the field of social sciences,During the interview,,Many scholars have revealed dissatisfaction with the current literature measurement method,and said that you need to convey your own values ​​to a person who only wants to see quantitative data。Some scholars have bluntly stated that the evaluation method is not suitable for the field of social sciences,The indicators involved cannot reflect the research results of scholars,But they have to continue using these indicators to meet the evaluation requirements。

Mara told this reporter,The issue of social science and natural science research is different,There are also differences in research methods。In natural science or science、Technology、Engineering、Mathematics (science、Technology、ENGINEERING、Mathematics,The following referred to as "STEM") field,Researchers can pass the quantitative method,Use clear data to summarize uniform universal conclusions,The impact of research results is often easier to measure,If you get a technical breakthrough、Get patent、The research results can be directly applied to production, etc.。And the research and development of natural science or STEM is also inclined to follow the linear trajectory,Therefore, it is easier to use reference evaluation standards to measure its influence。

For the field of social sciences,Mara thinks,First,The problem of research on social science scholars cannot be summarized by a unified definition。Social sciences provide information for public policy,Guide social development,Help us understand social trends and social problems,Then understand our world。At the same time, social science also helps to cultivate people’s empathy,Improve its critical thinking ability,Enhance its self -consciousness。In essence,Social science can help people understand、Driving and improving the world of our lives。

Next,Social Science Research on Human Behavior,Follow the complexity of society and culture,Research objects are often invisible content,Social relations、Cultural customs and historical backgrounds involving intricate and intangible various factors,It is difficult to simplify the indicator of quantified。Researchers are difficult to separate variables,Establish a causal relationship,also obtains the generally applicable theory。

Last,The influence of social science research is complicated、Fine、Disposter、Bet365 lotto review Long -term、Multi -level and other characteristics,It is difficult to be captured by traditional measurement standards。The impact of social science research usually has time lag,Therefore, it is difficult to measure and evaluate,Although the relevant social interests are expected to get the benefits of immediate shadow。other,The interdisciplinary nature of social science means that insights in one field may help ideological development in another field,Makes the impact of related results only difficult to measure through reference.。

There is a large difference between social science research and natural science research,Therefore, when determining the influence evaluation method in the field of social sciences,It is difficult to learn from the standards in the field of natural science or STEM。In Mara's view,The social psychological paper published in 1973 is still the debate theme of social psychologists,Clifford Geertz (Clifford Geertz) in 1973, "The Interpretation of Cultures" and John Rawls (John Rawls) in 1971 (the Theory of Justice "( A theory of justice),I made a long -lasting contribution to the theory of anthropology and political science。Visible,The impact of the results of social science research is long -term at the time level,And this effect often becomes more extensive over time。Another,Diversity of academic output forms are also characteristic of social science。

Emanula Reale, director of the Economic Sustainable Development Research Institute of the Italian State Research Commission, and his colleagues reviewed the literature on the influence of social sciences and humanistic research in the relevant literature summary,They found that the influence measurement method directly applied to the field of natural science,The value of social science and human science research will be underestimated,Because the current mainstream natural science influence assessment method does not take into account the unique features of social science and humanities science research。For example,Compared to discovering new theories and new species, etc.,Scholars of Social Science and Humanities and Humanities also hope to explore new research methods。Another,Despite social science and humanistic research, it is also committed to promoting social development,But the interests of scholars are not based on "results available",Instead, strive to influence and guide the society to maintain cultural heritage,and enhance people's self -understanding and mutual understanding of people in different backgrounds。Therefore,We need to find an evaluation method that is more suitable and can reflect the characteristics of social sciences。

  Establishing responsible for reliable evaluation standards

American economist Herbert Simon pointed out,With the advent of the explosive information era,Attention to become scarce resources。Therefore,The academic community needs more guiding significance、Comprehensive and accurate measurement indicators,Filter the real influential research results。But,Although the problem is determined,But what method is the best way to prove the impact of social science,The academic community still has no consensus。

New technology has developed rapidly to explore new Bet365 lotto review evaluation methods to open the door,At present, the academic community also tries to establish an alternative indicator,Altmetrics may be the most well -known attempt。Single thesis evaluation、Scientific research results measurement、Scientific research discovery measurement、Scientific Merit Study 2.0 and other studies of many studies,and the continuous development of network scientific exchanges,It has promoted the rise of alternative alternatives。Current,Alternative meterology is still a relatively broad term,It covers a variety of digital indicators related to academic achievements,Some of these indicators are derived from the academic ecosystem,Some originated from the interaction between the stakeholders in the public space of the public space and academic achievements。Alternative Metrology to evaluate the influence of scientific research through comprehensive data,Including all kinds of academic knowledge that can spread、Data from the platform for academic communication,If traditional media、Social Media、Blog、Policy documents, etc.。Under the context of alternative meterology,When people are evaluating,Not only does it need to analyze the quantity of the research results,and the download amount、Reading times、Share number of times and other indicators are included in consideration,It is a powerful supplement to the traditional literature measurement method。

Mara thinks,Alternative meterology is a measure that can show social influence on research results,It is beyond the influence evaluation mode in the academic field based on citations,Provided another choice for people。Alternative Metrology By considering social media participation、Many factors such as news reports and policy documents,More comprehensive reflecting the influence of a research results。But,He added,Alternative meterology also has limitations,Although it presents a wider perspective,But the data it provides may be easily prejudiced or manually manipulated,and may not be able to completely capture the long -term impact of research。other,Following real -time feedback may vague attention to research itself,Bring a key offset risk。

Mara said,Some scholars have set up new institutions,The application of special tracking academic research in policy formulation,He believes that this may be more helpful to evaluate the impact of social science research than alternative meterology。Shizhe Press as a social science publisher,Discuss on issues related to the impact of social science research,Explore the role you can play。In the past few years,Mara and others try to use other ways to measure the research influence,For example,Announced 5 -year impact factor、Establish an annual award for the most referenced articles published within 10 years。Mara thinks,The quality and impact of research should be measured for a long time in the future,It is still inseparable from the quotation of statistics,But it cannot be limited here。Harbin mentioned the overton policy file database,She said that using this database can capture research results and papers cited by policy documents,Related reference conditions can provide support for influence evaluation。

Wellsden pointed out Bet365 lotto review in the research report,A responsible and reliable measurement standard shall have the following characteristics: first,Stability,Based on as accurate and extensive data as possible; second,humility,That is to recognize that the role of quantitative assessment should be to further support the qualitative evaluation of experts,instead of replacing it; third,Transparency,is to ensure that the data collection and analysis process is open and transparent; fourth,Diversity,Differences in various fields are considered inside,and can use a series of indicators to reflect and support the diversity of the development of the academic career of researchers; fifth,Reflection,The systemic and potential effects of recognition and prediction indicators,and update according to the actual situation。

  Multi -party cooperation and interdisciplinary dialogue solve problems

Talk about how to contribute to solving related issues,Mara said,This is a systematic problem,Journal、The role of colleges and academic groups in the field of social sciences is more important than in other disciplines,They support exploring innovative research methods,Encourage researchers to contact and communicate with stakeholders such as decision makers and the public,The expert team they created can accumulate knowledge in controversial areas。These academic organizations promote the formation of inclusive research culture through various methods,Help explore to be more accurate、More meaningful methods to evaluate the impact of social science research。

Shizhe Press is also calling more organizations to discuss this issue together。2019,New York University、American Social Science Research Committee、New York University、Influential research experts from many institutions such as Washington University attended the seminar hosted by Shizhe Press,Kinds the impact of social scientific research and measures。Report of the "Latest Thinking of the Evaluation of Social Science Research Influence Evaluation" through sorting out the main points of the meeting,This report analyzes the interests of the influence evaluation、Definition of key terms、Clear question,45 resources and databases are also listed,Proposed 4 types of evaluation models for reference。The first is academic output mode,This is also the most common method for evaluating the impact of social science research,Evaluate through reference。The second is human -made mode,Proposal to transfer the focus of research from text to researchers itself,Because people are the incarnation of thought,The text is just the output form of the researcher,The influence of exploration and research is also tracking the spread of ideas and influence。The evaluation method in this mode includes tracking scholars' inauguration units and their participation innovative projects.,It can explore the actual conversion of the academic thought of researchers and its impact on the world。The third is the four major quadrant mode,Divided the impact into four parts,respectively: "Academic",That is, whether the research has enhanced people's understanding of the world; "industry",That is, whether the research has improved the ability of researchers Bet365 app download to carry out work,If you have developed a new research method、Create a new data set, etc.; "Society",That is, whether the research brings changes to society,If academic suggestion is with policy、Regulations and regulations are related,Whether it affects productivity or changes in GDP in China; "Public",That is, whether the research changes public understanding,This can be participated from the public、Public discussion、Internet communication and other angles Observation。The fourth type is a pragmatism mode,From a practical perspective,Researchers should consider how to make the funders believe that their investment is fully utilized,It can have a large academic impact。

Mara thinks,In addition to these efforts,Limited by a separate publisher or journal。According to what he knows,The current evaluation method based on citations is still the core mechanism of the prestige of scholars in academic ecosystems,It is also a funding for scholars、Promotion、The main evaluation basis for life -long positions,Therefore, the challenges faced by organizations such as higher education institutions and academic associations are actually a mechanism that changes to establish reputation。Each field can explore the new evaluation standards according to its own needs。

Mara told reporters,They will continue to work to develop more comprehensive、meticulous、Reliable methods to measure the influence of social scientific research。To do this,Need to recognize the limitations of the current method、The characteristics and importance of social science research,and promote interdisciplinary dialogue,Promote more innovative attempts。He also said that he is very looking forward to open acquisition and digital technology to play a key role in this process,Let the research results spread in a larger range,and create opportunities to participate for more people。

Editor in charge: Chen Jing
QR code icons 2.jpg
Key recommendation
The latest article
Graphics
bet365 live casino games

Friendship link:

Website filing number: Jinggong.com Anmi 11010502030146 Ministry of Industry and Information Technology:

All rights reserved by China Social Sciences Magazine shall not be reprinted and used without permission

General Editor Email: zzszbj@126.com This website contact information: 010-85886809 Address: Building 1, Building 1, No. 15, Guanghua Road, Chaoyang District, Beijing: 100026