Before 2018，There is no milestone product in the field of artificial language treatment，It can even be said that there is no decent product。but 2018，Bert (Bidirectional Encoder Reprerentation From Transformers) and GPT (GeneratVe Pre-Trapet Transformer) are available，There is a trend of fighting high，Language model begins to move towards the center of human technology。Since 2022，Various large language models appear more like rainy after rain，On average, a large language model is available every 4 days。For example，lamda、Gopher、palm、MT-NLG、jurassic-1, etc.。Since OpenAI released the language model ChatGPT (ie GPT-3.5) since November 2022,，Chatgpt continues to become popular，Become a recent hot topic，ChatGPT has also become a phenomenal product。Various types of ChatGPT products also begin to appear。This article will explore the formation mechanism and problem of ChatGPT。

　Bet365 lotto review

To clarify the ins and outs of ChatGPT，It is necessary to figure out the identity of the GPT first。GPT is a language model，Can learn to generate natural language that can be understood by deep machines。It is trained and developed by OPENAI Company，and was exclusively authorized by Microsoft in September 2020。The first version of the first generation after the birth of GPT in 2018 is GTP-1 (about 5GB training text，117 billion yuan) is still unpretentious，Even developed to the second-generation GPT-2 (about 40GB training text，1.5 billion yuan) did not leave too many impressions for people，Because there is really bet365 best casino games nothing particularly extraordinary。but but，From the third-generation GTP-3 (about 45TB training text，175 billion yuan) Start，GPT-3 shows super ability，Starting to shine in the field of natural language treatment。

Starting in May 2022，GPT-3 Increases knowledge reserve with geometric number，The new vocabulary of the daily vocabulary is as high as 45 billion words。Compared to 2021，GPT-3 new vocabulary daily increased by 10 times，Its text generation ability has also increased significantly。People only need to give a simple prompt，GPT-3 can automatically generate complete、Tong smooth and smooth long article。GPT-3 also emerged in the NLP field。but but，GPT-3 also has a lot of shortcomings。GPT-3 as a pre-training model is trained by massive data (about 45TB of training text) for training in large parameters (175 billion parameters) model，And the various opinions in these samples are different，to a large extent will have prejudice on some issues。

To optimize the deficiency of GPT-3，Openai improved it，Added instruction learning、Tips Learning (Prompt Learning)、Fine-Tune and artificial feedback enhancement learning，Make ChatGPT into the GPT-3.5 era。With the above four key technologies blessing，ChatGPT Compared with GPT-3 not only greatly reduced the number，and the text generation ability in the chat field greatly increases。Chatgpt optimization of GPT-3 can be divided into 3 steps。1. Use artificially marked data to fine-tune GPT-3。2. Training a evaluation model in line with human evaluation methods reward Model，Sort the score from high to low for the given response to the given with the automatic generating response above。3. Use the trained Reward Model to guide GPT-3 to fine-tune，Chat text that makes the model generate more in line with human habits。

bet365 live casino games When asking ChatGPT "What functions do you have"，It replied: "As an AI assistant，I can provide the following functions: 1. Question and answer: I can answer various questions，For example, science、History、Culture、Language、Computer and other questions。2. Translation: I can translate text or voice into multiple languages，For example, English、French、Chinese, etc.。3. Dialogue: I can perform intelligent dialogue，Answer all kinds of life、Work、Learning and other questions。4. Generate: I can generate text、Picture、audio and video and other types of content，For example, an article、Summary、Images and Music。5. Learning: I can learn and optimize according to user feedback and data，Improve your performance and performance。6. Entertainment: I can provide some entertainment functions，For example, joke、Game、Music, etc.。In short，I am a diverse function、AI assistant with strong flexibility，Can help users solve various problems and needs。"" Actually，Chatgpt's Q & A、Translation、Dialogue、Generation、Learning and Entertainment's six skills are not at a level。From the perspective of logical association，Questions and Answers、Translation、Dialogue、Learning and entertainment. The five skills are the subclasses of "generating"。In terms of expression,，Translation、Dialogue、Generation、Learning and entertainment is the subclass of "Q & A"，That is according to the user's prompt，Answers given by the machine。

　　Chatgpt's advantages and disadvantages

ChatGPT when launching more than two months，Monthly active users have exceeded 100 million。This reflects ChatGPT in the dialogue generation、Q & A System、Text generation、Text translation and other powerful abilities。Bet365 app download ChatGPT has the following advantages。1. Wide knowledge。Compared to humans，ChatGPT's knowledge is wider。Time of human individual、Energy including brain power is very limited; ChatGPT uses deep machine learning methods to train massive data，and the language model obtained by the reinforcement of manual feedback，The breadth of its knowledge is much more than human individual。2. Strong natural language generation ability。ChatGPT has strong natural language generation ability，This means that it can understand human language to a certain extent，Including various dialects and accents，Can answer questions in various forms。Especially when the text appears in the text、spelling and other errors，It can automatically correct，Make sure that users can get accurate answers。3. Have certain creativity。Because ChatGPT can remember the previous interaction content，Reinforcement learning from manual feedback，This means that it can better learn human preferences and habits，and provide better answers based on this information。So，Chatgpt text content generated during the creation or answering questions (such as poetry、Novel、News、Dialogue, etc.) Very similar to human style，It also makes ChatGPT superior to the previous text generation model。4. Wide application field，The prospect is huge。ChatGPT can be applied to a variety of scenes。For example，In customer service、Natural language generation、Voice Assistant、Q & A system and other fields，Chatgpt can all be competent，and can complete some basic tasks。More use scenarios of ChatGPT are also expanding，Broad development prospects。

but but，Chatgpt is not perfect，It is still impossible to cross the following barriers。1. Lack of real bet365 Play online games emotions and thoughts。It is difficult to obtain the expression between people because ChatGPT in the training corpus、Multi -mode information in other contexts，So although it has strong generating ability，The generated text is in line with grammar，Four Ping Eight Stability，But it is difficult to create content that can enjoy with people。2. It is easy to form a point of prejudice。Data feeding to ChatGPT are historical data，After learning these historical data, it is likely to form prejudice based on the content learned。Especially ChatGPT received an artificial feedback enhanced learning，It is inevitable that many conclusions are subjective，It is easy to form prejudice for certain problems。3. Easy to be a serious nonsense。Because ChatGPT is generated when generating answers，often generate text through the relationship between words and words，But it cannot judge the authenticity of the content of the text content，Therefore, it is likely to spread the situation that does not match the facts。4. It is easy to be deceived to give suggestions that violate ethical morals。ChatGPT has been set by developers to set up moral and ethical standards，What the user asked if it violates morality and ethical standards，ChatGPT is the right to refuse to answer。But due to the feedback result of ChatGPT, it is easily affected by Prompt，The same question，Different prompt given，The resulting results are different。Users can pretend to be camouflage、Deception，Easily gives ChatGPT to give up the moral and ethical standards set by the developer。

　　Course the problems brought by ChatGPT

ChatGPT's emergence will bring impact on many industries，Many problems such as their own advantages and disadvantages and the scientific and technological ethics generated by them，Need to think in depth Bet365 lotto review and give solutions。1. Positioning of ChatGPT。In human work and study，Chatgpt can only be a subordinate，People are always the first place。Although the knowledge of ChatGPT is very wide，It also has certain creativity，But this creativity is limited。Leaving people's creativity，Chatgpt is difficult to make a difference。Because ChatGPT is still based on Prompt drive，To solve the same problem，Different prompt results will be different，Prompt's proposal itself also needs creativity。This also gave birth to a large number of practitioners who specialize in providing Prompt。2.AI text detection needs to be solved urgently。Chatgpt text generation brings people's convenience and obvious visibility，While avoiding humans to repeat work，It also brought many practical problems。If most people use the text generated by artificial intelligence，It will be a very terrible and sad thing，This will weaken human thinking ability。Lack of thinking、Lack of innovation，will lead to the backbolic of society。How to be effective、Determine whether a text is automatically generated by artificial intelligence，Or it is significant and imminent。3. Establish and improve the establishment of relevant laws and regulations。Because the original data of training ChatGPT is not necessarily reasonable in distribution，and OpenAI only hired 40 data markers for artificial feedback to strengthen learning and correction，ChatGPT automatic texts that inevitably have prejudice or even illegal content，The use in many fields should be limited。Related laws and regulations need to be improved urgently，Any technological product should be used legally in the legal framework。

It can be said，ChatGPT's emergence not only subverts people's cognition of traditional chat robots，bet365 Play online games It will also bring innovation in many industries。With the popularity of ChatGPT，Many types of ChatGPT products will also appear constantly，Whether it is Bard，Or ERNIE BOT，Or other similar products，All need to be reinforced by manual feedback，It will generate a point of view with prejudice。For this，We should do the top -level design on the regulatory methods and methods，Early layout。

　　(Author is Associate Professor of Language and Language Education Research Center of Huazhong Normal University)