A brief analysis of ChatGPT:historical evolution, current applications,and future prospects

计算机科学 可扩展性 生成语法 人工智能 变压器 自然语言理解 安全性令牌 自然语言 语言模型 语言技术 自然语言处理 机器学习 理解法 工程类 数据库 计算机安全 电压 电气工程
作者
Yuliang Liu,Li Hongliang,Xiang Bai,Lianwen Jin
出处
期刊:Journal of Image and Graphics [University of Portsmouth]
卷期号:28 (4): 893-902 被引量:3
标识
DOI:10.11834/jig.230110
摘要

近年来,人工智能技术接连取得突破,尤其是在强化学习、大规模语言模型和人工智能生成内容技术等方面,正逐步成为各个行业的创新驱动力。OpenAI于2022年11月30日发布的ChatGPT由于具有惊人的自然语言理解和生成能力,引起全社会大范围的关注,成为全球热议的话题,并被广泛应用于各个行业。仅两个月后,ChatGPT的月活跃用户数便达1亿,成为史上用户数增长最快的消费者应用。鉴于ChatGPT目前造成的影响,对其进行全面的分析较为必要。本文从历史沿革、应用现状和前景展望这3个角度对ChatGPT进行剖析,探究其对社会的影响、技术的原理和挑战以及未来发展的可能性,并从模型能力的角度简要介绍GPT-4相对于ChatGPT的改进。作为一个现象级技术产品,从技术角度而言ChatGPT对相关领域具有里程碑式的重要意义,从应用角度而言其可能会给人类社会带来巨大的影响。ChatGPT有潜力成为计算机领域最伟大的成就之一。但就目前而言,ChatGPT仍然存在一些局限,尚未达到强人工智能的水平。在当前阶段,研究人员需要对人工智能技术持有自信和谦虚学习的态度,继续发展相关的技术研究和应用。;Artificial intelligence(AI)technology has been developing intensively,especially for such scenarios in relevance to its applications of 1)natural language processing,2)computer vision,3)recommendation systems,and 4)forecast analysis. AI technology has been challenging for human cognition over the past decade. In recent years,natural language processing techniques can be focused on more. ChatGPT,as a case of emerging generative AI technology,is launched in December of 2022. ChatGPT,as an advanced language model,is commonly used on the basis of its a)larger model sizes,b)advanced pre-training methods,c)faster computing resources,and d)more language processing tasks. This ChatGPT-related literature review is focused on its(1)public awareness and application status,(2)characteristics, (3)mechanisms,(4)scalability,(5)challenges and limitations,(6)future development and application prospects,and (7)improvements of GPT-4 relative to ChatGPT. Cognitive computing and AI-based ChatGPT can be as a sort of language model in terms of the Transformer architecture and Generative Pre-Training(GPT). This GPT-trained model can be related to natural language processing,which can predict the probability distribution of the next token using a multi-layer Transformer to generate natural language text. It can be outreached by training the learned language patterns on a large corpus of text. The OpenAI's language model has shown a significant improvement in their level of intelligence from GPT-1(117 million parameters)in 2018 to GPT-3(175 billion parameters)in 2020. The language processing and generation capabilities of GPT have been improving dramatically in terms of consistent optimization like its 1)model size,2)generative models, and 3)self-supervised learning. Thereafter,reinforcement learning-based InstructGPT is originated from Human Feedback and such probability of infeasible,untrue,and biased outputs can be significantly reduced in January 2022. In December 2022,ChatGPT is introduced as the sister model of InstructGPT. ChatGPT is not only add InstructGPT-based chat attributes,and a test version is opened to the public. The core technologies of ChatGPT can be linked to 1)reinforcement learning from human feedback(RLHF),2)supervised fine-tuning(SFT),3)instruction fine-tnning(IFT),and 4)chain-ofthought (CoT)as well. ChatGPT has attracked about 100 million active users per month after the launch of two months. In comparison,TikTok took nine months to achieve 100 million monthly active users,and Instagram took two and a half years. According to Similar Web,more than 13 million independent visitors use ChatGPT on average each day in January of 2023,which is more than twice in December of 2022. The leading US new media company Buzzfeed accurately seized the opportunity of ChatGPT and saw its stock price triple in two days. The ChatGPT-derived impact shows its potential preference for consumers. The ChatGPT can play mulitiple roles for such domain like clinics,translation,official administrations,and programming tasks. Such extensive application of ChatGPT is still to be developed. However,while ChatGPT has the potential for widespread application in various industries,it cannot be universally applied to all industries. For example,as certain industrial production processes typically rely on digitalization and do not necessitate the handling of human language,natural language processing techniques may not be required. Furthermore,various other factors,such as legal restrictions and data privacy concerns,may also impinge upon the application of natural language processing technologies within certain industries. For industries that require the processing of sensitive information,such as the healthcare industry,natural language processing technologies may need to comply with strict legal regulations to ensure data privacy and security. In addition to industry-specific reasons,it should be noted that ChatGPT has not yet achieved perfection in natural language processing tasks. In summary,as a phenomenal and technological product,AI-generated ChatGPT's potentials are beneficial for textual and multi-modal AIGC applications to a certain extent,and it may have an impact on the a)survival of corporations,b)competition among countries,and c)entire social structure. However,the current various positive evaluations of ChatGPT can only be seen as a phenomenon of good rain after a long drought,and it cannot change the fact that ChatGPT is a questions and answers(Q&A)solution based on prior knowledge and models. It is required to be acknowledged that ChatGPT does not have its true recognition,intention,and creativity yet,and its true intelligence need to be tackled further.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
研友_VZG64n完成签到,获得积分10
1秒前
天天快乐应助hll采纳,获得10
1秒前
xuanjiawu完成签到,获得积分10
1秒前
yuan3471完成签到,获得积分10
1秒前
元谷雪发布了新的文献求助10
1秒前
江野林完成签到 ,获得积分10
2秒前
HCl完成签到,获得积分10
3秒前
Zz发布了新的文献求助10
3秒前
yehan完成签到,获得积分10
3秒前
阳光彩虹小白马完成签到 ,获得积分10
4秒前
4秒前
清秀尔岚发布了新的文献求助30
4秒前
4秒前
何子欣完成签到,获得积分10
4秒前
5秒前
LIB完成签到,获得积分10
5秒前
5秒前
上官若男应助qiongqiong采纳,获得10
5秒前
科研通AI6.4应助xuanjiawu采纳,获得30
5秒前
6秒前
Gloria完成签到,获得积分10
6秒前
Yang发布了新的文献求助10
6秒前
cm5257发布了新的文献求助10
7秒前
龙仔完成签到,获得积分10
7秒前
Fengyun完成签到,获得积分10
7秒前
爱跑步的祥子完成签到,获得积分10
9秒前
orixero应助小苹果呀呀采纳,获得10
9秒前
9秒前
11秒前
喵喵拳完成签到,获得积分10
11秒前
义气觅双完成签到,获得积分10
12秒前
liao应助wu采纳,获得30
12秒前
12秒前
小二郎应助豆子采纳,获得10
12秒前
molihuakai应助尤珩采纳,获得10
12秒前
12秒前
14秒前
陶陶野畔完成签到,获得积分10
14秒前
天天浇水完成签到,获得积分10
14秒前
打打应助qiongqiong采纳,获得10
14秒前
高分求助中
Principles of Economics, 11th Edition 10000
University Physics with Modern Physics, 16th edition 10000
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Molecular Mechanisms of Photosynthesis, 4th Edition 1000
Organic Reactions, Volume 116 1000
Current concepts in cutaneous toxicity : proceedings of the Fourth Conference on Cutaneous Toxicity, Washington, D.C., May 9-11, 1979 1000
The recovery-stress questionnaires : user manual 800
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7258843
求助须知:如何正确求助?哪些是违规求助? 8880808
关于积分的说明 18764245
捐赠科研通 6939299
什么是DOI,文献DOI怎么找? 3201445
关于科研通互助平台的介绍 2375349
邀请新用户注册赠送积分活动 2177240