亲爱的研友该休息了!由于当前在线用户较少,发布求助请尽量完整地填写文献信息,科研通机器人24小时在线,伴您度过漫漫科研夜!身体可是革命的本钱,早点休息,好梦!

It may be time to improve the neuron of artificial neural network

作者
Gang Liu
标识
DOI:10.36227/techrxiv.12477266.v11
摘要

Artificial neural networks (ANNs) have won numerous contests in pattern recognition, machine learning, and artificial intelligence in recent years. The neuron of ANNs was designed by the stereotypical knowledge of biological neurons 70 years ago. Artificial Neuron is expressed as f(wx+b) or f(WX). This design does not consider dendrites’ information processing capacity. However, some recent studies show that biological dendrites participate in the pre-calculation of input data. Concretely, biological dendrites play a role in extracting the interaction information among inputs (features). Therefore, it may be time to improve the neuron of ANNs. In this study, some dendritic modules with excellent properties are proposed and added to artificial neurons to form new neurons named Gang neurons. E.g., The dendrite function can be expressed as Wi,i-1Ai-1 ○ A0|1|2|…|i-1 . The generalized new neuron can be expressed as f(W(Wi,i-1Ai-1 ○ A0|1|2|…|i-1)).The simplified new neuron be expressed as f(∑(WA ○ X)). After improving the neurons, many networks can be tried. This paper shows some basic architecture for reference in the future. Up to now, others and the author have applied Gang neurons to various fields, and Gang neurons show excellent performance in the corresponding fields. Interesting things: (1) The computational complexity of dendrite modules (Wi,i-1Ai-1 ○ Ai-1) connected in series is far lower than Horner’s method. Will this speed up the calculation of basic functions in computers? (2) The range of sight of animals has a gradient, but the convolution layer does not have this characteristic. This paper proposes receptive fields with a gradient. (3) The networks using Gang neurons can delete Fully-connected Layer. In other words, the parameters in Fully-connected Layers are assigned to a single neuron, which reduces the parameters of a network for the same mapping capacity. (4) ResDD(ResDD modules+One Linear module) can replace the current ANNs’ Neurons. ResDD has controllable precision for better generalization capability. Gang neuron code is available at https://github.com/liugang1234567/Gang-neuron.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
初初初啊发布了新的文献求助10
1秒前
迷路万天完成签到,获得积分10
2秒前
粥vbbb完成签到 ,获得积分10
6秒前
9秒前
10秒前
14秒前
初初初啊发布了新的文献求助10
15秒前
15秒前
17秒前
polymer1Ma完成签到,获得积分20
18秒前
搞怪巨人发布了新的文献求助30
19秒前
zoyaaa发布了新的文献求助10
20秒前
20秒前
yiyixt完成签到 ,获得积分10
23秒前
bkagyin的应助被polymer1Ma采纳,获得10
24秒前
初初初啊发布了新的文献求助10
24秒前
30秒前
小马甲的应助被SSUABWB采纳,获得10
30秒前
大方大船完成签到,获得积分10
30秒前
33秒前
liu完成签到 ,获得积分10
34秒前
Akim的应助被霸气的远望采纳,获得10
34秒前
37秒前
初初初啊发布了新的文献求助40
40秒前
诺一44发布了新的文献求助10
43秒前
郑嘉辉完成签到 ,获得积分10
43秒前
55秒前
卷卷心完成签到 ,获得积分10
1分钟前
JoyEn完成签到,获得积分10
1分钟前
强健的海菡完成签到 ,获得积分10
1分钟前
1分钟前
苹果香萱完成签到 ,获得积分10
1分钟前
bkagyin的应助被Z11125采纳,获得10
1分钟前
fantasy的应助被风吹麦浪采纳,获得10
1分钟前
menyu完成签到,获得积分20
1分钟前
Amelia发布了新的文献求助10
1分钟前
chenjzhuc完成签到,获得积分10
1分钟前
suyongye发布了新的文献求助10
1分钟前
朱雀发布了新的文献求助10
1分钟前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Sex, Aging, and Death in a Medieval Medical Compendium: Trinity College Cambridge MS R.14.52, Its Texts, Language, and Scribe 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
基于界面调控的高效湿气发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8190060
求助须知:如何正确求助?哪些是违规求助? 9577165
关于积分的说明 21851884
捐赠科研通 7788155
什么是DOI,文献DOI怎么找? 3436233
关于科研通互助平台的介绍 2559935
邀请新用户注册赠送积分活动 2482792