首页 | 官方网站   微博 | 高级检索  
     

一种基于正则优化的批次继承极限学习机算法
引用本文:刘彬,杨有恒,赵志彪,吴超,刘浩然,闻岩.一种基于正则优化的批次继承极限学习机算法[J].电子与信息学报,2020,42(7):1734-1742.
作者姓名:刘彬  杨有恒  赵志彪  吴超  刘浩然  闻岩
作者单位:1.燕山大学电气工程学院 秦皇岛 0660042.燕山大学信息科学与工程学院 秦皇岛 066004
基金项目:河北省自然科学基金(F2019203320, E2018203398)
摘    要:极限学习机(ELM)作为一种新型神经网络,具有极快的训练速度和良好的泛化性能。针对极限学习机在处理高维数据时计算复杂度高,内存需求巨大的问题,该文提出一种批次继承极限学习机(B-ELM)算法。首先将数据集均分为不同批次,采用自动编码器网络对各批次数据进行降维处理;其次引入继承因子,建立相邻批次之间的关系,同时结合正则化框架构建拉格朗日优化函数,实现批次极限学习机数学建模;最后利用MNIST, NORB和CIFAR-10数据集进行测试实验。实验结果表明,所提算法具有较高的分类精度,并且有效降低了计算复杂度和内存消耗。

关 键 词:极限学习机    高维数据    批次学习    继承因子    正则化
收稿时间:2019-07-05

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization
Bin LIU,Youheng YANG,Zhibiao ZHAO,Chao WU,Haoran LIU,Yan WEN.A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization[J].Journal of Electronics & Information Technology,2020,42(7):1734-1742.
Authors:Bin LIU  Youheng YANG  Zhibiao ZHAO  Chao WU  Haoran LIU  Yan WEN
Affiliation:1.School of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China2.School of Information Science and Engineering, Yanshan University, Qinhuangdao 066004, China
Abstract:As a new type of neural network, Extreme Learning Machine (ELM) has extremely fast training speed and good generalization performance. Considering the problem that the Extreme Learning Machine has high computational complexity and huge memory demand when dealing with high dimensional data, a Batch inheritance Extreme Learning Machine (B-ELM) algorithm is proposed. Firstly, the dataset is divided into different batches, and the automatic encoder network is used to reduce the dimension of each batch. Secondly, the inheritance factor is introduced to establish the relationship between adjacent batches. At the same time, the Lagrange optimization function is constructed by combining the regularization framework to realize the mathematical modeling of batch ELM. Finally, the MNIST, NORB and CIFAR-10 datasets are used for the test experiment. The experimental results show that the proposed algorithm not only has higher classification accuracy, but also reduces effectively computational complexity and memory consumption.
Keywords:
点击此处可从《电子与信息学报》浏览原始摘要信息
点击此处可从《电子与信息学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司    京ICP备09084417号-23

京公网安备 11010802026262号