改进Elman网络的逼近性质研究

提出了能够用于非线性系统建模的一种新型回归网络,该网络是Elman网络的改进,由输入层、隐层和输出层构成.输入层由外部输入和内部状态层组成,隐层到状态层的连接是任意的,因此在逼近系统时,改进的Elman网络比Elman网络有更多记忆空间.同时证明了改进的Elman网络能够逼近一定时间内的非线性系统的输出轨线,提出了利用动态反向传播算法训练神经网络的前向和反向权值,仿真结果验证了该方案的有效性.

Approximation Property of the Modified Elman Network

A new type of recurrent neural network is discussed, which provides the potential for modelling unknown nonlinear systems. The proposed network is a generalization of the network described by Elman, which has three layers including the input layer, the hidden layer and the output layer. The input layer is composed of two different groups of neurons, the group of external input neurons and the group of the internal context neurons. Since arbitrary connections can be allowed from the hidden layer to the context layer, the modified Elman network has more memory space to represent dynamic systems than the Elman network. In addition, it is proved that the proposed network with appropriate neurons in the context layer can approximate the trajectory of a given dynamical system for any fixed finite length of time. The dynamic backpropagation algorithm is used to estimate the weights of both the feedforward and feedback connections. The methods have been successfully applied to the modelling of nonlinear plants.