Fast Affine Projection Algorithms for Filtered-x Multichannel Active Noise Control

In recent years, affine projection algorithms have been proposed for adaptive system applications as an efficient alternative to the slow convergence speed of least mean square (LMS)-type algorithms. Whereas much attention has been focused on the development of efficient versions of affine projection algorithms for echo cancellation applications, the similar adaptive problem presented by active noise control (ANC) systems has not been studied so deeply. This paper is focused on the necessity to reduce even more the computational complexity of affine projection algorithms for real-time ANC applications. We present some alternative efficient versions of existing affine projection algorithms that do not significantly degrade performance in practice. Furthermore, while in the ANC context the commonly used affine projection algorithm is based on the modified filtered-x structure, an efficient affine projection algorithm based on the (nonmodified) conventional filtered-x structure, as well as efficient methods to reduce its computational burden, are discussed throughout this paper. Although the modified filtered-x scheme exhibits better convergence speed than the conventional filtered-x structure and allows recovery of all the signals needed in the affine projection algorithm for ANC, the conventional filtered-x scheme provides a significant computational saving, avoiding the additional filtering needed by the modified filtered-x structure. In this paper, it is shown that the proposed efficient versions of affine projection algorithms based on the conventional filtered-x structure show good performance, comparable to the performance exhibited by the efficient approaches of modified filtered-x affine projection algorithms, and also achieve meaningful computational savings. Experimental results are presented to validate the use of the algorithms introduced in the paper for practical applications.      

Neurocontrol of nonlinear dynamical systems with Kalman filtertrained recurrent networks

Although the potential of the powerful mapping and representational capabilities of recurrent network architectures is generally recognized by the neural network research community, recurrent neural networks have not been widely used for the control of nonlinear dynamical systems, possibly due to the relative ineffectiveness of simple gradient descent training algorithms. Developments in the use of parameter-based extended Kalman filter algorithms for training recurrent networks may provide a mechanism by which these architectures will prove to be of practical value. This paper presents a decoupled extended Kalman filter (DEKF) algorithm for training of recurrent networks with special emphasis on application to control problems. We demonstrate in simulation the application of the DEKF algorithm to a series of example control problems ranging from the well-known cart-pole and bioreactor benchmark problems to an automotive subsystem, engine idle speed control. These simulations suggest that recurrent controller networks trained by Kalman filter methods can combine the traditional features of state-space controllers and observers in a homogeneous architecture for nonlinear dynamical systems, while simultaneously exhibiting less sensitivity than do purely feedforward controller networks to changes in plant parameters and measurement noise.     

Nonlinear control structures based on embedded neural system models

This paper investigates in detail the possible application of neural networks to the modeling and adaptive control of nonlinear systems. Nonlinear neural-network-based plant modeling is first discussed, based on the approximation capabilities of the multilayer perceptron. A structure is then proposed to utilize feedforward networks within a direct model reference adaptive control strategy. The difficulties involved in training this network, embedded within the closed-loop are discussed and a novel neural-network-based sensitivity modeling approach proposed to allow for the backpropagation of errors through the plant to the neural controller. Finally, a novel nonlinear internal model control (IMC) strategy is suggested, that utilizes a nonlinear neural model of the plant to generate parameter estimates over the nonlinear operating region for an adaptive linear internal model, without the problems associated with recursive parameter identification algorithms. Unlike other neural IMC approaches the linear control law can then be readily designed. A continuous stirred tank reactor was chosen as a realistic nonlinear case study for the techniques discussed in the paper.     

基于混沌优化的非线性预测控制器

针对非线性系统的控制问题,本文将神经网络辨识、混沌优化和预测控制思想有机结合,提出了一种新型非线性预测控制器.该控制器以神经网络作为预测模型,混沌优化算法作为滚动优化策略,避免了非线性预测控制中复杂的梯度计算和矩阵求逆问题.另外在训练神经网络过程中,采用了带混沌机制的自适应学习率的BP算法,以提高神经网络的收敛能力和收敛速度.仿真研究说明了该非线性预测控制器的有效性及实时性.     

Supervised training algorithms for B-Spline neural networks and neuro-fuzzy systems

Complete supervised training algorithms for B-Spline neural networks and fuzzy rule-based systems are discussed. By introducing the relationships between B-Spline neural networks and Mamdani (satisfying certain assumptions) and Takagi-Kang-Sugeno fuzzy models, training algorithms developed initially for neural networks can be adapted to fuzzy systems. The standard training criterion is reformulated, by separating its linear and nonlinear parameters. By employing this reformulated criterion with the Levenberg-Marquardt algorithm, a new training method, offering a fast rate of convergence is obtained. It is also shown that the standard Error-Back Propagation algorithm, the most common training method for this class of systems, exhibits a very poor and unreliable performance.     

基于神经网络与多模型的非线性自适应广义预测控制

针对一类不确定非线性离散时间动态系统, 提出了基于神经网络与多模型的非线性广义预测自适应控制方法. 该自适应控制方法由线性鲁棒广义预测自适应控制器, 神经网络非线性广义预测自适应控制器和切换机制三部分构成. 线性鲁棒广义预测自适应控制器保证闭环系统的输入输出信号有界, 神经网络非线性广义预测自适应控制器能够改善系统的性能. 切换策略通过对上述两种控制器的切换, 保证系统稳定的同时, 改善系统性能. 给出了所提自适应方法的稳定性和收敛性分析. 最后通过仿真实例验证了所提方法的有效性.     

基于神经网络的机器人自学习控制器

提出一种神经网络与PID控制相结合的机器人自学习控制器.为加快神经网络的 学习收敛性,研究了有效的优化学习算法.以两关节机器人为对象的仿真表明,该控制器使机 器人跟踪希望轨迹,其系统响应、跟踪精度和鲁棒性优于常规的控制策略.     

Neural Network Based Adaptive Tracking Control for a Class of Pure Feedback Nonlinear Systems With Input Saturation

In this paper, an adaptive neural networks (NNs) tracking controller is proposed for a class of single-input/singleoutput (SISO) non-affine pure-feedback non-linear systems with input saturation. In the proposed approach, the original input saturated nonlinear system is augmented by a low pass filter. Then, new system states are introduced to implement states transformation of the augmented model. The resulting new model in affine Brunovsky form permits direct and simpler controller design by avoiding back-stepping technique and its complexity growing as done in existing methods in the literature. In controller design of the proposed approach, a state observer, based on the strictly positive real (SPR) theory, is introduced and designed to estimate the new system states, and only two neural networks are used to approximate the uncertain nonlinearities and compensate for the saturation nonlinearity of actuator. The proposed approach can not only provide a simple and effective way for construction of the controller in adaptive neural networks control of non-affine systems with input saturation, but also guarantee the tracking performance and the boundedness of all the signals in the closed-loop system. The stability of the control system is investigated by using the Lyapunov theory. Simulation examples are presented to show the effectiveness of the proposed controller.      

基于神经网络与多模型的非线性自适应广义预测解耦控制

针对一类非线性多变量离散时间动态系统,提出了基于神经网络与多模型的非线性自适应广义预测解耦控制方法.该控制方法由线性鲁棒广义预测解耦控制器和神经网络非线性广义预测解耦控制器以及切换机构组成.线性鲁棒广义预测解耦控制器用于保证闭环系统输入输出信号有界,神经网络非线性广义预测解耦控制器能够改善系统性能.切换策略通过对上述两种控制器的切换,保证系统稳定的同时,改善系统性能.同时本文给出了所提自适应解耦控制方法的稳定性和收敛性分析.最后,通过仿真实例验证了该方法的有效性.     

Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation

In this paper, a continuous time recurrent neural network (CTRNN) is developed to be used in nonlinear model predictive control (NMPC) context. The neural network represented in a general nonlinear state-space form is used to predict the future dynamic behavior of the nonlinear process in real time. An efficient training algorithm for the proposed network is developed using automatic differentiation (AD) techniques. By automatically generating Taylor coefficients, the algorithm not only solves the differentiation equations of the network but also produces the sensitivity for the training problem. The same approach is also used to solve the online optimization problem in the predictive controller. The proposed neural network and the nonlinear predictive controller were tested on an evaporation case study. A good model fitting for the nonlinear plant is obtained using the new method. A comparison with other approaches shows that the new algorithm can considerably reduce network training time and improve solution accuracy. The CTRNN trained is used as an internal model in a predictive controller and results in good performance under different operating conditions.     

Use of neural networks in iterative learning control systems

This paper presents an approach to the use of neural networks to improve iterative learning control performance. The neural networks are used to estimate the learning gain of an iterative learning law and to store the learned control input profiles for different reference trajectories. A neural network of piecewise linear approximation is presented to identify effectively the system dynamics, and the approximation property and persistently exciting condition are discussed. In addition, training of a feedforward neural controller is presented to accumulate control information learned by an iterative update law for various reference trajectories. Then, an iterative learning law with a feedforward neural controller is suggested and its convergence property is stated with the convergence condition. The effectiveness of the present methods has been demonstrated through simulations by applying them to a two-link robot manipulator.     

采用遗传算法训练对角递归神经网络预测控制器

本文提出了一种基于广义预测控制的神经网络预测控制方案．预测控制器由对角递归 神经网络预测控制器和前向神经网络静态补偿器组成．两种神经网络均采用遗传算法进行训 练．仿真实验表明,对于带纯时延的非线性被控对象,采用遗传算法设计的对角递归神经网 络预测控制器具有令人满意的控制性能．     

Improved training of neural networks for the nonlinear activecontrol of sound and vibration

Active control of sound and vibration has been the subject of a lot of research, and examples of applications are now numerous. However, few practical implementations of nonlinear active controllers have been realized. Nonlinear active controllers may be required in cases where the actuators used in active control systems exhibit nonlinear characteristics, or in cases when the structure to be controlled exhibits a nonlinear behavior. A multilayer perceptron neural-network based control structure was previously introduced as a nonlinear active controller, with a training algorithm based on an extended backpropagation scheme. This paper introduces new heuristical training algorithms for the same neural-network control structure. The objective is to develop new algorithms with faster convergence speed and/or lower computational loads. Experimental results of active sound control using a nonlinear actuator with linear and nonlinear controllers are presented. The results show that some of the new algorithms can greatly improve the learning rate of the neural-network control structure, and that for the considered experimental setup a neural-network controller can outperform linear controllers.     

Particle swarm optimization based nonlinear active noise control under saturation nonlinearity

In this paper, a method is proposed to overcome the saturation non-linearity linked to the microphones and loudspeakers of active noise control (ANC) system. The reference microphone gets saturated when the acoustic noise at the source increases beyond the dynamic limits of the microphone. When the controller tries to drive the loudspeaker system beyond its dynamic limits, the saturation nonlinearity is also introduced into the system. The secondary path which is generally estimated with a low level auxiliary noise by a linear transfer function does not model such saturation nonlinearity. Therefore, the filtered-x least mean square (FXLMS) algorithm fails to perform when the noise level is increased. For alleviating the saturation nonlinearity effect a nonlinear functional expansion based ANC algorithm is proposed where the particle swarm optimization (PSO) algorithm is suitably applied to tune the parameters of a filter bank based functional link artificial neural network (FLANN) structure, named as PSO based nonlinear structure (PSO-NLS) algorithm. The proposed algorithm does not require any computation of secondary path estimate filtering unlike other conventional gradient based algorithms and hence has got computational advantage. The computer simulation experiments show its superior performance compared to the FXLMS, filtered-s LMS and genetic algorithms under saturation present at both at secondary and reference paths. The paper also includes a sensitivity analysis to study the effect of different parameters on ANC performance.     

基于加速梯度求法的置信规则库参数训练方法

置信规则库（belief rule base,BRB）的参数训练问题实质上是一个带有约束条件的非线性优化问题,目前在求解该问题上主要使用FMINCON函数及群智能算法,但在算法的应用中存在移植性差,难实现,计算时间长等局限性。通过对这些问题的研究,结合现有的参数训练方法提出了基于加速梯度求法的置信规则库参数训练方法,并将其应用在多峰函数、输油管道泄漏检测的置信规则库的参数训练上。以收敛误差、收敛时间和皮尔森相关系数作为衡量指标,对新方法与其他传统方法进行了对比,实验结果表明,新算法在收敛精度和收敛速度上具有更理想的综合效益。     

神经网络增强学习的梯度算法研究

针对具有连续状态和离散行为空间的Markov决策问题，提出了一种新的采用多层前馈神经网络进行值函数逼近的梯度下降增强学习算法，该算法采用了近似贪心且连续可微的Boltzmann分布行为选择策略，通过极小化具有非平稳行为策略的Bellman残差平方和性能指标，以实现对Markov决策过程最优值函数的逼近，对算法的收敛性和近似最优策略的性能进行了理论分析，通过Mountain-Car学习控制问题的仿真研究进一步验证了算法的学习效率和泛化性能。     

Active control of vibration using a neural network

Feedforward control of sound and vibration using a neural network-based control system is considered, with the aim being to derive an architecture/algorithm combination which is capable of supplanting the commonly used finite impulse response filter/filtered-x least mean square (LMS) linear arrangement for certain nonlinear problems. An adaptive algorithm is derived which enables stable adaptation of the neural controller for this purpose, while providing the capacity to maintain causality within the control scheme. The algorithm is shown to be simply a generalization of the linear filtered-x LMS algorithm. Experiments are undertaken which demonstrate the utility of the proposed arrangement, showing that it performs as well as a linear control system for a linear control problem and better for a nonlinear control problem. The experiments also lead to the conclusion that more work is required to improve the predictability and consistency of the performance before the neural network controller becomes a practical alternative to the current linear feedforward systems.     

Reformulated radial basis neural networks trained by gradientdescent

This paper presents an axiomatic approach for constructing radial basis function (RBF) neural networks. This approach results in a broad variety of admissible RBF models, including those employing Gaussian RBFs. The form of the RBFs is determined by a generator function. New RBF models can be developed according to the proposed approach by selecting generator functions other than exponential ones, which lead to Gaussian RBFs. This paper also proposes a supervised learning algorithm based on gradient descent for training reformulated RBF neural networks constructed using the proposed approach. A sensitivity analysis of the proposed algorithm relates the properties of RBFs with the convergence of gradient descent learning. Experiments involving a variety of reformulated RBF networks generated by linear and exponential generator functions indicate that gradient descent learning is simple, easily implementable, and produces RBF networks that perform considerably better than conventional RBF models trained by existing algorithms     

Locally recurrent neural networks for wind speed prediction using spatial correlation

This paper deals with the wind speed prediction in wind farms, using spatial information from remote measurement stations. Owing to the temporal complexity of the problem, we employ local recurrent neural networks with internal dynamics, as advanced forecast models. To improve the prediction performance, the training task is accomplished using on-line learning algorithms based on the recursive prediction error (RPE) approach. A global RPE (GRPE) learning scheme is first developed where all adjustable weights are simultaneously updated. In the following, through weight grouping we devise a simplified method, the decoupled RPE (DRPE), with reduced computational demands. The partial derivatives required by the learning algorithms are derived using the adjoint model approach, adapted to the architecture of the networks being used. The efficiency of the proposed approach is tested on a real-world wind farm problem, where multi-step ahead wind speed estimates from 15 min to 3 h are sought. Extensive simulation results demonstrate that our models exhibit superior performance compared to other network types suggested in the literature. Furthermore, it is shown that the suggested learning algorithms outperform three gradient descent algorithms, in training of the recurrent forecast models.     

粒子群优化算法在神经网络控制中的应用

考虑粒子群优化算法在不确定系统的自适应控制中的应用。神经网络在不确定系统的自适应控制中起着重要作用。但传统的梯度下降法训练神经网络时收敛速度慢,容易陷入局部极小,且对网络的初始权值等参数极为敏感。为了克服这些缺点,提出了一种基于粒子群算法优化的RBF神经网络整定PID的控制策略。首先,根据粒子群算法的基本原理提出了优化得到RBF神经网络输出权、节点中心和节点基宽参数的初值的算法。其次,再利用梯度下降法对控制器参数进一步调节。将传统的神经网络控制与基于粒子群优化的神经网络控制进行了对比,结果表明,后者有更好逼近精度。以PID控制器参数整定为例,对一类非线性控制系统进行了仿真。仿真结果表明基于粒子群优化的神经网络控制具有较强的鲁棒性和自适应能力。