基于神经网络的分类决策树构造

目前基于符号处理的方法是解决分类规则提取问题的主要方法,而基于神经网络的连接主义方法则用的不多,其主要原因在于虽然神经网络的分类精度高,但难于提取其所隐含的分类规则与知识.针对这个问题,结合神经网络的具体特点,该文提出了一种基于神经网络的构造分类决策树的新方法.该方法通过神经网络训练建立各属性与分类结果之间的关系,进而通过提取各属性与分类结果之间的导数关系来建立分类决策树.给出了具体的决策树构造算法.同时为了提高神经网络所隐含关系的提取效果,提出了关系强化约束的概念并建立了具体的模型.实际应用结果证明了算法的有效性.     

New delay-dependent exponential stability criteria of BAM neural networks with time delays

In this paper, the global exponential stability is investigated for the bi-directional associative memory networks with time delays. Several new sufficient conditions are presented to ensure global exponential stability of delayed bi-directional associative memory neural networks based on the Lyapunov functional method as well as linear matrix inequality technique. To the best of our knowledge, few reports about such “linearization” approach to exponential stability analysis for delayed neural network models have been presented in literature. The method, called parameterized first-order model transformation, is used to transform neural networks. The obtained conditions show to be less conservative and restrictive than that reported in the literature. Two numerical simulations are also given to illustrate the efficiency of our result.     

发酵过程的多模型融合建模算法

提出了利用多模型融合技术进行发酵过程建模的新方法， 该方法能够将在线参数和离线参数同时用于建模中． 首先给出了多模型融合建模算法框架， 并描述了基于自适应模糊神经网络和模糊推理技术两个参与融合的子模型的建立方法. 采用三个非线性函数分别运用GMDH-PTSV算法、傅里叶神经网络和多模型融合建模算法进行建模精度比较. 最后给出了多模型融合建模算法在青霉素发酵过程中应用的结果．     

A genetic-based neuro-fuzzy approach for modeling and control ofdynamical systems

Linguistic modeling of complex irregular systems constitutes the heart of many control and decision making systems, and fuzzy logic represents one of the most effective algorithms to build such linguistic models. In this paper, a linguistic (qualitative) modeling approach is proposed. The approach combines the merits of the fuzzy logic theory, neural networks, and genetic algorithms (GAs). The proposed model is presented in a fuzzy-neural network (FNN) form which can handle both quantitative (numerical) and qualitative (linguistic) knowledge. The learning algorithm of a FNN is composed of three phases. The first phase is used to find the initial membership functions of the fuzzy model. In the second phase, a new algorithm is developed and used to extract the linguistic-fuzzy rules. In the third phase, a multiresolutional dynamic genetic algorithm (MRD-GA) is proposed and used for optimized tuning of membership functions of the proposed model. Two well-known benchmarks are used to evaluate the performance of the proposed modeling approach, and compare it with other modeling approaches.     

Uncertain data stream algorithm based on clustering RBF neural network

In this paper, the existing algorithms for modeling uncertain data streams based on radial basis function neural networks have problems of low accuracy, weak stability and slow speed. A new clustering method for uncertain data streams is proposed. Radial basis function neural network of the algorithm. The algorithm firstly models the uncertain data stream, then combines the fuzzy theory and the neural network principle to obtain the radial basis function neural network, and then obtains the radial basis function neural network through the clustering algorithm of the regular tetrahedral uncertain vector. The central weight and width weights ultimately result in hidden layer output and output layer output results. The experimental results show that the proposed algorithm is an effective algorithm for modeling uncertain data streams using clustering radial basis function neural networks. It has higher precision, stability and speed than similar algorithms.     

控制中的一种神经网络结构

本文介绍通过利用神经网络计算算法怎样将神经网络两个重要的计算特点用于自适应控制。以单自由度机械手为例,对神经形态控制方法和模型参考自适应控制方法进行比较,对很大规模的系统,利用神经网络作为自适应控制提供定速,比传统的方法优越。     

An expert system based on wavelet decomposition and neural network for modeling Chua’s circuit

This paper presents an expert system based on wavelet decomposition and neural network for modeling and simulation of Chua’s circuit which is used for chaos studies. The problems which arise in modeling Chua’s circuit by neural networks are high structural complexity and slow and difficult training. With this proposed method a new solutions is produced to solve these problems. Wavelet decomposition is used for new useful feature extracting from input signal and neural network is used for modeling. Test results of proposed wavelet decomposition and neural network model are compared with test results of neural network model. Desired performance is provided by this new model. Test results showed that the suggested method can be used efficiently for modeling nonlinear dynamical systems.     

A hybrid neural network and ARIMA model for water quality time series prediction

Accurate predictions of time series data have motivated the researchers to develop innovative models for water resources management. Time series data often contain both linear and nonlinear patterns. Therefore, neither ARIMA nor neural networks can be adequate in modeling and predicting time series data. The ARIMA model cannot deal with nonlinear relationships while the neural network model alone is not able to handle both linear and nonlinear patterns equally well. In the present study, a hybrid ARIMA and neural network model is proposed that is capable of exploiting the strengths of traditional time series approaches and artificial neural networks. The proposed approach consists of an ARIMA methodology and feed-forward, backpropagation network structure with an optimized conjugated training algorithm. The hybrid approach for time series prediction is tested using 108-month observations of water quality data, including water temperature, boron and dissolved oxygen, during 1996–2004 at Büyük Menderes river, Turkey. Specifically, the results from the hybrid model provide a robust modeling framework capable of capturing the nonlinear nature of the complex time series and thus producing more accurate predictions. The correlation coefficients between the hybrid model predicted values and observed data for boron, dissolved oxygen and water temperature are 0.902, 0.893, and 0.909, respectively, which are satisfactory in common model applications. Predicted water quality data from the hybrid model are compared with those from the ARIMA methodology and neural network architecture using the accuracy measures. Owing to its ability in recognizing time series patterns and nonlinear characteristics, the hybrid model provides much better accuracy over the ARIMA and neural network models for water quality predictions.     

Nonlinear control structures based on embedded neural system models

This paper investigates in detail the possible application of neural networks to the modeling and adaptive control of nonlinear systems. Nonlinear neural-network-based plant modeling is first discussed, based on the approximation capabilities of the multilayer perceptron. A structure is then proposed to utilize feedforward networks within a direct model reference adaptive control strategy. The difficulties involved in training this network, embedded within the closed-loop are discussed and a novel neural-network-based sensitivity modeling approach proposed to allow for the backpropagation of errors through the plant to the neural controller. Finally, a novel nonlinear internal model control (IMC) strategy is suggested, that utilizes a nonlinear neural model of the plant to generate parameter estimates over the nonlinear operating region for an adaptive linear internal model, without the problems associated with recursive parameter identification algorithms. Unlike other neural IMC approaches the linear control law can then be readily designed. A continuous stirred tank reactor was chosen as a realistic nonlinear case study for the techniques discussed in the paper.     

循环神经网络研究综述

循环神经网络是神经网络序列模型的主要实现形式,近几年得到迅速发展,其是机器翻译、机器问题回答、序列视频分析的标准处理手段,也是对于手写体自动合成、语音处理和图像生成等问题的主流建模手段.鉴于此,循环神经网络的各分支按照网络结构进行详细分类,大致分为3大类:一是衍生循环神经网络,这类网络是基于基本RNNs模型的结构衍生变体,即对RNNs的内部结构进行修改;二是组合循环神经网络,这类网络将其他一些经典的网络模型或结构与第一类衍生循环神经网络进行组合,得到更好的模型效果,是一种非常有效的手段;三是混合循环神经网络,这类网络模型既有不同网络模型的组合,又在RNNs内部结构上进行修改,是同属于前两类网络分类的结构.为了更加深入地理解循环神经网络,进一步介绍与循环神经网络经常混为一谈的递归神经网络结构以及递归神经网络与循环神经网络的区别和联系.在详略描述上述模型的应用背景、网络结构以及模型变种后,对各个模型的特点进行总结和比较,并对循环神经网络模型进行展望和总结.     

Univariate modeling and forecasting of monthly energy demand time series using abductive and neural networks

Neural networks have been widely used for short-term, and to a lesser degree medium and long-term, demand forecasting. In the majority of cases for the latter two applications, multivariate modeling was adopted, where the demand time series is related to other weather, socio-economic and demographic time series. Disadvantages of this approach include the fact that influential exogenous factors are difficult to determine, and accurate data for them may not be readily available. This paper uses univariate modeling of the monthly demand time series based only on data for 6 years to forecast the demand for the seventh year. Both neural and abductive networks were used for modeling, and their performance was compared. A simple technique is described for removing the upward growth trend prior to modeling the demand time series to avoid problems associated with extrapolating beyond the data range used for training. Two modeling approaches were investigated and compared: iteratively using a single next-month forecaster, and employing 12 dedicated models to forecast the 12 individual months directly. Results indicate better performance by the first approach, with mean percentage error (MAPE) of the order of 3% for abductive networks. Performance is superior to naı¨ve forecasts based on persistence and seasonality, and is better than results quoted in the literature for several similar applications using multivariate abductive modeling, multiple regression, and univariate ARIMA analysis. Automatic selection of only the most relevant model inputs by the abductive learning algorithm provides better insight into the modeled process and allows constructing simpler neural network models with reduced data dimensionality and improved forecasting performance.     

磁浮列车悬浮系统的神经网络建模研究

磁浮列车的悬浮系统是一个典型的非线性系统,其精确数学模型的建立非常困难。目前使用的系统模型大多是经过简化的近似线性化动力学模型,这样的模型在悬浮系统的研究中只起到方向上的指导作用,在工程实践中获取控制对象的精确模型具有重要的意义。神经网络不仅能够逼近复杂的非线性静态映射关系,同时也可以用于动态系统的特性学习,这里采用神经网络来建立悬浮系统的精确模型。文中简述了磁浮列车悬浮系统的基本结构和原理。讨论了非线性动态系统神经网络建模的一般方法。采用了输出反馈型的多层前向神经网络对悬浮系统进行了建模。并使用悬浮系统的输入输出数据对神经网络模型进行了训练和仿真,验证了该建模方法的可行性。     

Local model network identification with Gaussian processes.

A Bayesian Gaussian process (GP) modeling approach has recently been introduced to model-based control strategies. The estimate of the variance of the predicted output is the most useful advantage of GPs in comparison to neural networks (NNs) and fuzzy models. However, the GP model is computationally demanding and nontransparent. To reduce the computation load and increase transparency, a local linear GP model network is proposed in this paper. The proposed methodology combines the local model network principle with the GP prior approach. A novel algorithm for structure determination and optimization is introduced, which is widely applicable to the training of local model networks. The modeling procedure of the local linear GP (LGP) model network is demonstrated on an example of a nonlinear laboratory scale process rig.     

Execution of a remote sensing application on a custom neurocomputer

A radial basis function neural network was successfully applied to an area which is relatively new for neural networks: a remote sensing application that provides estimates of water vapor content, an important parameter for climate modeling. The neural network provided results which are up to 32% better than had been previously obtained using conventional statistical methods on the same data. These results have implications for improved short-term weather forecasting and for long-term global climate modeling. The neural network approach is compared with the past and present operating algorithms at the National Oceanic and Atmospheric Administration. The radial basis function network's performance is compared with sigmoidal backpropagation network. Low-power electronic implementations of the neural methodology were explored to demonstrate the feasibility of placing the network on a remote sensing platform. This would permit processing the raw sensor data into information on the platform, eliminating the need to store the raw data, and helping to contain the expected explosion of climate data.     

Neural Network Modeling of the Level of Observation Decision in an Acute Psychiatric Ward

Patients in an acute psychiatric ward need to be observed with varying levels of closeness. We report a series of experiments in which neural networks were trained to model this “level of observation” decision. One hundred eighty-seven such clinical decisions were used to train and test the networks which were evaluated by a multitrialv-fold cross-validation procedure. One neural network modeling approach was to break down the decision process into four subproblems, each of which was solved by a perceptron unit. This resulted in a hierarchical perceptron network having a structure that was equivalent to a sparsely connected two-layer perceptron. Neural network approaches were compared with nearest neighbor, linear regression, and naive Bayes classifiers. The hierarchical and sparse neural networks were the most accurate classifiers. This shows that the decision process is nonlinear, that neural nets can be more accurate than other statistical approaches, and that hierarchical decomposition is a useful methodology for neural network design.     

A neural network approach to the classification problem

The task of classifying observations into known groups is a common problem in decision making. A wealth of statistical approaches, commencing with Fisher's linear discriminant function, and including variations to accomodate a variety of modeling assumptions, have been proposed. In addition, nonparametric approaches based on various mathematical programming models have also been proposed as solutions. All of these proposed aolutions have performed well when conditions favorable to the specific model are present. The modeler, therefore, can usually be assured of a good solution to his problem of he chooses a model which fits his situation. In this paper, the performance of a neural network as a classifier is evaluated. It is found that the performance of the neural network is comparable to the best of otheother methods under a wide variety of modeling assumptions. The use of neural networks as classifiers thus relieves the modeler of testing assumptions which would otherwise be critical to the performance of the usual classification techniques.     

Evolutionary product unit neural networks for short-term wind speed forecasting in wind farms

Combinations of physical and statistical wind speed forecasting models are frequently used in wind speed prediction problems arising in wind farms management. Artificial neural networks can be used in these models as a final step to obtain accurate wind speed predictions. The aim of this work is to determine the potential of evolutionary product unit neural networks (EPUNNs) for improving the accuracy and interpretation of these systems. Traditional neural network and EPUNN approaches have been used to develop different wind speed prediction models. The results obtained using different EPUNN models show that the functional model and the hybrid algorithms proposed provide very accurate prediction compared with standard neural networks used to solve this regression problem. One of the main advantages of the application of these EPUNNs has been the possibility of obtaining some interpretation of the non-linear relation predicted by the model, as will be shown in real data of a wind farm in Spain.     

非对称Hopfield网络稳定性分析

Hopfield神经网络是迄今得到最广泛应用的神经网络模型之一，而这些应用极大地依赖于神经网络的动态特性。对于对称Hopfield网络，已有很多成熟的判定其稳定性的方法。对非对称Hopfield神经网络，提出了一种有效的方法来研究这种网络的全局稳定性，并又给出了其稳定性条件。应用所提供的方法很容易对非对称Hopfield神经网络的局部稳定性进行分析。     

选择性神经网络二次集成方法在定量构效关系建模中的应用研究

针对在建立定量构效关系(QSAR)模型中,单个人工神经网络模型难以确定参数,容易产生“过拟合”;一般神经网络集成模型虽然建立过程简单,但由于个体差异度小而导致泛化能力相对单个神经网络没有明显改善等问题,提出了一种基于随机梯度法的选择性神经网络二次集成方法。在建立除草剂(苯乙酰胺类化合物)的QSAR模型的实验研究中表明,该方法设计过程简单,能够以较小的运算代价明显地提高了模型的泛化能力,是建立QSAR模型的一个有效方法。