Voice conversion using General Regression Neural Network

The objective of voice conversion system is to formulate the mapping function which can transform the source speaker characteristics to that of the target speaker. In this paper, we propose the General Regression Neural Network (GRNN) based model for voice conversion. It is a single pass learning network that makes the training procedure fast and comparatively less time consuming. The proposed system uses the shape of the vocal tract, the shape of the glottal pulse (excitation signal) and long term prosodic features to carry out the voice conversion task. In this paper, the shape of the vocal tract and the shape of source excitation of a particular speaker are represented using Line Spectral Frequencies (LSFs) and Linear Prediction (LP) residual respectively. GRNN is used to obtain the mapping function between the source and target speakers. The direct transformation of the time domain residual using Artificial Neural Network (ANN) causes phase change and generates artifacts in consecutive frames. In order to alleviate it, wavelet packet decomposed coefficients are used to characterize the excitation of the speech signal. The long term prosodic parameters namely, pitch contour (intonation) and the energy profile of the test signal are also modified in relation to that of the target (desired) speaker using the baseline method. The relative performances of the proposed model are compared to voice conversion system based on the state of the art RBF and GMM models using objective and subjective evaluation measures. The evaluation measures show that the proposed GRNN based voice conversion system performs slightly better than the state of the art models.     

基于事件描述的社交事件参与度预测

在基于事件的社会网络（EBSNs）的相关研究中，基于事件描述来预测社交事件参与度是难点问题。相关的研究非常有限，研究难度主要来自对事件描述评价的主观性和语言建模算法的局限性。针对这些问题，首先定义了成功事件、相似事件和事件相似度等概念，并基于这些概念将采集自Meetup平台的社交数据进行抽取，同时分别设计了基于拉索回归、卷积神经网络（CNN）和门控循环神经网络（GRNN）的分析预测方法。实验时，先从抽取过的数据中选取部分数据训练三种模型，然后用剩余的数据进行分析预测。结果显示，相较于不含事件描述的事件，经过拉索回归模型处理的事件在不同分类器下的预测准确率可提高2.35%~3.8%，经过GRNN模型处理的事件在不同分类器下的预测准确率可提高4.5%~8.9%，而CNN模型的处理结果不理想。证明了事件描述能够提高事件参与度，GRNN模型在三个模型中预测准确率最高。     

基于事件描述的社交事件参与度预测

在基于事件的社会网络（EBSNs）的相关研究中，基于事件描述来预测社交事件参与度是难点问题。相关的研究非常有限，研究难度主要来自对事件描述评价的主观性和语言建模算法的局限性。针对这些问题，首先定义了成功事件、相似事件和事件相似度等概念，并基于这些概念将采集自Meetup平台的社交数据进行抽取，同时分别设计了基于拉索回归、卷积神经网络（CNN）和门控循环神经网络（GRNN）的分析预测方法。实验时，先从抽取过的数据中选取部分数据训练三种模型，然后用剩余的数据进行分析预测。结果显示，相较于不含事件描述的事件，经过拉索回归模型处理的事件在不同分类器下的预测准确率可提高2.35%~3.8%，经过GRNN模型处理的事件在不同分类器下的预测准确率可提高4.5%~8.9%，而CNN模型的处理结果不理想。证明了事件描述能够提高事件参与度，GRNN模型在三个模型中预测准确率最高。     

A comparison of regression methods for remote tracking of Parkinson’s disease progression

Remote patient tracking has recently gained increased attention, due to its lower cost and non-invasive nature. In this paper, the performance of Support Vector Machines (SVM), Least Square Support Vector Machines (LS-SVM), Multilayer Perceptron Neural Network (MLPNN), and General Regression Neural Network (GRNN) regression methods is studied in application to remote tracking of Parkinson’s disease progression. Results indicate that the LS-SVM provides the best performance among the other three, and its performance is superior to that of the latest proposed regression method published in the literature.     

一种SOM和GRNN结合的模式全自动分类新方法

非监督学习算法的分类精度通常很难令人满意,而监督的学习算法需要人工选取训练样本,这有时很难得到,并且其分类精度直接依赖于所选取的学习样本。针对这些缺陷,提出一种非监督自组织神经网络(SOMNN)和监督的广义回归网络(GRNN)结合的全自动模式分类新方法。新方法首先通过SOMNN将原始数据进行自动聚类,再用所得的聚类中心以及中心邻近数据点训练GRNN,然后根据GRNN的分类结果重新计算聚类中心,再根据新的聚类中心和中心邻近点训练GRNN,如此反复,直至得到稳定的中心为止。Iris数据,Wine数据的实验结果都验证了新方法的可行性。     

Application of ANN techniques for estimating backwater through bridge constrictions in Mississippi River basin

Bridge backwater data were collected for 92 different floods at 35 bridge sites in the Mississippi River basin in 1960s [Neely BL. Hydraulic performance of bridges, hydraulic efficiency of bridges—analysis of field data. Unpublished Report Conducted by US Geological Survey, June 30; 1966]. This major field data showed that the backwater computed both by the United States Geological Survey’s method (USGS) and the United States Bureau of Public Roads’ method (USBPR) averaged approximately 50% less than the measured backwater. Therefore, in the current work, a new bridge backwater formula based on the three different artificial neural network approaches (ANNs), namely FFBP (Feed-Forward Back Propagation), RBNN (Radial Basis Function-Based Neural Network), and GRNN (Generalized Regression Neural Networks) are proposed and compared with the methods mentioned above. The results showed that the FFBP produced slightly better estimations than those of the RBNN and these two was significantly superior to the GRNN, USGS and USBPR methods when applied to Neely’s field data.     

Capturing aesthetic intention during interactive evolution

Interactive Evolutionary Systems (IES) are capable of generating and evolving large numbers of alternative designs. When using such systems, users are continuously required to interact with the system by making evaluations and selections of the designs that are being generated and evolved. The evolutionary process is therefore led by the visual aesthetic intentions of the user. However, due to the limited size of the computer screen and fuzzy nature of aesthetic evaluations, evolution is usually a mutation-driven and divergent process. The convergent mechanisms typically found in standard Evolutionary Algorithms are more difficult to achieve with IES.To address this problem, this paper presents a computational framework that creates an IES with a higher level of convergence without requiring additional actions from the user. This can be achieved by incorporating a Neural Network based learning mechanism, called a General Regression Neural Network (GRNN), into an IES. GRNN analyses the user's aesthetic evaluations during the interactive evolutionary process and is thereby able to approximate their implicit aesthetic intentions. The approximation is a regression of aesthetic appeals conditioned on the corresponding designs. This learning mechanism allows the framework to infer which designs the users may find desirable. For the users, this reduces the tedious work of evaluating and selecting designs.Experiments have been conducted using the framework to support the process of parametric tuning of facial characters. In this paper we analyze the performance of our approach and discuss the issues that we believe are essential for improving the usability and efficiency of IES.     

基于深度学习的文本分类技术研究进展

随着深度学习技术的快速发展,许多研究者尝试利用深度学习来解决文本分类问题,特别是在卷积神经网络和循环神经网络方面,出现了许多新颖且有效的分类方法。对基于深度神经网络的文本分类问题进行分析,介绍卷积神经网络、循环神经网络、注意力机制等方法在文本分类中的应用和发展,分析多种典型分类方法的特点和性能,从准确率和运行时间方面对基础网络结构进行比较,表明深度神经网络较传统机器学习方法在用于文本分类时更具优势,其中卷积神经网络具有优秀的分类性能和泛化能力。在此基础上,指出当前深度文本分类模型存在的不足,并对未来的研究方向进行展望。     

Fusion of GRNN and FA for Online Noisy Data Regression

A new online neural-network-based regression model for noisy data is proposed in this paper. It is a hybrid system combining the Fuzzy ART (FA) and General Regression Neural Network (GRNN) models. Both the FA and GRNN models are fast incremental learning systems. The proposed hybrid model, denoted as GRNNFA-online, retains the online learning properties of both models. The kernel centers of the GRNN are obtained by compressing the training samples using the FA model. The width of each kernel is then estimated by the K-nearest-neighbors (kNN) method. A heuristic is proposed to tune the value of Kof the kNN dynamically based on the concept of gradient-descent. The performance of the GRNNFA-online model was evaluated using two benchmark datasets, i.e., OZONE and Friedman#1. The experimental results demonstrated the convergence of the prediction errors. Bootstrapping was employed to assess the performance statistically. The final prediction errors are analyzed and compared with those from other systems.     

A novel neural network ensemble architecture for time series forecasting

We propose a novel homogeneous neural network ensemble approach called Generalized Regression Neural Network (GEFTS–GRNN) Ensemble for Forecasting Time Series, which is a concatenation of existing machine learning algorithms. GEFTS uses a dynamic nonlinear weighting system wherein the outputs from several base-level GRNNs are combined using a combiner GRNN to produce the final output. We compare GEFTS with the 11 most used algorithms on 30 real datasets. The proposed algorithm appears to be more powerful than existing ones. Unlike conventional algorithms, GEFTS is effective in forecasting time series with seasonal patterns.     

Control of a nonlinear liquid level system using a new artificial neural network based reinforcement learning approach

Most industrial processes exhibit inherent nonlinear characteristics. Hence, classical control strategies which use linearized models are not effective in achieving optimal control. In this paper an Artificial Neural Network (ANN) based reinforcement learning (RL) strategy is proposed for controlling a nonlinear interacting liquid level system. This ANN-RL control strategy takes advantage of the generalization, noise immunity and function approximation capabilities of the ANN and optimal decision making capabilities of the RL approach. Two different ANN-RL approaches for solving a generic nonlinear control problem are proposed and their performances are evaluated by applying them to two benchmark nonlinear liquid level control problems. Comparison of the ANN-RL approach is also made to a discretized state space based pure RL control strategy. Performance comparison on the benchmark nonlinear liquid level control problems indicate that the ANN-RL approach results in better control as evidenced by less oscillations, disturbance rejection and overshoot.     

基于混沌免疫粒子群优化和广义回归神经网络的回采工作面瓦斯涌出量预测模型

为提高回采工作面绝对瓦斯涌出量预测的精度和效率,提出了将混沌免疫粒子群优化(CIPSO)算法与广义回归神经网络(GRNN)相耦合的绝对瓦斯涌出量预测模型。该方法采用CIPSO对GRNN的光滑因子进行动态优化调整,减少了人为因素对GRNN网络输出结果的影响,并采用优化后的网络建立瓦斯涌出量预测模型。通过对某煤矿瓦斯涌出量数据的仿真实验结果表明:基于CIPSO-GRNN的回采工作面绝对瓦斯涌出量模型比BP神经网络、Elman网络预测模型具有更好的预测精度和收敛速度,证明了该方法的有效性和可行性。     

基于PSO优化GRNN的语音转换方法

提出了一种基于粒子群算法PSO优化广义回归神经网络GRNN模型的语音转换方法。首先,该方法利用训练语音的声道和激励源的个性化特征参数分别训练两个GRNN,得到GRNN的结构参数;然后,利用PSO对GRNN的结构参数进行优化,减少人为因素对转换结果的影响;最后,对语音的韵律特征、基音轮廓和能量分别进行了线性转换,使得转换后的语音包含更多源语音的个性化特征信息。主客观实验结果表明:与径向基神经网络RBF和GRNN相比,使用本文提出的转换模型获得的转换语音的自然度和似然度都得到了很大的提升,谱失真率明显降低并且更接近于目标语音。     

Improving project-profit prediction using a two-stage forecasting system

Accurate project-profit prediction is a crucial issue because it can provide an early feasibility estimate for the project. In order to achieve accurate project-profit prediction, this study developed a novel two-stage forecasting system. In stage one, the proposed forecasting system adopts fuzzy clustering technology, fuzzy c-means (FCM) and kernel fuzzy c-means (KFCM), for the correct grouping of different projects. In stage two, least-squares support vector regression (LSSVR) technology is employed for forecasting the project-profit in different project groups, respectively. Moreover, genetic algorithms (GA) were simultaneously used to select the parameters of the LSSVR. The project data come from a real enterprise in Taiwan. In this study, some forecasting methodologies are also compared, for instance Generalized Regression Neural Network (GRNN), Radial Basis Function Neural Networks (RBFNN), and Back Propagation Neural Network (BPNN), to predict project-profit in this real case. Empirical results indicate that the two-stage forecasting system (FCM+LSSVR and KFCM+LSSVR) has superior performance in terms of forecasting accuracy, compared to other methods. Furthermore, in observing the results of the two-stage forecasting system, it can be seen that FCM+LSSVR can achieve superior performance, and KFCM+LSSVR can achieve consistently good performance. Therefore, based on the empirical results, the two-stage forecasting system was verified to efficiently provide credible predictions for project-profit forecasting.     

A comparative assessment of ensemble learning for credit scoring

Both statistical techniques and Artificial Intelligence (AI) techniques have been explored for credit scoring, an important finance activity. Although there are no consistent conclusions on which ones are better, recent studies suggest combining multiple classifiers, i.e., ensemble learning, may have a better performance. In this study, we conduct a comparative assessment of the performance of three popular ensemble methods, i.e., Bagging, Boosting, and Stacking, based on four base learners, i.e., Logistic Regression Analysis (LRA), Decision Tree (DT), Artificial Neural Network (ANN) and Support Vector Machine (SVM). Experimental results reveal that the three ensemble methods can substantially improve individual base learners. In particular, Bagging performs better than Boosting across all credit datasets. Stacking and Bagging DT in our experiments, get the best performance in terms of average accuracy, type I error and type II error.     

Normal and hypoacoustic infant cry signal classification using time-frequency analysis and general regression neural network

Crying is the most noticeable behavior of infancy. Infant cry signals can be used to identify physical or psychological status of an infant. Recently, acoustic analysis of infant cry signal has shown promising results and it has been proven to be an excellent tool to investigate the pathological status of an infant. This paper proposes short-time Fourier transform (STFT) based time-frequency analysis of infant cry signals. Few statistical features are derived from the time-frequency plot of infant cry signals and used as features to quantify infant cry signals. General Regression Neural Network (GRNN) is employed as a classifier for discriminating infant cry signals. Two classes of infant cry signals are considered such as normal cry signals and pathological cry signals from deaf infants. To prove the reliability of the proposed features, two neural network models such as Multilayer Perceptron (MLP) and Time-Delay Neural Network (TDNN) trained by scaled conjugate gradient algorithm are also used as classifiers. The experimental results show that the GRNN classifier gives very promising classification accuracy compared to MLP and TDNN and the proposed method can effectively classify normal and pathological infant cries.     

Forecasting financial time series volatility using Particle Swarm Optimization trained Quantile Regression Neural Network

Accurate forecasting of volatility from financial time series is paramount in financial decision making. This paper presents a novel, Particle Swarm Optimization (PSO)-trained Quantile Regression Neural Network namely PSOQRNN, to forecast volatility from financial time series. We compared the effectiveness of PSOQRNN with that of the traditional volatility forecasting models, i.e., Generalized Autoregressive Conditional Heteroskedasticity (GARCH) and three Artificial Neural Networks (ANNs) including Multi-Layer Perceptron (MLP), General Regression Neural Network (GRNN), Group Method of Data Handling (GMDH), Random Forest (RF) and two Quantile Regression (QR)-based hybrids including Quantile Regression Neural Network (QRNN) and Quantile Regression Random Forest (QRRF). The results indicate that the proposed PSOQRNN outperformed these models in terms of Mean Squared Error (MSE), on a majority of the eight financial time series including exchange rates of USD versus JPY, GBP, EUR and INR, Gold Price, Crude Oil Price, Standard and Poor 500 (S&P 500) Stock Index and NSE India Stock Index considered here. It was corroborated by the Diebold–Mariano test of statistical significance. It also performed well in terms of other important measures such as Directional Change Statistic (Dstat) and Theil's Inequality Coefficient. The superior performance of PSOQRNN can be attributed to the role played by PSO in obtaining the better solutions. Therefore, we conclude that the proposed PSOQRNN can be used as a viable alternative in forecasting volatility.     

An efficient speech recognition system in adverse conditions using the nonparametric regression

General Regression Neural Networks (GRNN) have been applied to phoneme identification and isolated word recognition in clean speech. In this paper, the authors extended this approach to Arabic spoken word recognition in adverse conditions. In fact, noise robustness is one of the most challenging problems in Automatic Speech Recognition (ASR) and most of the existing recognition methods, which have shown to be highly efficient under noise-free conditions, fail drastically in noisy environments. The proposed system was tested for Arabic digit recognition at different Signal-to-Noise Ratio (SNR) levels and under four noisy conditions: multispeakers babble background, car production hall (factory), military vehicle (leopard tank) and fighter jet cockpit (buccaneer) issued from NOISEX-92 database. The proposed scheme was successfully compared to the similar recognizers based on the Multilayer Perceptrons (MLP), the Elman Recurrent Neural Network (RNN) and the discrete Hidden Markov Model (HMM). The experimental results showed that the use of nonparametric regression with an appropriate smoothing factor (spread) improved the generalization power of the neural network and the global performance of the speech recognizer in noisy environments.     

不确定混沌系统的差分进化小波神经网络控制

提出一种基于小生境自适应差分进化小波神经网络（NADE-WNN）的方法对不确定混沌系统进行控制。该方法利用小波神经网络学习未知模型混沌系统的动态特性并实施控制,为提高神经网络的学习精度和收敛速度,采用小生境自适应差分进化算法同时优化小波神经网络的结构和参数,简化网络结构,提高网络的学习精度和全局收敛性。仿真实验结果表明,在有外部干扰和参数摄动的情况下,NADE-WNN仍能对不确定混沌系统进行有效控制,且网络结构、控制精度和收敛速度都优于传统神经网络。