Automatic detection of electroencephalographic changes using adaptive neuro-fuzzy inference system employing Lyapunov exponents

This paper describes the application of adaptive neuro-fuzzy inference system (ANFIS) model for automatic detection of electroencephalographic changes. Decision making was performed in two stages: feature extraction by computation of Lyapunov exponents and classification by the ANFIS trained with the backpropagation gradient descent method in combination with the least squares method. Five types of electroencephalogram (EEG) signals were classified by five ANFIS classifiers. To improve diagnostic accuracy, the sixth ANFIS classifier (combining ANFIS) was trained using the outputs of the five ANFIS classifiers as input data. The proposed ANFIS model combined the neural network adaptive capabilities and the fuzzy logic qualitative approach. Some conclusions concerning the saliency of features on classification of the EEG signals were obtained through analysis of the ANFIS. The performance of the ANFIS model was evaluated in terms of training performance and classification accuracies and the results confirmed that the proposed ANFIS model has potential in classifying the EEG signals.     

Application of adaptive neuro-fuzzy inference system for vigilance level estimation by using wavelet-entropy feature extraction

This paper presents the application of adaptive neuro-fuzzy inference system (ANFIS) model for estimation of vigilance level by using electroencephalogram (EEG) signals recorded during transition from wakefulness to sleep. The developed ANFIS model combined the neural network adaptive capabilities and the fuzzy logic qualitative approach. This study comprises of three stages. In the first stage, three types of EEG signals (alert signal, drowsy signal and sleep signal) were obtained from 30 healthy subjects. In the second stage, for feature extraction, obtained EEG signals were separated to its sub-bands using discrete wavelet transform (DWT). Then, entropy of each sub-band was calculated using Shannon entropy algorithm. In the third stage, the ANFIS was trained with the back-propagation gradient descent method in combination with least squares method. The extracted features of three types of EEG signals were used as input patterns of the three ANFIS classifiers. In order to improve estimation accuracy, the fourth ANFIS classifier (combining ANFIS) was trained using the outputs of the three ANFIS classifiers as input data. The performance of the ANFIS model was tested using the EEG data obtained from 12 healthy subjects that have not been used for the training. The results confirmed that the developed ANFIS classifier has potential for estimation of vigilance level by using EEG signals.     

Automatic diagnosis of diabetes using adaptive neuro‐fuzzy inference systems

Abstract: A new approach based on an adaptive neuro‐fuzzy inference system (ANFIS) is presented for diagnosis of diabetes diseases. The Pima Indians diabetes data set contains records of patients with known diagnosis. The ANFIS classifiers learn how to differentiate a new case in the domain by being given a training set of such records. The ANFIS classifier is used to detect diabetes diseases when eight features defining diabetes indications are used as inputs. The proposed ANFIS model combines neural network adaptive capabilities and the fuzzy logic qualitative approach. The conclusions concerning the impacts of features on the diagnosis of diabetes disease are obtained through analysis of the ANFIS. The performance of the ANFIS model is evaluated in terms of training performances and classification accuracies and the results confirm that the proposed ANFIS model has potential in detecting diabetes diseases.     

Automatic detection of ophthalmic artery stenosis using the adaptive neuro-fuzzy inference system

In this study, a new approach based on an adaptive neuro-fuzzy inference system (ANFIS) was presented for detection of ophthalmic artery stenosis. The ANFIS was used to detect ophthalmic artery stenosis when two features, resistivity and pulsatility indices, defining changes of ophthalmic arterial Doppler waveforms were used as inputs. The ophthalmic arterial Doppler signals were recorded from 115 subjects, of whom 52 suffered from ophthalmic artery stenosis and the rest were healthy. The proposed ANFIS model combined the neural network adaptive capabilities and the fuzzy logic qualitative approach. Some conclusions concerning the impacts of features on the detection of ophthalmic artery stenosis were obtained through analysis of the ANFIS. The performances of the classifiers were evaluated in terms of training performance and classification accuracies and the results confirmed that the proposed ANFIS classifier has potential in detecting the ophthalmic artery stenosis.     

Whale Optimization Algorithm and Adaptive Neuro-Fuzzy Inference System: a hybrid method for feature selection and land pattern classification

Adaptive Neuro-Fuzzy Inference System (ANFIS) is a robust method in solving non-linear classification by employing a human-readable interpretation manner. This paper verified a hybrid model, named WANFIS, where Whale Optimization Algorithm (WOA) was used for feature selection and tuning parameters of the ANFIS for land-cover classification. Hanoi, the capital of Vietnam, was selected as a case study, because of its complex surface morphology. The model was trained and validated with different data sets, which were subsets of the segmented objects from SPOT 7 satellite data (1.5 m in panchromatic and 6 m multiple spectral bands). The image segmentation was carried out by using PCI Geomatics software (evaluation version), and output objects with associated spectral, shape, and metric information were selected as input data to train and validate the proposed model. For accuracy assessment, the performance of the model was compared to several benchmarked classifiers by using standard statistical indicators such as Receiver Operator Characteristics, Area under ROC, Root Mean Square Error, Absolute Mean Error, Kappa index, and Overall accuracy. The results showed that WANFIS outperformed the other in almost all training data sets for both operations. It could be concluded that the examination of the classification model in different training data sizes is significant, and the proper determination of predictor variables and training sizes would improve the quality of classification of remotely sensed data.     

Two-phase classification: ANN and A-SVM classifiers on motor imagery BCI

Brain–Computer Interfaces (BCIs) based on Electroencephalograms (EEG) monitor mental activity with the ultimate objective of allowing people to communicate with computers only via their thoughts. Users must create precise cerebral activity patterns that the system uses as control signals to do this. A common activity used to elicit such signals is Motor Imagery (MI), in which certain signals are created in the sensorimotor cortex while imagining the movements. The three phases of the traditional EEG–BCI processing pipeline are preprocessing, feature extraction, and classification. We provide categorization advances and track performance gains in 4-class MI-based BCIs. In this study, 4-class MI events are produced via an illusory elevation of the left hand, right hand, feet, and tongue. Finally, a two-phase classification technique is provided with ANN classifiers being used in the first phase to discriminate between different pair-wise MI tasks. Secondly, an adaptive SVM classifier is used to assess the user's end task based on the weighted outputs of the classifiers. An adaptive classifier is one technique to maintain consistency in performance, reduce training time, and eliminate non-stationaries, all of which are required for efficient BCI performance. The suggested approach outperformed conventional two-stage classification algorithms on MI data, according to experimental findings. The average classification accuracy of this technique is 96% for datasets BCI competition IV 2a. This is a 4% improvement over the comparison approach.     

Application of an adaptive neuro-fuzzy inference system for classification of Behcet disease using the fast Fourier transform method

Abstract: In this study, ophthalmic arterial Doppler signals were obtained from 200 subjects, 100 of whom suffered from ocular Behcet disease while the rest were healthy subjects. An adaptive neuro-fuzzy inference system (ANFIS) was used to detect the presence of ocular Behcet disease. Spectral analysis of the ophthalmic arterial Doppler signals was performed by the fast Fourier transform method for determining the ANFIS inputs. The ANFIS was trained with a training set and tested with a testing set. All these data sets were obtained from ophthalmic arteries of healthy subjects and subjects suffering from ocular Behcet disease. Performance indicators and statistical measures were used for evaluating the ANFIS. The correct classification rate was 94% for healthy subjects and 90% for unhealthy subjects suffering from ocular Behcet disease. The classification results showed that the ANFIS was effective at detecting ophthalmic arterial Doppler signals from subjects with Behcet disease.     

An Automated Brain Image Analysis System for Brain Cancer using Shearlets

In this paper, an Automated Brain Image Analysis (ABIA) system that classifies the Magnetic Resonance Imaging (MRI) of human brain is presented. The classification of MRI images into normal or low grade or high grade plays a vital role for the early diagnosis. The Non-Subsampled Shearlet Transform (NSST) that captures more visual information than conventional wavelet transforms is employed for feature extraction. As the feature space of NSST is very high, a statistical t-test is applied to select the dominant directional sub-bands at each level of NSST decomposition based on sub-band energies. A combination of features that includes Gray Level Co-occurrence Matrix (GLCM) based features, Histograms of Positive Shearlet Coefficients (HPSC), and Histograms of Negative Shearlet Coefficients (HNSC) are estimated. The combined feature set is utilized in the classification phase where a hybrid approach is designed with three classifiers; k-Nearest Neighbor (kNN), Naive Bayes (NB) and Support Vector Machine (SVM) classifiers. The output of individual trained classifiers for a testing input is hybridized to take a final decision. The quantitative results of ABIA system on Repository of Molecular Brain Neoplasia Data (REMBRANDT) database show the overall improved performance in comparison with a single classifier model with accuracy of 99% for normal/abnormal classification and 98% for low and high risk classification.     

ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM FOR AUTOMATIC SLEEP MULTISTAGE LEVEL SCORING EMPLOYING EEG,EOG, AND EMG EXTRACTED FEATURES

A new system for sleep multistage level scoring by employing extracted features from twenty five polysomnographic recording is presented. For the new system, an adaptive neuro-fuzzy inference system (ANFIS) is developed for each sleep stage. Initially, three types of electrophysiological signals including electroencephalogram (EEG), electrooculogram (EOG), and electromyogram (EMG) were collected from twenty five healthy subjects. The input pattern used for training the ANFIS subsystem is a set of extracted features based on the entropy measure which characterize the recorded signals. Finally an output selection subsystem is utilized to provide the appropriate sleep stage according to the ANFIS stage subsystems outputs. The developed system was able to provide an acceptable estimation for six sleep stages with an average accuracy of about 76.43% which confirmed its ability for multistage sleep level scoring based on the extracted features from the EEG, EOG and EMG signals compared to other approaches.     

Neuro–fuzzy modeling tools for estimation of torque in Savonius rotor wind turbine

In the present paper, the ability and accuracy of an adaptive neuro–fuzzy inference system (ANFIS) has been investigated for dynamic modeling of wind turbine Savonius rotor. The main objective of this research is to predict torque performance as a function of the angular position of turbine. In order to better understanding the present technique, the dynamic performance modeling of a Savonius rotor is an important consideration for the wind turbine design procedure. It could be difficult to derive the exact mathematical derivation for the input–output relationships because of the complexity of the design algorithm. In order to show the best fitted algorithm, an extensive comparison test was applied on the ANFIS (adaptive neuro–fuzzy inference system), FIS (fuzzy inference system), and RBF (radial basis function). Resulting from the extensive comparison test, the ANFIS procedure yields very accurate results in comparison with two alternate procedures. The results show that there is an excellent agreement between the testing data (not used in training) and estimated data, with average errors very low. Also FIS with threshold 0.05 and the trained ANFIS are able to accurately capture the non-linear dynamics of torque even for a new condition that has not been used in the training process (testing data). For the sake of comparison, the results of the proposed ANFIS model is compared with those of the RBF model, as well. For implementation of the present technique, the Matlab codes and related instructions are efficiently used, respectively.     

Adaptive network-based fuzzy inference system vs. other classification algorithms for warped LPC-based speech/music discrimination

Automatic discrimination of speech and music is an important tool in many multimedia applications. The paper presents an effective approach based on an adaptive network-based fuzzy inference system (ANFIS) for the classification stage required in a speech/music discrimination system. A new simple feature, called warped LPC-based spectral centroid (WLPC-SC), is also proposed. Comparison between WLPC-SC and the classical features proposed in the literature for audio classification is performed, aiming to assess the good discriminatory power of the proposed feature. The vector length used to describe the proposed psychoacoustic-based feature is reduced to a few statistical values (mean, variance and skewness). With the aim of increasing the classification accuracy percentage, the feature space is then transformed to a new feature space by LDA. The classification task is performed applying ANFIS to the features in the transformed space. To evaluate the performance of the ANFIS system for speech/music discrimination, comparison to other commonly used classifiers is reported. The classification results for different types of music and speech signals show the good discriminating power of the proposed approach.     

Classification capacity of a modular neural network implementing neurally inspired architecture and training rules

A three-layer neural network (NN) with novel adaptive architecture has been developed. The hidden layer of the network consists of slabs of single neuron models, where neurons within a slab-but not between slabs- have the same type of activation function. The network activation functions in all three layers have adaptable parameters. The network was trained using a biologically inspired, guided-annealing learning rule on a variety of medical data. Good training/testing classification performance was obtained on all data sets tested. The performance achieved was comparable to that of SVM classifiers. It was shown that the adaptive network architecture, inspired from the modular organization often encountered in the mammalian cerebral cortex, can benefit classification performance.     

Combined neural network model employing wavelet coefficients for EEG signals classification

This paper illustrates the use of combined neural network model to guide model selection for classification of electroencephalogram (EEG) signals. The EEG signals were decomposed into time–frequency representations using discrete wavelet transform and statistical features were calculated to depict their distribution. The first-level networks were implemented for the EEG signals classification using the statistical features as inputs. To improve diagnostic accuracy, the second-level networks were trained using the outputs of the first-level networks as input data. Three types of EEG signals (EEG signals recorded from healthy volunteers with eyes open, epilepsy patients in the epileptogenic zone during a seizure-free interval, and epilepsy patients during epileptic seizures) were classified with the accuracy of 94.83% by the combined neural network. The combined neural network model achieved accuracy rates which were higher than that of the stand-alone neural network model.     

Diversity-based combination of non-parametric classifiers for EMG signal decomposition

Non-parametric classification procedures based on a certainty measure and nearest neighbour rule for motor unit potential classification (MUP) during electromyographic (EMG) signal decomposition were explored. A diversity-based classifier fusion approach is developed and evaluated to achieve improved classification performance. The developed system allows the construction of a set of non-parametric base classifiers and then automatically chooses, from the pool of base classifiers, subsets of classifiers to form candidate classifier ensembles. The system selects the classifier ensemble members by exploiting a diversity measure for selecting classifier teams. The kappa statistic is used as the diversity measure to estimate the level of agreement between base classifier outputs, i.e., to measure the degree of decision similarity between base classifiers. The pool of base classifiers consists of two kinds of classifiers: adaptive certainty-based classifiers (ACCs) and adaptive fuzzy k-NN classifiers (AFNNCs) and both utilize different types of features. Once the patterns are assigned to their classes, by the classifier fusion system, firing pattern consistency statistics for each class are calculated to detect classification errors in an adaptive fashion. Performance of the developed system was evaluated using real and simulated EMG signals and was compared with the performance of the constituent base classifiers and the performance of the fixed ensemble containing the full set of base classifiers. Across the EMG signal data sets used, the diversity-based classifier fusion approach had better average classification performance overall, especially in terms of reducing classification errors.     

Towards a comprehensive evaluation of V-I-S sub-pixel fractions and land surface temperature for urban land-use classification in the USA

Remote-sensing image classification based on the vegetation–impervious surface–soil (V-I-S) model and land-surface temperature (LST) has proved to be more efficient in characterizing the urban landscape than conventional spectral-based classification. However, current literature emphasizes discussion of the classifier's accuracy improvement achieved by the input of V-I-S fractions and LST over conventional spectral-based classification while ignoring the stability evaluation. Hence, this study proposes an evaluation framework for exploring the superiority of the input features and the stability of classifiers by integrating statistical randomization techniques and a kappa-error diagram. The evaluation framework was applied to case studies for demonstrating the superiority of V-I-S fractions and LST in the context of urban land-use classification with five different types of classifiers, including the maximum likelihood classifier (MLC), the tree classifier, the Bagging classifier, the random forest (RF) and the support vector machine (SVM). It followed that the use of V-I-S fractions and LST (1) could alleviate the ‘salt and pepper’ effect; (2) is preferred by tree and tree-based ensembles for branch splitting; (3) could produce classification trees with less complexity; (4) could benefit the stability of classifiers in addition to the accuracy improvement; and (5) could allow histograms following nearly normal distribution in its feature space, which boosts the performance of MLC. It is shown that MLC becomes comparable with modern classifiers when trained with V-I-S fractions and LST combination. Because of its adequacy and simplicity, MLC is recommended for urban land-use classification when V-I-S fractions and LST are used as the only input features. However, replacing them with, or including, the band reflectance might degrade MLC. A direct use of spectral band reflectance is not recommended for any of the classification approaches being considered in this study, except for SVM, which is the most robust classifier as it has a consistently high performance for all the input feature combinations. We recommend using tree-based ensemble classifiers or SVM when V-I-S fractions and LST as well as the band reflectance are all used in the classification. The proposed evaluation framework can also be applied to the assessment of input features and classifiers in other remote-sensing classification endeavours.     

Analysis of EEG signals by implementing eigenvector methods/recurrent neural networks

The implementation of recurrent neural network (RNN) employing eigenvector methods is presented for classification of electroencephalogram (EEG) signals. In practical applications of pattern recognition, there are often diverse features extracted from raw data which needs recognizing. Because of the importance of making the right decision, the present work is carried out for searching better classification procedures for the EEG signals. Decision making was performed in two stages: feature extraction by eigenvector methods and classification using the classifiers trained on the extracted features. The aim of the study is classification of the EEG signals by the combination of eigenvector methods and the RNN. The present research demonstrated that the power levels of the power spectral density (PSD) estimates obtained by the eigenvector methods are the features which well represent the EEG signals and the RNN trained on these features achieved high classification accuracies.     

Probabilistic neural networks combined with wavelet coefficients for analysis of electroencephalogram signals

Abstract: In this paper, the probabilistic neural network is presented for classification of electroencephalogram (EEG) signals. Decision making is performed in two stages: feature extraction by wavelet transform and classification using the classifiers trained on the extracted features. The purpose is to determine an optimum classification scheme for this problem and also to infer clues about the extracted features. The present research demonstrates that the wavelet coefficients obtained by the wavelet transform are features which represent the EEG signals well. The conclusions indicate that the probabilistic neural network trained on the wavelet coefficients achieves high classification accuracies (the total classification accuracy is 97.63%).     

Application of adaptive classification of tensotremorograms for revealing the pathological states of human motor control system

In this paper the adaptive binary classifier is applied for the classification of the tensotremorogramm (TTG) time series. The idea is to reveal pathological states of human motor control system. Adaptive binary classifier being a new type of trained classifiers can be trained on the data for healthy subjects. Then the trained classifier can be used for the examinees division into healthy and sick patients. It is shown, that the trained adaptive binary classifier is able to classify the patients with acceptable accuracy. Other method of classification-Neural Clouds-has also been used. The comparison both methods has been done.     

Nonlinear system identification of large-scale smart pavement systems

This paper proposes a novel model for predicting complex behavior of smart pavements under a variety of environmental conditions. The mathematical model is developed through an adaptive neuro fuzzy inference system (ANFIS). To evaluate the effectiveness of the ANFIS model, the temperature fluctuations at different locations in smart pavement systems equipped with pipe network systems under solar radiations is investigated. To develop the smart pavement ANFIS model, various sets of input and output field experimental data are collected from large-scale experimental test beds. The solar radiation and the inlet water flow are used as input signals for training complex behavior of the smart pavement ANFIS model, while the temperature fluctuation of the smart pavement system is used for the output signal. The trained model is validated using 20 different data sets that are not used for the training process. It is demonstrated from the simulation that the ANFIS identification approach is effective in modeling complex behavior of the pavement–fluid system under a variety of environmental conditions. Comparison with high fidelity data proves the viability of the proposed approach in pavement health monitoring setting, as well as automatic control systems.     

Recognition of human actions using CNN-GWO: a novel modeling of CNN for enhancement of classification performance

Recognizing human actions from unconstrained videos turns to be a major challenging task in computer visualization approaches due to decreased accuracy in the feature classification performance. Therefore to improve the classification performance it is essential to minimize the ‘classification’ errors. Here, in this work, we propose a hybrid CNN-GWO approach for the recognition of human actions from the unconstrained videos. The weight initializations for the proposed deep Convolutional Neural Network (CNN) classifiers highly depend on the generated solutions of GWO (Grey Wolf Optimization) algorithm, which in turn minimizes the ‘classification’ errors. The action bank and local spatio-temporal features are generated for a video and fed into the ‘CNN’ classifiers. The ‘CNN’ classifiers are trained by a gradient descent algorithm to detect a ‘local minimum’ during the fitness computation of GWO ‘search agents’. The GWO algorithms ‘global search’ capability as well as the gradient descent algorithms ‘local search’ capabilities are subjected for the identification of a solution which is nearer to the global optimum. Finally, the classification performance can be further enhanced by fusing the classifiers evidences produced by the GWO algorithm. The proposed classification frameworks efficiency for the recognition of human actions is evaluated with the help of four achievable action recognition datasets namely HMDB51, UCF50, Olympic Sports and Virat Release 2.0. The experimental validation of our proposed approach shows better achievable results on the recognition of human actions with 99.9% recognition accuracy.