A type-2 neural fuzzy system learned through type-1 fuzzy rules and its FPGA-based hardware implementation

This paper first proposes a type-2 neural fuzzy system (NFS) learned through its type-1 counterpart (T2NFS-T1) and then implements the built IT2NFS-T1 in a field-programmable gate array (FPGA) chip. The antecedent part of each fuzzy rule in the T2NFS-T1 uses interval type-2 fuzzy sets, while the consequent part uses a Takagi-Sugeno-Kang (TSK) type with interval combination weights. The T2NFS-T1 uses a simplified type-reduction operation to reduce system training time and hardware implementation cost. Given a training data set, a TSK type-1 NFS is first learned through structure and parameter learning. The built type-1 fuzzy logic system (FLS) is then extended to a type-2 FLS, where highly overlapped type-1 fuzzy sets are merged into interval type-2 fuzzy sets to reduce the total number of fuzzy sets. Finally, the rule consequent and antecedent parameters in the T2NFS-T1 are tuned using a hybrid of the gradient descent and rule-ordered recursive least square (RLS) algorithms. Simulation results and comparisons with various type-1 and type-2 FLSs verify the effectiveness and efficiency of the T2NFS-T1 for system modeling and prediction problems. A new hardware circuit using both parallel-processing and pipeline techniques is proposed to implement the learned T2NFS-T1 in an FPGA chip. The T2NFS-T1 chip reduces the hardware implementation cost in comparison to other type-2 fuzzy chips.     

Position tracking of a 3-PSP parallel robot using dynamic growing interval type-2 fuzzy neural control

Parallel robots have complicated structures as well as complex dynamic and kinematic equations, rendering model-based control approaches as ineffective due to their high computational cost and low accuracy. Here, we propose a model-free dynamic-growing control architecture for parallel robots that combines the merits of self-organizing systems with those of interval type-2 fuzzy neural systems. The proposed approach is then applied experimentally to position control of a 3-PSP (Prismatic–Spherical–Prismatic) parallel robot. The proposed rule-base construction is different from most conventional self-organizing approaches by omitting the node pruning process while adding nodes more conservatively. This helps preserve valuable historical rules for when they are needed. The use of interval type-2 fuzzy logic structure also better enables coping with uncertainties in parameters, dynamics of the robot model and uncertainties in rule space. Finally, the adaptation structure allows learning and further adapts the rule base to changing environment. Multiple simulation and experimental studies confirm that the proposed approach leads to fewer rules, lower computational cost and higher accuracy when compared with two competing type-1 and type-2 fuzzy neural controllers.     

Experimental study of intelligent controllers under uncertainty using type-1 and type-2 fuzzy logic

Uncertainty is an inherent part in control systems used in real world applications. The use of new methods for handling incomplete information is of fundamental importance. Type-1 fuzzy sets used in conventional fuzzy systems cannot fully handle the uncertainties present in control systems. Type-2 fuzzy sets that are used in type-2 fuzzy systems can handle such uncertainties in a better way because they provide us with more parameters and more design degrees of freedom. This paper deals with the design of control systems using type-2 fuzzy logic for minimizing the effects of uncertainty produced by the instrumentation elements, environmental noise, etc. The experimental results are divided in two classes, in the first class, simulations of a feedback control system for a non-linear plant using type-1 and type-2 fuzzy logic controllers are presented; a comparative analysis of the systems’ response in both cases was performed, with and without the presence of uncertainty. For the second class, a non-linear identification problem for time-series prediction is presented. Based on the experimental results the conclusion is that the best results are obtained using type-2 fuzzy systems.     

Bearing condition prediction considering uncertainty: An interval type-2 fuzzy neural network approach

Rolling-element bearings are critical components of rotating machinery. It is important to accurately predict in real-time the health condition of bearings so that maintenance practices can be scheduled to avoid malfunctions or even catastrophic failures. In this paper, an Interval Type-2 Fuzzy Neural Network (IT2FNN) is proposed to perform multi-step-ahead condition prediction of faulty bearings. Since the IT2FNN defines an interval type-2 fuzzy logic system in the form of a multi-layer neural network, it can integrate the merits of each, such as fuzzy reasoning to handle uncertainties and neural networks to learn from data. The interval type-2 fuzzy linguistic process in the IT2FNN enables the system to handle prediction uncertainties, since the type-2 fuzzy sets are such sets whose membership grades are type-1 fuzzy sets that can be used in failure prediction due to the difficult determination of an exact membership function for a fuzzy set. Noisy data of faulty bearings are used to validate the proposed predictor, whose performance is compared with that of a prevalent type-1 condition predictor called Adaptive Neuro-Fuzzy Inference System (ANFIS). The results show that better prediction accuracy can be achieved via the IT2FNN.     

Type-2 fuzzy neural networks with fuzzy clustering and differential evolution optimization

In many real-world problems involving pattern recognition, system identification and modeling, control, decision making, and forecasting of time-series, available data are quite often of uncertain nature. An interesting alternative is to employ type-2 fuzzy sets, which augment fuzzy models with expressive power to develop models, which efficiently capture the factor of uncertainty. The three-dimensional membership functions of type-2 fuzzy sets offer additional degrees of freedom that make it possible to directly and more effectively account for model’s uncertainties. Type-2 fuzzy logic systems developed with the aid of evolutionary optimization forms a useful modeling tool subsequently resulting in a collection of efficient “If-Then” rules.The type-2 fuzzy neural networks take advantage of capabilities of fuzzy clustering by generating type-2 fuzzy rule base, resulting in a small number of rules and then optimizing membership functions of type-2 fuzzy sets present in the antecedent and consequent parts of the rules. The clustering itself is realized with the aid of differential evolution.Several examples, including a benchmark problem of identification of nonlinear system, are considered. The reported comparative analysis of experimental results is used to quantify the performance of the developed networks.     

一种基于模糊神经网络的语音端点检测方法

为了提高语音端点检测的适应性和鲁棒性,提出一种基于小波分析和模糊神经网络的语音端点检测方法。利用小波变换得到语音信号的特征量,以这些特征量为模糊神经网络的输入进行运算,判断出该信号的类别。介绍了信号特征量的提取以及模糊神经网络的模型、学习算法等。实验表明,与传统的检测方法相比,所提出的方法有较好的适应性和鲁棒性,对不同信噪比的信号都有较好的检测能力。     

Modeling the permeability of carbonate reservoir using type-2 fuzzy logic systems

In this work, the use of type-2 fuzzy logic systems as a novel approach for predicting permeability from well logs has been investigated and implemented. Type-2 fuzzy logic system is good in handling uncertainties, including uncertainties in measurements and data used to calibrate the parameters. In the formulation used, the value of a membership function corresponding to a particular permeability value is no longer a crisp value; rather, it is associated with a range of values that can be characterized by a function that reflects the level of uncertainty. In this way, the model will be able to adequately account for all forms of uncertainties associated with predicting permeability from well log data, where uncertainties are very high and the need for stable results are highly desirable. Comparative studies have been carried out to compare the performance of the proposed type-2 fuzzy logic system framework with those earlier used methods, using five different industrial reservoir data. Empirical results from simulation show that type-2 fuzzy logic approach outperformed others in general and particularly in the area of stability and ability to handle data in uncertain situations, which are common characteristics of well logs data. Another unique advantage of the newly proposed model is its ability to generate, in addition to the normal target forecast, prediction intervals as its by-products without extra computational cost.     

An evolving recurrent interval type-2 intuitionistic fuzzy neural network for online learning and time series prediction

The prediction of time series has both the theoretical value and practical significance in reality. However, since the high nonlinear and noises in the time series, it is still an open problem to tackle with the uncertainties and fuzziness in the forecasting process. In this article, an evolving recurrent interval type-2 intuitionistic fuzzy neural network (eRIT2IFNN) is proposed for time series prediction and regression problems. The eRIT2IFNN employs interval type-2 intuitionistic fuzzy sets to enhance the modeling of uncertainties by intuitionistic evaluation and noise tolerance of the system. In the eRIT2IFNN, the antecedent part of each fuzzy rule is defined using intuitionistic interval type-2 fuzzy sets, and the consequent realizes the Takagi–Sugeno–Kang type fuzzy inference mechanism. In order to utilize the prior knowledge including intuitionistic information, a local internal feedback is established by feeding the rule firing strength of each rule to itself eRIT2IFNN is fully adaptive to the evolving of sequence data by online learning of structure and parameters. A modified density-based clustering is implemented for the structure learning, where both densities and membership degrees are involved to determine the fuzzy rules. Performance of eRIT2IFNN is evaluated using a set of benchmark problems and compared with existing fuzzy inference systems. Moreover, the eRIT2IFNN is tested for identification of dynamics under both noise-free and noisy environments. Finally, a group of practical financial price-tracking problems including high-frequency data of financial future, commodity future and precious metal are used for the evaluation of the proposed inference system.     

Differentiating types of muscle movements using a wavelet based fuzzy clustering neural network

Abstract: The electromyographic signals observed at the surface of the skin are the sum of many small action potentials generated in the muscle fibres. After the signals are processed, they can be used as a control source of multifunction prostheses. The myoelectric signals are represented by wavelet transform model parameters. For this purpose, four different arm movements (elbow extension, elbow flexion, wrist supination and wrist pronation) are considered in studying muscle contraction. Wavelet parameters of myoelectric signals received from the muscles for these different movements were used as features to classify the electromyographic signals in a fuzzy clustering neural network classifier model. After 1000 iterations, the average recognition percentage of the test was found to be 97.67% with clustering into 10 features. The fuzzy clustering neural network programming language was developed using Pascal under Delphi.     

A type-2 fuzzy embedded agent to realise ambient intelligence in ubiquitous computing environments

In this paper, we present a novel approach for realising the vision of ambient intelligence in ubiquitous computing environments (UCEs). This approach is based on embedding intelligent agents in UCEs. These agents use type-2 fuzzy systems which are able to handle the different sources of uncertainty and imprecision in UCEs to give a good response. We have developed a novel system for learning and adapting the type-2 fuzzy agents so that they can realise the vision of ambient intelligence by providing a seamless, unobtrusive, adaptive and responsive intelligence in the environment that supports the activities of the user. The user’s behaviours and preferences for controlling the UCE are learnt online in a non-intrusive and life long learning mode so as to control the UCE on the user’s behalf. We have performed unique experiments in which the type-2 intelligent agent has learnt and adapted online to the user’s behaviour during a stay of five days in the intelligent Dormitory (iDorm) which is a real UCE test bed. We will show how our type-2 agents can deal with the uncertainty and imprecision present in UCEs to give a very good response that outperforms the type-1 fuzzy agents while using smaller rule bases.     

Industrial applications of type-2 fuzzy sets and systems: A concise review

Data, as being the vital input of system modelling, contain dissimilar level of imprecision that necessitates different modelling approaches for proper analysis of the systems. Numbers, words and perceptions are the forms of data that has varying levels of imprecision. Existing approaches in the literature indicate that, computation of different data forms are closely linked with the level of imprecision, which the data already have. Traditional mathematical modelling techniques have been used to compute the numbers that have the least imprecision. Type-1 fuzzy sets have been used for words and type-2 fuzzy sets have been employed for perceptions where the level of imprecision is relatively high. However, in many cases it has not been easy to decide whether a solution requires a traditional approach, i.e., type-1 fuzzy approach or type-2 fuzzy approach. It has been a difficult matter to decide what types of problems really require modelling and solution either with type-1 or type-2 fuzzy approach. It is certain that, without properly distinguishing differences between the two approaches, application of type-1 and type-2 fuzzy sets and systems would probably fail to develop robust and reliable solutions for the problems of industry. In this respect, a review of the industrial applications of type-2 fuzzy sets, which are relatively novel to model imprecision has been considered in this work. The fundamental focus of the work has been based on the basic reasons of the need for type-2 fuzzy sets for the existing studies. With this purpose in mind, type-2 fuzzy sets articles have been selected from the literature using the online databases of ISI-Web of Science, ScienceDirect, SpringerLink, Informaworld, Engineering Village, Emerald and IEEE Xplore. Both the terms “type-2 fuzzy” and “application” have been searched as the main keywords in the topics of the studies to retrieve the relevant works. The analysis on the industrial applications of type-2 fuzzy sets/systems (FSs) in different topics allowed us to summarize the existing research areas and therefore it is expected be useful to prioritize future research topics. This review shows that there are still many opportunities for application of type-2 FSs for several different problem domains. Shortcomings of type-1 FSs can also be considered as an opportunity for the application of type-2 FSs in order to provide a better solution approach for industrial problems.     

Optimization of type-2 fuzzy weights in backpropagation learning for neural networks using GAs and PSO

In this paper the optimization of type-2 fuzzy inference systems using genetic algorithms (GAs) and particle swarm optimization (PSO) is presented. The optimized type-2 fuzzy inference systems are used to estimate the type-2 fuzzy weights of backpropagation neural networks. Simulation results and a comparative study among neural networks with type-2 fuzzy weights without optimization of the type-2 fuzzy inference systems, neural networks with optimized type-2 fuzzy weights using genetic algorithms, and neural networks with optimized type-2 fuzzy weights using particle swarm optimization are presented to illustrate the advantages of the bio-inspired methods. The comparative study is based on a benchmark case of prediction, which is the Mackey-Glass time series (for τ = 17) problem.     

Type-1 and type-2 fuzzy inference systems as integration methods in modular neural networks for multimodal biometry and its optimization with genetic algorithms

We describe in this paper a comparative study between fuzzy inference systems as methods of integration in modular neural networks for multimodal biometry. These methods of integration are based on techniques of type-1 fuzzy logic and type-2 fuzzy logic. Also, the fuzzy systems are optimized with simple genetic algorithms with the goal of having optimized versions of both types of fuzzy systems. First, we considered the use of type-1 fuzzy logic and later the approach with type-2 fuzzy logic. The fuzzy systems were developed using genetic algorithms to handle fuzzy inference systems with different membership functions, like the triangular, trapezoidal and Gaussian; since these algorithms can generate fuzzy systems automatically. Then the response integration of the modular neural network was tested with the optimized fuzzy systems of integration. The comparative study of the type-1 and type-2 fuzzy inference systems was made to observe the behavior of the two different integration methods for modular neural networks for multimodal biometry.     

A new gaussian noise filter based on interval type-2 fuzzy logic systems

In this paper, a new selective feedback fuzzy neural network (SFNN) based on interval type-2 fuzzy logic systems is introduced by partitioning input and output spaces and based upon which a new FLS filter is further studied. The experimental results demonstrate that this new FLS filter outperforms other filters (e.g. the mean filter and the Wiener filter) in suppressing Gaussian noise and maintaining the original structure of an image.     

A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks

In real life, information about the world is uncertain and imprecise. The cause of this uncertainty is due to: deficiencies on given information, the fuzzy nature of our perception of events and objects, and on the limitations of the models we use to explain the world. The development of new methods for dealing with information with uncertainty is crucial for solving real life problems. In this paper three interval type-2 fuzzy neural network (IT2FNN) architectures are proposed, with hybrid learning algorithm techniques (gradient descent backpropagation and gradient descent with adaptive learning rate backpropagation). At the antecedents layer, a interval type-2 fuzzy neuron (IT2FN) model is used, and in case of the consequents layer an interval type-1 fuzzy neuron model (IT1FN), in order to fuzzify the rule’s antecedents and consequents of an interval type-2 Takagi-Sugeno-Kang fuzzy inference system (IT2-TSK-FIS). IT2-TSK-FIS is integrated in an adaptive neural network, in order to take advantage the best of both models. This provides a high order intuitive mechanism for representing imperfect information by means of use of fuzzy If-Then rules, in addition to handling uncertainty and imprecision. On the other hand, neural networks are highly adaptable, with learning and generalization capabilities. Experimental results are divided in two kinds: in the first one a non-linear identification problem for control systems is simulated, here a comparative analysis of learning architectures IT2FNN and ANFIS is done. For the second kind, a non-linear Mackey-Glass chaotic time series prediction problem with uncertainty sources is studied. Finally, IT2FNN proved to be more efficient mechanism for modeling real-world problems.     

Granular type-2 membership functions: A new approach to formation of footprint of uncertainty in type-2 fuzzy sets

In this study, a new approach for the formation of type-2 membership functions is introduced. The footprint of uncertainty is formed by using rectangular type-2 fuzzy granules and the resulting membership function is named as granular type-2 membership function. This new approach provides more degrees of freedom and design flexibility in type-2 fuzzy logic systems. Uncertainties on the grades of membership functions can be represented independently for any region in the universe of discourse and free of any functional form. So, the designer could produce nonlinear, discontinuous or hybrid membership functions in granular formation and therefore could model any desired discontinuity and nonlinearity. The effectiveness of the proposed granular type-2 membership functions is firstly demonstrated by simulations done on noise corrupted Mackey–Glass time series prediction. Secondly, flexible design feature of granular type-2 membership functions is illustrated by modeling a nonlinear system having dead zone with uncertain system parameters. The simulation results show that type-2 fuzzy logic systems formed by granular type-2 membership functions have more modeling capabilities than the systems using conventional type-2 membership functions and they are more robust to system parameter changes and noisy inputs.     

Applications of type-2 fuzzy logic systems to forecasting of time-series

In this paper, we begin with a type-1 fuzzy logic system (FLS), trained with noisy data. We then demonstrate how information about the noise in the training data can be incorporated into a type-2 FLS, which can be used to obtain bounds within which the true (noisefree) output is likely to lie. We do this with the example of a one-step predictor for the Mackey–Glass chaotic time-series [M.C. Mackey, L. Glass, Oscillation and chaos in physiological control systems, Science 197 (1977) 287–280]. We also demonstrate how a type-2 FLS can be used to obtain better predictions than those obtained with a type-1 FLS.     

基于模糊熵和BP神经网络的彩色图像边缘检测

在RGB颜色空间中,分别提取R、G、B三个分量并计算R、G、B三个分量的组合V,通过引入模糊熵,构造出4个基于模糊熵的信息测度分量来定量描述彩色图像的边缘特征,并将4个测度分量组成一个整体的特征向量,计算训练图像的特征向量作为样本对BP网络进行训练,然后将训练的BP网络直接用于边缘检测。该方法充分考虑了颜色空间中各颜色分量以及它们之间的相关性;BP网络的结构和训练都比较简单;实验表明,改进方法具有较强的细节保持能力,对弱边缘具有较强的检测能力。     

模糊熵在车载环境下语音端点检测中的应用

为了提高车载噪声环境下语音端点检测的准确性,介绍了一种新的时间序列复杂性测度：模糊熵,并将其应用于语音信号的特征提取。分别以样本熵和模糊熵提取含噪语音信号的特征,使用双门限法对语音信号进行端点检测,特征门限值使用模糊C均值聚类算法和贝叶斯信息准则算法确定。仿真结果表明在车载噪声环境下与样本熵算法相比,模糊熵算法能更好地区分噪声信号和语音信号,具有更好的端点检测性能,相同环境下模糊熵算法的错误率比样本熵算法降低了16%以上。