A tuned hybrid intelligent fruit fly optimization algorithm for fuzzy rule generation and classification

Fuzzy rule-based systems (FRBSs) are well-known soft computing methods commonly used to tackle classification problems characterized by uncertainties and imprecisions. We propose a hybrid intelligent fruit fly optimization algorithm (FOA) to generate and classify fuzzy rules and select the best rules in a fuzzy if–then rule system. We combine a FOA and a heuristic algorithm in a hybrid intelligent algorithm. The FOA is used to create, evaluate and update triangular fuzzy rule-based and orthogonal fuzzy rule-based systems. The heuristic algorithm is used to calculate the certainty grade of the rules. The parameters in the proposed hybrid algorithm are tuned using the Taguchi method. An experiment with 27 benchmark datasets and a tenfold cross-validation strategy is designed and carried out to compare the proposed hybrid algorithm with nine different FRBSs. The results show that the hybrid algorithm proposed in this study is significantly more accurate than the nine competing FRBSs.

     

Hybrid identification of fuzzy rule‐based models

In this study, we propose a hybrid identification algorithm for a class of fuzzy rule‐based systems. The rule‐based fuzzy modeling concerns structure optimization and parameter identification using the fuzzy inference methods and hybrid structure combined with two methods of optimization theories for nonlinear systems. Two types of inference methods of a fuzzy model concern a simplified and linear type of inference. The proposed hybrid optimal identification algorithm is carried out using a combination of genetic algorithms and an improved complex method. The genetic algorithms determine initial parameters of the membership function of the premise part of the fuzzy rules. In the sequel, the improved complex method (being in essence a powerful auto‐tuning algorithm) leads to fine‐tuning of the parameters of the respective membership functions. An aggregate performance index with a weighting factor is proposed in order to achieve a balance between performance of the fuzzy model obtained for the training and testing data. Numerical examples are included to evaluate the performance of the proposed model. They are also contrasted with the performance of the fuzzy models existing in the literature. © 2002 John Wiley & Sons, Inc.     

Identification of control chart patterns using wavelet filtering and robust fuzzy clustering

This paper proposes a hybrid framework composed of filtering module and clustering module to identify six common types of control chart patterns, including natural pattern, cyclic pattern, upward shift, downward shift, upward trend, and downward trend. In particular, a multi-scale wavelet filter is designed for denoising and its performance is compared to single-scale filters, including mean filter and exponentially weighted moving average (EWMA) filter. Moreover, three fuzzy clustering algorithms, based on fuzzy c means (FCM), entropy fuzzy c means (EFCM) and kernel fuzzy c means (KFCM), are adopted to compare their performance of pattern classification. Experimental results demonstrate that the excellent performance of EFCM and KFCM against outliers, especially in the case of high noise level embedded in the input data. Therefore, a hybrid framework combining wavelet filter with robust fuzzy clustering is suggested and proposed in this paper. Compared to neural network based approaches, the proposed method provides a promising way for the on-line recognition of control chart patterns because of its efficient computation and robustness against outliers.     

The design of a fuzzy system shell using a database approach

This study presented a prototype of fuzzy system shell called FuzzyAccess. Using Microsoft Access database as a developing tools, the proposed system provided a friendly interface for user self-building a fuzzy system. A novice who has no programming-knowledge can also self-define a new fuzzy project. The main contributions of the proposed system were that using SQL method to search the candidate rules in rule evaluation stage and providing an integrated tuning interface for system adjustment. The SQL method can significantly reduce the search time in rule evaluation. The integrated tuning interface can assist user quickly inspecting the influence among different system parameters adjustment and reducing the system development time.     

A Novel Approach for Linguistic Group Decision Making Based on Generalized Interval‐Valued Intuitionistic Fuzzy Linguistic Induced Hybrid Operator and TOPSIS

In the multiple attribute linguistic group decision making analysis with interval‐valued intuitionistic fuzzy linguistic information, seeking highly efficient aggregation method and order relation play a crucial role. In this paper, we redefine an interval‐valued intuitionistic fuzzy linguistic variable that considers principal component and propose generalized interval‐valued intuitionistic fuzzy linguistic induced hybrid aggregation (GIVIFLIHA) operator with entropic order‐inducing variable and interval‐valued intuitionistic fuzzy linguistic technique for order preference by similarity to an ideal solution (TOPSIS) order relation based on interval‐valued intuitionistic fuzzy linguistic distance measure. Then, some primary properties of the GIVIFLIHA operator are discussed, and a linguistic group decision‐making approach based on GIVIFLIHA operator and interval‐valued intuitionistic fuzzy linguistic TOPSIS order relation is proposed. Finally, a numerical example concerning the investment strategy is given to illustrate the validity and applicability of the proposed method, and then the method is compared with the existing method to further illustrate its flexibility.     

Robust adaptive fuzzy controller for non‐affine nonlinear systems with dynamic rule activation

This paper describes the design of a robust adaptive fuzzy controller for an uncertain single‐input single‐output nonlinear dynamical systems. While most recent results on fuzzy controllers considers affine systems with fixed rule‐base fuzzy systems, we propose a control scheme for non‐affine nonlinear systems and a dynamic fuzzy rule activation scheme in which an appropriate number of the fuzzy rules are chosen on‐line. By using the proposed scheme, we can reduce the computation time, storage space, and dynamic order of the adaptive fuzzy system without significant performance degradation. The Lyapunov synthesis approach is used to guarantee a uniform ultimate boundedness property for the tracking error, as well as for all other signals in the closed loop. No a priori knowledge of an upper bounds on the uncertainties is required. The theoretical results are illustrated through a simulation example. Copyright © 2002 John Wiley & Sons, Ltd.     

基于知识库的开放领域问答系统

问答系统能够理解用户问题,并直接返回答案。现有问答系统大多是面向领域的,仅能回答特定领域的问题。文中提出了基于大规模知识库的开放领域问答系统实现方法。该系统首先采用自定义词典分词和CRF模型相结合的方法识别问句中的主体;其次,采用模糊匹配方法将问句中的主体与知识库中实体建立链接;然后,通过相似度计算以及规则匹配等多种方法识别问句中的谓词并与知识库实体的属性建立关联;最后,进行实体消歧和答案获取。该系统平均F-Measure值为0.695 6,表明所提方法在基于知识库的开放领域问答上具有可行性。     

Hybrid recommendations for mobile commerce based on mobile phone features

Mobile data communications have evolved as the number of third generation (3G) subscribers has increased. The evolution has triggered an increase in the use of mobile devices, such as mobile phones, to conduct mobile commerce and mobile shopping on the mobile web. There are fewer products to browse on the mobile web; hence, one‐to‐one marketing with product recommendations is important. Typical collaborative filtering (CF) recommendation systems make recommendations to potential customers based on the purchase behaviour of customers with similar preferences. However, this method may suffer from the so‐called sparsity problem, which means there may not be sufficient similar users because the user‐item rating matrix is sparse. In mobile shopping environments, the features of users' mobile phones provide different functionalities for using mobile services; thus, the features may be used to identify users with similar purchase behaviour. In this paper, we propose a mobile phone feature (MPF)‐based hybrid method to resolve the sparsity issue of the typical CF method in mobile environments. We use the features of mobile phones to identify users' characteristics and then cluster users into groups with similar interests. The hybrid method combines the MPF‐based method and a preference‐based method that uses association rule mining to extract recommendation rules from user groups and make recommendations. Our experiment results show that the proposed hybrid method performs better than other recommendation methods.     

A fuzzy vector valued KNN-algorithm for automatic outlier detection

The K nearest neighbors approach is a viable technique in time series analysis when dealing with ill-conditioned and possibly chaotic processes. Such problems are frequently encountered in, e.g., finance and production economics. More often than not, the observed processes are distorted by nonnormal disturbances, incomplete measurements, etc. that undermine the identification, estimation and performance of multivariate techniques. If outliers can be duly recognized, many crisp statistical techniques may perform adequately as such. Geno-mathematical programming provides a connection between statistical time series theory and fuzzy regression models that may be utilized e.g., in the detection of outliers. In this paper we propose a fuzzy distance measure for detecting outliers via geno-mathematical parametrization. Fuzzy KNN is connected as a linkable library to the genetic hybrid algorithm (GHA) of the author, in order to facilitate the determination of the LR-type fuzzy number for automatic outlier detection in time series data. We demonstrate that GHA[Fuzzy KNN] provides a platform for automatically detecting outliers in both simulated and real world data.     

Fuzzy logic-based formulation of the organizer of intelligent robotic systems

A fuzzy logic-based methodology is proposed to model the organization level of an intelligent robotic system. The user input commands to the system organizer are linguistic in nature and the primitive events-tasks from the task domain of the system are, in general, interpreted via fuzzy sets. Fuzzy relations are introduced to connect every event with a specific user input command. Approximate reasoning is accomplished via a modifier and the compositional rule of inference, whereas the application of the conjunction rule generates those fuzzy sets with elements all possible (crisp) plans. Themost possible plan among all those generated, that is optimal under an application dependent criterion, is chosen and communicated to the coordination level. Off-line feedback information from the lower levels is considered asa-priori known and is used to update all organization level information. An example demonstrates the applicability of the proposed algorithm to intelligent robotic systems.     

GenSoFNN: a generic self-organizing fuzzy neural network

Existing neural fuzzy (neuro-fuzzy) networks proposed in the literature can be broadly classified into two groups. The first group is essentially fuzzy systems with self-tuning capabilities and requires an initial rule base to be specified prior to training. The second group of neural fuzzy networks, on the other hand, is able to automatically formulate the fuzzy rules from the numerical training data. No initial rule base needs to be specified prior to training. A cluster analysis is first performed on the training data and the fuzzy rules are subsequently derived through the proper connections of these computed clusters. However, most existing neural fuzzy systems (whether they belong to the first or second group) encountered one or more of the following major problems. They are (1) inconsistent rule-base; (2) heuristically defined node operations; (3) susceptibility to noisy training data and the stability-plasticity dilemma; and (4) needs for prior knowledge such as the number of clusters to be computed. Hence, a novel neural fuzzy system that is immune to the above-mentioned deficiencies is proposed in this paper. This new neural fuzzy system is named the generic self-organizing fuzzy neural network (GenSoFNN). The GenSoFNN network has strong noise tolerance capability by employing a new clustering technique known as discrete incremental clustering (DIC). The fuzzy rule base of the GenSoFNN network is consistent and compact as GenSoFNN has built-in mechanisms to identify and prune redundant and/or obsolete rules. Extensive simulations were conducted using the proposed GenSoFNN network and its performance is encouraging when benchmarked against other neural and neural fuzzy systems.     

Additive Fuzzy Systems: From Generalized Mixtures to Rule Continua

A generalized probability mixture density governs an additive fuzzy system. The fuzzy system's if‐then rules correspond to the mixed probability densities. An additive fuzzy system computes an output by adding its fired rules and then averaging the result. The mixture's convex structure yields Bayes theorems that give the probability of which rules fired or which combined fuzzy systems fired for a given input and output. The convex structure also results in new moment theorems and learning laws and new ways to both approximate functions and exactly represent them. The additive fuzzy system itself is just the first conditional moment of the generalized mixture density. The output is a convex combination of the centroids of the fired then‐part sets. The mixture's second moment defines the fuzzy system's conditional variance. It describes the inherent uncertainty in the fuzzy system's output due to rule interpolation. The mixture structure gives a natural way to combine fuzzy systems because mixing mixtures yields a new mixture. A separation theorem shows how fuzzy approximators combine with exact Watkins‐based two‐rule function representations in a higher‐level convex sum of the combined systems. Two mixed Gaussian densities with appropriate Watkins coefficients define a generalized mixture density such that the fuzzy system's output equals any given real‐valued function if the function is bounded and not constant. Statistical hill‐climbing algorithms can learn the generalized mixture from sample data. The mixture structure also extends finite rule bases to continuum‐many rules. Finite fuzzy systems suffer from exponential rule explosion because each input fires all their graph‐cover rules. The continuum system fires only a special random sample of rules based on Monte Carlo sampling from the system's mixture. Users can program the system by changing its wave‐like meta‐rules based on the location and shape of the mixed densities in the mixture. Such meta‐rules can help mitigate rule explosion. The meta‐rules grow only linearly with the number of mixed densities even though the underlying fuzzy if‐then rules can have high‐dimensional if‐part and then‐part fuzzy sets.     

A hybrid approach to outlier detection in the offset lithographic printing process

Artificial neural networks are used to model the offset printing process aiming to develop tools for on-line ink feed control. Inherent in the modelling data are outliers owing to sensor faults, measurement errors and impurity of materials used. It is fundamental to identify outliers in process data in order to avoid using these data points for updating the model. We present a hybrid, the process-model-network-based technique for outlier detection. The outliers can then be removed to improve the process model. Several diagnostic measures are aggregated via a neural network to categorize data points into the outlier and inlier classes. We demonstrate experimentally that a soft fuzzy expert can be configured to label data for training the categorization of neural network.     

基于行为的UUV推进操纵系统异常辨识方法研究

在感知系统正常工作情况下，从行为学的角度出发，对UUV推进操纵系统异常进行辨识。根据UUV动力学方程设计滑模观测器，与传感器获得的信息进行实时比较，监测系统是否发生异常；当推进操作系统发生异常时，根据根据传感器实时获得的UUV位姿速度信息和推进操纵系统空间分布特点，从辨识行为库中匹配特定的辨识行为，实现对异常点的准确定位，再按照设计的模糊规则得到推进操纵系统异常点的危害程度，以采取相应的应急措施。最后，结合UUV右主推及卡舵异常情况，对基于行为的推进操纵系统异常辨识、异常点定位及异常级别判定方法进行了仿真验证。     

SIGNIFICANT FUZZY RULES EXTRACTION BY AN SVD–QR-BASED APPROACH

ABSTRACT

In this article, an SVD–QR-based approach is proposed to extract the important fuzzy rules from a rule base with several fuzzy rule tables to design an appropriate fuzzy system directly from some input-output data of the identified system. A fuzzy system with fuzzy rule tables is defined to approach the input-output pairs of an identified system. In the rule base of the defined fuzzy system, each fuzzy rule table corresponds to a partition of an input space. In order to extract the important fuzzy rules from the rule base of the defined fuzzy system, a firing strength matrix determined by the membership functions of the premise fuzzy sets is constructed. According to the firing strength matrix, the number of important fuzzy rules is determined by the Singular Value Decomposition SVD, and the important fuzzy rules are selected by the SVD–QR-based method. Consequently, a reconstructed fuzzy rule base composed of significant fuzzy rules is determined by the firing strength matrix. Furthermore, the recursive least-squares method is applied to determine the consequent part of the reconstructed fuzzy system according to the gathered input-output data so that a fine fuzzy system is determined by the proposed method. Finally, three nonlinear systems illustrate the efficiency of the proposed method.     

A hybrid learning algorithm with a similarity-based pruning strategy for self-adaptive neuro-fuzzy systems

An algorithm for the generation of a TS-type neuro-fuzzy system is presented. There are two stages in the generation: in the first stage, an initial structure adapted from an empty neuron or fuzzy rule set, based on the geometric growth criterion and the -completeness of fuzzy rules; in the second stage, the obtained initial structure is refined by a hybrid learning algorithm based on backpropagation and a proposed recursive weight learning algorithm to minimize the system error. The similarity analysis applied throughout the entire learning process attempts both to alleviate overlap among membership functions and to reduce the complexity of the obtained system. Benchmark examples, comparing the proposed algorithm with previous approaches, show the proposed algorithm is more effective in terms of both model accuracy and compactness.     

Adaptive fuzzy learning control for a class of nonlinear dynamic systems

This paper presents an adaptive iterative learning control scheme that is applicable to a class of nonlinear systems. The control scheme guarantees system stability and boundedness by using the feedback controller coupled with the fuzzy compensator and achieves precise tracking by using the iterative learning rules. In the feedback plus fuzzy compensator unit, the feedback control part stabilizes the overall closed‐loop system and keeps its error bounded, and the fuzzy compensator estimates and compensates for the nonlinear part of the system, thereby keeping the feedback gains reasonably low in the feedback controller. The fuzzy compensator is designed by applying the fuzzy approximation technique to the uncertain nonlinear term to be compensated. In the iterative learning controller, a simple learning control rule is used to achieve precise tracking of the reference signal and a parameter learning algorithm is used to update the parameters in the fuzzy compensator so as to identify the uncertain nonlinearity as much as possible. © 2000 John Wiley & Sons, Inc.     

Personalization and user verification in wearable systems using biometric walking patterns

In this article, a novel technique for user’s authentication and verification using gait as a biometric unobtrusive pattern is proposed. The method is based on a two stages pipeline. First, a general activity recognition classifier is personalized for an specific user using a small sample of her/his walking pattern. As a result, the system is much more selective with respect to the new walking pattern. A second stage verifies whether the user is an authorized one or not. This stage is defined as a one-class classification problem. In order to solve this problem, a four-layer architecture is built around the geometric concept of convex hull. This architecture allows to improve robustness to outliers, modeling non-convex shapes, and to take into account temporal coherence information. Two different scenarios are proposed as validation with two different wearable systems. First, a custom high-performance wearable system is built and used in a free environment. A second dataset is acquired from an Android-based commercial device in a ‘wild’ scenario with rough terrains, adversarial conditions, crowded places and obstacles. Results on both systems and datasets are very promising, reducing the verification error rates by an order of magnitude with respect to the state-of-the-art technologies.     

A parsimony fuzzy rule-based classifier using axiomatic fuzzy set theory and support vector machines

This paper proposes a classification method that is based on easily interpretable fuzzy rules and fully capitalizes on the two key technologies, namely pruning the outliers in the training data by SVMs (support vector machines), i.e., eliminating the influence of outliers on the learning process; finding a fuzzy set with sound linguistic interpretation to describe each class based on AFS (axiomatic fuzzy set) theory. Compared with other fuzzy rule-based methods, the proposed models are usually more compact and easily understandable for the users since each class is described by much fewer rules. The proposed method also comes with two other advantages, namely, each rule obtained from the proposed algorithm is simply a conjunction of some linguistic terms, there are no parameters that are required to be tuned. The proposed classification method is compared with the previously published fuzzy rule-based classifiers by testing them on 16 UCI data sets. The results show that the fuzzy rule-based classifier presented in this paper, offers a compact, understandable and accurate classification scheme. A balance is achieved between the interpretability and the accuracy.