Towards Incremental Fuzzy Classifiers

Fuzzy classification systems (FCS) are traditionally built from observations (data points) in an off-line one shot-experiment. Once the learning phase is exhausted, the classifier is no more capable to learn further knowledge from new observations nor is it able to update itself in the future. This paper investigates the problem of incremental learning in the context of FCS. It shows how, in contrast to off-line or batch learning, incremental learning infers knowledge in the form of fuzzy rules from data that evolves over time. To accommodate incremental learning, appropriate mechanisms are applied in all steps of the FCS construction: (1) Incremental supervised clustering to generate granules in a progressive manner, (2) Systematic and automatic update of fuzzy partitions, (3) Incremental feature selection using an incremental version of Fisher’s interclass separability criterion. The effect of incrementality on various aspects is demonstrated via a numerical evaluation.