A self-adaptive synthetic over-sampling technique for imbalanced classification

Traditionally, in supervised machine learning, (a significant) part of the available data (usually 50%-80%) is used for training and the rest—for validation. In many problems, however, the data are highly imbalanced in regard to different classes or does not have good coverage of the feasible data space which, in turn, creates problems in validation and usage phase. In this paper, we propose a technique for synthesizing feasible and likely data to help balance the classes as well as to boost the performance in terms of confusion matrix as well as overall. The idea, in a nutshell, is to synthesize data samples in close vicinity to the actual data samples specifically for the less represented (minority) classes. This has also implications to the so-called fairness of machine learning. In this paper, we propose a specific method for synthesizing data in a way to balance the classes and boost the performance, especially of the minority classes. It is generic and can be applied to different base algorithms, for example, support vector machines, k-nearest neighbour classifiers deep neural, rule-based classifiers, decision trees, and so forth. The results demonstrated that (a) a significantly more balanced (and fair) classification results can be achieved and (b) that the overall performance as well as the performance per class measured by confusion matrix can be boosted. In addition, this approach can be very valuable for the cases when the number of actual available labelled data is small which itself is one of the problems of the contemporary machine learning.     

基于支持向量机的多类分类研究

现今流行的分类方法的重要基础是传统的统计学，前提是要有足够的样本，当样本数目有限时容易出现过学习的问题，导致分类效果不理想。引入支持向量机方法，它基于统计学习理论，采用了结构风险最小化原则代替经验风险最小化原则，较好的解决了小样本学习的问题；又由于采用了核函数思想，把非线性空间的问题转换到线性空间，降低了算法的复杂度。对其相关内容包括优化算法及多类分类问题的解决进行了研究，最后用一个实例说明了该方法的可行性和有效性。     

一种基于几何分布的新支持向量机多分类方法

二叉树支持向量机是多分类问题的一种有效方法,然而分类的效果与二叉树的结构密切相关。获得更好的分类效果和更高的效率,要使得二叉树高度尽量小而两个子类尽量易分。距离通常用来衡量两个类的分离程度,但不能反映类的分布情况。考虑到多分类中类的分布,文中定义新的分离度和相似度来衡量两个类的分离度,并且提出了一中新的基于几何分布二叉树支持向量机多分类算法,该方法使得二叉树高度尽量小而两个子类尽量易分。实验表明该方法具有较高的分类准确率和效率。     

基于深度学习与不平衡样本集的输电线路故障分类

针对输电线路各类型故障样本间的数量不平衡会造成人工智能算法对故障中的少数类样本识别精度不足的问题,提出了一种基于Borderline-SMOTE（BSMOTE）算法与卷积神经网络（CNN）相结合的输电线路故障分类方法。该方法首先利用BSMOTE算法对位于分类边界上的少数类样本进行过采样合成处理,改善样本间的不平衡度,然后将所提取的一维故障电流信号样本重构成二维灰度图像数据形式,并在Pytorch深度学习框架下搭建了CNN网络模型,利用模型的自主学习能力对灰度图像进行特征自提取与辨识,减少传统人工设计特征提取的工序,完成对输电线路故障类型的分类。实验结果表明该模型能够提高对少数类故障样本的识别能力,准确地判断故障类型,并对噪音具有较强的抗干扰能力。     

不平衡数据的集成分类算法综述

集成学习是通过集成多个基分类器共同决策的机器学习技术,通过不同的样本集训练有差异的基分类器,得到的集成分类器可以有效地提高学习效果。在基分类器的训练过程中,可以通过代价敏感技术和数据采样实现不平衡数据的处理。由于集成学习在不平衡数据分类的优势,针对不平衡数据的集成分类算法得到广泛研究。详细分析了不平衡数据集成分类算法的研究现状,比较了现有算法的差异和各自存在的优点及问题,提出和分析了有待进一步研究的问题。     

The clustering-based case-based reasoning for imbalanced business failure prediction: a hybrid approach through integrating unsupervised process with supervised process

Case-based reasoning (CBR) is one of the main forecasting methods in business forecasting, which performs well in prediction and holds the ability of giving explanations for the results. In business failure prediction (BFP), the number of failed enterprises is relatively small, compared with the number of non-failed ones. However, the loss is huge when an enterprise fails. Therefore, it is necessary to develop methods (trained on imbalanced samples) which forecast well for this small proportion of failed enterprises and performs accurately on total accuracy meanwhile. Commonly used methods constructed on the assumption of balanced samples do not perform well in predicting minority samples on imbalanced samples consisting of the minority/failed enterprises and the majority/non-failed ones. This article develops a new method called clustering-based CBR (CBCBR), which integrates clustering analysis, an unsupervised process, with CBR, a supervised process, to enhance the efficiency of retrieving information from both minority and majority in CBR. In CBCBR, various case classes are firstly generated through hierarchical clustering inside stored experienced cases, and class centres are calculated out by integrating cases information in the same clustered class. When predicting the label of a target case, its nearest clustered case class is firstly retrieved by ranking similarities between the target case and each clustered case class centre. Then, nearest neighbours of the target case in the determined clustered case class are retrieved. Finally, labels of the nearest experienced cases are used in prediction. In the empirical experiment with two imbalanced samples from China, the performance of CBCBR was compared with the classical CBR, a support vector machine, a logistic regression and a multi-variant discriminate analysis. The results show that compared with the other four methods, CBCBR performed significantly better in terms of sensitivity for identifying the minority samples and generated high total accuracy meanwhile. The proposed approach makes CBR useful in imbalanced forecasting.     

半监督学习在不平衡样本集分类中的应用研究

在对不平衡样本集进行分类时容易产生少数类样误差大的问题,而目前半监督学习中的算法多数是针对未有明显此类特征的数据集。针对一种半监督协同分类算法在该问题上的有效性进行了研究。由于进一步增强了分类器差异性,该算法在理论上对不平衡样本集具有良好的分类性能。根据该算法建立分类模型,利用其对桥梁结构健康数据进行分类实验,与Tri-Training算法的结果比较表明,该算法对不平衡样本集具有良好的适用性,从而验证了上述算法的有效性。     

基于稀疏表征多分类器融合的遮挡人脸识别

为了同时利用人脸局部信息, 提出一种基于稀疏表征多分类器融合的遮挡人脸识别方法。先对人脸进行多分辨率分块, 求取并根据各子块稀疏表征分类器的识别率确定其权重, 计算其后验概率估值, 最终利用加权融合准则进行多分类器融合识别。在AR和YaleA库的实验结果表明, 该算法结果比稀疏表征遮挡人脸识别的效果更好, 鲁棒性更高。     

基于KPCA和SVM的火箭发动机试验台故障诊断方法

为了解决液体火箭发动机试验台的故障诊断问题,提出了一种基于核主元分析(KPCA)特征提取和支持向量多分类机(SVM)的故障诊断方法,该方法首先利用核主元分析对试验台标准故障样本进行特征提取,通过特征分析,建立适合于试验台故障状态识别的层次多分类支持向量机,并对其进行训练,然后将试验数据在主元上投影,输入到训练好的支持向量多分类器,对试验台故障状态进行识别.该方法充分利用了核主元分析强大的非线性特征提取能力和支持向量分类机良好的小样本泛化特性,解决了试验台故障诊断中的小样本、非线性模式识别问题.对试验台的试验结果表明,该方法是有效的、可行的.     

基于多分类SVM的图像情感分类研究

依据基于二叉树思想的多分类支持向量机算法,进行了天气图像的情感分类方法的研究。通过定性分析和计算对比,确定了图像情感分类的可行算法和合理参数选取方法。结果表明,完全二叉决策树SVM算法对于天气图像的情感识别具有较理想的效果。