一种基于动态小生境的自组织学习算法

提出了一种基于动态小生境的自组织学习算法(dynamic niche-based self-organizing learning algorithm,简称DNSLA),实现了基于0-1编码的动态学习机制.种群中的个体由被动适应转为主动学习,即通过系统的自组织学习而实现与环境的友好交互,因而具有更强健的动态环境适应能力,能够及时、准确地侦测到环境的变化并跟踪极值点在搜索空间内的运动轨迹,具有良好的可移植性和很强的泛化能力.一系列动态测试问题的对比仿真实验结果表明,该算法即使在剧烈动荡的环境中也能很好地与环境进行稳定而友好的交互学习,表现出了很强的鲁棒性,其动态搜索能力和极值点跟踪能力远优于同类搜索方法.     

交互学习的粒子群优化算法

分析基本的粒子群优化学习机制的缺陷,启发于人类社会不同群体之间可以交互学习的特点,提出了一种改进粒子群优化算法——ILPSO.在ILPSO算法中,粒子由2个种群构成.当2个种群中最佳的全局最优位置在连续一定的迭代次数内没有改善时,执行交互学习策略.依据每个种群的全局最优位置的适应值,运用模拟退火的机制和轮盘赌的方法确定学习种群和被学习种群.提出了一个基于适应度排序的经验公式,计算学习种群中的每个粒子向被学习种群学习的概率.为了摆脱选择压力,采用了一种速度变异的方法.多个测试函数的数值实验结果表明,IL-PSO具有较好的全局搜索能力,是一种求解复杂问题的有效方法.     

一种求解高维多模态复杂问题的差分文化算法

针对在求解高维多峰值复杂问题时种群容易陷入局部搜索、求解精度低的问题,提出了一种基于自适应差分进化算法和小生境高斯分布估计的文化算法。将差分进化算法用于种群空间的优化,利用动态小生境识别算法在种群空间中识别小生境群体。信度空间利用高斯分布估计算法在小生境内进行局部优化,并将小生境特征存入进化知识库,进化知识库进一步引导种群空间,有效地保证了种群的多样性,避免了局部的重复搜索。最后,通过仿真实验测试表明,算法具有收敛速度快、求解精度高、稳定性高和全局搜索能力强等优势。     

适于高维空间搜索的自组织学习算法

提出了一种有别于当前优化算法框架的自组织学习算法(self-organizing learning algorithm,SLA),该算法融合遗传算法并行搜索与模拟退火串行搜索,结合粒子群学习机制和禁忌搜索机制,实现了系统与环境的交互学习,能够很好地处理传统优化方无法应对的高维非线性优化问题.SLA分自学习和互学习两个智能化学习阶段,先进行基于自学习机制的邻域禁忌搜索,保证局部极值的收敛,然后通过信息共享平台,进行基于互学习机制的广域禁忌搜索,保证全局极值的收敛.系统通过与环境交互学习而自适应地调整搜索策略和相关参数,使得搜索过程能够有效地避免盲目性,而具有相当的自组织性.最后,通过高维测试函数的对比仿真实验表明,SLA在由小型低维空间转入超大型高维空间时,仍能够与环境保持稳定,透明的交互学习,其全局搜索能力和整体稳健性明显优于其它搜索方法.     

基于共享机制的自适应混合遗传算法

共享机制小生境遗传算法常由于保持算法种群的多样性而减缓了全局收敛速度.针对共享机制的这个缺陷,提出了一种基于共享机制的自适应混合遗传算法.将熵的概念引入共享机制,提出了用以度量种群多样性的小生境熵的概念;构造了小生境半径和进化参数(交叉、变异概率)的自适应计算方法;设计了用于增强算法局部搜索寻优能力的扩展突变算子.最后实验表明,该算法对于解决多模态函数优化问题具有很好的全局搜索能力和较快的收敛速度,能够有效避免早熟收敛.     

一种面向多模函数改进的果蝇优化算法

为将果蝇优化算法有效应用在多模函数优化问题中,设计了一种优化多模函数的果蝇优化算法—基于佳点集和小生境技术的混合果蝇优化算法。首先引入数论中的佳点集概念构造初始种群,使其较均匀地分布在可行域中并且产生的模式多样性比随机分布更好,提高了算法的搜索能力及效率和稳定性;其次用小生境技术改进算法的搜索模式,更好地维持了种群的多样性使种群能快速定位较多的峰;再通过小生境熵来量化群体的多样性并选择进化方向,当小生境熵低于设定的阈值时,结合佳点搜索产生新群体给以扰动,以维持种群的多样性,否则对各个峰进行精细搜索。对七个测试函数分别进行两类仿真,结果表明,该算法不仅能够高效且高精度地找到全局极值而且能够以较高的精度定位到所有全局极值和多个次优极值,显示了较强的多峰搜索能力。     

求解高维多模优化问题的正交小生境自适应差分演化算法

针对传统优化算法在求解高维多模态优化问题时存在收敛速度慢、求解精度低的问题,提出一种基于正交设计与小生境精英策略的自适应差分进化算法ONDE。首先利用正交表产生初始种群,然后采用小生境精英策略来产生小生境种群(NP),并用小生境种群更新精英个体;接着应用拥挤裁剪避免种群陷入局部搜索,最后利用自适应差分变异算子改进了差分进化(DE)算法。通过对7个benchmark函数仿真验证,实验结果表明,算法在收敛速度、求解精度和稳定性方面都有较大优势。     

基于知识引导的自适应动态多模态差分进化算法

为充分利用问题求解过程知识,提升动态多模态优化算法的计算资源利用效率,提出一种基于知识引导的自适应动态多模态差分进化算法.首先,利用自组织映射神经网络实现种群自聚类,形成稳定的小生境;然后,通过对种群全局知识和个体邻域知识的综合学习,设计一种基于知识引导的自适应差分进化算法,在对种群进化状态进行实时监测和分析的基础上,逐层递进地引导不同种群个体自适应地选择最符合当前进化需求的变异方式,提升种群搜索效率,平衡种群多样性与收敛性;最后,针对问题动态特性,设计一种基于历史动态过程知识引导的自适应动态响应机制,通过对历史寻优经验的自适应学习,预测生成新环境下的潜在精英个体,引导种群实现精准快速的多峰定位.实验结果表明,所提出算法能够有效解决动态多模态优化问题,且在不同动态环境设置下其求解性能均优于对比算法.     

一种双种群差分蜂群算法

人工蜂群算法(ABC)是一种基于蜜蜂群智能搜索行为的随机优化算法.为了有效改善人工蜂群算法的性能,结合差分进化算法,提出一种新的双种群差分蜂群算法(BDABC).该算法首先通过基于反向学习的策略初始化种群,使得初始化的个体尽可能均匀分布在搜索空间,然后将种群中的个体随机分成两组,每组采用不同的优化策略同时进行寻优,并通过在两群体之间引入交互学习的思想,来提高算法的收敛速度.基于6个标准测试函数的仿真实验表明,BDABC算法能有效避免早熟收敛,全局优化能力和收敛速率都有显著提高.     

基于邻域重心反向学习的混合樽海鞘群蝴蝶优化算法

针对蝴蝶优化算法（BOA）收敛速度较慢和过早收敛到局部解的问题,提出一种基于邻域重心反向学习的混合樽海鞘群蝴蝶优化算法（HSSBOA）。首先,将樽海鞘群算法（SSA）引入BOA中,使算法快速处理局部搜索阶段,并更新种群位置,从而更有效地完成寻优过程,避免算法陷入局部最优;然后,引入邻域重心反向学习以便更好地帮助算法在邻域内进行小范围精确搜索,从而提高算法的精度;最后,引入动态切换概率以改善搜索中全局与局部的比重,从而加快算法的搜索速度。选取10个标准检测函数进行测试,将HSSBOA与几个先进的优化算法从收敛精度、高维度数据、收敛速度、Wilcoxon秩和检验和平均绝对误差（MAE）五个方面进行对比分析。研究结果表明,相较于其他算法,HSSBOA取得了更优的结果。消融实验进一步验证了各项改进均为正向作用。实例问题上的表现表明相较于其他方法,在求解有约束的复杂问题时,HSSBOA能够更有效地搜索出最优解。可见HSSBOA在寻优精度、稳定性和收敛效率等方面取得了一定的优势,并且能够求解复杂的现实问题。     

基于变异的Bayesian优化算法

将变异算子与Bayesian优化算法相结合，提出了一种基于变异的Bayesian优化算法。在算法中设计了一个种群多样性函数，通过此函数引入变异算子，目的是利用变异算子的邻域搜索能力，保持种群多样性，将贝叶斯概率模型提取的全局信息与变异算子的局部信息联系起来，避免陷入局部最优。仿真研究表明基于变异的Bayesian优化算法的寻优能力比Bayesian优化算法更强。     

MPBOA - A novel hybrid butterfly optimization algorithm with symbiosis organisms search for global optimization and image segmentation

The conventional Butterfly Optimization Algorithm (BOA) does not appropriately balance the exploration and exploitation characteristics of an algorithm to solve present-day challenging optimization problems. For the same, in this paper, a novel hybrid BOA (MPBOA, in short) is suggested, where the BOA is combined with mutualism and parasitism phases of the Symbiosis Organisms Search (SOS) algorithm to enhance the search behaviour (both global and local) of BOA. The mutualism phase is applied with the global phase of BOA, and the parasitism phase is added with the local phase of BOA to ensure a better trade-off between the global and local search of the proposed algorithm. A suit of twenty-five benchmark functions is employed to investigate its performance with several other state-of-the-art algorithms available in the literature. Also, to check its performance statistically, the Friedman rank test and t-test are carried out. The consistency of the proposed algorithm is tested with a boxplot diagram. Also, four real-world problems are solved to check the efficiency of the algorithm in solving industrial problems. Finally, the proposed MPBOA is utilized to obtain the optimal threshold in the multilevel thresholding problem of the segmentation of individual images. From the obtained results, it is found that the overall performance of the newly introduced MPBOA is satisfactory in terms of its search behaviour and convergence time to obtain global optima.

     

一种混沌贝叶斯优化算法

为了减少贝叶斯优化算法的计算量,该文提出了一种混沌贝叶斯优化算法。用混沌随机序列产生贝叶斯优化算法的初始群体,利用混沌随机性、遍历性和对初始条件的敏感性的特点,提供给贝叶斯网络变量空间丰富的信息,有利于建立接近最优的贝叶斯网络。为增加群体的多样性同时减少贝叶斯网络的建立次数,采用混沌搜索方法对贝叶斯网络产生的新解进行变异寻优,以此为基础再建立贝叶斯网络。实验结果表明,与贝叶斯优化算法相比,混沌贝叶斯优化算法能有效减少计算量。     

Evolutionary algorithm based on schemata theory

The stochastic schemata exploiter (SSE), which is one of the evolutionary algorithms based on schemata theory, was presented by Aizawa. The convergence speed of SSE is much faster than simple genetic algorithm. It sacrifices somewhat the global search performance. This paper describes an improved algorithm of SSE, which is named as cross-generational elitist selection SSE (cSSE). In cSSE, the use of the cross-generational elitist selection enhances the diversity of the individuals in the population and therefore, the global search performance is improved. In the numerical examples, cSSE is compared with genetic algorithm with minimum generation gap (MGG), Bayesian optimization algorithm (BOA), and SSE. The results show that cSSE has fast convergence and good global search performance.     

Holographic memory-based Bayesian optimization algorithm (HM-BOA) in dynamic environments

This paper presents a new evolutionary dynamic optimization algorithm, holographic memory-based Bayesian optimization algorithm (HM-BOA), whose objective is to address the weaknesses of sequential memory-based dynamic optimization approaches. To this end, holographic associative neural memory is applied to one of the recent successful memory-based evolutionary methods, DBN-MBOA (memory-based BOA with dynamic Bayesian networks). Holographic memory is appropriate for encoding environmental changes since its stimulus and response data are represented by a vector of complex numbers such that the phase and the magnitude denote the information and its confidence level, respectively. In the learning process in HM-BOA, holographic memory is trained by probabilistic models at every environmental change. Its weight matrix contains abstract information obtained from previous changes and is used for constructing a new probabilistic model when the environment changes. The unique features of HM-BOA are: 1) the stored information can be generalized, and 2) a small amount of memory is required for storing the probabilistic models. Experimental results adduce grounds for its effectiveness especially in random environments.     

Biasing Bayesian Optimization Algorithm using Case Based Reasoning

Studies show that application of the prior knowledge in biasing the Estimation of Distribution Algorithms (EDAs), such as Bayesian Optimization Algorithm (BOA), increases the efficiency of these algorithms significantly. One of the main advantages of the EDAs over other optimization algorithms is that the former provides a trail of probabilistic models of candidate solutions with increasing quality. Some recent studies have applied these probabilistic models, obtained from previously solved problems in biasing the BOA algorithm, to solve the future problems. In this paper, in order to improve the previous works and reduce their disadvantages, a method based on Case Based Reasoning (CBR) is proposed for biasing the BOA algorithm. Herein, after running BOA for solving optimization problems, each problem, the corresponding solution, as well as the last Bayesian network obtained from the BOA algorithm, will be stored as an entry in the case-base. Upon introducing a new problem, similar problems from the case-base are retrieved and the last Bayesian networks of these solved problems are combined according to the degree of their similarity with the new problem; hence, a compound Bayesian network is constructed. The compound Bayesian network is sampled and the initial population for the BOA algorithm is generated. This network will be applied efficiently for biasing future probabilistic models during the runs of BOA for the new problem. The proposed method is tested on three well-known combinatorial benchmark problems. Experimental results show significant improvements in algorithm execution time and quality of solutions, compared to previous methods.     

一种用于智能组卷的自适应小生境遗传算法

在采用遗传算法进行智能组卷的过程中,常出现选择策略缺乏多样性保护机制的现象,易出现早熟收敛。为解决智能组卷的早熟收敛问题,提出一种自适应小生境遗传算法。采用小生境技术可提高个体的选择概率,增加个体的多样性选择机率;在保证算法收敛速度的情况下,给出一种一致变异算子,同时调节个体的变异概率和变异范围,提高种群多样性。最后,通过具体实例验证了该算法在较短的组卷时间内,可以实现全局寻优的结果,从而证明该算法的有效性。自适应小生境遗传算法在智能组卷中的应用具有实际意义。     

Exploiting Bivariate Dependencies to Speedup Structure Learning in Bayesian Optimization Algorithm

Bayesian optimization algorithm (BOA) is one of the successful and widely used estimation of distribution algorithms (EDAs) which have been employed to solve different optimization problems. In EDAs, a model is learned from the selected population that encodes interactions among problem variables. New individuals are generated by sampling the model and incorporated into the population. Different probabilistic models have been used in EDAs to learn interactions. Bayesian network (BN) is a well-known graphical model which is used in BOA. Learning a proper model in EDAs and particularly in BOA is distinguished as a computationally expensive task. Different methods have been proposed in the literature to improve the complexity of model building in EDAs. This paper employs bivariate dependencies to learn accurate BNs in BOA efficiently. The proposed approach extracts the bivariate dependencies using an appropriate pairwise interaction-detection metric. Due to the static structure of the underlying problems, these dependencies are used in each generation of BOA to learn an accurate network. By using this approach, the computational cost of model building is reduced dramatically. Various optimization problems are selected to be solved by the algorithm. The experimental results show that the proposed approach successfully finds the optimum in problems with different types of interactions efficiently. Significant speedups are observed in the model building procedure as well.     

Interactive genetic algorithms with large population and semi-supervised learning

Interactive genetic algorithms are effective methods of solving optimization problems with implicit (qualitative) criteria by incorporating a user's intelligent evaluation into traditional evolution mechanisms. The heavy evaluation burden of the user, however, is crucial and limits their applications in complex optimization problems. We focus on reducing the evaluation burden by presenting a semi-supervised learning assisted interactive genetic algorithm with large population. In this algorithm, a population with many individuals is adopted to efficiently explore the search space. A surrogate model built with an improved semi-supervised learning method is employed to evaluate a part of individuals instead of the user to alleviate his/her burden in evaluation. Incorporated with the principles of the improved semi-supervised learning, the opportunities of applying and updating the surrogate model are determined by its confidence degree in estimation, and the informative individuals reevaluated by the user are selected according to the concept of learning from mistakes. We quantitatively analyze the performance of the proposed algorithm and apply it to the design of sunglasses lenses, a representative optimization problem with one qualitative criterion. The empirical results demonstrate the strength of our algorithm in searching for satisfactory solutions and easing the evaluation burden of the user.     

基于衰减因子和动态学习的改进樽海鞘群算法

樽海鞘群算法是一种新型的群智能优化算法.与其他智能优化算法相比,樽海鞘群算法的优化求解策略仍有待改进,以进一步提高该算法的求解精度和寻优效率.本文提出一种基于衰减因子和动态学习的改进樽海鞘群算法,通过在领导者更新阶段添加衰减因子,提高算法的局部开发能力,在跟随者更新阶段引入动态学习策略,提高算法的全局搜索能力.本文对16个测试函数进行实验,将提出的改进算法与其他智能优化算法比较,实验结果表明,本文提出的改进算法在收敛精度和收敛速度方面有较大提升,具有良好的优化性能.