Adaptive three-dimensional cellular genetic algorithm for balancing exploration and exploitation processes

This paper presents a new adaptive algorithm that aims to control the exploration/exploitation trade-off dynamically. The algorithm is designed based on three-dimensional cellular genetic algorithms (3D-cGAs). In this study, our methodology is based on the change in the global selection pressure induced by dynamic tuning of the local selection rate. The parameter tuning of the local selection method is a way to define the global selection pressure. A diversity speed measure is used to guide the algorithm. Therefore, the integration of existing techniques helps in achieving our aims. A benchmark of well-known continuous test functions and real world problems was selected to investigate the effectiveness of the algorithm proposed. In addition, we provide a comparison between the proposed algorithm and other static and dynamic algorithms in order to study the different effects on the performance of the algorithms. Overall, the results show that the proposed algorithm provides the most desirable performance in terms of efficiency, efficacy, and speed for most problems considered. The results also confirm that problems of various characteristics require different selection pressures, which are difficult to be identified.     

基于目标空间划分的自适应多目标进化算法

目前,多目标进化算法在众多领域具有极高的应用价值,是优化领域的研究热点之一.分析已有多目标进化算法在保持种群多样性方面的不足并提出一种基于解空间划分的自适应多目标进化算法（space division basedadaptive multiobjective evolutionary algorithm,简称SDA-MOEA）来解决多目标优化问题.该方法首先将多目标优化问题的解空间划分为大量子空间,在算法进化过程中,每个子空间都保留一个非支配解集,以保证种群的多样性.另外,该方法根据每个子空间推进种群前进的距离,自适应地为每个子空间分配进化机会,以提高种群的进化速度.最后,利用3组共14个多目标优化问题检验SDA-MOEA的性能,并将SDA-MOEA与其他5个已有多目标进化算法进行对比分析.实验结果表明：在10个问题上,算法SDA-MOEA显著优于其他对比算法.     

基于向量角分解的高维多目标进化算法

选择是进化的主要驱动力,也是多目标进化算法的关键特征,然而,在处理高维多目标问题时,随着目标维数的增加种群的收敛性和分布性的冲突加剧,传统多目标进化算法中的选择算子已难以有效地维持种群的收敛性与分布性之间的平衡.针对该问题,提出一种基于向量角分解的高维多目标进化算法.首先,将个体本身作为参考向量,利用目标向量之间的夹角作为个体的相似度测度估计种群分布性,以减轻算法预先指定权重向量的负担;然后,利用成绩标量函数作为个体的收敛性测度,该收敛测度在引导种群走向Pareto最优前沿方面发挥着重要作用;最后,提出一种基于向量角分解的精英选择策略,其在环境选择过程中利用向量角信息将目标空间动态分解,并利用成绩标量函数从分布性较好的区域中挑选较好的个体进入下一代,能够动态地平衡种群的收敛性和分布性.对比实验结果表明,所提出算法具有较强的竞争力,其在保持种群分布性的同时具有足够的选择压力,能够有效地引导高维目标空间的搜索.     

Genetic diversity as an objective in multi-objective evolutionary algorithms

A key feature of an efficient and reliable multi-objective evolutionary algorithm is the ability to maintain genetic diversity within a population of solutions. In this paper, we present a new diversity-preserving mechanism, the Genetic Diversity Evaluation Method (GeDEM), which considers a distance-based measure of genetic diversity as a real objective in fitness assignment. This provides a dual selection pressure towards the exploitation of current non-dominated solutions and the exploration of the search space. We also introduce a new multi-objective evolutionary algorithm, the Genetic Diversity Evolutionary Algorithm (GDEA), strictly designed around GeDEM and then we compare it with other state-of-the-art algorithms on a well-established suite of test problems. Experimental results clearly indicate that the performance of GDEA is top-level.     

A niche-elimination operation based NSGA-III algorithm for many-objective optimization

Decomposition-based multi-objective evolutionary algorithms have been found to be very promising for many-objective optimization. The recently presented non-dominated sorting genetic algorithm III (NSGA-III) employs the decomposition idea to efficiently promote the population diversity. However, due to the low selection pressure of the Pareto-dominance relation the convergence of NSGA-III could still be improved. For this purpose, an improved NSGA-III algorithm based on niche-elimination operation (we call it NSGA-III-NE) is proposed. In the proposed algorithm, an adaptive penalty distance (APD) function is presented to consider the importance of convergence and diversity in the different stages of the evolutionary process. Moreover, the niche-elimination operation is designed by exploiting the niching technique and the worse-elimination strategy. The niching technique identifies the most crowded subregion, and the worse-elimination strategy finds and further eliminates the worst individual. The proposed NSGA-III-NE is tested on a number of well-known benchmark problems with up to fifteen objectives and shows the competitive performance compared with five state-of-the-art decomposition-based algorithms. Additionally, a vector angle based selection strategy is also proposed for handling irregular Pareto fronts.     

基于聚类排序选择方法的进化算法

为提高进化算法的效率,提出了聚类排序选择方法。主要工作有:(1)提出了新的种群内个体相似度度量,并使用种群所包含不同簇的数量来描述和度量种群的多样性;(2)为解决早熟问题提出了新的基于种群聚类和排序选择的聚类-排序选择方法;(3)导出了选择压力-种群多样性(SP-PD)方程,该方程能描述进化过程中选择压力随种群多样性变化的规律。在基于全面学习粒子群算法环境中作了详实的实验,对16个多峰函数进行了优化。实验结果表明,在10维和30维条件下,在15个函数优化中,新方法明显优于指数排序选择方法,最高能使精度提高4个数量级。     

多样性指导进化算法及其在机器人路径规划中的应用

通过分析及结合机器人路径规划的进化编程仿真实验发现，保存最优个体或淘汰最差个体都会引起进化算法早熟现象，而种群多样性无疑在进化算法中扮演着关键角色。虽然多样性已经用于分析算法中，但是很少用于指导搜索。多样性指导进化算法使用了众所周知的到平均点距离法使变异期与杂交期交替出现。多样性指导进化算法在机器人路径规划问题中展现出显著的结果，与用适应值比较的简单进化算法有着重大的区别。     

采用放松支配关系的高维多目标微分进化算法

为了提高进化算法在求解高维多目标优化问题时的收敛性和多样性,提出了采用放松支配关系的高维多目标微分进化算法。该算法采用放松的Pareto支配关系,以增加个体的选择压力;采用群体和外部存储器协同进化的方案,并通过混合微分变异算子,生成子代群体;采用基于指标的方法计算个体的适应度并对群体进行更新;采用基于Lp范数（0相似文献   

A many-objective evolutionary algorithm based on a projection-assisted intra-family election

In recent years, many researchers have put emphasis on the study of how to keep a good balance between convergence and diversity in many-objective optimization. This paper proposes a new many-objective evolutionary algorithm based on a projection-assisted intra-family election. In the proposed algorithm, basic evolution directions are adaptively generated according to the current population and potential evolution directions are excavated in each individual's family. Based on these evolution directions, a strategy of intra-family election is performed in every family and elite individuals are elected as representatives of the specific family to join the next stage, which can enhance the convergence of the algorithm. Moreover, a selection procedure based on angles is used to maintain the diversity. The performance of the proposed algorithm is verified and compared with several state-of-the-art many-objective evolutionary algorithms on a variety of well-known benchmark problems ranging from 5 to 20 objectives. Empirical results demonstrate that the proposed algorithm outperforms other peer algorithms in terms of both the diversity and the convergence of the final solutions set on most of the test instances. In particular, our proposed algorithm shows obvious superiority when handling the problems with larger number of objectives.     

一种基于邻域的多目标进化算法

种群维护是多目标进化算法的重要组成部分。针对维护方法和运行效率的矛盾,提出一种基于邻域的多目标进化算法（NMOEA）。定义了一个反映个体之间邻近程度的指标--邻域包含关系,利用此关系对个体进行分布适应度分级的赋值,并用动态方法快速地对种群进行维护。通过7个测试问题和3个方面的测试标准,结果表明新算法在较快速地接近真实的最优面的同时,拥有良好的分布性。     

Diversity Guided Evolutionary Programming: A novel approach for continuous optimization

Avoiding premature convergence to local optima and rapid convergence towards global optima has been the major concern with evolutionary systems research. In order to avoid premature convergence, sufficient amount of genetic diversity within the evolving population is considered necessary. Several studies have focused to devise techniques to control and preserve population diversity throughout the evolution. Since mutation is the major operator in many evolutionary systems, such as evolutionary programming and evolutionary strategies, a significant amount of research has also been done for the elegant control and adaptation of the mutation step size that is proper for traversing across the locally optimum points and reach for the global optima. This paper introduces Diversity Guided Evolutionary Programming, a novel approach to combine the best of both these research directions. This scheme incorporates diversity guided mutation, an innovative mutation scheme that guides the mutation step size using the population diversity information. It also takes some extra diversity preservative measures to maintain adequate amount of population diversity in order to assist the proposed mutation scheme. An extensive simulation has been done on a wide range of benchmark numeric optimization problems and the results have been compared with a number of recent evolutionary systems. Experimental results show that the performance of the proposed system is often better than most other algorithms in comparison on most of the problems.     

A memetic algorithm with adaptive hill climbing strategy for dynamic optimization problems

Dynamic optimization problems challenge traditional evolutionary algorithms seriously since they, once converged, cannot adapt quickly to environmental changes. This paper investigates the application of memetic algorithms, a class of hybrid evolutionary algorithms, for dynamic optimization problems. An adaptive hill climbing method is proposed as the local search technique in the framework of memetic algorithms, which combines the features of greedy crossover-based hill climbing and steepest mutation-based hill climbing. In order to address the convergence problem, two diversity maintaining methods, called adaptive dual mapping and triggered random immigrants, respectively, are also introduced into the proposed memetic algorithm for dynamic optimization problems. Based on a series of dynamic problems generated from several stationary benchmark problems, experiments are carried out to investigate the performance of the proposed memetic algorithm in comparison with some peer evolutionary algorithms. The experimental results show the efficiency of the proposed memetic algorithm in dynamic environments.     

A self-adaptive linear evolutionary algorithm for solving constrained optimization problems

In many real-world applications of evolutionary algorithms, the fitness of an individual requires a quantitative measure. This paper proposes a self-adaptive linear evolutionary algorithm (ALEA) in which we introduce a novel strategy for evaluating individual’s relative strengths and weaknesses. Based on this strategy, searching space of constrained optimization problems with high dimensions for design variables is compressed into two-dimensional performance space in which it is possible to quickly identify ‘good’ individuals of the performance for a multiobjective optimization application, regardless of original space complexity. This is considered as our main contribution. In addition, the proposed new evolutionary algorithm combines two basic operators with modification in reproduction phase, namely, crossover and mutation. Simulation results over a comprehensive set of benchmark functions show that the proposed strategy is feasible and effective, and provides good performance in terms of uniformity and diversity of solutions.     

一种基于多样性度量的多目标化进化算法

针对如何通过附加的方法对多目标化问题进行理论分析,提出并证明了选择附加函数的3个前提条件.提出一种多目标化进化算法,根据种群中个体的多样性度量进行多目标化,并采用改进的非劣分类遗传算法对构造所得的多目标优化问题进行多目标优化.在静态和动态两种环境下进行算法性能验证,结果表明,在种群多样性保持、处理欺骗问题、动态环境下的适应能力等方面,所提算法明显优于其他同类算法.     

Efficient and scalable Pareto optimization by evolutionary local selection algorithms

Local selection is a simple selection scheme in evolutionary computation. Individual fitnesses are accumulated over time and compared to a fixed threshold, rather than to each other, to decide who gets to reproduce. Local selection, coupled with fitness functions stemming from the consumption of finite shared environmental resources, maintains diversity in a way similar to fitness sharing. However, it is more efficient than fitness sharing and lends itself to parallel implementations for distributed tasks. While local selection is not prone to premature convergence, it applies minimal selection pressure to the population. Local selection is, therefore, particularly suited to Pareto optimization or problem classes where diverse solutions must be covered. This paper introduces ELSA, an evolutionary algorithm employing local selection and outlines three experiments in which ELSA is applied to multiobjective problems: a multimodal graph search problem, and two Pareto optimization problems. In all these experiments, ELSA significantly outperforms other well-known evolutionary algorithms. The paper also discusses scalability, parameter dependence, and the potential distributed applications of the algorithm.     

Multi-objective evolutionary algorithms based on the summation of normalized objectives and diversified selection

Most multi-objective evolutionary algorithms (MOEAs) use the concept of dominance in the search process to select the top solutions as parents in an elitist manner. However, as MOEAs are probabilistic search methods, some useful information may be wasted, if the dominated solutions are completely disregarded. In addition, the diversity may be lost during the early stages of the search process leading to a locally optimal or partial Pareto-front. Beside this, the non-domination sorting process is complex and time consuming. To overcome these problems, this paper proposes multi-objective evolutionary algorithms based on Summation of normalized objective values and diversified selection (SNOV-DS). The performance of this algorithm is tested on a set of benchmark problems using both multi-objective evolutionary programming (MOEP) and multi-objective differential evolution (MODE). With the proposed method, the performance metric has improved significantly and the speed of the parent selection process has also increased when compared with the non-domination sorting. In addition, the proposed algorithm also outperforms ten other algorithms.     

基于分解的高维多目标改进进化算法

针对基于参考向量的高维多目标进化算法中随机选择父代个体会降低算法的收敛速度,以及部分参考向量分配个体的缺失会减弱种群多样性的问题,提出了一种基于分解的高维多目标改进优化算法（IMaOEA/D）。首先,在分解策略框架下,当一个参考向量至少分配了2个个体时,对该参考向量分配的个体根据其到理想点的距离选择父代个体来繁殖子代,从而提高搜索速度。然后,针对未能分配到至少2个个体的参考向量,则从所有个体中选择沿该参考向量和理想点距离最小的点,使得该参考向量至少有2个个体与其相关。同时,确保环境选择后每个参考向量有一个个体与其相关,从而保证种群的多样性。在10个和15个目标的MaF测试问题集上将所提算法与其他4个基于分解的高维多目标优化算法进行了测试对比,实验结果表明所提算法对于高维多目标优化问题具有较好的寻优能力,且该算法在30个测试问题中的14个测试问题上得到的优化结果均优于其他4个对比算法,特别是对于退化问题具有一定的寻优优势。     

MCEDA: A novel many-objective optimization approach based on model and clustering

To solve many-objective optimization problems (MaOPs) by evolutionary algorithms (EAs), the maintenance of convergence and diversity is essential and difficult. Improved multi-objective optimization evolutionary algorithms (MOEAs), usually based on the genetic algorithm (GA), have been applied to MaOPs, which use the crossover and mutation operators of GAs to generate new solutions. In this paper, a new approach, based on decomposition and the MOEA/D framework, is proposed: model and clustering based estimation of distribution algorithm (MCEDA). MOEA/D means the multi-objective evolutionary algorithm based on decomposition. The proposed MCEDA is a new estimation of distribution algorithm (EDA) framework, which is intended to extend the application of estimation of distribution algorithm to MaOPs. MCEDA was implemented by two similar algorithm, MCEDA/B (based on bits model) and MCEDA/RM (based on regular model) to deal with MaOPs. In MCEDA, the problem is decomposed into several subproblems. For each subproblem, clustering algorithm is applied to divide the population into several subgroups. On each subgroup, an estimation model is created to generate the new population. In this work, two kinds of models are adopted, the new proposed bits model and the regular model used in RM-MEDA (a regularity model based multi-objective estimation of distribution algorithm). The non-dominated selection operator is applied to improve convergence. The proposed algorithms have been tested on the benchmark test suite for evolutionary algorithms (DTLZ). The comparison with several state-of-the-art algorithms indicates that the proposed MCEDA is a competitive and promising approach.     

A new particle swarm feature selection method for classification

Searching for an optimal feature subset from a high-dimensional feature space is an NP-complete problem; hence, traditional optimization algorithms are inefficient when solving large-scale feature selection problems. Therefore, meta-heuristic algorithms are extensively adopted to solve such problems efficiently. This study proposes a regression-based particle swarm optimization for feature selection problem. The proposed algorithm can increase population diversity and avoid local optimal trapping by improving the jump ability of flying particles. The data sets collected from UCI machine learning databases are used to evaluate the effectiveness of the proposed approach. Classification accuracy is used as a criterion to evaluate classifier performance. Results show that our proposed approach outperforms both genetic algorithms and sequential search algorithms.     

基于分级策略的演化算法

为了避免演化算法过早收敛,保持种群多样性,增加算法的搜索能力,本文提出基于分级策略的演化算法．即通过对种群进行分级,来度量种群的多样性,衡量算法是否陷入局部最优,协调种群多样性和精英策略之间的矛盾,再根据种群分布的多样性设计一种有效的半一致交叉算子与单重均匀变异算子。