An improved vector particle swarm optimization for constrained optimization problems

Increasing attention is being paid to solve constrained optimization problems (COP) frequently encountered in real-world applications. In this paper, an improved vector particle swarm optimization (IVPSO) algorithm is proposed to solve COPs. The constraint-handling technique is based on the simple constraint-preserving method. Velocity and position of each particle, as well as the corresponding changes, are all expressed as vectors in order to present the optimization procedure in a more intuitively comprehensible manner. The NVPSO algorithm [30], which uses one-dimensional search approaches to find a new feasible position on the flying trajectory of the particle when it escapes from the feasible region, has been proposed to solve COP. Experimental results showed that searching only on the flying trajectory for a feasible position influenced the diversity of the swarm and thus reduced the global search capability of the NVPSO algorithm. In order to avoid neglecting any worthy position in the feasible region and improve the optimization efficiency, a multi-dimensional search algorithm is proposed to search within a local region for a new feasible position. The local region is composed of all dimensions of the escaped particle’s parent and the current positions. Obviously, the flying trajectory of the particle is also included in this local region. The new position is not only present in the feasible region but also has a better fitness value in this local region. The performance of IVPSO is tested on 13 well-known benchmark functions. Experimental results prove that the proposed IVPSO algorithm is simple, competitive and stable.     

改进的r支配高维多目标粒子群优化算法

高维多目标优化问题是广泛存在于实际应用中的复杂优化问题,目前的研究方法大都限于进化算法.本文利用粒子群优化算法求解高维多目标优化问题,提出了一种基于r支配的多目标粒子群优化算法.采用r支配关系进行粒子的比较与选择,并结合粒子群优化算法收敛速度快的优势,使得算法在目标个数增加时仍保持较强的搜索能力;为了弥补由此造成的群体多样性的丢失,优化非r支配阈值的取值策略;此外,引入决策空间的拥挤距离测度,并给出新的外部存储器更新方法,从而进一步防止算法陷入局部最优.对多个基准测试函数的仿真结果表明所得解集在收敛性、多样性以及围绕参考点的分布性上均优于其他两种算法.     

A parallel boundary search particle swarm optimization algorithm for constrained optimization problems

During the past decade, considerable research has been conducted on constrained optimization problems (COPs) which are frequently encountered in practical engineering applications. By introducing resource limitations as constraints, the optimal solutions in COPs are generally located on boundaries of feasible design space, which leads to search difficulties when applying conventional optimization algorithms, especially for complex constraint problems. Even though penalty function method has been frequently used for handling the constraints, the adjustment of control parameters is often complicated and involves a trial-and-error approach. To overcome these difficulties, a modified particle swarm optimization (PSO) algorithm named parallel boundary search particle swarm optimization (PBSPSO) algorithm is proposed in this paper. Modified constrained PSO algorithm is adopted to conduct global search in one branch while Subset Constrained Boundary Narrower (SCBN) function and sequential quadratic programming (SQP) are applied to perform local boundary search in another branch. A cooperative mechanism of the two branches has been built in which locations of the particles near boundaries of constraints are selected as initial positions of local boundary search and the solutions of local boundary search will lead the global search direction to boundaries of active constraints. The cooperation behavior of the two branches effectively reinforces the optimization capability of the PSO algorithm. The optimization performance of PBSPSO algorithm is illustrated through 13 CEC06 test functions and 5 common engineering problems. The results are compared with other state-of-the-art algorithms and it is shown that the proposed algorithm possesses a competitive global search capability and is effective for constrained optimization problems in engineering applications.     

基于局部搜索的反向学习竞争粒子群优化算法

为提升粒子群优化算法在复杂优化问题,特别是高维优化问题上的优化性能,提出一种基于Solis&Wets局部搜索的反向学习竞争粒子群优化算法(solis and wets-opposition based learning competitive particle swarm optimizer with local search, SW-OBLCSO). SW-OBLCSO算法采用竞争学习和反向学习两种学习机制,并设计了基于个体的局部搜索算子.利用10个常用基准测试函数和12个带有偏移旋转的复杂测试函数,在不同维度情况下将SW-OBLCSO算法与多种优化算法进行对比.实验结果表明,所提出算法在收敛速度和全局搜索能力上表现出突出的性能.对模糊认知图(fuzzy cognitive maps)学习问题的测试表明, SW-OBLCSO算法在处理实际问题时同样具有出色的性能.     

Sequential approximation optimization assisted particle swarm optimization for expensive problems

In this paper, an efficient sequential approximation optimization assisted particle swarm optimization algorithm is proposed for optimization of expensive problems. This algorithm makes a good balance between the search ability of particle swarm optimization and sequential approximation optimization. Specifically, the proposed algorithm uses the optima obtained by sequential approximation optimization in local regions to replace the personal historical best particles and then runs the basic particle swarm optimization procedures. Compared with particle swarm optimization, the proposed algorithm is more efficient because the optima provided by sequential approximation optimization can direct swarm particles to search in a more accurate way. In addition, a space partition strategy is proposed to constraint sequential approximation optimization in local regions. This strategy can enhance the swarm diversity and prevent the preconvergence of the proposed algorithm. In order to validate the proposed algorithm, a lot of numerical benchmark problems are tested. An overall comparison between the proposed algorithm and several other optimization algorithms has been made. Finally, the proposed algorithm is applied to an optimal design of bearings in an all-direction propeller. The results show that the proposed algorithm is efficient and promising for optimization of the expensive problems.     

A hybrid algorithm based on particle swarm and chemical reaction optimization

In this paper, a hybrid method for optimization is proposed, which combines the two local search operators in chemical reaction optimization with global search ability of for global optimum. This hybrid technique incorporates concepts from chemical reaction optimization and particle swarm optimization, it creates new molecules (particles) either operations as found in chemical reaction optimization or mechanisms of particle swarm optimization. Moreover, some technical bound constraint handling has combined when the particle update in particle swarm optimization. The effects of model parameters like InterRate, γ, Inertia weight and others parameters on performance are investigated in this paper. The experimental results tested on a set of twenty-three benchmark functions show that a hybrid algorithm based on particle swarm and chemical reaction optimization can outperform chemical reaction optimization algorithm in most of the experiments. Experimental results also indicate average improvement and deviate over chemical reaction optimization in the most of experiments.     

一种基于相角映射的改进多目标粒子群优化算法

提出一种相角粒子群优化算法求解多目标优化问题。该算法采用相角映射实现了粒子在相角空间上仅依赖于归一化多目标函数的快速搜索,在粒子飞行信息共享机制上引入共享池概念,提出基于关联支配排序和相似度排序的共享池更新策略,提高了Pareto解的多样性。采用Sigma领导策略和混沌变异操作,平衡了算法的快速搜索能力和全局寻优能力。标准多目标测试函数和电力系统广域阻尼控制多目标优化算例表明了所提出算法的可行性和有效性。     

基于拥挤度与变异的动态微粒群多目标优化算法

提出一种动态微粒群多目标优化算法(DCMOPSO),算法中的惯性权重和加速因子动态变化以增强算法的全局搜索能力,并采用拥挤度的方法对外部档案进行维护以增加非劣解的多样性.在维护过程中,从外部档案中按拥挤度为每个微粒选择全局最好位置,同时使用变异操作避免算法早熟.通过几个典型的多目标测试函数对DCMOPSO算法的性能进行了测试,并与多目标优化算法MOPSO和NSGA-Ⅱ进行对比.结果表明,DCMOPSO算法具有良好的搜索性能.     

基于Pareto邻域交叉算子的多目标粒子群优化算法

针对粒子群优化（PSO）算法局部搜索能力不足的问题,提出一种基于Pareto邻域交叉算子的多目标粒子群优化算法(MPSOP)。该算法利用粒子群优化算法和Pareto邻域交叉算子相结合的策略产生新种群,并利用尺度因子在线调节粒子群优化算法和Pareto邻域交叉算子的贡献量。数值实验选取6个常用测试函数并对NSGA-Ⅱ、SPEA2、MOPSO三个多目标算法进行比较,数值实验结果表明MPSOP算法的有效性。     

Non-parametric particle swarm optimization for global optimization

In recent years, particle swarm optimization (PSO) has extensively applied in various optimization problems because of its simple structure. Although the PSO may find local optima or exhibit slow convergence speed when solving complex multimodal problems. Also, the algorithm requires setting several parameters, and tuning the parameters is a challenging for some optimization problems. To address these issues, an improved PSO scheme is proposed in this study. The algorithm, called non-parametric particle swarm optimization (NP-PSO) enhances the global exploration and the local exploitation in PSO without tuning any algorithmic parameter. NP-PSO combines local and global topologies with two quadratic interpolation operations to increase the search ability. Nineteen (19) unimodal and multimodal nonlinear benchmark functions are selected to compare the performance of NP-PSO with several well-known PSO algorithms. The experimental results showed that the proposed method considerably enhances the efficiency of PSO algorithm in terms of solution accuracy, convergence speed, global optimality, and algorithm reliability.     

Improved accelerated PSO algorithm for mechanical engineering optimization problems

This paper introduces an improved accelerated particle swarm optimization algorithm (IAPSO) to solve constrained nonlinear optimization problems with various types of design variables. The main improvements of the original algorithm are the incorporation of the individual particles memories, in order to increase swarm diversity, and the introduction of two selected functions to control balance between exploration and exploitation, during search process. These modifications are used to update particles positions of the swarm. Performance of the proposed algorithm is illustrated through six benchmark mechanical engineering design optimization problems. Comparison of obtained computation results with those of several recent meta-heuristic algorithms shows the superiority of the IAPSO in terms of accuracy and convergence speed.     

引入人工蜂群搜索算子的粒子群算法

针对标准粒子群算法易出现早熟现象和收敛速度慢等问题,提出一种引入人工蜂群搜索算子的粒子群算法.首先利用人工蜂群搜索算子很强的探索能力,对粒子搜索到的历史最优位置进行搜索以帮助算法快速跳出局部最优点;然后,为了提高算法的全局收敛速度,提出一种基于混沌和反学习的初始化方法.通过12个标准测试函数的仿真实验并与其他算法相比较,所得结果表明所提出的算法具有较快的收敛速度和很强的跳出局部最优的能力.     

Attributed multi-objective comprehensive learning particle swarm optimization for optimal security of networks

In particle swarm optimization (PSO) each particle uses its personal and global or local best positions by linear summation. However, it is very time consuming to find the global or local best positions in case of complex problems. To overcome this problem, we propose a new multi-objective variant of PSO called attributed multi-objective comprehensive learning particle swarm optimizer (A-MOCLPSO). In this technique, we do not use global or local best positions to modify the velocity of a particle; instead, we use the best position of a randomly selected particle from the whole population to update the velocity of each dimension. This method not only increases the speed of the algorithm but also searches in more promising areas of the search space. We perform an extensive experimentation on well-known benchmark problems such as Schaffer (SCH), Kursawa (KUR), and Zitzler–Deb–Thiele (ZDT) functions. The experiments show very convincing results when the proposed technique is compared with existing versions of PSO known as multi-objective comprehensive learning particle swarm optimizer (MOCLPSO) and multi-objective particle swarm optimization (MOPSO), as well as non-dominated sorting genetic algorithm II (NSGA-II). As a case study, we apply our proposed A-MOCLPSO algorithm on an attack tree model for the security hardening problem of a networked system in order to optimize the total security cost and the residual damage, and provide diverse solutions for the problem. The results of our experiments show that the proposed algorithm outperforms the previous solutions obtained for the security hardening problem using NSGA-II, as well as MOCLPSO for the same problem. Hence, the proposed algorithm can be considered as a strong alternative to solve multi-objective optimization problems.     

The improvement of glowworm swarm optimization for continuous optimization problems

Glowworm swarm optimization (GSO) algorithm is the one of the newest nature inspired heuristics for optimization problems. In order to enhances accuracy and convergence rate of the GSO, two strategies about the movement phase of GSO are proposed. One is the greedy acceptance criteria for the glowworms update their position one-dimension by one-dimension. The other is the new movement formulas which are inspired by artificial bee colony algorithm (ABC) and particle swarm optimization (PSO). To compare and analyze the performance of our proposed improvement GSO, a number of experiments are carried out on a set of well-known benchmark global optimization problems. The effects of the parameters about the improvement algorithms are discussed by uniform design experiment. Numerical results reveal that the proposed algorithms can find better solutions when compared to classical GSO and other heuristic algorithms and are powerful search algorithms for various global optimization problems.     

A novel particle swarm optimization algorithm with Levy flight

Particle swarm optimization (PSO) is one of the well-known population-based techniques used in global optimization and many engineering problems. Despite its simplicity and efficiency, the PSO has problems as being trapped in local minima due to premature convergence and weakness of global search capability. To overcome these disadvantages, the PSO is combined with Levy flight in this study. Levy flight is a random walk determining stepsize using Levy distribution. Being used Levy flight, a more efficient search takes place in the search space thanks to the long jumps to be made by the particles. In the proposed method, a limit value is defined for each particle, and if the particles could not improve self-solutions at the end of current iteration, this limit is increased. If the limit value determined is exceeded by a particle, the particle is redistributed in the search space with Levy flight method. To get rid of local minima and improve global search capability are ensured via this distribution in the basic PSO. The performance and accuracy of the proposed method called as Levy flight particle swarm optimization (LFPSO) are examined on well-known unimodal and multimodal benchmark functions. Experimental results show that the LFPSO is clearly seen to be more successful than one of the state-of-the-art PSO (SPSO) and the other PSO variants in terms of solution quality and robustness. The results are also statistically compared, and a significant difference is observed between the SPSO and the LFPSO methods. Furthermore, the results of proposed method are also compared with the results of well-known and recent population-based optimization methods.     

Particle swarm optimization with grey evolutionary analysis

Based on grey relational analysis, this study attempts to propose a grey evolutionary analysis (GEA) to analyze the population distribution of particle swarm optimization (PSO) during the evolutionary process. Then two GEA-based parameter automation approaches are developed. One is for the inertia weight and the other is for the acceleration coefficients. With the help of the GEA technique, the proposed parameter automation approaches would enable the inertia weight and acceleration coefficients to adapt to the evolutionary state. Such parameter automation behaviour also makes an attempt on the GEA-based PSO to perform a global search over the search space with faster convergence speed. In addition, the proposed PSO is applied to solve the optimization problems of twelve unimodal and multimodal benchmark functions for illustration. Simulation results show that the proposed GEA-based PSO could outperform the adaptive PSO, the grey PSO, and two well-known PSO variants on most of the test functions.     

Superior solution guided particle swarm optimization combined with local search techniques

Particle swarm optimization (PSO) is an evolutionary algorithm known for its simplicity and effectiveness in solving various optimization problems. PSO should have strong yet balanced exploration and exploitation capabilities to enhance its performance. A superior solution guided PSO (SSG-PSO) framework integrated with an individual level based mutation operator and different local search techniques is proposed in this study. In SSG-PSO, a collection of superior solutions is maintained and updated with the evolutionary process, such that each particle can comprehensively learn from the recorded superior solutions. In addition, to maintain the diversity of the particle swarm, SSG-PSO is combined with an individual level based mutation operator, which will be invoked when a particle is trapped in a local optimum (determined by the fitness and position states of the particle), thereby improving the adaptation and flexibility of each individual particle. Moreover, two gradient-based local search techniques, namely, the Broyden–Fletcher–Goldfarb–Shanno (BFGS) and Davidon–Fletcher–Powell (DFP) Quasi–Newton methods, and two derivative-free local search techniques, namely, pattern search and Nelder–Mead simplex search, are incorporated into SSG-PSO. The performances of SSG-PSO and that of its local search enhanced variants are extensively and comparatively studied on a suit of benchmark optimization functions.     

融合随机逼近算法的粒子群优化算法

针对粒子群优化算法(PSO)在寻优进程中的缺陷,提出一种融合随机逼近算法的粒子群优化算法,该算法选择合适时机将随机逼近算法融入粒子群优化算法维持种群的多样性,并且在算法寻优进程中充分利用已有的计算资源提高算法寻优效率,最后通过典型标准函数数值实验表明,改进后的粒子群优化算法寻优速度快、精度高、具较好的稳定性。     

Force-imitated particle swarm optimization using the near-neighbor effect for locating multiple optima

Multimodal optimization problems pose a great challenge of locating multiple optima simultaneously in the search space to the particle swarm optimization (PSO) community. In this paper, the motion principle of particles in PSO is extended by using the near-neighbor effect in mechanical theory, which is a universal phenomenon in nature and society. In the proposed near-neighbor effect based force-imitated PSO (NN-FPSO) algorithm, each particle explores the promising regions where it resides under the composite forces produced by the “near-neighbor attractor” and “near-neighbor repeller”, which are selected from the set of memorized personal best positions and the current swarm based on the principles of “superior-and-nearer” and “inferior-and-nearer”, respectively. These two forces pull and push a particle to search for the nearby optimum. Hence, particles can simultaneously locate multiple optima quickly and precisely. Experiments are carried out to investigate the performance of NN-FPSO in comparison with a number of state-of-the-art PSO algorithms for locating multiple optima over a series of multimodal benchmark test functions. The experimental results indicate that the proposed NN-FPSO algorithm can efficiently locate multiple optima in multimodal fitness landscapes.     

基于逻辑自映射的变尺度混沌粒子群优化算法*

针对基本粒子群优化算法的早熟收敛问题,提出了一种基于逻辑自映射的变尺度混沌粒子群优化算法。该算法在粒子群优化算法每次寻优结束时,采用逻辑自映射函数产生混沌序列,在已搜索到的精英粒子附近尝试搜索更优解并动态收缩搜索范围,在防止算法过早陷入局部最优的同时提高了算法搜索的精度。仿真结果表明,新算法在寻优成功率和平均最优值方面有很大提高,在求解包括欺骗性函数和高维函数在内的多种函数优化问题方面具有良好的效果。