A novel and effective particle swarm optimization like algorithm with extrapolation technique

A novel competitive approach to particle swarm optimization (PSO) algorithms is proposed in this paper. The proposed method uses extrapolation technique with PSO (ePSO) for solving optimization problems. By considering the basics of the PSO algorithm, the current particle position is updated by extrapolating the global best particle position and the current particle positions in the search space. The position equation is formulated with the global best (gbest) position, local best position (pbest) and the current position of the particle. The proposed method is tested with a set of 13 standard optimization benchmark problems and the results are compared with those obtained through two existing PSO algorithms, the canonical PSO (cPSO), the Global-Local best PSO (GLBest PSO). The cPSO includes a time-varying inertia weight (TVIW) and time-varying acceleration co-efficients (TVAC) while the GLBest PSO consists of Global-Local best inertia weight (GLBest IW) with Global-Local best acceleration co-efficient (GLBestAC). The simulation results clearly elucidate that the proposed method produces the near global optimal solution. It is also observed from the comparison of the proposed method with cPSO and GLBest PSO, the ePSO is capable of producing a quality of optimal solution with faster convergence rate. To strengthen the comparison and prove the efficacy of the proposed method a real time application of steel annealing processing (SAP) is also considered. The optimal control objectives of SAP are computed through the above said three PSO algorithms and also through two versions of genetic algorithms (GA), namely, real coded genetic algorithm (RCGA) and hybrid real coded genetic algorithm (HRCGA) and the results are analyzed with the proposed method. From the results obtained through benchmark problems and the real time application of SAP, it is clearly seen that the proposed ePSO method is competitive to the existing PSO algorithms and also to GAs.     

Memory based Hybrid Dragonfly Algorithm for numerical optimization problems

Dragonfly algorithm (DA) is a recently proposed optimization algorithm based on the static and dynamic swarming behaviour of dragonflies. Due to its simplicity and efficiency, DA has received interest of researchers from different fields. However, it lacks internal memory which may lead to its premature convergence to local optima. To overcome this drawback, we propose a novel Memory based Hybrid Dragonfly Algorithm (MHDA) for solving numerical optimization problems. The pbestand gbest concept of Particle Swarm optimization (PSO) is added to conventional DA to guide the search process for potential candidate solutions and PSO is then initialized with pbest of DA to further exploit the search space. The proposed method combines the exploration capability of DA and exploitation capability of PSO to achieve global optimal solutions. The efficiency of the MHDA is validated by testing on basic unconstrained benchmark functions and CEC 2014 test functions. A comparative performance analysis between MHDA and other powerful optimization algorithms have been carried out and significance of the results is proved by statistical methods. The results show that MHDA gives better performance than conventional DA and PSO. Moreover, it gives competitive results in terms of convergence, accuracy and search-ability when compared with the state-of-the-art algorithms. The efficacy of MHDA in solving real world problems is also explained with three engineering design problems.     

复形法粒子群优化算法研究

针对基本粒子群优化算法对复杂函数优化时难以获得最优解的缺陷,提出了一种复形粒子群优化算法。该算法采用复形法来提高粒子的局部搜索能力,从而保证了算法能够跳出局部最优,获得全局最优解。实验结果表明,与文献算法相比,该算法在基准函数优化时具有更强的寻优能力和更高的搜索精度。     

基于高斯变异的量子粒子群算法

粒子群算法相对于其他优化算法来说有着较强的寻优能力以及收敛速度快等特点,但是在多峰值函数优化中,基本粒子群算法存在着早熟收敛现象。针对粒子群算法易于陷入局部最小的弱点,提出了一种基于高斯变异的量子粒子群算法。该算法使粒子同时具有良好的全局搜索能力以及快速收敛能力。典型函数优化的仿真结果表明,该算法具有寻优能力强、搜索精度高、稳定性好等优点,适合于工程应用中的函数优化问题。     

Feedback controlled particle swarm optimization and its application in time-series prediction

Particle swarm optimization (PSO) algorithm is an algorithmic technique for optimization by solving a wide range of optimization problems. This paper presents a new approach of extending PSO to solve optimization problems by using the feedback control mechanism (FCPSO). The proposed FCPSO consists of two major steps. First, by evaluating the fitness value of each particle, a simple particle evolutionary fitness function is designed to control parameters involving acceleration coefficient, refreshing gap, learning probabilities and number of the potential exemplars automatically. By such a simple particle evolutionary fitness function, each particle has its own search parameters in a search environment. Secondly, a local learning method using a competitive penalized method is developed to refine the solution. The FCPSO has been comprehensively evaluated on 18 unimodal, multimodal and composite benchmark functions with or without rotation. Compared with various state-of-the-art algorithms, including traditional PSO algorithms and representative variants of PSO algorithms, the performance of FCPSO is promising. The effects of parameter adaptation, parameter sensitivity and local search method are studied. Lastly, the proposed FCPSO is applied to constructing a radial basis neural network, together with the K-means method for time-series prediction.     

Stepwise-then-intelligent algorithm (STIA) for optimizing remotely sensed image rectification

ABSTRACT

To address the problems of parameter selection and accuracy optimization of models in image rectification, this article first proposes a novel stepwise-then-intelligent algorithm (STIA) for image rectification optimization, which includes the following steps. First, stepwise regression is suggested to simultaneously solve the over-parameterization problem and select the optimum parameters of the polynomial model and rational function model according to different terrains. Second, intelligent algorithms, e.g. the genetic algorithm (GA) and particle swarm optimization (PSO), are proposed to search for better results based on an innovative search range determined by the uncertainty propagation and 3-sigma rule. The experimental results show that the proposed STIA can achieve higher accuracy than conventional methods; and in most cases, the PSO algorithm used in STIA is superior to the GA used in STIA in measures of time and accuracy. Moreover, stepwise-then-PSO algorithm exhibits the best performance of all compared methods, including least squares, stepwise regression, total least squares and partial least squares.     

A new gradient based particle swarm optimization algorithm for accurate computation of global minimum

Stochastic optimization algorithms like genetic algorithms (GAs) and particle swarm optimization (PSO) algorithms perform global optimization but waste computational effort by doing a random search. On the other hand deterministic algorithms like gradient descent converge rapidly but may get stuck in local minima of multimodal functions. Thus, an approach that combines the strengths of stochastic and deterministic optimization schemes but avoids their weaknesses is of interest. This paper presents a new hybrid optimization algorithm that combines the PSO algorithm and gradient-based local search algorithms to achieve faster convergence and better accuracy of final solution without getting trapped in local minima. In the new gradient-based PSO algorithm, referred to as the GPSO algorithm, the PSO algorithm is used for global exploration and a gradient based scheme is used for accurate local exploration. The global minimum is located by a process of finding progressively better local minima. The GPSO algorithm avoids the use of inertial weights and constriction coefficients which can cause the PSO algorithm to converge to a local minimum if improperly chosen. The De Jong test suite of benchmark optimization problems was used to test the new algorithm and facilitate comparison with the classical PSO algorithm. The GPSO algorithm is compared to four different refinements of the PSO algorithm from the literature and shown to converge faster to a significantly more accurate final solution for a variety of benchmark test functions.     

An improved hybrid particle swarm optimization algorithm for fuzzy p-hub center problem

The p-hub center problem is useful for the delivery of perishable and time-sensitive system such as express mail service and emergency service. In this paper, we propose a new fuzzy p-hub center problem, in which the travel times are uncertain and characterized by normal fuzzy vectors. The objective of our model is to maximize the credibility of fuzzy travel times not exceeding a predetermined acceptable efficient time point along all paths on a network. Since the proposed hub location problem is too complex to apply conventional optimization algorithms, we adapt an approximation approach (AA) to discretize fuzzy travel times and reformulate the original problem as a mixed-integer programming problem subject to logic constraints. After that, we take advantage of the structural characteristics to develop a parametric decomposition method to divide the approximate p-hub center problem into two mixed-integer programming subproblems. Finally, we design an improved hybrid particle swarm optimization (PSO) algorithm by combining PSO with genetic operators and local search (LS) to update and improve particles for the subproblems. We also evaluate the improved hybrid PSO algorithm against other two solution methods, genetic algorithm (GA) and PSO without LS components. Using a simulated data set of 10 nodes, the computational results show that the improved hybrid PSO algorithm achieves the better performance than GA and PSO without LS in terms of runtime and solution quality.     

A hybrid meta-heuristic algorithm for optimization of crew scheduling

Crew scheduling problem is the problem of assigning crew members to the flights so that total cost is minimized while regulatory and legal restrictions are satisfied. The crew scheduling is an NP-hard constrained combinatorial optimization problem and hence, it cannot be exactly solved in a reasonable computational time. This paper presents a particle swarm optimization (PSO) algorithm synchronized with a local search heuristic for solving the crew scheduling problem. Recent studies use genetic algorithm (GA) or ant colony optimization (ACO) to solve large scale crew scheduling problems. Furthermore, two other hybrid algorithms based on GA and ACO algorithms have been developed to solve the problem. Computational results show the effectiveness and superiority of the proposed hybrid PSO algorithm over other algorithms.     

基于局部搜索的反向学习竞争粒子群优化算法

为提升粒子群优化算法在复杂优化问题,特别是高维优化问题上的优化性能,提出一种基于Solis&Wets局部搜索的反向学习竞争粒子群优化算法(solis and wets-opposition based learning competitive particle swarm optimizer with local search, SW-OBLCSO). SW-OBLCSO算法采用竞争学习和反向学习两种学习机制,并设计了基于个体的局部搜索算子.利用10个常用基准测试函数和12个带有偏移旋转的复杂测试函数,在不同维度情况下将SW-OBLCSO算法与多种优化算法进行对比.实验结果表明,所提出算法在收敛速度和全局搜索能力上表现出突出的性能.对模糊认知图(fuzzy cognitive maps)学习问题的测试表明, SW-OBLCSO算法在处理实际问题时同样具有出色的性能.     

Introducing dynamic diversity into a discrete particle swarm optimization

Particle swarm optimization (PSO) is an evolutionary metaheuristic inspired by the flocking behaviour of birds, which has successfully been used to solve several kinds of problems, although there are few studies aimed at solving discrete optimization problems. One disadvantage of PSO is the risk of a premature search convergence. To prevent this, we propose to introduce diversity into a discrete PSO by adding a random velocity. The degree of the introduced diversity is not static (i.e. preset before running PSO) but instead changes dynamically according to the heterogeneity of the population (i.e. if the search has converged or not). We solve the response time variability problem (RTVP) to test these two new ideas. The RTVP is an NP-hard combinatorial scheduling problem that has recently appeared in the literature. It occurs whenever products, clients or jobs need to be sequenced in such a way that the variability in the time between the instants at which they receive the necessary resources is minimized. The most efficient algorithm for solving non-small instances of the RTVP published to date is a classical PSO algorithm, referred to by the authors as PSO-M1F. In this paper, we propose 10 discrete PSO algorithms for solving the RTVP: one based on the ideas described above (PSO  -_c3dyn$c_3\text{<italic>dyn</italic>}$) and nine based on strategies proposed in the literature and adapted for solving a discrete optimization problem such as the RTVP. We compare all 11 PSO algorithms and the computational experiment shows that, on average, the best results obtained are due to our proposal of dynamic control mechanism for introducing diversity.     

基于拓扑结构与粒子变异改进的粒子群优化算法

为使粒子群优化算法(PSO)优化过程的多样性与收敛性得到合理解决,以提高算法优化性能,基于种群拓扑结构与粒子变异提出两种粒子群改进算法RSMPSO和RVMPSO.改进算法将具有信息定向流动的闭环拓扑结构与星型拓扑结构或四边形拓扑结构相结合,促使粒子在前期寻优过程中具有较高的多样性,保证搜索的广度,而在后期满足粒子群的整体收敛性,保证寻优的精度.同时,将布谷鸟搜索算法(CS)中的偏好随机游走变异策略引入改进算法中,增强粒子跳出局部最优的能力.对标准测试函数的仿真实验表明,所改进的PSO算法与其他6个对比算法相比不仅操作简单,优化精度高,而且在算法收敛性及稳健性方面都有着更出色的表现.     

Particle swarm optimization with selective particle regeneration for data clustering

This paper presents selective regeneration particle swarm optimization (SRPSO), a novel algorithm developed based on particle swarm optimization (PSO). It contains two new features, unbalanced parameter setting and particle regeneration operation. The unbalanced parameter setting enables fast convergence of the algorithm and the particle regeneration operation allows the search to escape from local optima and explore for better solutions. This algorithm is applied to data clustering problems for performance evaluation and a hybrid algorithm (KSRPSO) of K-means clustering method and SRPSO is developed. In the conducted numerical experiments, SRPSO and KSRPSO are compared to the original PSO algorithm, K-means, as well as, other methods proposed by other studies. The results demonstrate that SRPSO and KSRPSO are efficient, accurate, and robust methods for data clustering problems.     

基于改进PSO算法的LSSVM入侵检测模型

在基本PSO算法和线性权重下降PSO算法的基础上,提出一种并行PSO算法,将粒子群分成两组,分别采用不同的惯性权重,各侧重于全局搜索和局部搜索,根据进化代数动态调整两种算法中进化的粒子数。通过仿真实验,证明了并行PSO算法的寻优性能优于基本PSO算法和线性权重下降PSO算法。     

改进PSO算法的性能分析与研究*

分析了粒子群优化(PSO)算法的进化式,针对其容易发生早熟、收敛速度慢、后期搜索性能和个体寻优能力降低等缺点,结合遗传算法的思想,提出一种新的混合PSO算法——遗传PSO(GAPSO)。该算法是在PSO算法的更新过程中,对粒子速度引入遗传算法的变异操作,对粒子位置引入遗传算法交叉操作。对速度的变异降低了算法后期因种群过于密集而陷入局部最优的可能,对位置的交叉使得父代中优良个体的基因能够更好地遗传给下一代,从而得到更优、更多样化的后代,加快进化过程,提高了收敛速度和群体搜索性能。选取了其他几种典型的改进PS     

An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis

Clustering is a popular data analysis and data mining technique. A popular technique for clustering is based on k-means such that the data is partitioned into K clusters. However, the k-means algorithm highly depends on the initial state and converges to local optimum solution. This paper presents a new hybrid evolutionary algorithm to solve nonlinear partitional clustering problem. The proposed hybrid evolutionary algorithm is the combination of FAPSO (fuzzy adaptive particle swarm optimization), ACO (ant colony optimization) and k-means algorithms, called FAPSO-ACO–K, which can find better cluster partition. The performance of the proposed algorithm is evaluated through several benchmark data sets. The simulation results show that the performance of the proposed algorithm is better than other algorithms such as PSO, ACO, simulated annealing (SA), combination of PSO and SA (PSO–SA), combination of ACO and SA (ACO–SA), combination of PSO and ACO (PSO–ACO), genetic algorithm (GA), Tabu search (TS), honey bee mating optimization (HBMO) and k-means for partitional clustering problem.     

A particle swarm optimization based memetic algorithm for dynamic optimization problems

Recently, there has been an increasing concern from the evolutionary computation community on dynamic optimization problems since many real-world optimization problems are dynamic. This paper investigates a particle swarm optimization (PSO) based memetic algorithm that hybridizes PSO with a local search technique for dynamic optimization problems. Within the framework of the proposed algorithm, a local version of PSO with a ring-shape topology structure is used as the global search operator and a fuzzy cognition local search method is proposed as the local search technique. In addition, a self-organized random immigrants scheme is extended into our proposed algorithm in order to further enhance its exploration capacity for new peaks in the search space. Experimental study over the moving peaks benchmark problem shows that the proposed PSO-based memetic algorithm is robust and adaptable in dynamic environments.     

基于遗传交叉和多混沌策略改进的粒子群优化算法

为有效改进基本PSO算法的搜索能力,提出了一种基于遗传交叉和多混沌方式改进的粒子群算法。该算法为获得比当前群体更优的最优解,采用了以下四种措施：其一,对当前群体中的最优解和每个粒子最优解进行遗传交叉操作;其二,用混沌系统动态地调整PSO算法的惯性权重;其三,对整个解空间进行混沌全局搜索;最后,对当前群体中最优解进行多维和单维的混沌局部搜索。仿真实验结果表明：与其它三种算法相比,提出的算法在解决8个整数和混合整数非线性规划问题时不仅收敛速度最快,而且具有100%的成功率。     

粒子置换的双种群综合学习PSO算法

针对粒子群算法(PSO)种群多样性低和易于陷入局部最优等问题,提出一种粒子置换的双种群综合学习PSO算法(PP-CLPSO)。根据PSO算法的收敛特性和Logistic映射的混沌思想,设计并行进化的PSO种群和混沌化种群,结合粒子编号机制,形成双种群系统中粒子的同号结构和同位结构,其中粒子的惯性权重根据适应度值自适应调节;当搜索过程陷入局部最优时,PSO种群同位结构下适应度值较差的粒子,根据与混沌化种群间的同号结构执行粒子置换操作,实现了双种群系统资源的合理调度,增加了种群的多样性;进而综合双向搜索的同位粒子学习策略和线性递减搜索步长的局部学习策略,进行全局探勘和局部搜索,提高了算法的求解精度。实验选取9个基准测试函数,同时与4个改进的粒子群算法和4个群智能算法进行对比验证,实验结果表明,PP-CLPSO算法在求解精度和收敛速度等方面具备较好的综合性能。     

基于K-均值聚类的协同进化粒子群优化算法

针对粒子群优化（PSO）算法优化高维问题时,易陷入局部最优,提出一种基于K-均值聚类的协同进化粒子群优化（KMS-CCPSO）算法。该算法通过引入K-均值算法扩大种群的局部搜索范围,采用柯西分布和高斯分布相结合的方法更新粒子的位置。实验结果表明,该算法具有较好的优化性能,其优势在处理高维问题上更为明显。