Time-response-based evolutionary optimization

Solutions to engineering problems are often evaluated by considering their time responses; thus, each solution is associated with a function. To avoid optimizing the functions, such optimization is usually carried out by setting auxiliary objectives (e.g. minimal overshoot). Therefore, in order to find different optimal solutions, alternative auxiliary optimization objectives may have to be defined prior to optimization. In the current study, a new approach is suggested that avoids the need to define auxiliary objectives. An algorithm is suggested that enables the optimization of solutions according to their transient behaviours. For this optimization, the functions are sampled and the problem is posed as a multi-objective problem. The recently introduced algorithm NSGA-II-PSA is adopted and tailored to solve it. Mathematical as well as engineering problems are utilized to explain and demonstrate the approach and its applicability to real life problems. The results highlight the advantages of avoiding the definition of artificial objectives.     

Reduced order model assisted evolutionary algorithms for multi-objective flow design optimization

Evolutionary algorithms (EAs) have been widely used for flow design optimization problems for their well-known robustness and derivative-free property as well as their advantages in dealing with multi-objective optimization problems and providing global optimal solutions. However, EAs usually involve a large number of function evaluations that are sometimes quite time consuming. In this article a reduced order modelling technique that combines proper orthogonal decomposition and radial basis function interpolation is developed to reduce the computational cost. These models provide an efficient way to simulate the whole flow region with varied geometry parameters instead of solving partial differential equations. As a test case, the design optimization of a heat exchanger is considered. Shape variation is conducted through a free form deformation technique, which deforms the computational grid employed by the flow solver. A comparison between the optimization results when using reduced order models and the exact flow solver is presented.     

Genetic-algorithms-based algorithm portfolio for inventory routing problem with stochastic demand

This paper presents an algorithm portfolio methodology based on evolutionary algorithms to solve complex dynamic optimisation problems. These problems are known to have computationally complex objective functions, which make their solutions computationally hard to find, when problem instances of large dimensions are considered. This is due to the inability of the algorithms to provide an optimal or near-optimal solution within an allocated time interval. Therefore, this paper employs a bundle of evolutionary algorithms (EAs) tied together with several processors, known as an algorithm portfolio, to solve a complex optimisation problem such as the inventory routing problem (IRP) with stochastic demands. EAs considered for algorithm portfolios are the genetic algorithm and its four variants such as the memetic algorithm, genetic algorithm with chromosome differentiation, age-genetic algorithm, and gender-specific genetic algorithm. In order to illustrate the applicability of the proposed methodology, a generic method for algorithm portfolios design, evaluation, and analysis is discussed in detail. Experiments were performed on varying dimensions of IRP instances to validate different properties of algorithm portfolio. A case study was conducted to illustrate that the set of EAs allocated to a certain number of processors performed better than their individual counterparts.     

A surrogate assisted parallel multiobjective evolutionary algorithm for robust engineering design

A number of multi-objective evolutionary algorithms have been proposed in recent years and many of them have been used to solve engineering design optimization problems. However, designs need to be robust for real-life implementation, i.e. performance should not degrade substantially under expected variations in the variable values or operating conditions. Solutions of constrained robust design optimization problems should not be too close to the constraint boundaries so that they remain feasible under expected variations. A robust design optimization problem is far more computationally expensive than a design optimization problem as neighbourhood assessments of every solution are required to compute the performance variance and to ensure neighbourhood feasibility. A framework for robust design optimization using a surrogate model for neighbourhood assessments is introduced in this article. The robust design optimization problem is modelled as a multi-objective optimization problem with the aim of simultaneously maximizing performance and minimizing performance variance. A modified constraint-handling scheme is implemented to deal with neighbourhood feasibility. A radial basis function (RBF) network is used as a surrogate model and the accuracy of this model is maintained via periodic retraining. In addition to using surrogates to reduce computational time, the algorithm has been implemented on multiple processors using a master–slave topology. The preliminary results of two constrained robust design optimization problems indicate that substantial savings in the actual number of function evaluations are possible while maintaining an acceptable level of solution quality.     

An adaptive penalty scheme to solve constrained structural optimization problems by a Craziness based Particle Swarm Optimization

The use of Evolutionary Algorithms (EAs) to solve optimization problems has been increasing. One of the most used techniques is Particle Swarm Optimization (PSO), which is considered robust, efficient and competitive in comparison with other bio-inspired algorithms. EAs were originally designed to solve unconstrained optimization problems. However, the most significant problems, particularly those from real world optimization, present constraints. It is not trivial to define a strategy to handle constraints and, in general, penalty functions containing parameters to be set by the user and it may affect the search considerably. This paper consists of a combination of the Craziness based Particle Swarm Optimization (CRPSO) with an adaptive penalty technique, called Adaptive Penalty Method (APM), to solve constrained optimization problems. A CRPSO is adopted here in order to avoid premature convergence using a new velocity expression and an operator called “craziness velocity”. APM and its variants were applied in other EAs, originally in a Genetic Algorithm, which demonstrated its robustness. APM deals with inequality and equality constraints, and it is free of parameters to be defined by the user. In order to assess the applicability and performance of the algorithm, several structural engineering optimization problems traditionally found in the literature are used in the computational experiments.     

Reliability optimization using multiobjective ant colony system approaches

The multiobjective ant colony system (ACS) meta-heuristic has been developed to provide solutions for the reliability optimization problem of series-parallel systems. This type of problems involves selection of components with multiple choices and redundancy levels that produce maximum benefits, and is subject to the cost and weight constraints at the system level. These are very common and realistic problems encountered in conceptual design of many engineering systems. It is becoming increasingly important to develop efficient solutions to these problems because many mechanical and electrical systems are becoming more complex, even as development schedules get shorter and reliability requirements become very stringent. The multiobjective ACS algorithm offers distinct advantages to these problems compared with alternative optimization methods, and can be applied to a more diverse problem domain with respect to the type or size of the problems. Through the combination of probabilistic search, multiobjective formulation of local moves and the dynamic penalty method, the multiobjective ACSRAP, allows us to obtain an optimal design solution very frequently and more quickly than with some other heuristic approaches. The proposed algorithm was successfully applied to an engineering design problem of gearbox with multiple stages.     

A Hopfield Neural Network Approach to the Dual Response Problem

The application of neural networks to optimization problems has been an active research area since the early 1980s. Unconstrained optimization, constrained optimization and combinatorial optimization problems have been solved using neural networks. This study presents a new approach using Hopfield neural networks (HNNs) for solving the dual response system (DRS) problems. The major aim of the proposed method is to produce a string of solutions, rather than a ‘one‐shot’ optimum solution, to make the trade‐offs available between the mean and standard deviation responses. This gives more flexibility to the decision‐maker in exploring alternative solutions. The proposed method has been tested on two examples. The HNN results are very close to those obtained by using the NIMBUS (Nondifferentiable Interactive Multiobjective Bundle‐based Optimization System) algorithm. Choosing an appropriate solution method for a certain multi‐objective optimization problem is not easy, as has been made abundantly clear. Unlike the NIMBUS method, the HNN approach does not set any specific assumptions on the behaviour or the preference structure of the decision maker. As a result, the proposed method will still work and generate alternative solutions whether or not the decision maker has enough time and capabilities for co‐operation. Copyright © 2005 John Wiley & Sons, Ltd.     

Variation-aware clock network buffer sizing using robust multi-objective optimization

Many engineering optimization problems include unavoidable uncertainties in parameters or variables. Ignoring such uncertainties when solving the optimization problems may lead to inferior solutions that may even violate problem constraints. Another challenge in most engineering optimization problems is having different conflicting objectives that cannot be minimized simultaneously. Finding a balanced trade-off between these objectives is a complex and time-consuming task. In this paper, an optimization framework is proposed to address both of these challenges. First, we exploit a self-calibrating multi-objective framework to achieve a balanced trade-off between the conflicting objectives. Then, we develop the robust counterpart of the uncertainty-aware self-calibrating multi-objective optimization framework. The significance of this framework is that it does not need any manual tuning by the designer. We also develop a mathematical demonstration of the objective scale invariance property of the proposed framework. The engineering problem considered in this paper to illustrate the effectiveness of the proposed framework is a popular sizing problem in digital integrated circuit design. However, the proposed framework can be applied to any uncertain multi-objective optimization problem that can be formulated in the geometric programming format. We propose to consider variations in the sizes of circuit elements during the optimization process by employing ellipsoidal uncertainty model. For validation, several industrial clock networks are sized by the proposed framework. The results show a significant reduction in one objective (power, on average 38 %) as well as significant increase in the robustness of solutions to the variations. This is achieved with no significant degradation in the other objective (timing metrics of the circuit) or reduction in its standard deviation which demonstrates a more robust solution.     

Genetic algorithms for job shop scheduling problems with alternative routings

The purpose of this research is to solve a general job shop problem with alternative machine routings. We consider four performance measures: mean flow time, makespan, maximum lateness, and total absolute deviation from the due dates. We first develop mixed-integer linear programming (MILP) formulations for the problems. The MILP formulations can be used either to compute optimal solutions for small-sized problems or to test the performance of existing heuristic algorithms. In addition, we have developed a genetic algorithm that can be used to generate relatively good solutions quickly. Further, computational experiments have been performed to compare the solution of the MILP formulations with that of existing algorithms.     

A tutorial on geometric programming

A geometric program (GP) is a type of mathematical optimization problem characterized by objective and constraint functions that have a special form. Recently developed solution methods can solve even large-scale GPs extremely efficiently and reliably; at the same time a number of practical problems, particularly in circuit design, have been found to be equivalent to (or well approximated by) GPs. Putting these two together, we get effective solutions for the practical problems. The basic approach in GP modeling is to attempt to express a practical problem, such as an engineering analysis or design problem, in GP format. In the best case, this formulation is exact; when this is not possible, we settle for an approximate formulation. This tutorial paper collects together in one place the basic background material needed to do GP modeling. We start with the basic definitions and facts, and some methods used to transform problems into GP format. We show how to recognize functions and problems compatible with GP, and how to approximate functions or data in a form compatible with GP (when this is possible). We give some simple and representative examples, and also describe some common extensions of GP, along with methods for solving (or approximately solving) them.     

Efficient hybrid evolutionary algorithm for optimization of a strip coiling process

This article proposes an efficient metaheuristic based on hybridization of teaching–learning-based optimization and differential evolution for optimization to improve the flatness of a strip during a strip coiling process. Differential evolution operators were integrated into the teaching–learning-based optimization with a Latin hypercube sampling technique for generation of an initial population. The objective function was introduced to reduce axial inhomogeneity of the stress distribution and the maximum compressive stress calculated by Love's elastic solution within the thin strip, which may cause an irregular surface profile of the strip during the strip coiling process. The hybrid optimizer and several well-established evolutionary algorithms (EAs) were used to solve the optimization problem. The comparative studies show that the proposed hybrid algorithm outperformed other EAs in terms of convergence rate and consistency. It was found that the proposed hybrid approach was powerful for process optimization, especially with a large-scale design problem.     

Evolutionary algorithms applied to reliable communication network design

Several evolutionary algorithms (EAs) applied to a wide class of communication network design problems modelled under the generalized Steiner problem (GSP) are evaluated. In order to provide a fault-tolerant design, a solution to this problem consists of a preset number of independent paths linking each pair of potentially communicating terminal nodes. This usually requires considering intermediate non-terminal nodes (Steiner nodes), which are used to ensure path redundancy, while trying to minimize the overall cost. The GSP is an NP-hard problem for which few algorithms have been proposed. This article presents a comparative study of pure and hybrid EAs applied to the GSP, codified over MALLBA, a general purpose library for combinatorial optimization. The algorithms were tested on several GSPs, and asset efficient numerical results are reported for both serial and distributed models of the evaluated algorithms.     

Deriving inventory-control policies with genetic programming

One of the key areas of operations and supply chain management is inventory control. Inventory control determines which quantity of a product should be ordered when to achieve some objective, such as minimizing cost. Inventory-control policies are typically derived analytically, and this requires advanced mathematical skills and can be quite time consuming. In this paper, we present an alternative approach for solving inventory-control problems that is based on Genetic Programming. Genetic Programming is an optimization method that applies the principles of natural evolution to optimization problems. One of the key characteristics of Genetic Programming is that it does not require the specification of how a problem should be solved, but only the specification of what needs to be solved. After the user has specified the problem, GP searches for a solution without significant human involvement. The solutions generated by GP can be simple algorithms or closed-form expressions that represent the decision variables, i.e., the order point and the order quantity as a function of the problem parameters. However, expert knowledge in inventory control is still essential for building the inventory models and determining the parameters of Genetic Programming. Genetic Programming searches for both the structure and the parameters of the optimal solution. For simple settings, the structure and the parameters of the optimal solution can be found. For complex settings, near-optimal solutions that outperform traditional heuristics can be found if the structure of the optimal solution is known.     

Efficiency for multiobjective multidisciplinary optimization problems with quasiseparable subproblems

Multidisciplinary optimization (MDO) has proved to be a useful tool for engineering design problems. Multiobjective optimization has been introduced to strengthen MDO techniques and deal with non-comparable and conflicting design objectives. A large majority of papers on multiobjective MDO have been applied in nature. This paper develops theory of multiobjective MDO and examines relationships between efficient solutions of a quasi-separable multiobjective multidisciplinary optimization problem and efficient solutions of its separable counterpart. Equivalence of the original and separable problems in the context of the Kuhn-Tucker constraint qualification and efficiency conditions are proved. Two decomposition approaches are proposed and offer a possibility of finding efficient solutions of the original problem by only finding efficient solutions of the subproblems. The presented results are related to algorithms published in the engineering literature on multiobjective MDO.     

Optimizing of ANFIS for estimating INS error during GPS outages

Global positioning system (GPS) has been extensively used for land vehicle navigation systems. However, GPS is incapable of providing permanent and reliable navigation solutions in the presence of signal evaporation or blockage. On the other hand, navigation systems, in particular, inertial navigation systems (INSs), have become important components in different military and civil applications due to the recent advent of micro-electro-mechanical systems (MEMS). Both INS and GPS systems are often paired together to provide a reliable navigation solution by integrating the long-term GPS accuracy with the short-term INS accuracy. This article presents an alternative method to integrate GPS and INS systems and provide a robust navigation solution. This alternative approach to Kalman filtering (KF) utilizes artificial intelligence based on adaptive neuro-fuzzy inference system (ANFIS) to fuse data from both systems and estimate position and velocity errors. The KF is usually criticized for working only under predefined models and for its observability problem of hidden state variables, sensor error models, immunity to noise, sensor dependency, and linearization dependency. The training and updating of ANFIS parameters is one of the main problems. Therefore, the challenges encountered implementing an ANFIS module in real time have been overcome using particle swarm optimization (PSO) to optimize the ANFIS learning parameters since PSO involves less complexity and has fast convergence. The proposed alternative method uses GPS with INS data and PSO to update the intelligent PANFIS navigator using GPS/INS error as a fitness function to be minimized. Three methods of optimization have been tested and compared to estimate the INS error. Finally, the performance of the proposed alternative method has been examined using real field test data of MEMS grade INS integrated with GPS for different GPS outage periods. The results obtained outperform KF, particularly during long GPS signal blockage.     

Dark Forest Algorithm: A Novel Metaheuristic Algorithm for Global Optimization Problems

Metaheuristic algorithms, as effective methods for solving optimization problems, have recently attracted considerable attention in science and engineering fields. They are popular and have broad applications owing to their high efficiency and low complexity. These algorithms are generally based on the behaviors observed in nature, physical sciences, or humans. This study proposes a novel metaheuristic algorithm called dark forest algorithm (DFA), which can yield improved optimization results for global optimization problems. In DFA, the population is divided into four groups: highest civilization, advanced civilization, normal civilization, and low civilization. Each civilization has a unique way of iteration. To verify DFA’s capability, the performance of DFA on 35 well-known benchmark functions is compared with that of six other metaheuristic algorithms, including artificial bee colony algorithm, firefly algorithm, grey wolf optimizer, harmony search algorithm, grasshopper optimization algorithm, and whale optimization algorithm. The results show that DFA provides solutions with improved efficiency for problems with low dimensions and outperforms most other algorithms when solving high dimensional problems. DFA is applied to five engineering projects to demonstrate its applicability. The results show that the performance of DFA is competitive to that of current well-known metaheuristic algorithms. Finally, potential upgrading routes for DFA are proposed as possible future developments.