Visual servoing of redundant manipulator with Jacobian matrix estimation using self-organizing map

Vision based redundant manipulator control with a neural network based learning strategy is discussed in this paper. The manipulator is visually controlled with stereo vision in an eye-to-hand configuration. A novel Kohonen’s self-organizing map (KSOM) based visual servoing scheme has been proposed for a redundant manipulator with 7 degrees of freedom (DOF). The inverse kinematic relationship of the manipulator is learned using a Kohonen’s self-organizing map. This learned map is shown to be an approximate estimate of the inverse Jacobian, which can then be used in conjunction with the proportional controller to achieve closed loop servoing in real-time. It is shown through Lyapunov stability analysis that the proposed learning based servoing scheme ensures global stability. A generalized weight update law is proposed for KSOM based inverse kinematic control, to resolve the redundancy during the learning phase. Unlike the existing visual servoing schemes, the proposed KSOM based scheme eliminates the computation of the pseudo-inverse of the Jacobian matrix in real-time. This makes the proposed algorithm computationally more efficient. The proposed scheme has been implemented on a 7 DOF PowerCube? robot manipulator with visual feedback from two cameras.     

Visual Motor Control of a 7 DOF Robot Manipulator Using Function Decomposition and Sub-Clustering in Configuration Space

This paper deals with real-time implementation of visual-motor control of a 7 degree of freedom (DOF) robot manipulator using self-organized map (SOM) based learning approach. The robot manipulator considered here is a 7 DOF PowerCube manipulator from Amtec Robotics. The primary objective is to reach a target point in the task space using only a single step movement from any arbitrary initial configuration of the robot manipulator. A new clustering algorithm using Kohonen SOM lattice has been proposed that maintains the fidelity of training data. Two different approaches have been proposed to find an inverse kinematic solution without using any orientation feedback. In the first approach, the inverse Jacobian matrices are learnt from the training data using function decomposition. It is shown that function decomposition leads to significant improvement in accuracy of inverse kinematic solution. In the second approach, a concept called sub-clustering in configuration space is suggested to provide multiple solutions for the inverse kinematic problem. Redundancy is resolved at position level using several criteria. A redundant manipulator is dexterous owing to the availability of multiple configurations for a given end-effector position. However, existing visual motor coordination schemes provide only one inverse kinematic solution for every target position even when the manipulator is kinematically redundant. Thus, the second approach provides a learning architecture that can capture redundancy from the training data. The training data are generated using explicit kinematic model of the combined robot manipulator and camera configuration. The training is carried out off-line and the trained network is used on-line to compute the joint angle vector to reach a target position in a single step only. The accuracy attained is better than the current state of art.     

Kinematic control of a redundant manipulator using an inverse-forward adaptive scheme with a KSOM based hint generator

This paper proposes an online inverse-forward adaptive scheme with a KSOM based hint generator for solving the inverse kinematic problem of a redundant manipulator. In this approach, a feed-forward network such as a radial basis function (RBF) network is used to learn the forward kinematic map of the redundant manipulator. This network is inverted using an inverse-forward adaptive scheme until the network inversion solution guides the manipulator end-effector to reach a given target position with a specified accuracy. The positioning accuracy, attainable by a conventional network inversion scheme, depends on the approximation error present in the forward model. But, an accurate forward map would require a very large size of training data as well as network architecture. The proposed inverse-forward adaptive scheme effectively approximates the forward map around the joint angle vector provided by a hint generator. Thus the inverse kinematic solution obtained using the network inversion approach can take the end-effector to the target position within any arbitrary accuracy.In order to satisfy the joint angle constraints, it is necessary to provide the network inversion algorithm with an initial hint for the joint angle vector. Since a redundant manipulator can reach a given target end-effector position through several joint angle vectors, it is desirable that the hint generator is capable of providing multiple hints. This problem has been addressed by using a Kohonen self organizing map based sub-clustering (KSOM-SC) network architecture. The redundancy resolution process involves selecting a suitable joint angle configuration based on different task related criteria.The simulations and experiments are carried out on a 7 DOF PowerCube? manipulator. It is shown that one can obtain a positioning accuracy of 1 mm without violating joint angle constraints even when the forward approximation error is as large as 4 cm. An obstacle avoidance problem has also been solved to demonstrate the redundancy resolution process with the proposed scheme.     

Uncalibrated Eye-to-Hand Visual Servoing Using Inverse Fuzzy Models

A new uncalibrated eye-to-hand visual servoing based on inverse fuzzy modeling is proposed in this paper. In classical visual servoing, the Jacobian plays a decisive role in the convergence of the controller, as its analytical model depends on the selected image features. This Jacobian must also be inverted online. Fuzzy modeling is applied to obtain an inverse model of the mapping between image feature variations and joint velocities. This approach is independent from the robot's kinematic model or camera calibration and also avoids the necessity of inverting the Jacobian online. An inverse model is identified for the robot workspace, using measurement data of a robotic manipulator. This inverse model is directly used as a controller. The inverse fuzzy control scheme is applied to a robotic manipulator performing visual servoing for random positioning in the robot workspace. The obtained experimental results show the effectiveness of the proposed control scheme. The fuzzy controller can position the robotic manipulator at any point in the workspace with better accuracy than the classic visual servoing approach.     

New inverse kinematic algorithms for redundant robots

New inverse kinematic algorithms for generating redundant robot joint trajectories are proposed. The algorithms utilize the kinematic redundancy to improve robot motion performance (in joint space or Cartesian space) as specified by certain objective functions. The algorithms are based on the extension of the existing “joint-space command generator” technique in which a null space vector is introduced which optimizes a specific objective function along the joint trajectories. In this article, the algorithms for generating the joint position and velocity (PV) trajectories are extensively developed. The case for joint position, velocity, and acceleration (PVA) generation is also addressed. Application of the algorithms to a four-link revolute planar robot manipulator is demonstrated through simulation. Several motion performance criteria are considered and their results analyzed.     

Application of Fuzzy Logic for the Solution of Inverse Kinematics and Hierarchical Controls of Robotic Manipulators

In this paper, hierarchical control techniques is used for controlling a robotic manipulator. The proposed method is based on the establishment of a non-linear mapping between Cartesian and joint coordinates using fuzzy logic in order to direct each individual joint. The hierarchical control will be implemented with fuzzy logic to improve the robustness and reduce the run time computational requirements. Hierarchical control consists of solving the inverse kinematic equations using fuzzy logic to direct each individual joint. A commercial Microbot with three degrees of freedom is utilized to evaluate this methodology. A decentralized fuzzy controller is used for each joint, with a Fuzzy Associative Memories (FAM) performing the inverse kinematic mapping in a supervisory mode. The FAM determines the inverse kinematic mapping which maps the desired Cartesian coordinates to the individual joint angles. The individual fuzzy controller for each joint generates the required control signal to a DC motor to move the associated link to the new position. The proposed hierarchical fuzzy controller is compared to a conventional controller. The simulation experiments indeed demonstate the effectiveness of the proposed method.     

Self-Learning for a Humanoid Robotic Ping-Pong Player

Imitating the learning process of a human playing ping-pong is extremely complex. This work proposes a suitable learning strategy. First, an inverse kinematics solution is presented to obtain the smooth joint angles of a redundant anthropomorphic robot arm in order to imitate the paddle motion of a human ping-pong player. As humans instinctively determine which posture is suitable for striking a ball, this work proposes two novel processes: (i) estimating ball states and predicting trajectory using a fuzzy adaptive resonance theory network, and (ii) self-learning the behavior for each strike using a self-organizing map-based reinforcement learning network that imitates human learning behavior. Experimental results demonstrate that the proposed algorithms work effectively when applied to an actual humanoid robot playing ping-pong.     

Canonical parameterization of excess motor degrees of freedom withself-organizing maps

The problem of sensorimotor control is underdetermined due to excess (or "redundant") degrees of freedom when there are more joint variables than the minimum needed for positioning an end-effector. A method is presented for solving the nonlinear inverse kinematics problem for a redundant manipulator by learning a natural parameterization of the inverse solution manifolds with self-organizing maps. The parameterization approximates the topological structure of the joint space, which is that of a fiber bundle. The fibers represent the "self-motion manifolds" along which the manipulator can change configuration while keeping the end-effector at a fixed location. The method is demonstrated for the case of the redundant planar manipulator. Data samples along the self-motion manifolds are selected from a large set of measured input-output data. This is done by taking points in the joint space corresponding to end-effector locations near "query points", which define small neighborhoods in the end-effector work space. Self-organizing maps are used to construct an approximate parameterization of each manifold which is consistent for all of the query points. The resulting parameterization is used to augment the overall kinematics map so that it is locally invertible. Joint-angle and end-effector position data, along with the learned parameterizations, are used to train neural networks to approximate direct inverse functions.     

Fault-tolerant motion planning and control of redundant manipulator

One important issue in the motion planning of a kinematic redundant manipulator is fault tolerance. In general, if the motion planner is fault tolerant, the manipulator can achieve the required path of the end-effector even when its joint fails. In this situation, the contribution of the faulty joint to the end-effector is required to be compensated by the healthy joints to maintain the prescribed end-effector trajectory. To achieve this, this paper proposes a fault-tolerant motion planning scheme by adding a simple fault-tolerant equality constraint for the faulty joint. Such a scheme is then unified into a quadratic program (QP), which incorporates joint-physical constraints such as joint limits and joint-velocity limits. In addition, a numerical computing solver based on linear variational inequalities (LVI) is presented for the real-time QP solving. Simulative studies and experimental results based on a six degrees-of-freedom (DOF) redundant robot manipulator with variable joint-velocity limits substantiate the effectiveness of the proposed fault-tolerant scheme and its solution.     

Kinematics analysis of a novel all-attitude flight simulator

To overcome the kinematic singularity limitation of simulator, which is unavoidable in a three-axis architecture, an all-attitude flight simulator in a four-axis architecture is proposed. The simulator can always provide 3DOF motion by applying redundant manipulator mechanism. For direct kinematics of the manipulator, a dual-Euler method is adopted to solve the expressions of attitude angles; thus computation singularity of all- attitude angles is overcome. For inverse kinematics of the manipulator, pseudo-...     

Robust adaptive control of redundant manipulators

This paper presents an adaptive scheme for the motion control of kinematically redundant manipulators. The proposed controller is very general and computationally efficient since it does not require knowledge of either the mathematical model or the parameter values of the robot dynamics, and is implemented without calculation of the robot inverse dynamics or inverse kinematic transformation. It is shown that the control strategy is globally stable in the presence of bounded disturbances, and that in the absence of disturbances the size of the residual tracking errors can be made arbitrarily small. The performance of the controller is illustrated through computer simulations with a nine degree-of-freedom (DOF) compound manipulator consisting of a relatively small, fast six-DOF manipulator mounted on a large three-DOF positioning device. These simulations demonstrate that the proposed scheme provides accurate and robust trajectory tracking and, moreover, permits the available redundancy to be utilized so that a high bandwidth response can be achieved over a large workspace.     

Multiple fuzzy state-value functions for human evaluation through interactive trajectory planning of a partner robot

The purpose of this study is to develop partner robots that can obtain and accumulate human-friendly behaviors. To achieve this purpose, the entire architecture of the robot is designed, based on a concept of structured learning which emphasizes the importance of interactive learning of several modules through interaction with its environment. This paper deals with a trajectory planning method for generating hand-to-hand behaviors of a partner robot by using multiple fuzzy state-value functions, a self-organizing map, and an interactive genetic algorithm. A trajectory for the behavior is generated by an interactive genetic algorithm using human evaluation. In order to reduce human load, human evaluation is estimated by using the fuzzy state-value function. Furthermore, to cope with various situations, a self-organizing map is used for clustering a given task dependent on a human hand position. And then, a fuzzy state-value function is assigned to each output unit of the self-organizing map. The robot can easily obtain and accumulate human-friendly trajectories using a fuzzy state-value function and a knowledge database corresponding to the unit selected in the self-organizing map. Finally, multiple fuzzy state-value functions can estimate a human evaluation model for the hand-to-hand behaviors. Several experimental results show the effectiveness of the proposed method.     

Kinematic aspects of a robot-positioner system in an arc welding application

This paper focuses on the kinematic control of a redundant robotic system taking into account particularities of the arc welding technology. The considered system consists of a 6-axis industrial robot (welding tool manipulator) and a 2-axis welding positioner (workpiece manipulator) that is intended to optimise a weld joint orientation during the technological process. The particular contribution of the paper lies in the area of the positioner inverse kinematics, which is a key issue of such system off-line programming and control. It has been proposed a novel formulation and a closed-form solution of the inverse kinematic problem that deals with the explicit definition of the weld joint orientation relative to the gravity. Similar results have also been obtained for the known problem statement that is based on a unit vector transformation. For both the cases, a detailed investigation of the singularities and uniqueness-existence topics have been carried out. The presented results are implemented in a commercial software package and verified for real-life applications in the automotive industry.     

Reliability-based approach to the inverse kinematics solution of robots using Elman's networks

The solution of inverse kinematics problem of redundant manipulators is a fundamental problem in robot control. The inverse kinematics problem in robotics is the determination of joint angles for a desired cartesian position of the end effector. For the solution of this problem, many traditional solutions such as geometric, iterative and algebraic are inadequate if the joint structure of the manipulator is more complex. Furthermore, many neural network approaches have been done to this problem. But the neural network-based solutions are not much reliable due to the error at the end of learning. Therefore, a reliability-based neural network inverse kinematics solution approach has been presented, and applied to a six-degrees of freedom (dof) robot manipulator in this paper. The structure of the proposed method is based on using three networks designed parallel to minimize the error of the whole system. Elman network, which has a profound impact on the learning capability and performance of the network, is chosen and designed according to the proposed solution method. At the end of parallel implementation, the results of each network are evaluated using direct kinematics equations to obtain the network with best result.     

Equilibrium point control of a robot manipulator using biologically-inspired redundant actuation system

Unlike their robotic counterparts, humans excel at various contact tasks even in unknown environments by utilizing their ability to adaptively modulate the arm impedance. As one of many theories in human motor control, the equilibrium point control hypothesis suggests that multi-joint limb movements can be achieved by shifting the equilibrium positions defined by the central nervous system and utilizing the spring-like property of the peripheral neuromuscular system. To generate human arm-like compliant motion, this study implements the equilibrium point control on a robot manipulator using redundant actuation: two actuators are installed on each joint: one to control the joint position and the other to control the joint stiffness, respectively. With the double-actuator unit, the equilibrium position and stiffness (or impedance) can be independently programmed. Also, it is possible to estimate the contact force based on angle measurement with a user-specified stiffness. These features enable the robot manipulator to execute stable and safe movement in contact tasks. A two-link manipulator equipped with the double-actuator units was developed, and experimental results from teleoperated contact tasks show the potential of the proposed approach.     

Separating visual information into position and direction by SOM

A model is proposed to self-organize a map for the visual recognition of position and direction by a robot moving autonomously in a room. The robot is assumed to have visual sensors. The model is based on Kohonens self-organizing map (SOM), which was proposed as a model of self-organization of the cortex. An ordinary SOM consists of a two-dimensional array of neuron-like feature detector units. In our model, however, units are arranged in a three-dimensional array, and a periodic boundary condition is assumed in one dimension. Also, some new learning rules are added. Our model is shown by a computer simulation to form a map which can extract from the visual input two factors of information separately, i.e., the position and direction of the robot. This is an example of so-called two-factor problems. In our algorithm, the difference in the topology of the information is used to separate two factors of information.This work was presented in part at the 8th International Symposium on Artificial Life and Robotics, Oita, Japan, January 24–26, 2003     

仿人机器人复杂动作设计中人体运动数据提取及分析方法

提出了仿人机器人复杂动作设计中人体运动数据提取及分析方法. 首先, 通过运动捕捉系统获取人体运动数据, 并采用运动重定向技术, 输出人--机简化模型的数据; 然后, 对运动数据进行分析和运动学解算, 给出基于人体运动数据的仿人机器人逆运动学求解方法, 得到仿人机器人模型的关节角数据; 再经过运动学约束和稳定性调节后, 生成能够应用于仿人机器人的运动轨迹. 最终, 通过在仿人机器人BHR-2上进行刀术实验验证了该方法的有效性.     

Failure tolerant teleoperation of a kinematically redundant manipulator: an experimental study

Teleoperated robots in harsh environments have a significant likelihood of failures. It has been shown in previous work that a common type of failure such as that of a joint "locking up," when unidentified by the robot controller, can cause considerable performance degradation in the local behavior of the manipulator even for simple point-to-point motion tasks. The effects of a failure become more critical for a system with a human in the loop, where unpredictable behavior of the robotic arm can completely disorient the operator. In this experimental study involving teleoperation of a graphically simulated kinematically redundant manipulator, two control schemes, the pseudoinverse and a proposed failure-tolerant inverse, were randomly presented under both nonfailure and failure scenarios to a group of operators. Based on performance measures derived from the recorded trajectory data and operator ratings of task difficulty, it is seen that the failure-tolerant inverse kinematic control scheme improved the performance of the human/robot system.     

Analytical Inverse Kinematic Computation for 7-DOF Redundant Manipulators With Joint Limits and Its Application to Redundancy Resolution

This paper proposes an analytical methodology of inverse kinematic computation for 7 DOF redundant manipulators with joint limits. Specifically, the paper focuses on how to obtain all feasible inverse kinematic solutions in the global configuration space where joint movable ranges are limited. First, a closed-form inverse kinematic solution is derived based on a parameterization method. Second, how the joint limits affect the feasibility of the inverse solution is investigated to develop an analytical method for computing feasible solutions under the joint limits. Third, how to apply the method to the redundancy resolution problem is discussed and analytical methods to avoid joint limits are developed in the position domain. Lastly, the validity of the methods is verified by kinematic simulations.      

Trajectory Planning with Collision Avoidance for Redundant Robots Using Jacobian and Artificial Potential Field-based Real-time Inverse Kinematics

This study proposes an algorithm for combining the Jacobian-based numerical approach with a modified potential field to solve real-time inverse kinematics and path planning problems for redundant robots in unknown environments. With an increase in the degree of freedom (DOF) of the manipulator, however, the problems in realtime inverse kinematics become more difficult to solve. Although the analytical and geometrical inverse kinematics approach can obtain the exact solution, it is considerably difficult to solve as the DOF increases, and it necessitates recalculations whenever the robot arm DOF or Denavit-Hartenberg (D-H) parameters change. In contrast, the numerical method, particularly the Jacobian-based numerical method, can easily solve inverse kinematics irrespective of the aforementioned changes including those in the robot shape. The latter method, however, is not employed in path planning for collision avoidance, and it presents real-time calculation problems. This study accordingly proposes the Jacobian-based numerical approach with a modified potential field method that can realize real-time calculations of inverse kinematics and path planning with collision avoidance irrespective of whether the case is redundant or non-redundant. To achieve this goal, the use of a judgment matrix is proposed for obstacle condition identification based on the obstacle boundary definition; an approach for avoiding the local minimum is also proposed. After the obstacle avoidance path is generated, a trajectory plan that follows the path and avoids the obstacle is designed. Finally, the proposed method is evaluated by implementing a motion planning simulation of a 7-DOF manipulator, and an experiment is performed on a 7-DOF real robot.