Iterative Path Integral Approach to Nonlinear Stochastic Optimal Control Under Compound Poisson Noise

Nonlinear stochastic optimal control theory has played an important role in many fields. In this theory, uncertainties of dynamics have usually been represented by Brownian motion, which is Gaussian white noise. However, there are many stochastic phenomena whose probability density has a long tail, which suggests the necessity to study the effect of non‐Gaussianity. This paper employs Lévy processes, which cause outliers with a significantly higher probability than Brownian motion, to describe such uncertainties. In general, the optimal control law is obtained by solving the Hamilton–Jacobi–Bellman equation. This paper shows that the path‐integral approach combined with the policy iteration method is efficiently applicable to solve the Hamilton–Jacobi–Bellman equation in the Lévy problem setting. Finally, numerical simulations illustrate the usefulness of this method.     

Detection of environmental changes from network structure

We studied the networks of the temperature record in the atmosphere. They are made by the strength of the synchronization, including the delay between temperatures at locations on Earth. We consider these locations as nodes, and we consider a pair of locations as a link if the synchronization between them is stronger than a threshold. The network is scale-free, which is thought to contribute to the stability of the climate. This work was presented in part at the 12th International Symposium on Artificial Life and Robotics, Oita, Japan, January 25–27, 2007     

Design of a memory‐based prefilter supplementing a robust PID control system

For systems with uncertainties, lots of PID parameter tuning methods have been proposed from the view point of the robust stability theory. However, the control performance becomes conservative using robust PID controllers. In this paper, a new two‐degree‐of‐freedom (2DOF) controller, which can improve the tracking properties, is proposed for nonlinear systems. According to the proposed method, the prefilter is designed as the PD compensator whose control parameters are tuned by the idea of a memory‐based modeling (MBM) method. Since the MBM method is a type of local modeling methods for nonlinear systems, PD parameters can be tuned adequately in an online manner corresponding to nonlinear properties. Finally, the effectiveness of the newly proposed control scheme is numerically evaluated on a simulation example. Copyright © 2008 John Wiley and Sons Asia Pte Ltd and Chinese Automatic Control Society     

Achieving evenhandedness in certified email system for contract signing

Certified email is a system which enables a sender to prove a receiver’s receipt of email. Such a system can be used for applications related to electronic commerce on the Internet. This paper considers a situation where a sender or a receiver wants to change his/her mind due to the change of mail content value (e.g., stock, auction, gambling) during the transaction. We point out that no traditional certified email systems have been designed for such a case, thus one of the participants can be at a disadvantage. To avoid this problem, we propose an evenhanded certified email system in which each participant can change his/her choice, either cancel or finish the transaction, at any time during the transaction.

Technique for anisotropic extension of organic crystals: application to temperature dependence of electrical resistance

We have developed a technique for the anisotropic extension of fragile molecular crystals. The pressure medium and the instrument, which extends the pressure medium, are both made from epoxy resin. Since the thermal contraction of our instrument is identical to that of the pressure medium, the strain applied to the pressure medium has no temperature dependence down to 2 K. Therefore, the degree of extension applied to the single crystal at low temperatures is uniquely determined from the degree of extension in the pressure medium and thermal contractions of the epoxy resin and the single crystal at ambient pressure. Using this novel instrument, we have measured the temperature dependence of the electrical resistance of metallic, superconducting, and insulating materials. The experimental results are discussed from the viewpoint of the extension (compression) of the lattice constants along the parallel (perpendicular) direction.     

Accumulation of triosephosphate isomerase, with sequence homology to Beta amyloid peptides, in vessel walls of the newborn piglet hippocampus

We investigated whether beta-amyloid (Abeta)-like immunoreactivity was seen in the brains of newborn piglets. The immunoreactivity for Abeta(1-42) and Abeta(1-40) proteins, but not Abeta precursor protein, was present in CD68-positive perivascular cells of the hippocampus and in parts of the meninges. It was colocalized with immunoreactivity for receptor for advanced glycation end product and tumor necrosis factor-alpha. The protein with a molecular mass of 27 kDa, which was recognized by the Abeta antibodies, was identified as triosephosphate isomerase (TPI) with sequence homology to Abeta peptides by N-terminal amino acid sequencing, mass fingerprint analysis using matrix-associated laser desorption/ionization mass spectrometry, and Western blotting. Western blotting assay also revealed that detectable expression of Abeta proteins were not seen in the piglet brains. These findings indicate that TPI with sequence homology to Abeta peptides accumulates in perivascular cells of the microglia/macrophage lineage located around arterial vessels of the newborn piglet hippocampus.     

Selectivity and stability via dendritic nonlinearity

Inspired by recent studies regarding dendritic computation, we constructed a recurrent neural network model incorporating dendritic lateral inhibition. Our model consists of an input layer and a neuron layer that includes excitatory cells and an inhibitory cell; this inhibitory cell is activated by the pooled activities of all the excitatory cells, and it in turn inhibits each dendritic branch of the excitatory cells that receive excitations from the input layer. Dendritic nonlinear operation consisting of branch-specifically rectified inhibition and saturation is described by imposing nonlinear transfer functions before summation over the branches. In this model with sufficiently strong recurrent excitation, on transiently presenting a stimulus that has a high correlation with feed- forward connections of one of the excitatory cells, the corresponding cell becomes highly active, and the activity is sustained after the stimulus is turned off, whereas all the other excitatory cells continue to have low activities. But on transiently presenting a stimulus that does not have high correlations with feedforward connections of any of the excitatory cells, all the excitatory cells continue to have low activities. Interestingly, such stimulus-selective sustained response is preserved for a wide range of stimulus intensity. We derive an analytical formulation of the model in the limit where individual excitatory cells have an infinite number of dendritic branches and prove the existence of an equilibrium point corresponding to such a balanced low-level activity state as observed in the simulations, whose stability depends solely on the signal-to-noise ratio of the stimulus. We propose this model as a model of stimulus selectivity equipped with self-sustainability and intensity-invariance simultaneously, which was difficult in the conventional competitive neural networks with a similar degree of complexity in their network architecture. We discuss the biological relevance of the model in a general framework of computational neuroscience.     

Role of granulosa and theca cell interactions in ovarian follicular maturation

We developed a culture system in which two types of ovarian follicular cells were allowed to attach to opposite sides of a collagen membrane. Using this in vitro cell culture system, we studied the effects of granulosa- and theca-cell interaction on the morphology, structure, and function of bovine ovarian follicular cells. In the first part of the study, we explored how the interaction between theca and granulosa cells affects the morphology and structure of the cells. This study was done using follicular cells collected from bovine ovarian follicles at the early developmental stage. Granulosa cells cultured alone were flattened, and formed a monolayer sheet. By contrast, granulosa cells cultured with theca cells were convex, and formed multilayer sheets. Theca cells cultured alone were thin, flat, and spindle-shaped. Theca cells cultured with granulosa cells were also spindle-shaped; however, they appeared convex and more densely packed when compared with theca cells cultured alone. In the second part of the study, the possible role of the cellular interaction in the control of differentiation and growth of granulosa and theca cells was investigated. When follicular cells were isolated from the early stage of follicular development, theca cells reduced progesterone and inhibin production by granulosa cells and augmented the growth of granulosa cells. When the cells were isolated from the late stage of follicular development, by contrast, theca cells augmented hormonal production by granulosa cells, and did not affect the growth of granulosa cells. The growth and androstenedione production by theca cells were increased by the presence of granulosa cells, irrespective of the origin of follicular cells. These results demonstrated that communication between two types of follicular cells results in reciprocal modulation of their morphology, structure, growth, and function. Cellular interactions seem to be one of the major factors controlling the differentiation and growth of the follicular cells during the follicular maturation process. In contrast to granulosa and theca cells cultured alone, cells in the coculture seemed to possess morphological and functional characteristics more similar to those of cells in the growing follicular wall in vivo. Thus, we speculate that the interaction between these two types of follicular cells is essential for the maintenance of original structure and function of the bovine follicular wall.     

Patient views of adverse events: comparisons of self-reported healthcare staff attitudes with disclosure of accident information

In the present paper, we report results of surveys in 2003 in Japan and Denmark about patients' views about adverse events, focusing on the actions of healthcare staff involved in a medical accident. Results show that patients were more likely to indicate negative expectations to a doctor's reactions after a medical accident when asked in general terms than when asked in relation to concrete case stories. When asked in general terms, 66% (47%) of Japanese (Danish) respondents expected that doctors sometimes hold back on providing information to patients about a medical accident, while 37% (7%) did so when asked about a concrete, mild-outcome case. We examine some possible reasons for the relatively high level of distrust of Japanese patients, and we discuss whether the seemingly lower level of disclosure in Japan than in Denmark and the negative stories in the Japanese press may have an impact. We also suggest some implications for introducing a patient-centred or customer-centred approach to risk management in healthcare and other domains.