Bayesian calibration of simultaneity in audiovisual temporal order judgments

After repeated exposures to two successive audiovisual stimuli presented in one frequent order, participants eventually perceive a pair separated by some lag time in the same order as occurring simultaneously (lag adaptation). In contrast, we previously found that perceptual changes occurred in the opposite direction in response to tactile stimuli, conforming to bayesian integration theory (bayesian calibration). We further showed, in theory, that the effect of bayesian calibration cannot be observed when the lag adaptation was fully operational. This led to the hypothesis that bayesian calibration affects judgments regarding the order of audiovisual stimuli, but that this effect is concealed behind the lag adaptation mechanism. In the present study, we showed that lag adaptation is pitch-insensitive using two sounds at 1046 and 1480 Hz. This enabled us to cancel lag adaptation by associating one pitch with sound-first stimuli and the other with light-first stimuli. When we presented each type of stimulus (high- or low-tone) in a different block, the point of simultaneity shifted to "sound-first" for the pitch associated with sound-first stimuli, and to "light-first" for the pitch associated with light-first stimuli. These results are consistent with lag adaptation. In contrast, when we delivered each type of stimulus in a randomized order, the point of simultaneity shifted to "light-first" for the pitch associated with sound-first stimuli, and to "sound-first" for the pitch associated with light-first stimuli. The results clearly show that bayesian calibration is pitch-specific and is at work behind pitch-insensitive lag adaptation during temporal order judgment of audiovisual stimuli.     

Neural gain changes subserving perceptual acuity

When small and large objects of equal weight are lifted, the small object feels heavier than the large one (the size-weight illusion) and requires more effort to lift (the size-effort illusion). It has been suggested that these illusions result from neural gain changes designed to maintain acuity under different working conditions. If this suggestion is correct, a given mass should produce a larger increase in perceived weight or effort when added to the small object. This was found to be the case.     

Mirror adaptation in sensory-motor simultaneity

Background

When one watches a sports game, one may feel her/his own muscles moving in synchrony with the player''s. Such parallels between observed actions of others and one''s own has been well supported in the latest progress in neuroscience, and coined “mirror system.” It is likely that due to such phenomena, we are able to learn motor skills just by observing an expert''s performance. Yet it is unknown whether such indirect learning occurs only at higher cognitive levels, or also at basic sensorimotor levels where sensorimotor delay is compensated and the timing of sensory feedback is constantly calibrated.

Methodology/Principal Findings

Here, we show that the subject''s passive observation of an actor manipulating a computer mouse with delayed auditory feedback led to shifts in subjective simultaneity of self mouse manipulation and auditory stimulus in the observing subjects. Likewise, self adaptation to the delayed feedback modulated the simultaneity judgment of the other subjects manipulating a mouse and an auditory stimulus. Meanwhile, subjective simultaneity of a simple visual disc and the auditory stimulus (flash test) was not affected by observation of an actor nor self-adaptation.

Conclusions/Significance

The lack of shift in the flash test for both conditions indicates that the recalibration transfer is specific to the action domain, and is not due to a general sensory adaptation. This points to the involvement of a system for the temporal monitoring of actions, one that processes both one''s own actions and those of others.     

Dynamic integration of reward and stimulus information in perceptual decision-making

In perceptual decision-making, ideal decision-makers should bias their choices toward alternatives associated with larger rewards, and the extent of the bias should decrease as stimulus sensitivity increases. When responses must be made at different times after stimulus onset, stimulus sensitivity grows with time from zero to a final asymptotic level. Are decision makers able to produce responses that are more biased if they are made soon after stimulus onset, but less biased if they are made after more evidence has been accumulated? If so, how close to optimal can they come in doing this, and how might their performance be achieved mechanistically? We report an experiment in which the payoff for each alternative is indicated before stimulus onset. Processing time is controlled by a “go” cue occurring at different times post stimulus onset, requiring a response within msec. Reward bias does start high when processing time is short and decreases as sensitivity increases, leveling off at a non-zero value. However, the degree of bias is sub-optimal for shorter processing times. We present a mechanistic account of participants'' performance within the framework of the leaky competing accumulator model [1], in which accumulators for each alternative accumulate noisy information subject to leakage and mutual inhibition. The leveling off of accuracy is attributed to mutual inhibition between the accumulators, allowing the accumulator that gathers the most evidence early in a trial to suppress the alternative. Three ways reward might affect decision making in this framework are considered. One of the three, in which reward affects the starting point of the evidence accumulation process, is consistent with the qualitative pattern of the observed reward bias effect, while the other two are not. Incorporating this assumption into the leaky competing accumulator model, we are able to provide close quantitative fits to individual participant data.     

Phase reset affects auditory-visual simultaneity judgment

We continuously receive the external information from multiple sensors simultaneously. The brain must judge a source event of these sensory informations and integrate them. It is thought that judging the simultaneity of such multisensory stimuli is an important cue when we discriminate whether the stimuli are derived from one event or not. Although previous studies have investigated the correspondence between an auditory-visual (AV) simultaneity perceptions and the neural responses, there are still few studies of this. Electrophysiological studies have reported that ongoing oscillations in human cortex affect perception. Especially, the phase resetting of ongoing oscillations has been examined as it plays an important role in multisensory integration. The aim of this study was to investigate the relationship of phase resetting for the judgment of AV simultaneity judgement tasks. The subjects were successively presented with auditory and visual stimuli with intervals that were controlled as SOA_50% and they were asked to report whether they perceived them simultaneously or not. We investigated the effects of the phase of ongoing oscillations on simultaneity judgments with AV stimuli with SOAs in which the detection rate of asynchrony was 50 %. It was found that phase resetting at the beta frequency band in the brain area that related to the modality of the following stimulus occurred after preceding stimulus onset only when the subjects perceived AV stimuli as simultaneous. This result suggested that beta phase resetting occurred in areas that are related to the subsequent stimulus, supporting perception multisensory stimuli as simultaneous.     

Delayed perceptual awareness in rapid perceptual decisions

The flourishing of studies on the neural correlates of decision-making calls for an appraisal of the relation between perceptual decisions and conscious perception. By exploiting the long integration time of noisy motion stimuli, and by forcing human observers to make difficult speeded decisions--sometimes a blind guess--about stimulus direction, we traced the temporal buildup of motion discrimination capability and perceptual awareness, as assessed trial by trial through direct rating. We found that both increased gradually with motion coherence and viewing time, but discrimination was systematically leading awareness, reaching a plateau much earlier. Sensitivity and criterion changes contributed jointly to the slow buildup of perceptual awareness. It made no difference whether motion discrimination was accomplished by saccades or verbal responses. These findings suggest that perceptual awareness emerges on the top of a developing or even mature perceptual decision. We argue that the middle temporal (MT) cortical region does not confer us the full phenomenic depth of motion perception, although it may represent a precursor stage in building our subjective sense of visual motion.     

Temporal structure in audiovisual sensory selection

In natural environments, sensory information is embedded in temporally contiguous streams of events. This is typically the case when seeing and listening to a speaker or when engaged in scene analysis. In such contexts, two mechanisms are needed to single out and build a reliable representation of an event (or object): the temporal parsing of information and the selection of relevant information in the stream. It has previously been shown that rhythmic events naturally build temporal expectations that improve sensory processing at predictable points in time. Here, we asked to which extent temporal regularities can improve the detection and identification of events across sensory modalities. To do so, we used a dynamic visual conjunction search task accompanied by auditory cues synchronized or not with the color change of the target (horizontal or vertical bar). Sounds synchronized with the visual target improved search efficiency for temporal rates below 1.4 Hz but did not affect efficiency above that stimulation rate. Desynchronized auditory cues consistently impaired visual search below 3.3 Hz. Our results are interpreted in the context of the Dynamic Attending Theory: specifically, we suggest that a cognitive operation structures events in time irrespective of the sensory modality of input. Our results further support and specify recent neurophysiological findings by showing strong temporal selectivity for audiovisual integration in the auditory-driven improvement of visual search efficiency.     

Causal inference regulates audiovisual spatial recalibration via its influence on audiovisual perception

To obtain a coherent perception of the world, our senses need to be in alignment. When we encounter misaligned cues from two sensory modalities, the brain must infer which cue is faulty and recalibrate the corresponding sense. We examined whether and how the brain uses cue reliability to identify the miscalibrated sense by measuring the audiovisual ventriloquism aftereffect for stimuli of varying visual reliability. To adjust for modality-specific biases, visual stimulus locations were chosen based on perceived alignment with auditory stimulus locations for each participant. During an audiovisual recalibration phase, participants were presented with bimodal stimuli with a fixed perceptual spatial discrepancy; they localized one modality, cued after stimulus presentation. Unimodal auditory and visual localization was measured before and after the audiovisual recalibration phase. We compared participants’ behavior to the predictions of three models of recalibration: (a) Reliability-based: each modality is recalibrated based on its relative reliability—less reliable cues are recalibrated more; (b) Fixed-ratio: the degree of recalibration for each modality is fixed; (c) Causal-inference: recalibration is directly determined by the discrepancy between a cue and its estimate, which in turn depends on the reliability of both cues, and inference about how likely the two cues derive from a common source. Vision was hardly recalibrated by audition. Auditory recalibration by vision changed idiosyncratically as visual reliability decreased: the extent of auditory recalibration either decreased monotonically, peaked at medium visual reliability, or increased monotonically. The latter two patterns cannot be explained by either the reliability-based or fixed-ratio models. Only the causal-inference model of recalibration captures the idiosyncratic influences of cue reliability on recalibration. We conclude that cue reliability, causal inference, and modality-specific biases guide cross-modal recalibration indirectly by determining the perception of audiovisual stimuli.     

Auditory stimulus-induced changes in immediate-early gene expression related to an inborn perceptual predisposition

Auditory-induced expression of the immediate-early gene ZENK was examined in 18 brain areas of domestic chicken and Japanese quail subjects with no previous exposure to parental vocalizations. After one 30-min exposure (approximately 120 calls) within 24 h of hatching to either the chicken or quail maternal call, paired subjects from each species showed significantly more intense levels of ZENK staining to conspecific (own species) calls. Single brain areas did not show consistent, large differences in ZENK expression across all subject pairs. Instead, a majority of brain areas exhibited a small conspecific stimulus-induced staining advantage in each species. The species differed in the quantitative distribution of ZENK responses among brain areas; qualitative patterns of call-induced staining exhibited both similarities and differences. The results suggest shared neural correlates and potential developmental/evolutionary differences in congenital brain responses to biologically significant auditory stimuli in na?ve individuals of the two species.     

克隆胚胎中核有丝分裂器蛋白(NuMA)的动态变化

核有丝分裂器蛋白(NuMA)是一种负责纺缍体极装配的蛋白质。供体细胞核移入去核卵母细胞后,在供体核中未发现NuMA,在重构胚的原核中出现NuMA。克隆胚胎卵裂后,NuMA存在于卵裂球的核中。在克隆胚胎中,NuMA的缺乏会导致有丝分裂纺缍体异常,染色体排列混乱,这些异常影响克隆胚胎的正常发育。     

中国东北区沼泽湿地景观的动态变化

以GIS和RS技术为关键技术平台,分析了1986~2000年东北区沼泽湿地的动态变化特征。东北区沼泽湿地较为丰富,多年平均沼泽率为3.66%;但地区分布不均匀,最大沼泽率(乌苏里江区)是最小沼泽率(绥芬河区)的407.67倍;沼泽湿地分布面积整体上呈下降趋势。东北地区沼泽湿地多年平均分布重心位于东北区几何中心北东方向,距离为150.62 km,反应了东北地区沼泽湿地景观“北多南少”的整体态势;从分布重心的年均变化程度来看,东北地区沼泽湿地受干扰的程度在1986~1996年小于1996~2000年,但各分布区间的差异明显;从各分区沼泽湿地的景观类型的动态变化来看,东北区沼泽湿地的动态变化主要受到农业开发活动(包括牧业)的影响;从沼泽湿地景观格局的动态变化来看,东北地区多年平均斑块面积为1.99 km2,但呈增加趋势;从分维特征的角度来看,东北区沼泽湿地景观平均分维指数整体上呈增加趋势,表现为斑块形状渐趋复杂。     

Mechanisms and asymmetries in visual perception of simultaneity and temporal order

Temporally overlapping, spatially separated visual stimuli were used for studying perception of simultaneity and temporal order. Pairs of flashes each of 100 ms duration were presented with stimulus onset asynchronies of 0, 30, 50, and 70 ms. Three spatial arrangements of flash presentation were tested: 1) both flashes were presented foveally; 2) one flash was presented foveally and the other at 9 deg in the left visual hemifield; 3) one flash was presented foveally and the other at 8 deg in the right visual hemifield. Onset asynchronies of 30 and 50 ms were not sufficient for correct identification of temporal order although the flashes were not perceived as simultaneous. Analysis of the response distributions suggests the existence of two-independent mechanisms for evaluating temporal interrelations: one for detecting simultaneity and the other for identifying temporal order. A better detection of simultaneity was found when synchroneous flashes were presented together with pairs of flashes separated by larger onset asynchronies. Reading habits may explain only part of the left-right asymmetries of the response distributions. The possible lateralization of the two suggested mechanisms within the cerebral hemispheres is discussed.     

Dynamic changes of the phosphoproteome in postmortem mouse brains

Protein phosphorylation is deeply involved in the pathological mechanism of various neurodegenerative disorders. However, in human pathological samples, phosphorylation can be modified during preservation by postmortem factors such as time and temperature. Postmortem changes may also differ among proteins. Unfortunately, there is no comprehensive database that could support the analysis of protein phosphorylation in human brain samples from the standpoint of postmortem changes. As a first step toward addressing the issue, we performed phosphoproteome analysis with brain tissue dissected from mouse bodies preserved under different conditions. Quantitative whole proteome mass analysis showed surprisingly diverse postmortem changes in phosphoproteins that were dependent on temperature, time and protein species. Twelve hrs postmortem was a critical time point for preservation at room temperature. At 4°C, after the body was cooled down, most phosphoproteins were stable for 72 hrs. At either temperature, increase greater than 2-fold was exceptional during this interval. We found several standard proteins by which we can calculate the postmortem time at room temperature. The information obtained in this study will be indispensable for evaluating experimental data with human as well as mouse brain samples.     

Dynamic changes in volatile emissions of breeding burying beetles

Burying beetles reproduce on small vertebrate carcasses by exhibiting elaborate biparental brood care. Partner recognition in breeding Nicrophorus species (Coleoptera: Silphidae) relies substantially on information encoded in cuticular hydrocarbon profiles. Until recently, it was unknown whether breeding burying beetles also produce volatile low molecular weight substances and, if so, which functions can be attributed to such volatiles. The present study reports a survey of the volatiles released by males and females of Nicrophorus vespilloides Herbst in nonbreeding status and at different stages of breeding. Headspace analyses are performed by using solid phase micro‐extraction fibres and gas chromatography–mass spectrometry. The volatiles released by nonbreeding males and females include phenolic compounds, alcohols, aldehydes and ketones and are quite similar in both sexes. With the onset of breeding, the volatile profiles of males and females become distinct, with a number of female‐specific compounds occurring. An analysis of the anal secretions reveals the presence of some of the compounds previously detected in the headspace analysis. The specific chemical properties suggest that some of the volatiles may function against competitors and parasites, such as bacteria, fungi, nematodes and arthropods at the carcass breeding resource. By contrast, the emission of 4‐methyl branched esters by the females closely parallels the emission of the terpenoid methyl geranate and they may function together as a complex signal by the females. Signalling traits associated with biparental care and specific constraints associated with the ephemeral nature of the breeding resource may explain the occurrence of both groups of compounds in the volatile profiles.     

Dynamic conformational changes in munc18 prevent syntaxin binding

The Sec1/munc18 protein family is essential for vesicle fusion in eukaryotic cells via binding to SNARE proteins. Protein kinase C modulates these interactions by phosphorylating munc18a thereby reducing its affinity to one of the central SNARE members, syntaxin-1a. The established hypothesis is that the reduced affinity of the phosphorylated munc18a to syntaxin-1a is a result of local electrostatic repulsion between the two proteins, which interferes with their compatibility. The current study challenges this paradigm and offers a novel mechanistic explanation by revealing a syntaxin-non-binding conformation of munc18a that is induced by the phosphomimetic mutations. In the present study, using molecular dynamics simulations, we explored the dynamics of the wild-type munc18a versus phosphomimetic mutant munc18a. We focused on the structural changes that occur in the cavity between domains 3a and 1, which serves as the main syntaxin-binding site. The results of the simulations suggest that the free wild-type munc18a exhibits a dynamic equilibrium between several conformations differing in the size of its cavity (the main syntaxin-binding site). The flexibility of the cavity's size might facilitate the binding or unbinding of syntaxin. In silico insertion of phosphomimetic mutations into the munc18a structure induces the formation of a conformation where the syntaxin-binding area is rigid and blocked as a result of interactions between residues located on both sides of the cavity. Therefore, we suggest that the reduced affinity of the phosphomimetic mutant/phosphorylated munc18a is a result of the closed-cavity conformation, which makes syntaxin binding energetically and sterically unfavorable. The current study demonstrates the potential of phosphorylation, an essential biological process, to serve as a driving force for dramatic conformational changes of proteins modulating their affinity to target proteins.