The existence of sensitive optimal policies in two multi-dimensional queueing models

Recently Dekker and Hordijk [3,4] introduced conditions for the existence of deterministic Blackwell optimal policies in denumerable Markov decision chains with unbounded rewards. These conditions include- uniform geometric recurrence.The-uniform geometric recurrence property also implies the existence of average optimal policies, a solution to the average optimality equation with explicit formula's and convergence of the value iteration algorithm for average rewards. For this reason, the verification of-uniform geometric convergence is also useful in cases where average and-discounted rewards are considered.On the other hand,-uniform geometric recurrence is a heavy condition on the Markov decision chain structure for negative dynamic programming problems. The verification of-uniform geometric recurrence for the Markov chain induced by some deterministic policy together with results by Sennott [14] yields the existence of a deterministic policy that minimizes the expected average cost for non-negative immediate cost functions.In this paper-uniform geometric recurrence will be proved for two queueing models: theK competing queues and the two centre open Jackson network with control of the service rates.The research of the author is supported by the Netherlands Organization for Scientific Research N.W.O.     

Microstructural and physicochemical study of the buried Fe/AlGaAs(100) interface by transmission electron microscopy and x‐ray emission spectroscopy

Among the magnetic metal/semiconductor contacts, the Fe/GaAs system has been widely studied owing to its potential applications in electronic devices. In contrast, there are not many studies concerning the Fe/Al_xGa_1?xAs contact, and in particular there are no reports concerning the changes induced in the interfacial zone by the presence of Al. In this work, thin polycrystalline iron films were deposited by ion beam sputtering at room temperature on a 300 nm thick Al_0.25Ga_0.75As layer grown by molecular beam epitaxy onto GaAs(001). X‐ray diffraction analysis showed that the iron films are polycrystalline, and indications of a (002) texture of the film were observed. The fine scale analysis of the interface was achieved by high‐resolution transmission electron microscopy (HRTEM) observations, the results of which are compared with the physicochemical information obtained from electron‐induced x‐ray emission spectroscopy, by analysing the Al 3p valence states at the Fe/Al_xGa_1?xAs interface. The HRTEM experiments on cross‐section samples indicate that the interfacial zone between iron and AlGaAs is limited to <1.5 nm in thickness. X‐ray emission spectroscopy showed the presence of Al atoms in an FeAl‐like environment at the interface, and the existence of wrong bonds and point defects. The estimated width of the perturbed interface (2.0 ± 0.5 nm) is in agreement with the HRTEM results. Copyright © 2003 John Wiley & Sons, Ltd.     

Synthesis and Crystal Structure of 2-Chloromethyl-1H-benzimidazole Nitrate, [ClCH_2(C_7H_6N_2)]NO_3

1 INTRODUCTION Benzimidazole is an interesting heterocyclic compound because it is found in various naturally occurring drugs, such as omeprazole, astemizole and emedastine difumarate[1]. The efficacy of sub- stituted benzimidazoles in the treatment of parasitic infections is well known[2～4]. Substituted benzimid- azole moieties are established pharmacophores in parasitic chemotherapy. Bis(2-benzimidazole) and some substituted bis(benzimidazol-2-yl)alkanes have attracted much interest …     

Preparation of novel,high‐modulus,swollen‐ or jungle‐gym‐type polyimide gels end‐crosslinked with 1,3,5‐tris(4‐aminophenyl)benzene

A novel preparation approach for high‐performance polyimide gels that are swollen or have a jungle‐gym‐type structure is proposed. A new rigid and symmetric trifunctional amine, 1,3,5‐tris(4‐aminophenyl)benzene (TAPB), was synthesized as a crosslinker. Three different kinds of amic acid oligomers derived from pyromellitic dianhydride (PMDA), 4,4′‐oxydiphthalic anhydride (ODPA), p‐phenylenediamine (PDA), and 4,4′‐oxydianiline (ODA) were end‐crosslinked with TAPB at a high temperature to make polyimide networks with different structures. Transparent polyimide gels were obtained from the ODPA–ODA/TAPB series with high compression moduli of about 1 MPa at their equilibrium swollen states in N‐methylpyrrolidone. Microscopic phase separation occurred during the gelation–imidization process when polyimide networks were generated from PMDA–PDA/TAPB and PMDA–ODA/TAPB. After these opaque polyimide networks were dried, a jungle‐gym‐like structure was obtained for the PMDA–PDA/TAPB and PMDA–ODA/TAPB series; that is, there was a high void content inside the networks (up to 70%) and little volume shrinkage. These polyimide networks did not expand but absorbed the solvent and showed moduli as high as those of solids. Therefore, using the highly rigid crosslinker TAPB combined with the flexible monomers ODPA and ODA and the rigid monomers PMDA and PDA, we prepared swollen, high‐performance polyimide gels and jungle‐gym‐type polyimide networks, respectively. © 2002 Wiley Periodicals, Inc. J Polym Sci Part A: Polym Chem 40: 2501–2512, 2002     

Novel aromatic carboxamides from dehydroabietylamine as potential fungicides: Design,synthesis and antifungal evaluation

The present study was carried out to design and synthesize a number of novel aromatic carboxamide derivatives of dehydroabietylamine. The preliminary antifungal assay indicated that most of title compounds displayed moderate to good antifungal activity toward the six fungal strains in vitro. Compounds 3i, 3q, 4b and 4d showed significant antifungal activity against Sclerotinia sclerotiorum, with EC₅₀ values ranging from 0.067 ～ 0.393 mg/L. Compounds 3i, 4b and 4d also showed pronounced mycelial growth inhibition activities against B. cinerea and A. solani. Furthermore, in the in vivo assay, compound 4b exhibited brilliant protective activity against S. sclerotiorum-infected rape leaves. Meanwhile, the in vivo bioassay on tomato plants infected by B. cinerea showed that compound 3i and 4d displayed excellent protective activity at 200 mg/L, which were near to boscalid. Primary mechanistic study revealed that 4b could inhibit sclerotia formation as well as reduce the exopolysaccharide level. SEM and TEM analysis indicated that 4b possessed a strong ability to destroy the surface morphology of mycelia, cell structure and seriously interfere with the growth of the fungal pathogen. In addition, 4b exhibited good inhibitory activity (IC₅₀ = 23.3 ± 1.6 μM) toward succinate dehydrogenase (SDH). Molecular modeling study confirmed the binding modes between compound 4b and SDH. The above antifungal results and fungicidal mechanism study revealed that this class of dehydroabietylamine derivatives could be potential SDH inhibitors and lead compounds for novel fungicides development.     

多信道接入微谐振环波长选择开关特性

对一种新型结构微谐振环波长选择开关的特性进行了研究.分析了器件的工作状态和相应的开关操作,利用新型光强传递函数公式,对器件不同工作状态的光谱响应和不同开关操作的开关响应进行了数值模拟,讨论了耦合系数和损耗对光谱响应和开关响应的影响.结果表明,该器件可以实现三个信道同时接入、两个信道同时接入、单信道接入以及无信道接入等四种方式的信号波长选择性接入.多信道接入方式的开态串扰性能变差,关态的串扰性能不受影响.实现器件上述接入方式之间转换的开关操作可以分成三类,开关操作达到最佳关态串扰时的小微环折射率变化值都在6.0×10－3左右,而实现完全开关时的小微环折射率变化值小于8.0×10－4,表明易于通过热-光效应实现开关操作,并且温度调制的控制容差较大.损耗对器件开关特性的影响结果表明可根据损耗的实际数值,优化信道关闭时的微环折射率取值.     

水体透射光谱结合主成分分析(PCA )改进化学需氧量(COD)含量估算研究

化学需氧量（Chemical Oxygen Demand,COD）是水体有机污染的一项重要指标,化学需氧量越高,表示水污染程度越严重。 为了解决传统的COD测量方法耗时较长,不利于快速、实时地获取水体中COD的信息等问题。本文提出了基于透射光谱测量结合主成分分析(Principal Component Analysis, PCA)改进水体COD含量估算模型。具体的,采集100组COD水体光谱信息,分别使用3种不同的高光谱数据预处理方法对光谱数据进行预处理,分析不同预处理方法对模型精度的影响,并基于不同的预处理方法分别建立高斯过程回归模型(Gaussian Process Regression, GPR)和BP神经网络模型,分析不同预处理方法对模型精度的影响;并对各模型结合PCA数据降维方法进行模型的改进,通过比较模型的精度选择最优模型进行水体COD含量的检测。结果显示,相比于原始光谱数据建立的GPR模型和BP神经网络模型,数据预处理后的模型精度明显提升;且结合PCA对预处理后的数据进一步降维处理后,模型精度得到了进一步的提升。其中,基于标准正态变量变换特征结合PCA改进BP神经网络模型基于PCA改进的BP神经网络模型R^2高达0.9940,均方根误差RMSE为0.022540。证明了基于PCA改进的BP神经网络数据降维方法对预处理后的光谱数据进行降维处理,有利于去除光谱中的冗余信息,提取特征信息,可以实现高光谱检测方法可以实现COD含量估算模型的优化,从而为传统COD测量方法存在的问题提出了一种新的解决思路。     

基于流量测点的热网变动阻力系数优化辨识

随着供热计量系统的普及,系统可以根据负荷的变化进行调整,管网的阻力系数随即发生变化.对变动阻力系数进行优化辨识是了解供热管网实时运行状况的有效手段.提出一种基于流量监测数据的供热管网变动阻力系数优化辨识方法,并利用遗传算法进行求解.对洛阳市某小区供暖季管网实际运行数据进行验证,辨识结果的相对误差在5％以内.结果表明:该...     

An Extensive Assessment of Network Embedding in PPI Network Alignment

Network alignment is a fundamental task in network analysis. In the biological field, where the protein–protein interaction (PPI) is represented as a graph, network alignment allowed the discovery of underlying biological knowledge such as conserved evolutionary pathways and functionally conserved proteins throughout different species. A recent trend in network science concerns network embedding, i.e., the modelling of nodes in a network as a low-dimensional feature vector. In this survey, we present an overview of current PPI network embedding alignment methods, a comparison among them, and a comparison to classical PPI network alignment algorithms. The results of this comparison highlight that: (i) only five network embeddings for network alignment algorithms have been applied in the biological context, whereas the literature presents several classical network alignment algorithms; (ii) there is a need for developing an evaluation framework that may enable a unified comparison between different algorithms; (iii) the majority of the proposed algorithms perform network embedding through matrix factorization-based techniques; (iv) three out of five algorithms leverage external biological resources, while the remaining two are designed for domain agnostic network alignment and tested on PPI networks; (v) two algorithms out of three are stated to perform multi-network alignment, while the remaining perform pairwise network alignment.     

Space-Air-Ground Integrated Mobile Crowdsensing for Partially Observable Data Collection by Multi-Scale Convolutional Graph Reinforcement Learning

Mobile crowdsensing (MCS) is attracting considerable attention in the past few years as a new paradigm for large-scale information sensing. Unmanned aerial vehicles (UAVs) have played a significant role in MCS tasks and served as crucial nodes in the newly-proposed space-air-ground integrated network (SAGIN). In this paper, we incorporate SAGIN into MCS task and present a Space-Air-Ground integrated Mobile CrowdSensing (SAG-MCS) problem. Based on multi-source observations from embedded sensors and satellites, an aerial UAV swarm is required to carry out energy-efficient data collection and recharging tasks. Up to date, few studies have explored such multi-task MCS problem with the cooperation of UAV swarm and satellites. To address this multi-agent problem, we propose a novel deep reinforcement learning (DRL) based method called Multi-Scale Soft Deep Recurrent Graph Network (ms-SDRGN). Our ms-SDRGN approach incorporates a multi-scale convolutional encoder to process multi-source raw observations for better feature exploitation. We also use a graph attention mechanism to model inter-UAV communications and aggregate extra neighboring information, and utilize a gated recurrent unit for long-term performance. In addition, a stochastic policy can be learned through a maximum-entropy method with an adjustable temperature parameter. Specifically, we design a heuristic reward function to encourage the agents to achieve global cooperation under partial observability. We train the model to convergence and conduct a series of case studies. Evaluation results show statistical significance and that ms-SDRGN outperforms three state-of-the-art DRL baselines in SAG-MCS. Compared with the best-performing baseline, ms-SDRGN improves 29.0% reward and 3.8% CFE score. We also investigate the scalability and robustness of ms-SDRGN towards DRL environments with diverse observation scales or demanding communication conditions.