In this article, a model-free off-policy reinforcement learning algorithm is applied to address the optimal tracking problem based on multiplayer non-zero-sum games for discrete-time linear systems. In contrast to the traditional method and the policy iteration method for solving the optimal tracking problems, the proposed algorithm operates with the system data rather than the knowledge of the system dynamics. For performing the proposed algorithm, an auxiliary augmented system is constructed via assembling the original system and the reference trajectory while a discount factor is introduced into the performance indexes. It is analyzed that the solutions of the proposed algorithm converge to the Nash equilibrium and the result is not influenced by the probing noise. Two simulations are presented to verify the feasibility and effectiveness of the proposed algorithm. 相似文献
BackgroundIn the field of transplantation, inducing immune tolerance in recipients is of great importance. Blocking co-stimulatory molecule using anti-CD28 antibody could induce tolerance in a rat kidney transplantation model. Myeloid-derived suppressor cells (MDSCs) reveals strong immune suppressive abilities in kidney transplantation. Here we analyzed key genes of MDSCs leading to transplant tolerance in this model.MethodsMicroarray data of rat gene expression profiles under accession number {"type":"entrez-geo","attrs":{"text":"GSE28545","term_id":"28545"}}GSE28545 in the Gene Expression Omnibus (GEO) database were analyzed. Running the LIMMA package in R language, the differentially expressed genes (DEGs) were found. Enrichment analysis of the DEGs was conducted in the Database for Annotation, Visualization and Integrated Discovery (DAVID) database to explore gene ontology (GO) annotation and their Kyoto Encyclopedia of Genes and Genomes (KEGG) pathways. Their protein-protein interactions (PPIs) were provided by STRING database and was visualized in Cytoscape. Hub genes were carried out by CytoHubba.ResultsThree hundred and thirty-eight DEGs were exported, including 27 upregulated and 311 downregulated genes. The functions and KEGG pathways of the DEGs were assessed and the PPI network was constructed based on the string interactions of the DEGs. The network was visualized in Cytoscape; the entire PPI network consisted of 192 nodes and 469 edges. Zap70, Cdc42, Stat1, Stat4, Ccl5 and Cxcr3 were among the hub genes.ConclusionsThese key genes, corresponding proteins and their functions may provide valuable background for both basic and clinical research and could be the direction of future studies in immune tolerance, especially those examining immunocyte-induced tolerance. 相似文献
Major ursodeoxycholic acid (UDCA)-based therapies for primary biliary cirrhosis (PBC) include UDCA only, or combined with either methotrexate (MTX), corticosteroids (COT), colchicine (COC), or bezafibrate (BEF). As the optimum treatment regimen is unclear and warrants exploration, we aimed to compare these therapies in terms of patient mortality or liver transplantation (MOLT) and adverse events (AE).PubMed, the Cochrane Library, and Scopus were searched for randomized controlled trials up to August 31, 2014. We estimated the hazard ratios (HRs) for MOLT and odds ratios (ORs) for AE. A sensitivity analysis based on the dose of UDCA was also executed.Thirty-one eligible articles were included. Compared with COT plus UDCA, UDCA (HR 0.38, 95% confidence interval [CI] 0.09–1.39), BEF plus UDCA (HR 0.29, 95% CI 0.02–4.83), COC plus UDCA (HR 0.39, 95% CI 0.07–2.25), MTX plus UDCA (HR 0.28, 95% CI 0.05–1.63), or OBS (HR 0.49, 95% CI 0.11–2.01) all provided an increased risk of MOLT. With respect to drug AE profile, although not differing appreciably, BEF plus UDCA was associated with more AEs compared with UDCA (OR 3.16, 95% CI 0.59–20.67), COT plus UDCA (OR 2.27, 95% CI 0.15–33.36), COC plus UDCA (OR 1.00, 95% CI 0.09–12.16), MTX plus UDCA (OR 2.03, 95% CI 0.23–17.82), or OBS (OR 3.00, 95% CI 0.53–20.75). The results of sensitivity analyses were highly consistent with previous analyses.COT plus UDCA was the optimal UDCA-based regimen for both MOLT and AEs. BEF plus UDCA was most likely to cause AEs, whereas monotherapy with UDCA and coadministriation of COT plus UDCA appeared to be associated with the fewest AEs for PBC treatment. 相似文献
Objective: To evaluate the effectiveness of a modified behavioral activation treatment (MBAT) intervention on reducing depressive symptoms in rural left-behind elderly.
Method: This is a randomized study registered in Chinese Clinical Trial Registry (ChiCTR-IOR-17011289). Eighty rural left-behind elderly people who had a Geriatric Depression Scale (GDS) score between 11 and 25 were randomly assigned to the intervention (n?=?40) and control group (n?=?40). The intervention group received both MBAT and regular treatment for 8 weeks while the control group received regular treatment. Both groups were assessed with the GDS, Beck Anxiety Inventory (BAI), and Oxford Happiness Questionnaire (OHQ) at baseline, immediately post-intervention, and at 3 months post-intervention.
Results: There were a total of 73 participants that completed the intervention. The scores of GDS and BAI decreased significantly, but the scores of OHQ increased significantly in the intervention group after 8 sessions of MBAT (P?<?.01). The reduction in depression symptoms after the intervention was maintained at the 3-month follow-up. Significant differences in GDS, BAI, and OHQ scores were observed between the intervention group and the control group (P?<?.01).
Conclusion: MBAT produced a significantly greater reduction in depressive symptoms than regular care in rural left-behind elderly.
Clinical or methodological significance of this article: A modified behavioral activation (BA) psychotherapy can significantly reduce the recurrence and seriousness of depression symptoms in the left-behind elderly with mild to moderate depression. This study also suggests that further study of the MBAT as an intervention will provide a direction for the management of mental health in rural left-behind elders. 相似文献