基于模糊聚类的分层强化学习算法

本文提出了一种新的分层强化学习Option自动生成算法,以Agent在学习初始阶段探测到的状态空间为输入,采用模糊逻辑神经元的网络进行聚类,在聚类后的各状态子集上通过经验回放学习产生内部策略集,生成Option,仿真实验结果表明了该算法的有效性。

A Hierarchical Reinforcement Learning Algorithm Based on Fuzzy Clustering

A new algorithm for the automatic generation of the Option Hierarchical Reinforcement Learning is presented. The algorithm takes the state space detected by the agent as input in the initial learning phase,and clusters the states by employing fuzzy clustering. Based on the clustered state sets,the intra-strategies are learned by an experience replay procedure. As a result,the options are generated. The validity of the algorithm is demonstrated by simulation experiments.